The technology of content based video analysis is a new research task in the multimedia retrieval field

but the most research is centralized in structurizing video sequence

indexing recognizing and browsing

and video inquiry is seldom focused. This paper analyses the shortcoming of the "window pairs" technology proposed by Nevenka. The way of selecting window pairs is arbitrary in that method

so it is inappropriate sometimes. This paper suggests a new method about row and column coding based on the video coding characteristics

video peculiarities and normal technology of video analysis. The character this method used describes the color and position information of video frame. Most video about different formats could be processed using the frame by frame matching and streaming inquiry technology by this method. This method needs a few bytes to figure a picture

occupying fewer memory

and using less computing. The experiment improved that this technology is robust to frame shift and luminance variable

achieved better experiment results that the Recall and Precision are highly improved.