Background reconstruction is a fundanmental task of video and image processing. To overcome disadvantages of traditonal backgound reconctruction algorithms, such as complex computation and distortional backgound, a pratical backgound reconstruction algorithm was proposed based on pixel sequence pattern classification. The pixel sequence patterns, extracted through calculating differences between sequential two frames, were classified by means of pixel sequence patterns’ charateristics determined by those differences. Furthermore, independent background extraction and background update mechanisms were destined for pixels with different pixel sequence patterns. Simulation results indicate that correct backgrounds of video with moving targets can be reconstructed without the models of background and moving targets. And, the background can be effiently updated when backgound is changed.