In order to solve the problem of segmentation and location of moving object in moving scenes, an algorithm of segmentation and location of moving object in moving scenes with the fusion of background compensation and mean shift is proposed. Firstly, frame-difference method is used to get difference image based on moving scenes compensation. Then, multiple feature descriptors of nonzero pixels in difference image are established and mean shift algorithm is adopted to deal with the nonzero pixels. Lastly, segmentation and location of moving object is done with the nonzero pixels gotten from mean shift clustering. The results indicate that this method can realize moving object detection accurately.