How to extract moving object in the case of moving camera is researched in this paper. At first, the background subtraction is implemented to detect the moving region in the case of motionless camera, and then the interested moving object is fast segmented from the detected moving region with the proposed method of barycenter shift iteration instead of the time-consuming method of connected components analysis. In the enhanced Camshift tracking algorithm, the Color Probability Density Distribution Image (CPDDI) in the Region of Interest (ROI) predicted by the Kalman filter is obtained, and Instantaneous Background (IB) is introduced to suppress background features. A novel method is suggested to extract the moving object from the tracking result combining CPDDI with proper morphologic filter strategy in the case of moving camera, which can resist the disturbance from the background. Experiments show that the proposed method can extract intact moving objects stably in the case of moving camera, and can well deal with dynamic complex background. The system is computationally efficient and can run in real-time speed.