Background change, shape change and target covering will cause target tracking failure. Real-time and accuracy in target tracking must be considered. First, the Mean Shift algorithm is presented, and then the Mean Shift algorithm iterative weight is modified with main information more prominent, secondary information suppressed, avoiding the tedious root, and improving the real-time and effectiveness of target tracking. The target template updating algorithm is presented to solve change of background and target shape change. Then a Kalman filter in the horizontal position and the vertical position is established to solve the problem of target tracking completely covered. Simulation results show that target tracking algorithm on the condition of target template update has higher tracking accuracy, higher real-time property and at the same time is more robust than the traditional Mean Shift tracking algorithm.