Traditional color-based mean shift tracking algorithm is unable to accurately track the object. To address this problem, we present an improved tracking algorithm. The improved tracker integrates the color and motion cues which characterize the appearance and motion information of the object, respectively. These two visual cues can complement each other and make for more precise target localization. Experiments show that the proposed tracking algorithm has better performance than the traditional mean shift tracker.