In order to solve the problem of boundary effects of the correlation filter,an object tracking algorithm is proposed based on similar background and color histogram in HSV color space.By using the Best-Buddies Similarity principle,similar backgrounds with higher similarity to the target are selected in the real background as the negative sample to train the correlation filter,so as to reduce the boundary effect.In order to improve the success rate of object tracking in complicated environment,the color histogram in HSV color space is combined with Bayes classifier for color tracking.Experiments are carried out on 16 videos selected from OTB-50 and OTB-100,and the results are compared with that of the current six tracking algorithms.The success rate and accuracy of the proposed algorithm are 0.593 and 0.467 respectively, which is superior to that of the other six algorithms.The proposed algorithm can effectively improve the success rate and accuracy of object tracking and has good real-time performance.