In order to estimate the target scale in real time, avoid multi-scale test and improve the speed and accuracy of target tracking, a new optimized target tracking algorithm is proposed. By introducing the regional proposal network with good tracking effect into the common siamese network, and introducing the strip pooling module and the efficient channel attention module in the algorithm, we can deal with the scale difference of objects and the severe deformation in the tracking process. The proposed algorithm achieves 0.833 accuracy and 0.658 success rate on OTB100 dataset, 0.411 EAO index on VOT2016 dataset, and 0.275 EAO index on VOT2019 dataset.