A relation between deviation angle, caused by state of polarization (SOP) evolution, and quantum bit error rate (QBER) is presented. The distribution of deviation angle for single SOP traveling several distances compensated by one reference signal of different wavelengths and two reference signals of the same SOP is simulated. A strategy which compensates photon polarization by using two reference lights of non-orthogonal SOPs and tracking the middle SOP of them in the Poincaré sphere for quantum key distribution (QKD) system is presented and simulated to be feasible.