For high-precision situation that the impact of angle error on precision is comparable with the impact of position error, a camera pose estimation algorithm that can fuse the angle and position errors is proposed. The covariance of position error is projected onto a unit sphere and fused with the covariance of angle error in the iterative process of position estimation algorithm of traditional least squares adjustment camera. The problem that the projection progress depends on the parameters to be estimated is solved with block relaxation iteration method. The weighted least squares adjustment equation is constructed using the covariance. From the adjustment equation, the estimated values of camera pose in the current iteration are obtained, which combine the position and angle errors. The proposed algorithm unifies the measurement models of the position error and angle error. Experimental results show the effectiveness of the proposed algorithm applied in orientation system for missile vehicle.