The influence of each error source on the position and orientation determination accuracy in three fields of view celestial positioning and orientation method based on minimum loss function was researched. Firstly, the mathematical model of celestial positioning and orientation of three fields of view based on the minimum loss function was proposed. Secondly, the characteristic and the probability distribution of error source were summarized, the impact of error sources on positioning and orientation information pair was analyzed. Finally, the position and orientation error simulation model was established, and the error simulation was done by using Monte Carlo method. The simulation results show that the mean of position accuracy is 88.1 m, and the mean of orientation accuracy is 3.0″. We point out that dominant error source is horizontal measurement error, and next one is vertical deviation data error. Outdoor experiments show that the mean of positioning accuracy is 163.0 m, the mean of orientation accuracy is 3.5″, and the horizontal measurement error is the main influence on the overall result.