When the star sensor is operating in space, it is easy to be interfered by stray light such as sunlight, moonlight and earth-air light. As a result, the overall gray level of the star map taken is increased, the background uniformity is poor, and it is difficult to accurately extract the star coordinates. Aiming at the above problems and combining the existing algorithms, a composite background estimation star map processing algorithm under stray light interference is proposed. First of all, star points had the characteristics of dimensions ranging from 3×3 to 7×7 in diameter after point diffusion imaging, so the corresponding background estimation template was designed. Then, in order to improve the robustness of the algorithm and the utilization rate of local information, a pixel estimation template was designed. The two estimation templates calculate the post-processing data at the same time to achieve threshold segmentation, and then the centroid of star points was calculated. This method can better resist stray light interference and improve the accuracy of star extraction under stray light background.