Determination and calibration of high precision sensor line of sight (LOS) attitude are the key prerequisite of high precision tracking and location of targets in space based optical surveillance systems. LOS determination and calibration of staring sensor with high frame frequency and narrow field of view are difficult points of the problem. Based on the research of the imaging model and observation characteristics of staring sensor, the real time LOS attitude determination and calibration algorithm using landmark control point is proposed. The influential factors (including thermal distortions error, assemble error, and so on) of staring sensor LOS attitude error are equivalent to bias angle of LOS attitude. By establishing the observation equation of landmark control point and the state transition mode of bias angle, and using an extend Kalman filter (EKF), the real time estimation of bias angle and the high precision LOS attitude determination and calibration are achieved. The simulation results show that the precision and timeliness of the proposed algorithm meet the request of target tracking and location process in space based infrared surveillance system.