Traditional image registration techniques are inadaptable to aerial remote sensing image which does not have obvious feature points, such as ocean, desert,and grassland. A registration algorithm is proposed for aerial remote sensing image based on geo-location information. Using aircraft position and attitude information measured by airborne position and orientation system and the gimbal angle from the encoder in an aerial camera, the projection of registration point in geodetic coordinate system is solved by homogeneous coordinate transformation. Using the earth ellipsoidal model which is defined by the world geodetic system-84, the longitude and latitude information for matching points are solved, and the matching points with the same geo-location information are registered. The influence of the aircraft position and attitude and the gimbal angle on geo-location accuracy and registration accuracy is analyzed with Monte Carlo method. Experiments were carried out using actual aerial remote sensing images. Experimental results show that the registration accuracy is less than 3 m, and the positioning accuracy of sea control point in remote sensing image is less than 35 m, when the flight height of plane is below 2000 m and the photography inclination angle is less than 18°.