With the deepening of the application of remote sensing technology in the railway industry, the application of multi-source remote sensing to observe the state of railway facilities has become a hot topic in academia and industry. In order to solve the problem of quantitative monitoring of the state of railway facilities, the settlement information of railway facilities can be obtained by applying InSAR technology, and the analysis and extraction of settlement information often rely on the attributes such as the type and location of the facilities, otherwise the settlement of specific railway facilities cannot be further quantitatively evaluated. In this paper, satellite-based optics and microwave remote sensing images are used to automatically extract railway facilities through target detection technology, and the correspondence between microwave scattering points and categories and locations in the optical properties of railway facilities is determined. The results show that the extraction accuracy of railway facilities is increased by 2.8% compared with that of optical remote sensing images, and 9.2% is higher than that of SAR images, at the same time, the facility extraction results are more accurate in terms of location compared to SAR image extraction results.It can reduce the impact of driving safety caused by incorrect monitoring of facilities, and provide a reference for the quantitative monitoring of deformation of InSAR railway facilities.