To resolve the data processing problem of point cloud for optical surface in general interface of optical-mechanical integrated simulation, the surface data processing method based on point cloud boundary detection was presented. First, the surface data preprocessing method in integrated simulation was discussed and effect of boundary detection in surface preprocessing data was also referred. Then, boundary detection algorithm referring to several techniques was researched including the data organization of point cloud, the small tangential plane fitting algorithm of the K-nearest neighbor node and the judgment of boundary node. Based on the research of point cloud boundary detection algorithm, the primary data structure and the program realization was discussed and by the extraction of demonstrated surface point cloud, the algorithm of boundary detection was proved to be right and effective. The algorithm of boundary detection provides the new technical reference for data process of optical surface.