Based on a 2m aspheric segmented primary mirror of infrared telescope,wavefront aberration representation is derived through aspheric surface equation,the relation between wavefront aberration and interference bright fringe is established,the telescope model is created in ZEMAX,a MATLAB-based program is compiled in order to simulate and analyze the relation between stitching tolerances and aberrations in terms of fringe Zernike coefficients by this model.A linear retrieval method of stitching tolerances base on the tolerances sensitivity matrix is proposed,the retrieval algorithm of all segments stitching tolerances is established on this basis,and stitching tolerances of single sector-shaped segment are retrieved,the simulation results show that when stitching translation tolerance is less than 1mm or angular tolerance is less than 1°,the retrieval deviation is better than 3% and fast convergence,when the stitching translation tolerance is less than 0.1mm or angular tolerance is less than 0.1°,the retrieval deviation is better than 0.5%,and retrieval deviation continue to decrease to near zero.The algorithm is simple,efficacious,suited engineering application.