An optimization model of optical tolerance is proposed to enable straight forward calculation instead of the usual tolerance-budget balancing by trial and error. The objective function, is the minimum fabrication cost of the optical system. A general expression relating the cost of component processing to the tolerance is obtained by fitting to existing data. The constraints are image qualities in terms of MTF and distortion. An example is given which has two variables and is solved by network algorithm.