The mathematical model of coherent detection for inter-satellite tracking is rebuilt under Gaussian approximation. The intermediate frequency current from a detector as a function of a beam mismatched angle is calculated under this model which can get a smaller error compared with the one under plate wave approximation. The expression of the intermediate frequency current is simplified by choosing a right ratio between the detector diameter and the beam diameter, which can improve the calculation efficiency.