On the basis of localization error of the first order frequency spectrum associated with interferogram phase unwrapping by Fourier transform method, especially aimed at phase unwrapping for practical interferograms with nonstrictly parallel and equally spaced references, a method of localized matching filtering using Gabor wavelets is proposed. Multi-channel Gabor spatial filter set is constructed to get the best matched local spatial frequency in meaning of Mallat maximum modulo. At the same time noises and opaque objects can be removed. The method is proved more effective than conventional Fourier transform method for cases of nonequally-spaced references and seriously deformed fringes by applying it to simulated and real interferograms to reconstruct interferometric wave fronts.