Electric speckle pattern interferometry (ESPI) is a modern measuring technology and has many applications. But the high speckle noise makes the signal-to-noise ratio (SNR) of the electric speckle pattern interferometry fringe pattern very low and so limits the applications of electric speckle pattern interferometry. It is hard for usual filters to filter off the high speckle noise. A novel filtering method is proposed based on contoured window filter. Because the contoured window is obtained from fringe orientations, so we proposed a new algorithm to get more precise orientations. This algorithm can calculate the precise orientations and estimate the fringe widths at the same time. Based on this algorithm, adaptive window filter is designed. This new filter can adapt its shape following the fringe orientations and adapt its size according to the density of the local fringe. Last the phase can be obtained from the filtered image whose density varies a lot.