Based on the sine/cosine (sin/cos) filtering technique, an adaptive filtering algorithm is proposed. This novel method can automatically select the filtering window size according to the fringe-orientation of the speckle phase fringe pattern. After calculating the fringe-orientation of the speckle wrapped phase fringe pattern, the filtering algorithm can choose an appropriate filtering window accordingly, and carry out adaptive mean filtering operations on sin and cos transformation maps of the speckle wrapped phase pattern, respectively. The wrapped phase fringe pattern is obtained by the four-quadrant arctangent function. Simulation and experimental results show that the proposed method can protect the stripe phase jump information effectively, and still be able to perform a good fringe filtering processing even for the speckle wrapped phase pattern with varying stripe density and complicated fringe shape. The filtered phase pattern is closer to the original stripe direction.