Combined with the temporal and frequency domain fringe analysis methods, a new phase shifting shadow moiré technique to relax the restriction on the phase shift between frames is proposed. The proposed algorithm can extract the precise phase using three or more interferograms in an arbitrary sequence. The first stage of the algorithm is to estimate the heights and determines the frame differences based on the spiral phase transform technique. The second stage uses the generalized least-squares method to extract the temporal phase. Experimental results show that high accuracy phase estimates are obtained by the proposed algorithm. It is shown the standard deviation of the proposed method is less than 3×10-3 mm. The proposed algorithm gives an effective solution to improve measurement accuracy of shadow moiré.