Among phase unwrapping algorithms, quality guide algorithm adopting fringe modulation as parameter can constrain the error in shadow and abrupt areas from spreading globally. Reliability guide algorithm with second-order derivative of unwrapped phase as parameter can conduct the unwrapping path to orient the most continuous direction. In order to combine the merits of the above two algorithms, a hybrid algorithm based on fringe modulation analysis and second-order derivative guide is proposed. Firstly, the algorithm finds out an optimal threshold, based on which the fringe modulation quality image is divided into two kinds of area, "good area" and "bad area". Within the good area, unwrapping process is implemented by adopting flood algorithm, while in the bad area second-order derivative of wrapped phase guiding method is utilized to conduct the unwrapping path to orient the most continuous direction. Experimental results on the wrapped phase map of projected fringe method and digital speckle pattern interferometry demonstrate the robustness and efficiency of the proposed algorithm.