Since the traditional algorithm may cause problems such as slow running speed and more mismatching points when perform stereo matching on underwater environment, the ORB characteristics detection and curve re-striction has been applied in this paper. Firstly the image should be detected so as to find out the characteristics, generate the descriptor, and match the feature points. Then the underwater curve restriction can be deduced ac-cording to the law of refraction combining internal and external parameters of camera. Finally the mismatching points can be decreased by means of underwater curve restriction. The experimental results have shown that in the case of effectively controlling mismatches, the speed of this algorithm are faster than traditional SIFT algorithm combined with curve restriction. As a result, it is of practical significance to improve the speed of underwater binocular vision system.