Virtual sports is a vivid human-computer interaction system. Search speed of the traditional speckle correlation algorithm is a little lower and it cannot meet the actual requirement of virtual sports. By studying the methods of digital speckle correlation measurement, a kind of an effective fast search method based on the relevant information of the neighborhood is proposed which can greatly reduce the computational complexity of the corresponding point matching and increase the speed of depth measurement. According to the error characteristics, a new interpolation method based on distance weighting is presented, which can greatly improve the accuracy of depth measurement. Experiments are demonstrated to support the effectiveness of this method.