Holographic display technology, which is considered to be the most ideal three-dimensional (3D) display technology, can accurately recover 3D image containing all the information of the object and provide the user a natural and real visual experience. Accurate acquisition of 3D real-scene data is important for realizing high-quality holographic 3D display and application. This paper compares various methods of 3D scene data reconstruction, introduces the basic principles of active, passive, and deep-learning-based reconstruction methods, analyzes the characteristics, advantages, and disadvantages of various methods, summarizes the basic methods of 3D reconstruction based on deep learning, and discusses the application prospect of combining them with holographic display technology. This article provides a reference for the further research on holographic 3D displays.