A method for three-dimensional (3D) reconstruction from four-dimensional (4D) light fields was presented. The 4D light field image recorded the direction and intensity of all rays passing through the scene and contained useful information to estimate scene depth. Point 3D coordinates were obtained by calculating relative positional relationships between rays emitted from one point in the scene. However, it was very difficult in practice to determine these light rays from 4D light field data. The proposed method used fringe projection to mark object surfaces. Light ray information can then be accurately and quickly determined from the phase marker and 3D data calculated. The 4D light field matrix was light ray phase rather of intensity as in the conventional method and can record rays with various directions. Thus, shadow, occlusion, and surface specular reflection problems can be addressed. Feasibility and accuracy of the proposed method were verified experimentally.