Based on an electronic speckle pattern interferometry (ESPI) optical setup with one illuminating light sensitive to out-of-plane displacement, a method is presented for three-dimensional deformation measurement by using the combination of digital speckle correlation method (DSCM) and ESPI. One speckle pattern before deformation is captured by a CCD camera without a reference light. The reference light is used and an ESPI system is constructed. The out-plane displacement component can be measured after the test object is deformed by using phase shifting technique in the ESPI system. Another speckle pattern is captured without reference light after deformation. The in-plane displacement components can be obtained by using DSCM from the two speckle patterns, one obtained before deformation and another after deformation. In this way the measurement of the three-dimensional displacement of an object is completed. A typical three-point-bending beam experiment is carried out by the method proposed. Experimental results show that the three displacement components can be obtained effectively. The deformation measurement system is simple and useful for it has a simple setup and easy operation.