Phase-shifting digital holography based on circular polarized light interference is proposed. It generates the object beam with right-rotated circular polarization and the reference beam with left-rotated circular polarization by quarter wave plate, successively changing the phase difference between the object beam and the reference beam by accurately rotating the polarizer located in front of the CCD and acquiring four digital holograms with corresponding phase changes. Numerical simulation and analysis and optical experimental results demonstrate that the method presented above can effectively remove the zero-order and conjugated images and has good-quality reconstructed image.