The foreground ray has a serious impact on the quality of reconstruction during the traditional synthetic aperture imaging is refocused on the surface of object. For the above problem, we propose a refocusing imaging algorithm via foreground labeling in this paper. The algorithm first estimates the depth range of the scene based on the edge features of the EPI, extraction of foreground edge features and propagation according to the parameters of the specified surface to be rebuilt, thus determining the foreground occlusion corresponding rays. After labeling and removing those corresponding rays, reconstructing a specific surface with light field reconstruction algorithm to achieve the high quality reconstruction of the occluded object.The paper uses datasets provided by Stanford University and Disney laboratory to simulate, the experimental results show that the proposed algorithm can effectively remove the information of the occlusion in the scene and improve the quality of the refocused image.