An error concealment algorithm in stereoscopic video transmission based on structural similarity (SSIM) is proposed. Firstly, the concepts of temporal and inter-view SSIM are presented. Secondly, according to the temporal correlation of video sequence, the prediction mode of a Macroblock (MB) in the right view on the previous time is taken as the prediction mode of the lost MB. Thirdly, temporal and inter-view correspondence is adopted to obtain the pixel-wise SSIM map of the right view on the previous time. Finally, the prediction of the MB is obtained by comparing the SSIM values of each MB between the temporal and inter-view of the right view in the previous stereo image pairs. Consequently, the given MB prediction mode is taken as the MB mode in the lost frame, and the motion and disparity compensated prediction are used to restore the content of the lost frame. Experimental results show that the proposed algorithm has improved the PSNR by 2.76 dB and 3.43 dB compared with the traditional methods and Pang’s algorithm, respectively. Meanwhile, the proposed algorithm is efficient in improving the subjective quality of the concealed lost frames.