Finger-vein recognition is widely applied on access control system due to the high user acceptance and convince. Improving the integrity of finger-vein is helpful for increasing the finger-vein recognition accuracy. During the process of finger-vein imaging, foreign objects may be attached on fingers, which directly affects the integrity of finger-vein images. In order to effectively extract finger-vein networks, the integrity of venous networks is still not ideal after preprocessing of finger vein images. In this paper, we propose a novel deep learning based image restoration method to improve the integrity of finger-vein networks. First, a region detecting method based on adaptive threshold is presented to locate the incomplete region. Next, an encoder-decoder model is used to restore the venous networks of the finger-vein images. Then we analyze the restoration results using several different methods. Experimental results show that the proposed method is effective to restore the venous networks of the finger-vein images.