This Letter presents a novel approach to enhance the fringe contrast (visibility) in a digital off-axis hologram digitally, which can save several adjustment procedures. In the approach, we train a pair of coupled dictionaries from a low fringe contrast hologram and a high one of the same specimen, use the dictionaries to sparse code the input hologram, and finally output a higher fringe contrast hologram. The sparse representation shows good adaptability on holograms. The experimental results demonstrate the benefit of low noise in a three-dimensional profile and prove the effectiveness of the approach.