• Laser & Optoelectronics Progress
  • Vol. 59, Issue 24, 2411001 (2022)
Dongbin Liu1, Huiqin Wang1、*, Ke Wang1, Zhan Wang2, and Gang Zhen2
Author Affiliations
  • 1School of Information and Control Engineering, Xi'an University of Architecture and Technology, Xi'an 710055, Shaanxi, China
  • 2Shaanxi Provincial Institute of Cultural Relics Protection, Xi'an 710075, Shaanxi, China
  • show less
    DOI: 10.3788/LOP202259.2411001 Cite this Article Set citation alerts
    Dongbin Liu, Huiqin Wang, Ke Wang, Zhan Wang, Gang Zhen. Blind Restoration Method for Incomplete and Sparse Text Images Based on Content Style Transfer[J]. Laser & Optoelectronics Progress, 2022, 59(24): 2411001 Copy Citation Text show less

    Abstract

    The existing incomplete text image restoration must identify and fill the Mask region. The Mask region cannot be determined if the residual information of the incomplete text part is too sparse. A blind restoration method of incomplete and sparse text images based on content style transfer is proposed to address this issue. Using a cyclic generative adversarial network to construct the global related pixel information between the text images before and after restoration, the image content style features of the incomplete text were transferred to complete text images for restoration. The selfattention mechanism is added to the network to globally restrict the sparse pixels, thereby resolving the issue of weak dependence between the text sparse pixels far away in the migration process. simultaneously, the maximum pooling is used in the selfattention mechanism to enhance the texture features of the text images after migration and restoration. To improve migration accuracy, the least square loss function is used to replace the sigmoid cross-entropy loss function in the original network model. The proposed algorithm can repair random unknown missing regions in sparse incomplete text images without the assistance of Mask, according to experimental results.
    Dongbin Liu, Huiqin Wang, Ke Wang, Zhan Wang, Gang Zhen. Blind Restoration Method for Incomplete and Sparse Text Images Based on Content Style Transfer[J]. Laser & Optoelectronics Progress, 2022, 59(24): 2411001
    Download Citation