• Journal of Applied Optics
  • Vol. 46, Issue 3, 632 (2025)
Xiaoning GAO, Liju YIN*, Feng WANG, Yulin DENG, and Yiming QIN
Author Affiliations
  • School of Electrical and Electronic Engineering, Shandong University of Technology, Zibo 255049, China
  • show less
    DOI: 10.5768/JAO202546.0302003 Cite this Article
    Xiaoning GAO, Liju YIN, Feng WANG, Yulin DENG, Yiming QIN. Colorization of grayscale images combined with semantic segmentation[J]. Journal of Applied Optics, 2025, 46(3): 632 Copy Citation Text show less

    Abstract

    Image colorization is one of the core problems of great interest in computer vision and has attracted more and more researchers in recent years. The colorization technique improves the recognition rate and scene comprehension of targets of human eyes in grayscale images, especially in low-light-level (LLL) images. However, the current colorization methods still have problems such as color bleeding, color deviation and boundary blurring. To solve the above problems, a colorization method for grayscale images combined with semantic segmentation was proposed. A colorization network composed of a classification sub-network and a semantic segmentation sub-network was designed to fuse the features extracted from the semantic segmentation sub-network and the classification sub-network into the colorization network, and guide the colorization network to assign an accurate color to each object and background in the image. Then the attention mechanism combining with the space and channel was introduced into the semantic segmentation sub-network to obtain a more accurate semantic segmentation results, thereby improving the perception ability of image boundaries and the processing ability of details of the colorization network. To verify the effectiveness of the proposed method, several sets of LLL images of different scenes were captured under LLL environment and colorized by multi-pixel photon counter (MPPC) experimental platform. The experimental results show that the peak signal-to-noise ratio (PSNR), structural similarity index measure (SSIM), and learned perceptual image patch similarity (LPIPS) of the proposed method is improved by 6.12%, 11.65%, and 4.99%, respectively.
    Xiaoning GAO, Liju YIN, Feng WANG, Yulin DENG, Yiming QIN. Colorization of grayscale images combined with semantic segmentation[J]. Journal of Applied Optics, 2025, 46(3): 632
    Download Citation