• Chinese Optics Letters
  • Vol. 21, Issue 5, 051101 (2023)
Axin Fan1、2, Tingfa Xu1、2、*, Geer Teng1、3, Xi Wang4, Chang Xu1, Yuhan Zhang1、2, Xin Xu1、2, and Jianan Li1、**
Author Affiliations
  • 1Key Laboratory of Photoelectronic Imaging Technology and System of Ministry of Education of China, School of Optics and Photonics, Beijing Institute of Technology, Beijing 100081, China
  • 2Beijing Institute of Technology Chongqing Innovation Center, Chongqing 401151, China
  • 3Department of Engineering Science, Institute of Biomedical Engineering, University of Oxford, Oxford OX3 7DQ, UK
  • 4School of Printing & Packaging Engineering, Beijing Institute of Graphic Communication, Beijing 102600, China
  • show less
    DOI: 10.3788/COL202321.051101 Cite this Article Set citation alerts
    Axin Fan, Tingfa Xu, Geer Teng, Xi Wang, Chang Xu, Yuhan Zhang, Xin Xu, Jianan Li. Deep learning reconstruction enables full-Stokes single compression in polarized hyperspectral imaging[J]. Chinese Optics Letters, 2023, 21(5): 051101 Copy Citation Text show less
    Overall schematic diagram of DL-FSCPHI method.
    Fig. 1. Overall schematic diagram of DL-FSCPHI method.
    The reconstruction strategy proposed in this work. F2 is the measured full-Stokes images, while G2 is the detected polarization-compressed images, containing N2 targets, Nλ2 spectral bands, and Nx × Ny spatial pixels. The epoch, the batch size, and the learning rate are parameters set for model training. The iepoch and the jbatch refer to training the ith epoch and jth batch. F1 is the full-Stokes images predicted from the detected polarization-compressed images G1, containing N1 targets and Nλ1 spectral bands.
    Fig. 2. The reconstruction strategy proposed in this work. F2 is the measured full-Stokes images, while G2 is the detected polarization-compressed images, containing N2 targets, Nλ2 spectral bands, and Nx × Ny spatial pixels. The epoch, the batch size, and the learning rate are parameters set for model training. The iepoch and the jbatch refer to training the ith epoch and jth batch. F1 is the full-Stokes images predicted from the detected polarization-compressed images G1, containing N1 targets and Nλ1 spectral bands.
    Measured and reconstructed full-Stokes images of three test targets in 6 spectral bands from 560 nm to 660 nm with an interval of 20 nm. The reconstructed images are marked with the PSNR and the SSIM values.
    Fig. 3. Measured and reconstructed full-Stokes images of three test targets in 6 spectral bands from 560 nm to 660 nm with an interval of 20 nm. The reconstructed images are marked with the PSNR and the SSIM values.
    PSNR and SSIM values of the reconstructed full-Stokes images of the three test targets in 18 spectral bands ranging from 520 nm to 690 nm at intervals of 10 nm.
    Fig. 4. PSNR and SSIM values of the reconstructed full-Stokes images of the three test targets in 18 spectral bands ranging from 520 nm to 690 nm at intervals of 10 nm.
    Loss curves of the training models under different settings, including two sets of training parameters (epoch = 20, batch size = 7 and epoch = 40, batch size = 5), two sets of polarization angles (θ = 114°, β = 0° and θ = 27°, β = 0°), and two convolution models (DL-M1 and DL-M2).
    Fig. 5. Loss curves of the training models under different settings, including two sets of training parameters (epoch = 20, batch size = 7 and epoch = 40, batch size = 5), two sets of polarization angles (θ = 114°, β = 0° and θ = 27°, β = 0°), and two convolution models (DL-M1 and DL-M2).
    θ = 27°, β = 0°DL-M1DL-M2TwIST
    Evaluation metricsEpoch = 20Epoch = 40Epoch = 20Epoch = 40Accuracy = 0.005
    Batch size = 7Batch size = 5Batch size = 7Batch size = 5
    PSNR/dBS037.5838.0438.9538.7629.37
    S122.1722.6222.0622.2710.96
    S224.8725.1724.3825.2210.37
    S332.6333.5731.2032.199.85
    Average29.3129.8529.1529.6115.14
    SSIMS01.001.001.001.001.00
    S100.800.820.800.810.52
    S20.890.900.870.880.52
    S30.980.980.970.970.52
    Average0.920.920.910.920.64
    Table 1. Average PSNR and SSIM Values of the Reconstructed Full-Stokes Images of 7 Test Targets in 18 Spectral Bands under Different Settings, Including Two Sets of Polarization Angles (θ = 114°, β = 0° and θ = 27°, β = 0°), Two Convolution Models and One Traditional Algorithm (DL-M1, DL-M2, and TwIST), and Two Sets of Training Parameters (Epoch = 20, Batch Size = 7 and Epoch = 40, Batch Size = 5)
    Axin Fan, Tingfa Xu, Geer Teng, Xi Wang, Chang Xu, Yuhan Zhang, Xin Xu, Jianan Li. Deep learning reconstruction enables full-Stokes single compression in polarized hyperspectral imaging[J]. Chinese Optics Letters, 2023, 21(5): 051101
    Download Citation