• Photonics Research
  • Vol. 8, Issue 3, 395 (2020)
Chang Xu1, Tingfa Xu1、4、*, Ge Yan1, Xu Ma1、5、*, Yuhan Zhang1, Xi Wang1, Feng Zhao2, and Gonzalo R. Arce3
Author Affiliations
  • 1Key Laboratory of Photoelectronic Imaging Technology and System, School of Optics and Photonics, Beijing Institute of Technology, Beijing 100081, China
  • 2School of Computer Science and Information Security, Guilin University of Electronic Technology, Guilin 541004, China
  • 3Department of Electrical and Computer Engineering, University of Delaware, Newark, Delaware 19716, USA
  • 4e-mail: ciom_xtf1@bit.edu.cn
  • 5e-mail: maxu@bit.edu.cn
  • show less
    DOI: 10.1364/PRJ.377665 Cite this Article Set citation alerts
    Chang Xu, Tingfa Xu, Ge Yan, Xu Ma, Yuhan Zhang, Xi Wang, Feng Zhao, Gonzalo R. Arce. Super-resolution compressive spectral imaging via two-tone adaptive coding[J]. Photonics Research, 2020, 8(3): 395 Copy Citation Text show less
    Sketch of the LCTF-based hyperspectral imager.
    Fig. 1. Sketch of the LCTF-based hyperspectral imager.
    Examples of different projection matrices (N=401,L=100) for the original signal shown in (a): (b) the random projection matrix and (c) the TACS projection matrix.
    Fig. 2. Examples of different projection matrices (N=401,L=100) for the original signal shown in (a): (b) the random projection matrix and (c) the TACS projection matrix.
    Sequential scan of the spectral channels and compressive measurements using multiple coded snapshots. Note the coarse resolution of the detector array compared with that of the coded aperture.
    Fig. 3. Sequential scan of the spectral channels and compressive measurements using multiple coded snapshots. Note the coarse resolution of the detector array compared with that of the coded aperture.
    Method to generate the TACS coded apertures for the hyperspectral imaging systems.
    Fig. 4. Method to generate the TACS coded apertures for the hyperspectral imaging systems.
    (a) Original reference image; (b) the recovered image using a random coded aperture; and (c), (d) a pair of the TACS coded aperture patterns generated based on (b).
    Fig. 5. (a) Original reference image; (b) the recovered image using a random coded aperture; and (c), (d) a pair of the TACS coded aperture patterns generated based on (b).
    (a) Original spectral images, (b) the simulated low-resolution images obtained by conventional system, (c) the reconstructed spectral images using TACS coded apertures, and (d) the reconstructed spectral images using random coded apertures. Magnified details are presented as well.
    Fig. 6. (a) Original spectral images, (b) the simulated low-resolution images obtained by conventional system, (c) the reconstructed spectral images using TACS coded apertures, and (d) the reconstructed spectral images using random coded apertures. Magnified details are presented as well.
    (a) RGB image of the scene, and (b)–(d) the original and reconstructed spectral signatures for three representative points, indicated by P1, P2, and P3 in (a).
    Fig. 7. (a) RGB image of the scene, and (b)–(d) the original and reconstructed spectral signatures for three representative points, indicated by P1, P2, and P3 in (a).
    Influence of three key factors on the reconstruction performance. (a) The average reconstructed PSNRs in all spectral channels using different sub-group numbers, (b) the curves of average reconstructed PSNRs with respect to different compression ratios, and (c) the average PSNRs and (d) runtime corresponding to different reconstruction algorithms.
    Fig. 8. Influence of three key factors on the reconstruction performance. (a) The average reconstructed PSNRs in all spectral channels using different sub-group numbers, (b) the curves of average reconstructed PSNRs with respect to different compression ratios, and (c) the average PSNRs and (d) runtime corresponding to different reconstruction algorithms.
    Examples of coded patterns generated by (a) Galvis’s method and (b) Yang’s method.
    Fig. 9. Examples of coded patterns generated by (a) Galvis’s method and (b) Yang’s method.
    (a) Original spectral images in four spectral channels, (b) the reconstructed spectral images using the TACS coding method, (c) the reconstructed spectral images using Galvis’s method, and (d) the reconstructed spectral images using Yang’s method.
    Fig. 10. (a) Original spectral images in four spectral channels, (b) the reconstructed spectral images using the TACS coding method, (c) the reconstructed spectral images using Galvis’s method, and (d) the reconstructed spectral images using Yang’s method.
    Testbed of the staring hyperspectral imager with the proposed TACS coded apertures.
    Fig. 11. Testbed of the staring hyperspectral imager with the proposed TACS coded apertures.
    (a) RGB image of the target used in the experiment; (b) an example of random coded aperture patterns; and (c), (d) the examples of TACS coded aperture patterns.
    Fig. 12. (a) RGB image of the target used in the experiment; (b) an example of random coded aperture patterns; and (c), (d) the examples of TACS coded aperture patterns.
    (a) Original images in four spectral channels, (b) the low-resolution images obtained by the conventional system, (c) the reconstructed images obtained by TACS coded apertures, and (d) the reconstructed images obtained by random coded apertures. The color maps of the error patterns corresponding to (e) TACS coded apertures and (f) random coded apertures.
    Fig. 13. (a) Original images in four spectral channels, (b) the low-resolution images obtained by the conventional system, (c) the reconstructed images obtained by TACS coded apertures, and (d) the reconstructed images obtained by random coded apertures. The color maps of the error patterns corresponding to (e) TACS coded apertures and (f) random coded apertures.
    Original and reconstructed spectra for two representative points indicated by P1 and P2 as shown in Fig. 12(a).
    Fig. 14. Original and reconstructed spectra for two representative points indicated by P1 and P2 as shown in Fig. 12(a).
    (a) Original spectral images with center wavelengths of 554 nm, 563 nm, and 572 nm; (b) the simulated low-resolution images obtained by the conventional system; (c) the reconstructed spectral images using the proposed multi-channel method, and the reconstructed spectral images using the single-channel method with (d) TACS coded apertures and (e) random coded apertures.
    Fig. 15. (a) Original spectral images with center wavelengths of 554 nm, 563 nm, and 572 nm; (b) the simulated low-resolution images obtained by the conventional system; (c) the reconstructed spectral images using the proposed multi-channel method, and the reconstructed spectral images using the single-channel method with (d) TACS coded apertures and (e) random coded apertures.
    SignalSignal 1 with Dimension 400×1Signal 2 with Dimension 2500×1
    Projection matrixRandom (N=400,L=50)TACS (N=400,L=50)Random (N=2500,L=120)TACS (N=2500,L=120)
    μ¯ϒ0.309270.320180.276330.30408
    μ¯ϒ¯0.004050.002850.000800.00057
    Table 1. Comparison of Mean Values of μϒ and μϒ¯ Obtained by Random Projection Matrices and TACS Projection Matrices
    Chang Xu, Tingfa Xu, Ge Yan, Xu Ma, Yuhan Zhang, Xi Wang, Feng Zhao, Gonzalo R. Arce. Super-resolution compressive spectral imaging via two-tone adaptive coding[J]. Photonics Research, 2020, 8(3): 395
    Download Citation