• Acta Photonica Sinica
  • Vol. 50, Issue 10, 1011001 (2021)
Fei LIU1、2、3, Xiaoqin WU1、2, Jingbo DUAN1、2, Pingli HAN1、2、4, and Xiaopeng SHAO1、2、3、*
Author Affiliations
  • 1School of Physics and Optoelectronic Engineering,Xi'dian University,Xi'an 710071,China
  • 2Xi'an Key Laboratory of Computational Imaging,Xi'an 710071,China
  • 3Academy of Advanced Interdisciplinary Research,Xi'dian University,Xi'an 710071,China
  • 4Key Laboratory of Optical Engineering,Chinese Academic of Science,Chengdu 610209,China
  • show less
    DOI: 10.3788/gzxb20215010.1011001 Cite this Article
    Fei LIU, Xiaoqin WU, Jingbo DUAN, Pingli HAN, Xiaopeng SHAO. An Introduction of Application of Computational Imaging in Photoelectric Detection(Invited)[J]. Acta Photonica Sinica, 2021, 50(10): 1011001 Copy Citation Text show less
    References

    [1] Shaomin LI, Wei NIU, Xin MA et al. Research on space target detection technology. National Defense Science & Technology, 30, 6-13(2009).

    [2] Dong LU, Zhanyue ZHANG, Dagong HAO et al. Simulation analysis of detection distance of space-based visible light camera. OME Information, 28, 39-43(2011).

    [3] Zhao SHI, Lizhu LI, Yu ZHAO et al. Implantable biomedical optoelectronic devices and systems. Chinese Journal of Lasers, 45, 9-40(2018).

    [4] Lei ZHANG. Research on optical imaging system of medical electronic hysteroscope(2015).

    [5] Yefeng XU, Haitao QIU, Zhiyu LI et al. Calculation and realization of the position command of the single axis camera for ground detection. Journal of Projectiles, Rockets, Missiles and Guidance, 29, 231-234(2009).

    [6] Xianyu TAN. Research on detection, tracking and confrontation of stealth offensive weapons. Electro-Optic Warfare & Radar Passive Countermeas, 26-33(2000).

    [7] Dadong LIU, Wei SOING. Operational use and technology development of shipborne photoelectric detection. Infrared and Laser Engineering, 73-75(2006).

    [8] Dayong CHEN. Development of active vehicle night vision device(2011).

    [9] Shenao WANG. Optimal design and analysis of structure of compound eye camera support(2018).

    [10] Hao HU, Yuan FAN, Dangjuan LI et al. Research and design of intelligent food delivery robot. Internal Combustion Engine & Parts, 6-8(2017).

    [11] R LUKAC. Computational photography:methods and application(2011).

    [12] Xiaopeng SHAO, Yun SU, Jinpeng LIU et al. Connotation and system of computational imaging (Invited). Acta Photonica Sinica, 50, 0511001(2021).

    [13] O COSSAIRT, S NATAR. Spectral focal sweep: Extended depth of field from chromatic aberrations, 1-8(2010).

    [14] I M VELLEKOOP, A P MOSK. Focusing coherent light through opaque strongly scattering media. Optics Letters, 32, 2309-2311(2007).

    [15] I M VELLEKOOP, C M AEGERTER. Focusing light through living tissue, 7554, 755430(2010).

    [16] I M VELLEKOOP. Feedback-based wavefront shaping. Optics Express, 23, 12189-12206(2015).

    [17] I M VELLEKOOP, A LAGENDIJK, A P MOSK. Exploiting disorder for perfect focusing. Nature Photonics, 4, 320-322(2010).

    [18] O KATZ, E SMALL, Y SILLBERBERG. Looking around corners and through thin turbid layers in real time with scattered incoherent light. Nature Photonics, 6, 549-553(2012).

    [19] S POPOFF, G LEROSEY, M FINK et al. Image transmission imaging through an opaque material. Nature Communications, 1, 81(2010).

    [20] S M POPOFF, G LEROSEY, R CARMINATI et al. Measuring the transmission matrix in optics: an approach to the study and control of light propagation in disordered media. Physical Review Letters, 104, 100601(2010).

    [21] A DREMEAU, A LIUTKUS, D MARTINA et al. Reference-less measurement of the transmission matrix of a highly scattering material using a DMD and phase retrieval techniques. Optics Express, 23, 11898-11911(2015).

    [22] A LIUTKUS, D MARTINA, S POPOFF et al. Imaging with nature: compressive imaging using a multiply scattering medium. Scientific Reports, 4, 5552(2015).

    [23] D ANDREOLI, U VOLPE, S POPOFF et al. Deterministic control of broadband light through a multiply scattering medium via the multispectral transmission matrix. Scientific Reports, 5, 10347(2015).

    [24] J DONG, F KRZAKALA, S GIGAN. Spectral method for multiplexed phase retrieval and application in optical imaging in complex media, 4936-4967(2019).

    [25] Z YAQOOB, D PSALTIS, M S FELD et al. Optical phase conjugation for turbidity suppression in biological samples. Nature Photonics, 2, 110-115(2008).

    [26] CUIM , C YANG. Implementation of a digital optical phase conjugation system and its application to study the robustness of turbidity suppression by phase conjugation. Optics Express, 18, 3444-3455(2010).

    [27] C L HSIEH, Y PU, R GRANGE et al. Digital phase conjugation of second harmonic radiation emitted by nanoparticles in turbid media. Optics Express, 18, 12283-12290(2010).

    [28] Y SHEN, Y LIU, C MA et al. Focusing light through biological tissue and tissue-mimicking phantoms up to 9.6 cm in thickness with digital optical phase conjugation. Journal of Biomedical Optics, 21, 085001(2016).

    [29] H RUAN, J BRAKE, J E ROBINSON et al. Deep tissue optical focusing and optogenetic modulation with time-reversed ultrasonically encoded light. Science Advances, 3, 5520(2017).

    [30] I FREUND, M ROSENBLUH, S FENG. Memory effects in propagation of optical waves through disordered media. Physical Review Letters, 61, 2328(1988).

    [31] S FENG, C KANE, P A LEE et al. Correlations and fluctuations of coherent wave transmission through disordered media. Physical Review Letters, 61, 834(1988).

    [32] J BERTOLOTTI, E GVAN PUTTEN, C BLUM et al. Non-invasive imaging through opaque scattering layers. Nature, 491, 232-234(2012).

    [33] O KATZ, P HEIDMANN, M FINK et al. Non-invasive single-shot imaging through scattering layers and around corners via speckle correlations. Nature Photonics, 8, 784-790(2014).

    [34] N STASIO, D B CONKEY, C MOSER et al. Light control in a multicore fiber using the memory effect. Optics Express, 23, 30532-30544(2015).

    [35] A PORAT, E R ANDRESEN, H RIGNEAULT et al. Widefield lensless imaging through a fiber bundle via speckle correlations. Optics Express, 24, 16835-16855(2016).

    [36] M LIAO, W HE, D LU et al. Ciphertext-only attack on optical cryptosystem with spatially incoherent illumination: from the view of imaging through scattering medium. Scientific Reports, 7, 1-9(2017).

    [37] G LI, W YANG, D LI et al. Cyphertext-only attack on the double random-phase encryption: experimental demonstration. Optics Express, 25, 8690-8697(2017).

    [38] M QIAO, H LIU, G PANG et al. Non-invasive three-dimension control of light between turbid layers using a surface quasi-point light source for precorrection. Scientific Reports, 7, 1-8(2017).

    [39] C GUO, J LIU, T WU et al. Tracking moving targets behind a scattering medium via speckle correlation. Applied Optics, 57, 905-913(2018).

    [40] R RAMESH, J DAVIS. : What can we reason about scene properties?(5). https://scholar.google.com/scholar

    [41] A VELTEN, T WILLWACHER, O GUPTA et al. Recovering three-dimensional shape around a corner using ultrafast time-of-flight imaging. Nature Communications, 3, 1-8(2012).

    [42] G GARIEPY, F TONOLINI, R HENDERSON et al. Detection and tracking of moving objects hidden from view. Nature Photonics, 10, 23-26(2016).

    [43] S CHAN, R E WARBURTON, G GARIEPY et al. Non-line-of-sight tracking of people at long range. Optics Express, 25, 10109-10117(2017).

    [44] C WU, J LIU, X HUANG et al. Non-line-of-sight imaging over 1.43 km. Proceedings of the National Academy of Sciences, 118, e2024468118(2021).

    [45] M O’TOOLE, D B LINDELL, G WETZSTEIN. Confocal non-line-of-sight imaging based on the light-cone transform. Nature, 555, 338-341(2018).

    [46] F HEIDE, M O'TOOLE, K ZANG et al. Non-line-of-sight imaging with partial occluders and surface normals. ACM Transactions on Graphics, 38, 1-10(2019).

    [47] F XU, G SHULKIND, C THRAMPOULIDIS et al. Revealing hidden scenes by photon-efficient occlusion-based opportunistic active imaging. Optics Express, 26, 9945-9962(2018).

    [48] M BATARSEH, S SUKHOV, Z SHEN et al. Passive sensing around the corner using spatial coherence. Nature Communications, 9, 1-6(2018).

    [49] C SAUUNDERS, B J MURRAY, V K GOYAL. Computational periscopy with an ordinary digital camera. Nature, 565, 472-475(2019).

    [50] T ANDO, R HORISAKI, J TANIDA. Speckle-learning-based object recognition through scattering media. Optics Express, 23, 33902-33910(2015).

    [51] M LYU, H WANG, G LI et al. Learning-based lensless imaging through optically thick scattering media. Advanced Photonics, 1, 036002(2019).

    [52] Y LI, Y XUE, L TIAN. Deep speckle correlation: a deep learning approach toward scalable imaging through scattering media. Optica, 5, 1181-1190(2018).

    [53] X LAI, Q LI, X WU et al. Mutual transfer learning of reconstructing images through a multimode fiber or a scattering medium. IEEE Access, 9, 68387-68395(2021).

    [54] Y Y SCHECHNER, S G NARASIMHAN, S K NAYAR. Polarization-based vision through haze. Applied Optics, 42, 511-525(2003).

    [55] S PANIGRAHI, J FADE, M ALOUINI. Adaptive polarimetric image representation for contrast optimization of a polarized beacon through fog. Journal of Optics, 17, 065703(2015).

    [56] S FANG, X S XIA, X HUO et al. Image dehazing using polarization effects of objects and airlight. Optics Express, 22, 19523-19537(2014).

    [57] W ZHANG, J LIANG, H JU et al. A robust haze-removal scheme in polarimetric dehazing imaging based on automatic identification of sky region. Optics & Laser Technology, 86, 145-151(2016).

    [58] F LIU, L CAO, X SHAO et al. Polarimetric dehazing utilizing spatial frequency segregation of images. Applied Optics, 54, 8116-8122(2015).

    [59] M P ROWE, E N PUGH, J S TYO et al. Polarization-difference imaging: a biologically inspired technique for observation through scattering media. Optics Letters, 20, 608-610(1995).

    [60] Jinge GUAN, Jingping ZHU, Hen TIAN et al. Real-time polarization differential underwater imaging based on Stokes vector. Acta Physica Sinica, 64, 224203(2015).

    [61] P HAN, F LIU, Y WEI et al. Optical correlation assists to enhance underwater polarization imaging performance. Optics and Lasers in Engineering, 134, 106256(2020).

    [62] Y Y SCHECHNER, N KARPEL. Recovery of underwater visibility and structure by polarization analysis. IEEE Journal of Oceanic Engineering, 30, 570-587(2005).

    [63] B HUANG, T LIU, H HU et al. Underwater image recovery considering polarization effects of objects. Optics express, 24, 9826-9838(2016).

    [64] H HU, L ZHAO, B HUANG et al. Enhancing visibility of polarimetric underwater image by transmittance correction. IEEE Photonics Journal, 9, 1-10(2017).

    [65] Yi WEI, Fei LIU, Kui YANG et al. Passive underwater polarization imaging detection method in neritic area. Acta Physica Sinica, 67, 184202(2018).

    [66] F LIU, Y WEI, P HAN et al. Polarization-based exploration for clear underwater vision in natural illumination. Optics Express, 27, 3629-3641(2019).

    [67] T TREIBITZ, Y Y SCHECHNER. Active polarization descattering. IEEE Transactions on Pattern Analysis and Machine Intelligence, 31, 385-399(2009).

    [68] Pingli HAN. Underwater targets detection based on polarization imaging, 67-78(2018).

    [69] Pingli HAN, Fei LIU, Guang ZHANG et al. Multi-scale analysis method of underwater polarization imaging. Acta Physica Sinica, 67, 054202(2018).

    [70] F LIU, P HAN, Y WEI et al. Deeply seeing through highly turbid water by active polarization imaging. Optics Letters, 43, 4903-4906(2018).

    [71] D MIYAZAKI, T SHIGETOMI, M BABA et al. Surface normal estimation of black specular objects from multiview polarization images. Optical Engineering, 56, 041303.17(2016).

    [72] G A ATKINSION, E R HANCOCK. Recovery of surface orientation from diffuse polarization. IEEE Transactions on Image Processing, 15, 1653-1664(2006).

    [73] D MIYAZAKI, M KAGESAWA, K IKEUCHI. Determining shapes of transparent objects from two polarization images, 26-31(2002).

    [74] D MIYAZAKI, M SAITO, Y SATO et al. Determining surface orientations of transparent objects based on polarization degrees in visible and infrared wavelengths. Journal of the Optical Society of America A, 19, 687-694(2002).

    [75] Jinglei HAO, Yongqiang ZHAO, Haimeng ZHAO et al. 3D reconstruction method high-reflective and textureless targets based on multispectral polarization and machine vision. Acta Geodartica Sinica, 47, 816-824(2018).

    [76] Y ZHAO, C YI, S G KONG et al. Multi-band polarization imaging. Multi-band Polarization Imaging and Applications, 47-71(2016).

    [77] O MOREL, C STOLZ, F MERIAUDEAU et al. Active lighting applied to three-dimensional reconstruction of specular metallic surfaces by polarization imaging. Applied Optics, 45, 4062-4068(2006).

    [78] Z ZHOU, Z WU, P TAN. Multi-view photometric stereo with spatially varying isotropic materials, 1482-1489(2013).

    [79] G A ATKINSON, E R HANCOCK. Surface reconstruction using polarization and photometric stereo, 466-473(2007).

    [80] A KADAMBI, V TAAMAZTAN, B SHI et al. Depth sensing using geometrically constrained polarization normals. International Journal of Computer Vision, 125, 34-51(2017).

    [81] X LI, F LIU, P HAN et al. Near-infrared monocular 3D computational polarization imaging of surfaces exhibiting nonuniform reflectance. Optics Express, 29, 15616-15630(2021).

    [82] D J BRADY, N HAGEN. Multiscale lens design. Optics Express, 17, 10659-10674(2009).

    [83] H AFSHARI, V POPOVIC, T TASCI et al. A spherical multi-camera system with real-time omnidirectional video acquisition capability. IEEE Transactions on Consumer Electronics, 58, 1110-1118(2012).

    [84] H AFSHARI, L JACQUES, L BAGNATO et al. The PANOPTIC camera: a plenoptic sensor with real-time omnidirectional capability. Journal of Signal Processing Systems, 70, 305-328(2013).

    [85] V POPOVIC, K SEYID, A AKIN et al. Image blending in a high frame rate FPGA-based multi-camera system. Journal of Signal Processing Systems, 76, 169-184(2014).

    [86] A AKIN, O COGAL, K SEYID et al. Hemispherical multiple camera system for high resolution omni-directional light field imaging. IEEE Journal on Emerging & Selected Topics in Circuits & Systems, 3, 137-144(2013).

    [87] O COGAL, V POPOVIC. A new omni-directional multi-camera system for high resolution surveillance, 9120, 91200N(2014).

    [88] V POPOVIC. Real-time computational gigapixel multi-camera systems(2016).

    [89] O COGAL, Y LEBLEBICI. An insect eye inspired miniaturized multi-camera system for endoscopic imaging. IEEE Transactions on Biomedical Circuits and Systems, 11, 212-224(2017).

    [90] N M LAW, O FORS, P WULFKEN et al. The Evryscope: the first full-sky gigapixel-scale telescope, 9145, 91450Z(2014).

    [91] N M LAW, T J MACCARONE. Evryscope science: exploring the potential of all-sky gigapixel-scale telescopes. Publications of the Astronomical Society of the Pacific, 127, 234-249(2015).

    [92] Yuegang FU, Yu ZHAO, Zhiyin LIU et al. Design of bionic compound eye optical system based on field of view stitching method. China Journal of Scientific Instrument, 36, 422-429(2015).

    [93] Yuegang FU, Yu ZHAO, Zhiyin LIU et al. Design of compact bionic compound eye optical system for target recognition. Infrared and Laser Engineering, 46, 8-14(2017).

    [94] Xiaopeng SHAO, Fei LIU, Wei LI et al. Latest progress in computational imaging technology and application. Laster & Optoelectronics Progress, 57, 11-55(2020).

    [95] D R GOLISH, E M VERA, K J KELLY et al. Development of a scalable image formation pipeline for multiscale gigapixel photography. Optics Express, 20, 22048(2012).

    [96] D L MARKS, H S SON, J KIM et al. Engineering a gigapixel monocentric multiscale camera. Optical Engineering, 51, 083202(2012).

    [97] D J BRADY, M E GEHM, R A STACK et al. Multiscale gigapixel photography. Nature, 486, 386-389(2012).

    [98] S S HUI, A JOHNSON, R A STACK et al. Optomechanical design of multiscale gigapixel digital camera. Applied Optics, 52, 1541-1549(2013).

    [99] S H YOUN, H S SON, D L MARKS et al. Optical performance test and validation of microcameras in multiscale, gigapixel imagers. Optics Express, 22, 3712-3723(2014).

    [100] T NAKAMURA, D S KITTLE, S H YOUN et al. Autofocus for a multiscale gigapixel camera. Applied Optics, 52, 8146-8153(2013).

    [101] D L MARKS, P R LLULL, Z PHILLIPS et al. Characterization of the AWARE 10 two-gigapixel wide-field-of-view visible imager. Applied Optics, 53, C54-C63(2014).

    [102] T NAKAMURA, D S KITTLE, S H YOUN et al. Autofocus for a multiscale gigapixel camera. Applied Optics, 52, 8146-8153(2013).

    [103] P LLULL, L BANGE, Z PHILLIPS et al. Characterization of the AWARE 40 wide-field-of-view visible imager. Optica, 2, 1086(2015).

    [104] J WU, B XIONG, X LIN et al. Snapshot hyperspectral volumetric microscopy. Scientific Reports, 6, 1-10(2016).

    [105] Fei LIU, Yazhe WEI, Pingli HAN et al. Design of multi-scale wide-area high-resolution computational imaging system based on concentric spherical lens. Acta Physica Sinica, 68, 99-108(2019).

    [106] Wei YANG, Jiawei LIU, Pingli HAN et al. Design of wide-area high-resolution infrared zoom imaging system based on concentric spherical lens. Journal of Infrared and Millimeter Waves, 38, 805-812(2019).

    [107] D G STORK, M D ROBINSON. Theoretical foundations for joint digital-optical analysis of electro-optical imaging systems. Applied Optics, 47, B64-B75(2008).

    [108] D ROBINSON, D G STORK. Joint design of lens systems and digital image processing(2006).

    [109] M D ROBINSON, D G STORK. End-to-end compensation of digital-optical imaging systems(2006).

    [110] M D ROBINSON, D G STORK. Joint digital-optical design of multi-frame imaging systems(2007).

    [111] M D ROBINSON, D G STORK. Joint digital-optical design of superresolution multiframe imaging systems. Applied Optics, 47, 11-20(2008).

    [112] T MIRANI, D RAJAN, M P CHRISTENSEN et al. Computational imaging systems: joint design and end-to-end optimality. Applied Optics, 47, 86-103(2008).

    [113] Zheng TAN, Yu FANG, Jingang ZHANG et al. A design method of reflective digital imaging system.

    [114] Jingang ZHANG, Bin XIANGLI, Zhen TAN et al. A design method of transmissive digital imaging system.

    [115] Bin XIANGLI, Jingang ZHANG, Zhen TAN et al. Optical and digital joint design method of digital imaging system.

    [116] Yazhe WEI. Research on the design method of computational optical system in computational imaging(2019).

    [117] Yunda ZHENG, Wei HUANG, Mingfei XU et al. Optical/algorithmic co-design of large-field high-quality simple optical system. Chinese Optics, 12, 1090-1099(2019).

    [118] J L HARRIS. Diffraction and resolving power. Journal of Stochastic Analysis, 54, 931-936(1964).

    [119] F LIU, P HAN, Y WANG et al. Super resolution reconstruction of infrared images based on classified dictionary learning. Infrared Physics & Technology, 90, 146-155(2018).

    [120] C DONG, C C LOY, K HE et al. Learning a deep convolutional network for image super-resolution, 184-199(2014).

    [121] J KIM, J K LEE, K M LEE. Accurate image super-resolution using very deep convolutional networks, 1646-1654(2016).

    [122] B LIM, S SON, H KIM et al. Enhanced deep residual networks for single image super-resolution, 136-144(2017).

    [123] Z ZHANG, Y LI, F WANG et al. A novel multi-sensor environmental perception method using low-rank representation and a particle filter for vehicle reversing safety. Sensors, 16, 848(2016).

    [124] Jiaying CHEN. Low-rank matrix restoration regularization algorithm and its application(2016).

    [125] Xiaoyang WANG. Research on infrared dim and small target detection theory and methodology based on sparse dynamic inversion(2018).

    [126] Fei LIU, Shaojie SUN, Pingli HAN et al. Clear underwater vision in non-uniform scattering field by low-rank-and-sparse-decomposition-based olarization imaging. Acta Physica Sinica, 70, 164201(2021).

    [127] Wenjun HANG, Jie LI, Chun QI. A defogging algorithm for dense fog images via low-rank and dctionary expression decomposition. Journal of Xi'an Jiaotong University, 54, 118-125(2020).

    Fei LIU, Xiaoqin WU, Jingbo DUAN, Pingli HAN, Xiaopeng SHAO. An Introduction of Application of Computational Imaging in Photoelectric Detection(Invited)[J]. Acta Photonica Sinica, 2021, 50(10): 1011001
    Download Citation