• Acta Optica Sinica
  • Vol. 40, Issue 1, 0111002 (2020)
Fei Wang1、2, Hao Wang1、2, Yaoming Bian1、2, and Guohai Situ1、2、*
Author Affiliations
  • 1Laboratory of Information Optics and Optoelectronic Technology, Shanghai Institute of Optics and Fine Mechanics, Chinese Academy of Sciences, Shanghai 201800, China
  • 2Center of Materials Science and Optoelectronics Engineering, University of Chinese Academy of Sciences, Beijing 100049, China
  • show less
    DOI: 10.3788/AOS202040.0111002 Cite this Article Set citation alerts
    Fei Wang, Hao Wang, Yaoming Bian, Guohai Situ. Applications of Deep Learning in Computational Imaging[J]. Acta Optica Sinica, 2020, 40(1): 0111002 Copy Citation Text show less
    Schematic diagram. (a) Conventional imaging model; (b) computational imaging model
    Fig. 1. Schematic diagram. (a) Conventional imaging model; (b) computational imaging model
    Schematic of regression problem solved using neural network. (a) Training; (b) testing; (c) fitting process
    Fig. 2. Schematic of regression problem solved using neural network. (a) Training; (b) testing; (c) fitting process
    Diagram of data acquisition methods in computational imaging. (a) Images reconstructed by traditionally complex and costly methods; (b) presetting real objects with SLM; (c) data obtained by numerical simulation
    Fig. 3. Diagram of data acquisition methods in computational imaging. (a) Images reconstructed by traditionally complex and costly methods; (b) presetting real objects with SLM; (c) data obtained by numerical simulation
    Schematic of fully connected neural network. (a) Single hidden layer; (b) multi hidden layers
    Fig. 4. Schematic of fully connected neural network. (a) Single hidden layer; (b) multi hidden layers
    Simplified diagram of convolutional neural network. (a) Convolution: different convolution kernels corresponding to different feature maps; (b) pooling: replace data within the scope of operation with its maximum or mean; (c) deconvolution: interpolate data with zeros and then implement convolution; (d) convolution
    Fig. 5. Simplified diagram of convolutional neural network. (a) Convolution: different convolution kernels corresponding to different feature maps; (b) pooling: replace data within the scope of operation with its maximum or mean; (c) deconvolution: interpolate data with zeros and then implement convolution; (d) convolution
    Main problems in neural network training. (a) Local minimum; (b) overfitting
    Fig. 6. Main problems in neural network training. (a) Local minimum; (b) overfitting
    Flow chart of neural network training
    Fig. 7. Flow chart of neural network training
    Applications of deep learning in scattering imaging. (a) Imaging through strong scattering media[28,74]; (b) imaging through different ground glasses[27]
    Fig. 8. Applications of deep learning in scattering imaging. (a) Imaging through strong scattering media[28,74]; (b) imaging through different ground glasses[27]
    Applications of deep learning in digital holography. (a) Removing twin image[32]; (b) end-to-end phase reconstruction[34]; (c) end-to-end complex amplitude reconstruction[66]
    Fig. 9. Applications of deep learning in digital holography. (a) Removing twin image[32]; (b) end-to-end phase reconstruction[34]; (c) end-to-end complex amplitude reconstruction[66]
    Applications of deep learning in computational ghost imaging. (a) Improving signal-noise-ratio[29]; (b) reconstructing objects by using intensity sequences[31]
    Fig. 10. Applications of deep learning in computational ghost imaging. (a) Improving signal-noise-ratio[29]; (b) reconstructing objects by using intensity sequences[31]
    Imaging problemReferenceTraining dataData obtainingNetwork structureCost function
    Phase imaging[23][24][25]Faces-LFW or ImageNetDatabase,10000HeLa cell,925,human skin tissue,2500Method 2Method 1Method 1CNNCNNGANMAEMAE+regularizationAdversarial loss+TV
    Imaging throughscattering media[26][27][28]MNIST,10000MNIST,2400MNIST,3990Method 2Method 2Method 2CNNCNNCNNMAE, NPCCAveraged cross-entropyMSE
    Computational ghost imaging[29][30][31]MNIST,2000Aircraft model,200MNIST,9000Method 2Method 1Method 3FCNCNNCNNMSENormalized MSEMSE
    Digital holography[32][33][34]Breast tissue slide,100USAF pattern,3750MNIST,9000Method 1Method 1Method 2CNNCNNCNNMSESquare of the L2 normMSE
    Fourier ptychographic microscopy[35][36]Hela cell,20760Animal tissue,23040Method 1Method 1,3GANCNNAdversarial loss+normL1 norm
    Super-resolution[37][38][39]Single-molecule,10000Hela cell,2625Pap smear,65475Method 1,3Method 1Method 1CNNGANGANMSE+L1Adversarial loss+normAdversarial loss+norm
    Imaging in low light[40][41]imageNet,9500Celeba face images,9000Method 2Method 2CNNGANNPCCAdversarial loss+MSE
    Phase unwrapping[42][43]Random surface,30000Random surface,25000Method 3Method 3CNNCNNMSEMSE
    Fringe analysis[44][45]Fringe images,960Fringe pattern,80000Method 2Method 3CNNCNNMAEMAE
    Optical tomography[46][47][48]Retinal images,55080NIH3T3 cells,5512Retinal image,16000Method 1Method 2Method 1CNNGANGANMSEAdversarial loss+normAdversarial loss+norm
    Multimode fiberimaging[49][50]MINST,16000Handwritten latin alphabet,60000Method 2Method 2CNNCNNMSEMSE
    Table 1. Typical applications of deep learning in computational imaging
    Fei Wang, Hao Wang, Yaoming Bian, Guohai Situ. Applications of Deep Learning in Computational Imaging[J]. Acta Optica Sinica, 2020, 40(1): 0111002
    Download Citation