Single-pixel imaging using physics enhanced deep learning

Fei Wang; Chenglong Wang; Chenjin Deng; Shensheng Han; Guohai Situ

doi:10.1364/PRJ.440123

[1] T. B. Pittman, Y. H. Shih, D. V. Strekalov, A. V. Sergienko. Optical imaging by means of two-photon quantum entanglement. Phys. Rev. A, 52, R3429-R3432(1995).

[2] B. I. Erkmen, J. H. Shapiro. Ghost imaging: from quantum to classical to computational. Adv. Opt. Photon., 2, 405-450(2010).

[3] M. P. Edgar, G. M. Gibson, M. J. Padgett. Principles and prospects for single-pixel imaging. Nat. Photonics, 13, 13-20(2019).

[4] M. F. Duarte, M. A. Davenport, D. Takhar, J. N. Laska, T. Sun, K. F. Kelly, R. G. Baraniuk. Single-pixel imaging via compressive sampling. IEEE Signal Process Mag., 25, 83-91(2008).

[5] W. Gong, C. Zhao, H. Yu, M. Chen, W. Xu, S. Han. Three-dimensional ghost imaging lidar via sparsity constraint. Sci. Rep., 6, 26133(2016).

[6] C. Wang, X. Mei, L. Pan, P. Wang, W. Li, X. Gao, Z. Bo, M. Chen, W. Gong, S. Han. Airborne near infrared three-dimensional ghost imaging lidar via sparsity constraint. Remote Sens., 10, 732(2018).

[7] B. Sun, M. P. Edgar, R. Bowman, L. E. Vittert, S. Welsh, A. Bowman, M. J. Padgett. 3D computational imaging with single-pixel detectors. Science, 340, 844-847(2013).

[8] M. Sun, M. P. Edgar, G. M. Gibson, B. Sun, N. Radwell, R. Lamb, M. J. Padgett. Single-pixel three-dimensional imaging with time-based depth resolution. Nat. Commun., 7, 12010(2016).

[9] L. Bian, J. Suo, G. Situ, Z. Li, J. Fan, F. Chen, Q. Dai. Multispectral imaging using a single bucket detector. Sci. Rep., 6, 24752(2016).

[10] F. Magalhães, F. M. Araújo, M. Correia, M. Abolbashari, F. Farahi. High-resolution hyperspectral single-pixel imaging system based on compressive sensing. Opt. Eng., 51, 071406(2012).

[11] N. Radwell, K. J. Mitchell, G. M. Gibson, M. P. Edgar, R. Bowman, M. J. Padgett. Single-pixel infrared and visible microscope. Optica, 1, 285-289(2014).

[12] G. M. Gibson, S. D. Johnson, M. J. Padgett. Single-pixel imaging 12 years on: a review. Opt. Express, 28, 28190-28208(2020).

[13] Z. Zhang, X. Wang, G. Zheng, J. Zhong. Fast Fourier single-pixel imaging via binary illumination. Sci. Rep., 7, 12029(2017).

[14] M. Sun, L. Meng, M. P. Edgar, M. J. Padgett, N. Radwell. A Russian dolls ordering of the Hadamard basis for compressive single-pixel imaging. Sci. Rep., 7, 3464(2017).

[15] Z.-H. Xu, W. Chen, J. Penuelas, M. Padgett, M.-J. Sun. 1000 fps computational ghost imaging using led-based structured illumination. Opt. Express, 26, 2427-2434(2018).

[16] O. Katz, Y. Bromberg, Y. Silberberg. Compressive ghost imaging. Appl. Phys. Lett., 95, 131110(2009).

[17] M. Lyu, W. Wang, H. Wang, H. Wang, G. Li, N. Chen, G. Situ. Deep-learning-based ghost imaging. Sci. Rep., 7, 17865(2017).

[18] Y. LeCun, Y. Bengio, G. Hinton. Deep learning. Nature, 521, 436-444(2015).

[19] G. Barbastathis, A. Ozcan, G. Situ. On the use of deep learning for computational imaging. Optica, 6, 921-943(2019).

[20] F. H. Catherine, M.-S. Roderick, J. P. Miles, P. E. Matthew. Deep learning for real-time single-pixel video. Sci. Rep., 8, 2369(2010).

[21] F. Wang, H. Wang, H. Wang, G. Li, G. Situ. Learning from simulation: an end-to-end deep-learning approach for computational ghost imaging. Opt. Express, 27, 25560-25572(2019).

[22] B. Neyshabur, S. Bhojanapalli, D. McAllester, N. Srebro. Exploring generalization in deep learning. Advances in Neural Information Processing Systems (NIPS), 1-10(2017).

[23] R. Shang, K. Hoffer-Hawlik, F. Wang, G. Situ, G. P. Luke. Two-step training deep learning framework for computational imaging without physics priors. Opt. Express, 29, 15239-15254(2021).

[24] A. Goy, G. Rughoobur, S. Li, K. Arthur, A. I. Akinwande, G. Barbastathis. High-resolution limited-angle phase tomography of dense layered objects using deep neural networks. Proc. Natl. Acad. Sci. USA, 116, 19848-19856(2019).

[25] A. Goy, K. Arthur, S. Li, G. Barbastathis. Low photon count phase retrieval using deep learning. Phys. Rev. Lett., 121, 243902(2018).

[26] F. Wang, Y. Bian, H. Wang, M. Lyu, G. Pedrini, W. Osten, G. Barbastathis, G. Situ. Phase imaging with an untrained neural network. Light Sci. Appl., 9, 77(2020).

[27] R. Iten, T. Metger, H. Wilming, L. del Rio, R. Renner. Discovering physical concepts with neural networks. Phys. Rev. Lett., 124, 010508(2020).

[28] C.-H. Lee, Z. Liu, L. Wu, P. Luo. Maskgan: towards diverse and interactive facial image manipulation. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 5548-5557(2020).

[29] F. Ferri, D. Magatti, L. A. Lugiato, A. Gatti. Differential ghost imaging. Phys. Rev. Lett., 104, 253603(2010).

[30] W. Gong, S. Han. A method to improve the visibility of ghost images obtained by thermal light. Phys. Lett. A, 374, 1005-1008(2010).

[31] L. Bian, J. Suo, Q. Dai, F. Chen. Experimental comparison of single-pixel imaging algorithms. J. Opt. Soc. Am. A, 35, 78-87(2018).

[32] S. Boyd, L. Vandenberghe. Convex Optimization(2004).

[33] F. Zhuang, Z. Qi, K. Duan, D. Xi, Y. Zhu, H. Zhu, H. Xiong, Q. He. A comprehensive survey on transfer learning. Proc. IEEE, 109, 43-76(2020).

[34] X. Zhang, F. Wang, G. Situ. BlindNet: an untrained learning approach toward computational imaging with model uncertainty. J. Phys. D, 55, 034001(2022).

[35] K. M. Czajkowski, A. Pastuszczak, R. Kotyński. Real-time single-pixel video imaging with Fourier domain regularization. Opt. Express, 26, 20009-20022(2018).

[36] A. Pastuszczak, R. Stojek, P. Wróbel, R. Kotyński. Differential real-time single-pixel imaging with fourier domain regularization: applications to VIS-IR imaging and polarization imaging. Opt. Express, 29, 26685-26700(2021).

[37] D. Ulyanov, A. Vedaldi, V. Lempitsky. Deep image prior. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 9446-9454(2018).

[38] C. Li. An Efficient Algorithm for Total Variation Regularization with Applications to the Single Pixel Camera and Compressive Sensing(2010).

[39] A. Coates, A. Ng, H. Lee. An analysis of single-layer networks in unsupervised feature learning. 14th International Conference on Artificial Intelligence and Statistics, 215-223(2011).

[40] Z.-P. Li, X. Huang, Y. Cao, B. Wang, Y.-H. Li, W. Jin, C. Yu, J. Zhang, Q. Zhang, C.-Z. Peng, F. Xu, J.-W. Pan. Single-photon computational 3D imaging at 45km. Photon. Res., 8, 1532-1540(2020).