All-optical object identification and three-dimensional reconstruction based on optical computing metasurface

Dingyu Xu; Wenhao Xu; Qiang Yang; Wenshuai Zhang; Shuangchun Wen; Hailu Luo

doi:10.29026/oea.2023.230120

[1] S Rusinkiewicz, O Hall-Holt, M Levoy. Real-time 3D model acquisition. ACM Trans Graphics, 438-446(2002).

[3] S Zhang. High-speed 3D shape measurement with structured light methods: a review. Opt Lasers Eng, 119-131(2018).

[4] G Kim, Y Kim, J Yun, SW Moon, S Kim et al. Metasurface-driven full-space structured light for three-dimensional imaging. Nat Commun, 5920(2022).

[5] JW Liu, Q Yang, SZ Chen, ZC Xiao, SC Wen et al. Intrinsic optical spatial differentiation enabled quantum dark-field microscopy. Phys Rev Lett, 193601(2022).

[6] WT Buono, A Forbes. Nonlinear optics with structured light. Opto-Electron Adv, 210174(2022).

[7] R Gordon, GT Herman. Three-dimensional reconstruction from projections: a review of algorithms. Int Rev Cytol, 111-151(1974).

[8] O Russakovsky, J Deng, H Su, J Krause, S Satheesh et al. ImageNet large scale visual recognition challenge. Int J Comput Vis, 211-252(2015).

[9] H Kwon, D Sounas, A Cordaro, A Polman, A Alù. Nonlocal metasurfaces for optical signal processing. Phys Rev Lett, 173004(2018).

[10] JX Zhou, HL Qian, CF Chen, JX Zhao, GR Li et al. Optical edge detection based on high-efficiency dielectric metasurface. Proc Natl Acad Sci U S A, 11137-11140(2019).

[11] HJ Caulfield, S Dolev. Why future supercomputing requires optics. Nat Photonics, 261-263(2010).

[12] A Silva, F Monticone, G Castaldi, V Galdi, A Alù et al. Performing mathematical operations with metamaterials. Science, 160-163(2014).

[13] WL Liu, M Li, RS Guzzon, EJ Norberg, JS Parker et al. A fully reconfigurable photonic integrated signal processor. Nat Photonics, 190-195(2016).

[14] Y Zhou, HY Zheng, II Kravchenko, J Valentine. Flat optics for image differentiation. Nat Photonics, 316-323(2020).

[15] T Badloe, S Lee, J Rho. Computation at the speed of light: metamaterials for all-optical calculations and neural networks. Adv Photonics, 064002(2022).

[16] X Zhang, LL Huang, RZ Zhao, HQ Zhou, X Li et al. Basis function approach for diffractive pattern generation with Dammann vortex metasurfaces. Sci Adv, eabp8073(2022).

[17] LM Wu, TJ Fan, SR Wei, YJ Xu, Y Zhang et al. All-optical logic devices based on black arsenic–phosphorus with strong nonlinear optical response and high stability. Opto-Electron Adv, 200046(2022).

[18] AV Kildishev, A Boltasseva, VM Shalaev. Planar photonics with metasurfaces. Science, 1232009(2013).

[19] DY Xu, SC Wen, HL Luo. Metasurface-based optical analog computing: from fundamentals to applications. Adv Devices Instrum, 0002(2022).

[20] YX Zhang, MB Pu, JJ Jin, XJ Lu, YH Guo et al. Crosstalk-free achromatic full Stokes imaging polarimetry metasurface enabled by polarization-dependent phase optimization. Opto-Electron Adv, 220058(2022).

[21] YY Shi, CW Wan, CJ Dai, S Wan, Y Liu et al. On-chip meta-optics for semi-transparent screen display in sync with AR projection. Optica, 670-676(2022).

[22] T Pertsch, SM Xiao, A Majumdar, GX Li. Optical metasurfaces: fundamentals and applications. Photonics Res, OMFA1-OMFA3(2023).

[23] JX Zhou, HL Qian, JX Zhao, M Tang, QY Wu et al. Two-dimensional optical spatial differentiation and high-contrast imaging. Natl Sci Rev, nwaa176(2021).

[24] YL Wang, QB Fan, T Xu. Design of high efficiency achromatic metalens with large operation bandwidth using bilayer architecture. Opto-Electron Adv, 200008(200008).

[25] A Pors, MG Nielsen, SI Bozhevolnyi. Analog computing using reflective plasmonic metasurfaces. Nano Lett, 791-797(2015).

[26] SJ Wang, WT Qin, S Zhang, YC Lou, CQ Liu et al. Nanoengineered spintronic-metasurface terahertz emitters enable beam steering and full polarization control. Nano Lett, 10111-10119(2022).

[27] YJ Huang, TX Xiao, S Chen, ZW Xie, J Zheng et al. All-optical controlled-NOT logic gate achieving directional asymmetric transmission based on metasurface doublet. Opto-Electron Adv, 220073(2023).

[28] TF Zhu, YH Zhou, YJ Lou, H Ye, M Qiu et al. Plasmonic computing of spatial differentiation. Nat Commun, 15391(2017).

[29] Y Zhou, WH Wu, R Chen, WJ Chen, RP Chen et al. Analog optical spatial differentiators based on dielectric metasurfaces. Adv Opt Mater, 1901523(2020).

[30] Q He, F Zhang, MB Pu, XL Ma, X Li et al. Monolithic metasurface spatial differentiator enabled by asymmetric photonic spin-orbit interactions. Nanophotonics, 741-748(2020).

[31] DY Xu, H Yang, WH Xu, WS Zhang, KM Zeng et al. Inverse design of Pancharatnam–Berry phase metasurfaces for all-optical image edge detection. Appl Phys Lett, 241101(2022).

[32] X Liang, Z Zhou, ZL Li, JX Li, C Peng et al. All-optical multiplexed meta-differentiator for tri-mode surface morphology observation. Adv Mater, 2301505(2023).

[33] ZL Deng, QA Tu, YJ Wang, ZQ Wang, T Shi et al. Vectorial compound metapixels for arbitrary nonorthogonal polarization steganography. Adv Mater, 2103472(2021).

[34] H Yang, K Ou, HY Wan, YQ Hu, ZY Wei et al. Metasurface-empowered optical cryptography. Mater Today, 424-445(2023).

[35] F Zhang, YH Guo, MB Pu, LW Chen, MF Xu et al. Meta-optics empowered vector visual cryptography for high security and rapid decryption. Nat Commun, 1946(2023).

[36] MB Pu, X Li, XL Ma, YQ Wang, ZY Zhao et al. Catenary optics for achromatic generation of perfect optical angular momentum. Sci Adv, e1500396(2015).

[37] XG Luo, MB Pu, X Li, XL Ma. Broadband spin Hall effect of light in single nanoapertures. Light Sci Appl, e16276(2017).

[38] Y Liu, MC Huang, QK Chen, DG Zhang. Single planar photonic chip with tailored angular transmission for multiple-order analog spatial differentiator. Nat Commun, 7944(2022).

[39] C Zeng, H Lu, D Mao, YQ Du, H Hua et al. Graphene-empowered dynamic metasurfaces and metadevices. Opto-Electron Adv, 200098(2022).

[40] XW Wang, H Wang, JL Wang, XS Liu, HJ Hao et al. Single-shot isotropic differential interference contrast microscopy. Nat Commun, 2063(2023).

[41] XM Zhang, Y Zhou, HY Zheng, AE Linares, FC Ugwu et al. Reconfigurable metasurface for image processing. Nano Lett, 8715-8722(2021).

[42] TT Xiao, H Yang, Q Yang, DY Xu, RS Wang et al. Realization of tunable edge-enhanced images based on computing metasurfaces. Opt Lett, 925-928(2022).

[43] WW Fu, D Zhao, ZQ Li, SD Liu, C Tian et al. Ultracompact meta-imagers for arbitrary all-optical convolution. Light Sci Appl, 62(2022).

[44] ZC Shen, F Zhao, CQ Jin, S Wang, LC Cao et al. Monocular metasurface camera for passive single-shot 4D imaging. Nat Commun, 1035(2023).

[45] MW Song, L Feng, PC Huo, MZ Liu, CY Huang et al. Versatile full-colour nanopainting enabled by a pixelated plasmonic metasurface. Nat Nanotechnol, 71-78(2023).

[46] XL Jing, RZ Zhao, X Li, Q Jiang, CZ Li et al. Single-shot 3D imaging with point cloud projection based on metadevice. Nat Commun, 7842(2022).

[47] XL Jing, Y Li, JJ Li, YT Wang, LL Huang. Active 3D positioning and imaging modulated by single fringe projection with compact metasurface device. Nanophotonics, 1923-1930(2023).

[48] SS He, RS Wang, HL Luo. Computing metasurfaces for all-optical image processing: a brief review. Nanophotonics, 1083-1108(2022).

[49] Z Bomzon, G Biener, V Kleiner, E Hasman. Space-variant Pancharatnam–Berry phase optical elements with computer-generated subwavelength gratings. Opt Lett, 1141-1143(2002).

[50] X Yin, Z Ye, J Rho, Y Wang, X Zhang. Photonic spin Hall effect at metasurfaces. Science, 1405-1407(2013).

[51] XH Ling, XX Zhou, XN Yi, WX Shu, YC Liu et al. Giant photonic spin Hall effect in momentum space in a structured metamaterial with spatially varying birefringence. Light Sci Appl, e290(2015).

[52] L Peng, H Ren, YC Liu, TW Lan, KW Xu et al. Spin Hall effect of transversely spinning light. Sci Adv, eabo6033(2022).

[53] SQ Liu, SZ Chen, SC Wen, HL Luo. Photonic spin Hall effect: fundamentals and emergent applications. Opto-Electron Sci, 220007(2022).