Photonic integrated neuro-synaptic core for convolutional spiking neural network

Shuiying Xiang; Yuechun Shi; Yahui Zhang; Xingxing Guo; Ling Zheng; Yanan Han; Yuna Zhang; Ziwei Song; Dianzhuang Zheng; Tao Zhang; Hailing Wang; Xiaojun Zhu; Xiangfei Chen; Min Qiu; Yichen Shen; Wanhua Zheng; Yue Hao

doi:10.29026/oea.2023.230140

[1] G Indiveri, SC Liu. Memory and information processing in neuromorphic systems. Proc IEEE, 1379-1397(2015).

[2] K Roy, A Jaiswal, P Panda. Towards spike-based machine intelligence with neuromorphic computing. Nature, 607-617(2019).

[3] D Marković, A Mizrahi, D Querlioz, J Grollier. Physics for neuromorphic computing. Nat Rev Phys, 499-510(2020).

[4] RA Nawrocki, RM Voyles, SE Shaheen. A mini review of neuromorphic architectures and implementations. IEEE Trans Electron Devices, 3819-3829(2016).

[5] CD Schuman, TE Potok, RM Patton, JD Birdwell, ME Dean et al. A survey of neuromorphic computing and neural networks in hardware. arXiv preprint arXiv: 1705.06963(2017).

[6] E Painkras, LA Plana, J Garside, S Temple, F Galluppi et al. SpiNNaker: a 1-W 18-core system-on-chip for massively-parallel neural network simulation. IEEE J Solid-State Circuits, 1943-1953(2013).

[7] BV Benjamin, PR Gao, E McQuinn, S Choudhary, AR Chandrasekaran et al. Neurogrid: a mixed-analog-digital multichip system for large-scale neural simulations. Proc IEEE, 699-716(2014).

[8] PA Merolla, JV Arthur, R Alvarez-Icaza, AS Cassidy, J Sawada et al. A million spiking-neuron integrated circuit with a scalable communication network and interface. Science, 668-673(2014).

[9] JC Shen, D Ma, ZH Gu, M Zhang, XL Zhu et al. Darwin: a neuromorphic hardware co-processor based on spiking neural networks. Sci China Inform Sci, 1-5(2016).

[10] M Davies, N Srinivasa, TH Lin, G Chinya, YQ Cao et al. Loihi: a neuromorphic manycore processor with on-chip learning. IEEE Micro, 82-99(2018).

[11] J Pei, L Deng, S Song, MG Zhao, YH Zhang et al. Towards artificial general intelligence with hybrid Tianjic chip architecture. Nature, 106-111(2019).

[12] G Wetzstein, A Ozcan, S Gigan, SH Fan, D Englund et al. Inference in artificial intelligence with deep optics and photonics. Nature, 39-47(2020).

[13] BJ Shastri, AN Tait, de Lima T Ferreira, WHP Pernice, H Bhaskaran et al. Photonics for artificial intelligence and neuromorphic computing. Nat Photonics, 102-114(2021).

[14] HL Zhou, JJ Dong, JW Cheng, WC Dong, CR Huang et al. Photonic matrix multiplication lights up photonic accelerator and beyond. Light Sci Appl, 30(2022).

[15] CR Huang, VJ Sorger, M Miscuglio, M Al-Qadasi, A Mukherjee et al. Prospects and applications of photonic neural networks. Adv Phys X, 1981155(2022).

[16] HX Qi, ZC Du, XY Hu, JY Yang, SS Chu et al. High performance integrated photonic circuit based on inverse design method. Opto-Electron Adv, 210061(2022).

[17] CH Li, W Du, YX Huang, JH Zou, LZ Luo et al. Photonic synapses with ultralow energy consumption for artificial visual perception and brain storage. Opto-Electron Adv, 210069(2022).

[18] SM Jiao, JW Liu, LW Zhang, FH Yu, GM Zuo et al. All-optical logic gate computing for high-speed parallel information processing. Opto-Electron Sci, 220010(2022).

[19] XY Meng, GJ Zhang, NN Shi, GY Li, J Azaña et al. Compact optical convolution processing unit based on multimode interference. Nat Commun, 3000(2023).

[20] F Zhang, YH Guo, MB Pu, LW Chen, MF Xu et al. Meta-optics empowered vector visual cryptography for high security and rapid decryption. Nat Commun, 1946(2023).

[21] C He, D Zhao, F Fan, HQ Zhou, X Li et al. Pluggable multitask diffractive neural networks based on cascaded metasurfaces. Opto-Electron Adv, 230005(2024).

[22] W Maass. Networks of spiking neurons: the third generation of neural network models. Neural Netw, 1659-1671(1997).

[23] R Gütig, H Sompolinsky. The tempotron: a neuron that learns spike timing–based decisions. Nat Neurosci, 420-428(2006).

[24] F Ponulak, A Kasiński. Supervised learning in spiking neural networks with ReSuMe: sequence learning, classification, and spike shifting. Neural Comput, 467-510(2010).

[25] J Feldmann, N Youngblood, CD Wright, H Bhaskaran, WHP Pernice. All-optical spiking neurosynaptic networks with self-learning capabilities. Nature, 208-214(2019).

[26] SY Xiang, ZX Ren, ZW Song, YH Zhang, XX Guo et al. Computing primitive of fully VCSEL-based all-optical spiking neural network for supervised learning and pattern classification. IEEE Trans Neural Netw Learn Syst, 2494-2505(2021).

[27] A Jha, CR Huang, HT Peng, B Shastri, PR Prucnal. Photonic spiking neural networks and graphene-on-silicon spiking neurons. J Lightwave Technol, 2901-2914(2022).

[28] SY Xiang, YC Shi, XX Guo, YH Zhang, HJ Wang et al. Hardware-algorithm collaborative computing with photonic spiking neuron chip based on an integrated Fabry–Perot laser with a saturable absorber. Optica, 162-171(2023).

[29] AN Tait, de Lima T Ferreira, E Zhou, AX Wu, MA Nahmias et al. Neuromorphic photonic networks using silicon photonic weight banks. Sci Rep, 7430(2017).

[30] YC Shen, NC Harris, S Skirlo, M Prabhu, T Baehr-Jones et al. Deep learning with coherent nanophotonic circuits. Nat Photonics, 441-446(2017).

[31] ZG Cheng, C Ríos, WHP Pernice, CD Wright, H Bhaskaran. On-chip photonic synapse. Sci Adv, e1700160(2017).

[32] HL Zhou, YH Zhao, X Wang, DS Gao, JJ Dong et al. Self-configuring and reconfigurable silicon photonic signal processor. ACS Photonics, 792-799(2020).

[33] J Feldmann, N Youngblood, M Karpov, H Gehring, X Li et al. Parallel convolutional processing using an integrated photonic tensor core. Nature, 52-58(2021).

[34] XY Xu, MX Tan, B Corcoran, JY Wu, A Boes et al. 11 TOPS photonic convolutional accelerator for optical neural networks. Nature, 44-51(2021).

[35] SF Xu, J Wang, HW Shu, ZK Zhang, SC Yi et al. Optical coherent dot-product chip for sophisticated deep learning regression. Light Sci Appl, 221(2021).

[36] H Zhang, M Gu, XD Jiang, J Thompson, H Cai et al. An optical neural chip for implementing complex-valued neural network. Nat Commun, 457(2021).

[37] XH Guo, JL Xiang, YJ Zhang, YK Su. Integrated neuromorphic photonics: synapses, neurons, and neural networks. Adv Photonics Res, 2000212(2021).

[38] JW Cheng, YH Zhao, WK Zhang, HL Zhou, DM Huang et al. A small microring array that performs large complex-valued matrix-vector multiplication. Front Optoelectron, 15(2022).

[39] PR Prucnal, BJ Shastri, de Lima T Ferreira, MA Nahmias, AN Tait. Recent progress in semiconductor excitable lasers for photonic spike processing. Adv Opt Photonics, 228-299(2016).

[40] J Robertson, E Wade, Y Kopp, J Bueno, A Hurtado. Toward neuromorphic photonic networks of ultrafast spiking laser neurons. IEEE J Sel Top Quantum Electron, 7700715(2020).

[41] YH Zhang, J Robertson, SY Xiang, M Hejda, J Bueno et al. All-optical neuromorphic binary convolution with a spiking VCSEL neuron for image gradient magnitudes. Photonics Res, B201-B209(2021).

[42] MA Nahmias, BJ Shastri, AN Tait, PR Prucnal. A leaky integrate-and-fire laser neuron for ultrafast cognitive computing. IEEE J Sel Top Quantum Electron, 1800212(2013).

[43] BJ Shastri, MA Nahmias, AN Tait, AW Rodriguez, B Wu et al. Spike processing with a graphene excitable laser. Sci Rep, 19126(2016).

[44] I Chakraborty, G Saha, G Sengupta, K Roy. Toward fast neural computing using all-photonic phase change spiking neurons. Sci Rep, 12980(2018).

[45] F Selmi, R Braive, G Beaudoin, I Sagnes, R Kuszelewicz et al. Relative refractory period in an excitable semiconductor laser. Phys Rev Lett, 183902(2014).

[46] HT Peng, G Angelatos, de Lima T Ferreira, MA Nahmias, AN Tait et al. Temporal information processing with an integrated laser neuron. IEEE J Sel Top Quantum Electron, 5100209(2020).

[47] JL Xiang, YJ Zhang, YT Zhao, XH Guo, YK Su. All-optical silicon microring spiking neuron. Photonics Res, 939-946(2022).

[48] DZ Zheng, SY Xiang, XX Guo, YH Zhang, BL Gu et al. Experimental demonstration of coherent photonic neural computing based on a Fabry–Perot laser with a saturable absorber. Photonics Res, 65-71(2023).

[49] YC Shi, SM Li, XF Chen, LY Li, JS Li et al. High channel count and high precision channel spacing multi-wavelength laser array for future PICs. Sci Rep, 7377(2014).

[50] YC Shi, SY Xiang, XX Guo, YH Zhang, HJ Wang et al. Photonic integrated spiking neuron chip based on a self-pulsating DFB laser with a saturable absorber. Photonics Res, 1382-1389(2023).

[51] H Beck, Y Yaari. Plasticity of intrinsic neuronal properties in CNS disorders. Nat Rev Neurosci, 357-369(2008).

[53] JA Alanis, J Robertson, M Hejda, A Hurtado. Weight adjustable photonic synapse by nonlinear gain in a vertical cavity semiconductor optical amplifier. Appl Phys Lett, 201104(2021).

[54] J Robertson, JA Alanis, M Hejda, A Hurtado. Photonic synaptic system for MAC operations by interconnected vertical cavity surface emitting lasers. Opt Mater. Express, 1417-1426(2022).