All-optical neuromorphic binary convolution with a spiking VCSEL neuron for image gradient magnitudes

Yahui Zhang; Joshua Robertson; Shuiying Xiang; Matěj Hejda; Julián Bueno; Antonio Hurtado

doi:10.1364/PRJ.412141

[1] O. Abdel-Hamid, A. R. Mohamed, H. Jiang, G. Penn. Applying convolutional neural networks concepts to hybrid NN-HMM model for speech recognition. IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 4277-4280(2012).

[2] J. Fu, H. Zheng, T. Mei. Look closer to see better: recurrent attention convolutional neural network for fine-grained image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 4438-4446(2017).

[3] K. Gopalakrishnan, S. K. Khaitan, A. Choudhary, A. Agrawal. Deep convolutional neural networks with transfer learning for computer vision-based data-driven pavement distress detection. Constr. Build. Mater., 157, 322-330(2017).

[4] P. Y. Simard, D. Steinkraus, J. C. Platt. Best practices for convolutional neural networks applied to visual document analysis. International Conference on Document Analysis and Recognition (ICDAR), 958-963(2003).

[5] C. Farabet, C. Couprie, L. Najman, Y. LeCun. Learning hierarchical features for scene labeling. IEEE Trans. Pattern Anal. Mach. Intell., 35, 1915-1929(2013).

[6] L. Cavigelli, M. Magno, L. Benini. Accelerating real-time embedded scene labeling with convolutional networks. Proceedings of the 52nd Annual Design Automation Conference, 108(2015).

[7] M. Rastegari, V. Ordonez, J. Redmon, A. Farhadi. Xnor-net: ImageNet classification using binary convolutional neural networks. European Conference on Computer Vision (ECCV), 525-542(2016).

[8] F. Juefei-Xu, V. N. Boddeti, M. Savvides. Local binary convolutional neural networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 19-28(2017).

[9] X. Lin, C. Zhao, W. Pan. Towards accurate binary convolutional neural network. Advances in Neural Information Processing Systems (NIPS), 345-353(2017).

[10] M. Courbariaux, Y. Bengio, J.-P. David. BinaryConnect: training deep neural networks with binary weights during propagations. Advances in Neural Information Processing Systems (NIPS), 3105-3113(2015).

[11] M. Courbariaux, I. Hubara, D. Soudry, R. El-Yaniv, Y. Bengio. Binarized neural networks: training deep neural networks with weights and activations constrained to +1 or -1(2016).

[12] M. Turconi, B. Garbin, M. Feyereisen, M. Giudici, S. Barland. Control of excitable pulses in an injection-locked semiconductor laser. Phys. Rev. E, 88, 022923(2013).

[13] P. R. Prucnal, B. J. Shastri, T. F. de Lima, M. A. Nahmias, A. N. Tait. Recent progress in semiconductor excitable lasers for photonic spike processing. Adv. Opt. Photon., 8, 228-299(2016).

[14] S. Xiang, Y. Zhang, J. Gong, X. Guo, L. Lin, Y. Hao. STDP-based unsupervised spike pattern learning in a photonic spiking neural network with VCSELs and VCSOAs. IEEE J. Sel. Top. Quantum Electron., 25, 1700109(2019).

[15] Y. Zhang, S. Xiang, X. Guo, A. Wen, Y. Hao. All-optical inhibitory dynamics in photonic neuron based on polarization mode competition in a VCSEL with an embedded saturable absorber. Opt. Lett., 44, 1548-1551(2019).

[16] J. Feldmann, N. Youngblood, C. D. Wright, H. Bhaskaran, W. H. P. Pernice. All-optical spiking neurosynaptic networks with self-learning capabilities. Nature, 569, 208-214(2019).

[17] J. Robertson, E. Wade, Y. Kopp, J. Bueno, A. Hurtado. Toward neuromorphic photonic networks of ultrafast spiking laser neurons. IEEE J. Sel. Top. Quantum Electron., 26, 7700715(2019).

[18] A. Mehrabian, Y. Al-Kabani, V. J. Sorger, T. El-Ghazawi. PCNNA: a photonic convolutional neural network accelerator. IEEE International System-on-Chip Conference (SOCC), 169-173(2018).

[19] H. Bagherian, S. Skirlo, Y. Shen, H. Meng, V. Ceperic, M. Soljacic. On-chip optical convolutional neural networks(2018).

[20] S. Xu, J. Wang, R. Wang, J. Chen, W. Zou. High-accuracy optical convolution unit architecture for convolutional neural networks by cascaded acousto-optical modulator arrays. Opt. Express, 27, 19778-19787(2019).

[21] S. Xu, J. Wang, W. Zou. High-energy-efficiency integrated photonic convolutional neural networks(2019).

[22] K. Iga, H. E. Li. Vertical-Cavity Surface-Emitting Laser Devices(2003).

[23] R. Michalzik. VCSELs: Fundamentals, Technology and Applications of Vertical-Cavity Surface-Emitting Lasers, 166(2013).

[24] A. Hurtado, J. Javaloyes. Controllable spiking patterns in long-wavelength vertical cavity surface emitting lasers for neuromorphic photonics systems. Appl. Phys. Lett., 107, 241103(2015).

[25] B. Garbin, J. Javaloyes, G. Tissoni, S. Barland. Topological solitons as addressable phase bits in a driven laser. Nat. Commun., 6, 5915(2015).

[26] S. Y. Xiang, A. J. Wen, W. Pan. Emulation of spiking response and spiking frequency property in VCSEL-based photonic neuron. IEEE Photon. J., 8, 1504109(2016).

[27] T. Deng, J. Robertson, A. Hurtado. Controlled propagation of spiking dynamics in vertical-cavity surface-emitting lasers: towards neuromorphic photonic networks. IEEE J. Sel. Top. Quantum Electron., 23, 1800408(2017).

[28] J. Robertson, T. Deng, J. Javaloyes, A. Hurtado. Controlled inhibition of spiking dynamics in VCSELs for neuromorphic photonics: theory and experiments. Opt. Lett., 42, 1560-1563(2017).

[29] A. Dolcemascolo, B. Garbin, B. Peyce, R. Veltz, S. Barland. Resonator neuron and triggering multipulse excitability in laser with injected signal. Phys. Rev. E, 98, 062211(2018).

[30] J. Robertson, M. Hejda, J. Bueno, A. Hurtado. Ultrafast optical integration and pattern classification for neuromorphic photonics based on spiking VCSEL neurons. Sci. Rep., 10, 1(2020).

[31] M. Hejda, J. Robertson, J. Bueno, A. Hurtado. Spike-based information encoding in VCSELs for neuromorphic photonic systems. J. Phys., 2, 044001(2020).

[32] P. Arbelaez, M. Maire, C. Fowlkes, J. Malik. Contour detection and hierarchical image segmentation. IEEE Trans. Pattern Anal. Mach. Intell., 33, 898-916(2011).

[33] P. L. St-Charles, G. A. Bilodeau, R. Bergevin. Fast image gradients using binary feature convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 1-9(2016).

[34] E. Nadernejad. Edge detection techniques: evaluations and comparisons. Appl. Math. Sci., 2, 1507-1520(2008).

[35] J. Canny. A computational approach to edge detection. IEEE Trans. Pattern Anal. Mach. Intell., 8, 679-698(1986).

[36] R. Hamerly, L. Bernstein, A. Sludds, M. Soljačić, D. Englund. Large-scale optical neural networks based on photoelectric multiplication. Phys. Rev. X, 9, 021032(2019).

[37] V. Spiliopoulos, G. Keramidas, S. Kaxiras, K. Efstathiou. Power-performance adaptation in Inter core i7. Proceedings of 2nd Workshop Computer Architecture and Operating System Co-design, 1-10(2011).

CLP Journals