Optimization of optical convolution kernel of optoelectronic hybrid convolution neural network

Xiaofeng XU; Lianqing ZHU; Wei ZHUANG; Dongliang ZHANG; Lidan LU; Pei YUAN

doi:10.1007/s11801-022-1183-x

[1] LI S, SUN K, LUO Y, et al. Novel CNN-based AP2D-net accelerator:an area and power efficient solution for real-time applications on mobile FPGA[J]. Electronics, 2020, 9(5):832.

[2] WU Y, ABDEL-ATY M, ZHENG O, et al. Automated safety diagnosis based on unmanned aerial vehicle video and deep learning algorithm[J]. Transportation research record:journal of the transportation research board, 2020, 2674(99):036119812092580.

[3] PENG H, NAHMIAS M A, THOMAS F, et al. Neuromorphic photonic integrated circuits[J]. IEEE journal of selected topics in quantum electronics, 2018, 24(6): 1-15.

[4] SHEN Y, HARRIS N C, SKIRLO S, et al. Deep learning with coherent nanophotonic circuits[J]. Nature photonics, 2017, 11:441-446.

[5] BANGARI V, MARQUEZ B A, MILLER H, et al. Digital electronics and analog photonics for convolutional neural networks (DEAP-CNNs)[J]. IEEE journal of selected topics in quantum electronics, 2020, 26(1): 1-13.

[6] ONG J R, OOI C C, ANG T Y L, et al. Photonic convolutional neural networks using integrated diffractive optics[J]. IEEE journal of selected topics in quantum electronics, 2020, 26(5):1-8.

[7] PAI S, BARTLETT B, SOLGAARD O, et al. Matrix optimization on universal unitary photonic devices[J]. Physical review applied, 2019, 11:064044.

[8] YING Z F, FENG C H, ZHAO Z, et al. Electronic-photonic arithmetic logic unit for high-speed computing[J]. Nature communications, 2020, 11:2154.

[9] XU X, ZHU L, ZHUANG W, et al. Photoelectric hybrid convolution neural network with coherent nanophotonic circuits[J]. Optical engineering, 2021, 60(11):117106.

[10] CLEMENTS W R, HUMPHREYS P C, METCALF B J, et al. An optimal design for universal multiport interferometers[J]. Optica, 2016, 3(12):1460.

[11] RECK M, ZEILINGER A, BERNSTEIN H J, et al. Experimental realization of any discrete unitary operator[J]. Physical review letters, 1994, 73(1):58-61.

[12] CONNELLY M J. Semiconductor optical amplifiers[M]. Berlin, Heidelberg:Springer Science & Business Media, 2007.

[13] CORPORATION N. NVIDIA TESLA V100[EB/OL]. (2018-01-26) [2021-12-04]. https://www.nvidia.com/en-us/data-center/tesla-v100/.

[14] MILLER D A B. Device requirements for optical interconnects to silicon chips[J]. Proceedings of the IEEE, 2009, 97(7):1166-1185.

[15] FELDMANN J, YOUNGBLOOD N, KARPOV M, et al. Parallel convolutional processing using an integrated photonic tensor core[J]. Nature, 2021, 589:52-58.

[16] JHA A, HUANG C, PRUCNAL P R. Reconfigurable all-optical nonlinear activation functions for neuromorphic photonics[J]. Optics letters, 2020, 45(17): 4819-4822.