• Acta Photonica Sinica
  • Vol. 50, Issue 10, 1020001 (2021)
Shuiying XIANG1,2,*, Ziwei SONG1, Shuang GAO1, Yanan HAN1..., Yahui ZHANG1, Xingxing GUO1 and Yue HAO2|Show fewer author(s)
Author Affiliations
  • 1State Key Laboratory of Integrated Service Networks,Xidian University,Xi'an 710071,China
  • 2State Key Discipline Laboratory of Wide Bandgap Semiconductor Technology,School of Microelectronics,Xidian University,Xi'an 710071,China
  • show less
    DOI: 10.3788/gzxb20215010.1020001 Cite this Article
    Shuiying XIANG, Ziwei SONG, Shuang GAO, Yanan HAN, Yahui ZHANG, Xingxing GUO, Yue HAO. Progress and Prospects of Photonic Neuromorphic Computing(Invited)[J]. Acta Photonica Sinica, 2021, 50(10): 1020001 Copy Citation Text show less
    The schematic diagram of biological neuron and synapse
    Fig. 1. The schematic diagram of biological neuron and synapse
    Nonlinear activation functions
    Fig. 2. Nonlinear activation functions
    Weight matrix based on MRRs and MZIs
    Fig. 3. Weight matrix based on MRRs and MZIs
    STDP and anti-STDP curves
    Fig. 4. STDP and anti-STDP curves
    Research progress of the Xidian University team[109-110]
    Fig. 5. Research progress of the Xidian University team109-110
    Optical piking neuronsPowerSpeedCascadabilityFootprintsInjection schemePump
    VCSEL-SAmWsub-nsYesBigElectricalElectrical
    DFB LasermWsub-nsYesBigElectricalElectrical
    VCSELmWsub-nsYesBigCoherent opticalOptical
    Quantum-dot lasermWsub-nsYesBigCoherent opticalElectrical
    Micropillar lasermWsub-nsYesBigElectricalElectrical
    PCMmWnsNoSmallPhotonic laser pulses/
    Table 1. Key performance of optical spiking neurons
    MethodIntegrationRefresh rate/GHzComputing rangeComputing method
    MRRsIntegrated>10Real fieldExplicit computing
    MZIsIntegrated>10Complex fieldImplicit computing
    Table 2. Comparison of optical matrix calculation methods
    YearFirst author/JournalTypeNetwork scalePerformance
    2014VANDOORNE K,Nature Communications[81]The integrated passive silicon photonics reservoir chip on a silicon platformA 16-node square mesh reservoir.The chip contained waveguides,splitters,and combinersPerformed arbitrary Boolean logic operations with memory,5-bit header recognition up to 12.5 Gbit/s,and classification of spoken digits
    2017SHEN Yichen,Nature Photonics[70]Feedforward fully connected optical neural network based on MZI4×4 weight matrix based on56 MZIsThe neuron was simulated by a nonlinear activation function in the electrical domainThe accuracy of vowel recognition is 76.7%,which is more than two orders of magnitude faster than the latest electronic chip at that time,but the energy used is less than one thousandth
    2017TAIT A N,Scientific Reports[59]Recurrent silicon photonic neural network based on MRR4×4 weight matrix based on 16 MRRs24 optical neurons based on EOMThe network had a 294-fold acceleration against a conventional benchmark in performing a differential system emulation task
    2018LIN Xing,Science[82]3D-printed diffractive deep neural networkClassification(Imaging)network:5-layers,200×200(300×300)neurons of a layerIn the task of handwritten digit classification,the accuracy was 91.75% for a five-layer design,and 93.39% for a seven-layer design
    2019FELDMANN J,Nature[80]Optical spiking neural network based on PCMs and MRRs4 spiking neurons based on MRRs with PCMs60 optical synapses based on PCMs and integrate waveguideThe network can implement supervised and unsupervised learning and was able to successfully classify the four 15-pixel images
    2019ZUO Ying,Optica[83]All-optical neural network(AONN)with linear operations and nonlinear activationfunctionsTwo-layer AONN:16×4×2A two-layer AONN can classify the phases of a prototypical Ising model,and successfully capture the essential features that distinguish the order and disorder phases
    2019BERNSTEIN L,Physical Review X[84]A new type of photonic accelerator based on coherent detectionThe number of neurons can be extended to ≥106 by the massive spatial multiplexing enabled by standard free-space optical componentsThe standard quantum limit can be as low as 50 zJ/MAC when neural networks are trained on the MNIST dataset
    2020RAFAYALYAN M,Physical Review X[85]Reservoir network based on the spatial light modulator and scattering mediumUp to 50000 optical nodesThe network successfully predicted on large spatiotemporal chaotic datasets
    2020SHI Bin,IEEE JSTQE[86]Feedforward neural network based on SOAs8×8 InP on-chip weighted circuitsThe non-linear function of neuron was implemented via softwareThe prediction accuracy of the Iris flower classification problem by the 3-layer photonic deep neural network was 85.8%
    2020BANGARI V,IEEE JSTQE[62]Digital electronics and analog photonics for convolutional neural networks(DEAP-CNNs)There are up to 1200 MRRs in the weight bank array theoreticallyDEAP-CNN was 2.8 to 14 times faster while using almost 25% less energy than current state-of-the-art graphical processing units. Overall accuracy was 97.6% for a test set of 500 images in the MNIST task
    2021FELDMANN J,Nature[87]A specific integrated photonic hardware accelerator based on photonic tensor core16×16 PCM integrated array to realize the matrix vector multiplicationThe accelerator operated at the speed of 1012 MAC operations per second
    2021XU Xingyuan,Nature[88]Optical vector convolutional acceleratorTen 3×3 convolutional kernels.Optical frequency combs provide 90 optical signals with different wavelengthsUsing wavelength division multiplexing,time division multiplexing and space division multiplexingThe computing speed of a single processor exceeded 10 TOPS,and the accuracy of handwritten digit images recognition was 88%
    Table 3. Key process of optical neural networks
    Company

    Date of

    establishment

    Founder/Team/PlaceAchievements
    Lightelligence2017

    MIT,

    Dr. SHEN Yichen

    In April 2019,Lightelligence released the prototype of its optical AI computer,the first of its kind in the world

    In 2021,the world's first commercial optical chip will be available soon

    Lightmatter2017MITIn 2020,the chip Mars for AI inference acceleration was presented. It is planned to launch its first optical AI chip Envise by the end of 2021
    Optalysys2013University of CambridgeIn 2015,an optical computing prototype was created,with a processing speed of about 320Gflops and very low energy efficiency. On March 7,2019,FT:X 2000 which is the world’s first optical co-processor system for AI computing was announced
    Fathom Computing2014BritainPhoton prototype computer was the first time that machine learning software used laser pulse circuits instead of power for training. In 2014,the accuracy of handwritten digits recognition was only about 30%,and by 2018,it had exceeded 90%
    Ayar Labs2015MITAyar Labs demonstrated the industry's first terabit optical link for co-packaged optics and chip-to-chip connectivity,which provided optical communication with high bandwidth,low delay,and low power consumption
    LightOn2016FranceA coprocessor Aurora has been fabricated,embedded with a very efficient optical core Nitro
    Photoncounts2017

    Beijing Jiaotong University,

    Dr. BAI Bing

    The field programmable photonic gate arrays chip has been developed,and a server-oriented photoelectric hybrid AI accelerated computing card has been built together with Beijing universities
    Luminous Computing2018Princeton UniversityThe scheme of Broadcast and Weight based on Micro-ring optical filters was used. The prototype at that time saved three orders of magnitude more energy than other most advanced AI chips
    Table 4. Photonic AI chip company
    Shuiying XIANG, Ziwei SONG, Shuang GAO, Yanan HAN, Yahui ZHANG, Xingxing GUO, Yue HAO. Progress and Prospects of Photonic Neuromorphic Computing(Invited)[J]. Acta Photonica Sinica, 2021, 50(10): 1020001
    Download Citation