• Journal of Inorganic Materials
  • Vol. 39, Issue 4, 345 (2024)
Zongxiao LI1, Lingxiang HU1, Jingrui WANG2, and Fei ZHUGE1,3,4,5,*
Author Affiliations
  • 11. Ningbo Institute of Materials Technology and Engineering, Chinese Academy of Sciences, Ningbo 315201, China
  • 22. School of Electronic and Information Engineering, Ningbo University of Technology, Ningbo 315211, China
  • 33. Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Shanghai 200031, China
  • 44. Center of Materials Science and Optoelectronics Engineering, University of Chinese Academy of Sciences, Beijing 100029, China
  • 55. Institute of Wenzhou, Zhejiang University, Wenzhou 325006, China
  • show less
    DOI: 10.15541/jim20230405 Cite this Article
    Zongxiao LI, Lingxiang HU, Jingrui WANG, Fei ZHUGE. Oxide Neuron Devices and Their Applications in Artificial Neural Networks[J]. Journal of Inorganic Materials, 2024, 39(4): 345 Copy Citation Text show less
    References

    [1] K ROY, A JAISWAL, P PANDA. Towards spike-based machine intelligence with neuromorphic computing. Nature, 607(2019).

    [2] K BOAHEN. Dendrocentric learning for synthetic intelligence. Nature, 43(2022).

    [3] P A MEROLLA, J V ARTHUR, R ALVAREZ-ICAZA et al. A million spiking-neuron integrated circuit with a scalable communication network and interface. Science, 668(2014).

    [4] N IMAM, T A CLELAND. Rapid online learning and robust recall in a neuromorphic olfactory circuit. Nature Machine Intelligence, 181(2020).

    [5] J PEI, L DENG, S SONG et al. Towards artificial general intelligence with hybrid Tianjic chip architecture. Nature, 106(2019).

    [6] J SHEN, D MA, Z GU et al. Darwin: a neuromorphic hardware co-processor based on spiking neural networks. Science China Information Sciences, 023401(2015).

    [7] L HU, J YANG, J WANG et al. All-optically controlled memristor for optoelectronic neuromorphic computing. Advanced Functional Materials, 2005582(2021).

    [8] T WANG, H RAN, G ZHOU. Defect-induced analogue resistive switching behavior in FeOx-based memristor and synaptic paired-pulse facilitation feature. Journal of Inorganic Materials, 437(2023).

    [9] C WAN, Y HE, S JIANG et al. Emerging devices for biologically accurate neuron. ACS Applied Electronic Materials, 389(2020).

    [10] M FARRANT, Z NUSSER. Variations on an inhibitory theme: phasic and tonic activation of GABA(A) receptors. Nature Reviews Neuroscience, 215(2005).

    [11] H MARKRAM, M TOLEDO-RODRIGUEZ, Y WANG et al. Interneurons of the neocortical inhibitory system. Nature Reviews Neuroscience, 793(2004).

    [12] E M IZHIKEVICH. Which model to use for cortical spiking neurons?. IEEE Transactions on Neural Networks, 1063(2004).

    [13] A L HODGKIN, A F HUXLEY. The components of membrane conductance in the giant axon of loligo. The Journal of Physiology, 473(1952).

    [14] A L HODGKIN, A F HUXLEY. Currents carried by sodium and potassium ions through the membrane of the giant axon of loligo. The Journal of Physiology, 449(1952).

    [15] G BUGMANN. Summation and multiplication: two distinct operation domains of leaky integrate-and-fire neurons. Network: Computation in Neural Systems, 489(1991).

    [16] L F XU, C D LI, L CHEN. Contrastive analysis of neuron model. Acta Physica Sinica, 240701(2016).

    [17] J V NEUMANN. Non-linear capacitance or inductance switching, amplifying and memory organs. USA, 2,815,488(1957).

    [18] R L WIGINGTON. A new concept in computing. Proceedings of the IRE, 516(1959).

    [19] E C SOBEL, D W TANK. In vivo Ca2+ dynamics in a cricket auditory neuron: an example of chemical computation. Science, 823(1994).

    [20] S PERON, F GABBIANI. Spike frequency adaptation mediates looming stimulus selectivity in a collision-detecting neuron. Nature Neuroscience, 318(2009).

    [21] J S ISAACSON, M SCANZIANI. How inhibition shapes cortical activity. Neuron, 231(2011).

    [22] Y ZHOU, H CHEN, Y WANG. Role of lateral inhibition on visual number sense. Frontiers in Computational Neuroscience, 810448(2022).

    [23] Q MA, M R HAIDER, V L SHRESTHA et al. Bursting Hodgkin-Huxley model-based ultra-low-power neuromimetic silicon neuron. Analog Integrated Circuits and Signal Processing, 329(2012).

    [24] M W KWON, M H BAEK, S HWANG et al. Integrate-and-fire neuron circuit using positive feedback field effect transistor for low power operation. Journal of Applied Physics, 152107(2018).

    [25] D CHATTERJEE, A KOTTANTHARAYIL. A CMOS compatible bulk FinFET-based ultra low energy leaky integrate and fire neuron for spiking neural networks. IEEE Electron Device Letters, 1301(2019).

    [26] J VALASEK. Piezo-electric and allied phenomena in Rochelle salt. Physical Review, 475(1921).

    [27] Y ISHIBASHI, Y TAKAGI. Note on ferroelectric domain switching. Journal of the Physical Society of Japan, 506(1971).

    [28] J GROLLIER, D QUERLIOZ, K Y CAMSARI et al. Neuromorphic spintronics. Nature Electronics, 360(2020).

    [29] L CHUA. Memristor-the missing circuit element. IEEE Transactions on Circuit Theory, 507(1971).

    [30] L CHUA. Memristor, Hodgkin-Huxley, and edge of chaos. Nanotechnology, 383001(2013).

    [31] M D PICKETT, G MEDEIROS-RIBEIRO, R S WILLIAMS. A scalable neuristor built with mott memristors. Nature Materials, 114(2013).

    [32] W YI, K K TSANG, S K LAM et al. Biological plausibility and stochasticity in scalable VO2 active memristor neurons. Nature Communications, 4661(2018).

    [33] Y XU, S GAO, Z LI et al. Adaptive Hodgkin-Huxley neuron for retina-inspired perception. Advanced Intelligent Systems, 2200210(2022).

    [34] H M HUANG, R YANG, Z H TAN et al. Quasi-Hodgkin-Huxley neurons with leaky integrate-and-fire functions physically realized with memristive devices. Advanced Materials, 1803849(2019).

    [35] M D PICKETT, WILLIAMS R STANLEY. Phase transitions enable computational universality in neuristor-based cellular automata. Nanotechnology, 384002(2013).

    [36] M T BUSCAGLIA, V BUSCAGLIA, M VIVIANI et al. Ferroelectric properties of dense nanocrystalline BaTiO3 ceramics. Nanotechnology, 1113(2004).

    [37] Z X LI, X L LIU, W J CHEN et al. Switchable diode effect in ferroelectric thin film: high dependence on poling process and temperature. AIP Advances, 127111(2014).

    [38] J WANG, H ZHENG, Z MA et al. Epitaxial BiFeO3 thin films on Si. Applied Physics Letters, 2574(2004).

    [39] T S BÖSCKE, J MÜLLER, D BRÄUHAUS et al. Ferroelectricity in hafnium oxide thin films. Applied Physics Letters, 102903(2011).

    [40] H MULAOSMANOVIC, T MIKOLAJICK, S SLESAZECK. Accumulative polarization reversal in nanoscale ferroelectric transistors. ACS Applied Materials & Interfaces, 23997(2018).

    [41] H MULAOSMANOVIC, T MIKOLAJICK, S SLESAZECK. Random number generation based on ferroelectric switching. IEEE Electron Device Letters, 135(2018).

    [42] H MULAOSMANOVIC, E CHICCA, M BERTELE et al. Mimicking biological neurons with a nanoscale ferroelectric transistor. Nanoscale, 21755(2018).

    [43] R CAO, X ZHANG, S LIU et al. Compact artificial neuron based on anti-ferroelectric transistor. Nature Communications, 7018(2022).

    [44] C CHEN, M YANG, S LIU et al. Bio-inspired Neurons Based on Novel Leaky-FeFET with Ultra-low Hardware Cost and Advanced Functionality for All-ferroelectric Neural NetWork. Symposium on VLSI Technology, Kyoto, T136-T137(2019).

    [45] J LUO, L YU, T LIU et al. Capacitor-less Stochastic Leaky-FeFET Neuron of Both Excitatory and Inhibitory Connections for SNN with Reduced Hardware Cost. IEEE International Electron Devices Meeting, San Francisco(2019).

    [46] J A KATINE, F J ALBERT, R A BUHRMAN et al. Current- driven magnetization reversal and spin-wave excitations in Co/Cu/Co pillars. Physical Review Letters, 3149(2000).

    [47] M TSOI, A G JANSEN, J BASS et al. Generation and detection of phase-coherent current-driven magnons in magnetic multilayers. Nature, 46(2000).

    [48] A KURENKOV, S DUTTAGUPTA, C ZHANG et al. Artificial neuron and synapse realized in an antiferromagnet/ferromagnet heterostructure using dynamics of spin-orbit torque switching. Advanced Materials, 1900636(2019).

    [49] S YANG, J SHIN, T KIM et al. Integrated neuromorphic computing networks by artificial spin synapses and spin neurons. NPG Asia Materials, 11(2021).

    [50] J H LIU, T XU, H M FENG et al. Compensated ferrimagnet based artificial synapse and neuron for ultrafast neuromorphic computing. Advanced Functional Materials, 2107870(2022).

    [51] D WANG, R TANG, H LIN et al. Spintronic leaky-integrate-fire spiking neurons with self-reset and winner-takes-all for neuromorphic computing. Nature Communications, 1068(2023).

    [52] W J MA, S P LIN, J M LUO et al. Highly uniform bipolar resistive switching characteristics in TiO2/BaTiO3/TiO2 multilayer. Applied Physics Letters, 262903(2013).

    [53] G ZHOU, B SUN, X HU et al. Negative photoconductance effect: an extension function of the TiOx-based memristor. Advanced Science, 2003765(2021).

    [54] F ZHUGE, K LI, B FU et al. Mechanism for resistive switching in chalcogenide-based electrochemical metallization memory cells. AIP Advances, 057125(2015).

    [55] L HU, S FU, Y CHEN et al. Ultrasensitive memristive synapses based on lightly oxidized sulfide films. Advanced Materials, 1606927(2017).

    [56] S R ZHANG, L ZHOU, J Y MAO et al. Artificial synapse emulated by charge trapping-based resistive switching device. Advanced Materials Technologies, 1800342(2019).

    [57] J YOU, D YANG, C LI et al. Double dielectric layer metal-oxide memristor: design and applications. Journal of Inorganic Materials, 387(2023).

    [58] X ZHUGE, R ZHU, J WANG et al. Oxide memristors for brain-inspired computing. Journal of Inorganic Materials, 1149(2023).

    [59] J YANG, L HU, L SHEN et al. Optically driven intelligent computing with ZnO memristor. Fundamental Research, 158(2024).

    [60] S LASHKARE, S CHOUHAN, T CHAVAN et al. PCMO RRAM for integrate-and-fire neuron in spiking neural networks. IEEE Electron Device Letters, 484(2018).

    [61] J J WANG, S G HU, X T ZHAN et al. Handwritten-digit recognition by hybrid convolutional neural network based on HfO2 memristive spiking-neuron. Scientific Reports, 12546(2018).

    [62] T TUMA, A PANTAZI, GALLO M LE et al. Stochastic phase-change neurons. Nature Nanotechnology, 693(2016).

    [63] J X ZHU, X M ZHANG, R WANG et al. Flexible memristive spiking neuron for neuromorphic sensing and computing. Acta Physica Sinica, 148503(2022).

    [64] Y N GU, Y LIANG, G Y WANG et al. Design of NbOx memristive neuron and its application in spiking neural networks. Acta Physica Sinica, 110501(2022).

    [65] P STOLIAR, J TRANCHANT, B CORRAZE et al. A leaky- integrate-and-fire neuron analog realized with a Mott insulator. Advanced Functional Materials, 1604740(2017).

    [66] C ADDA, B CORRAZE, P STOLIAR et al. Mott insulators: a large class of materials for leaky integrate and fire (LIF) artificial neuron. Journal of Applied Physics, 152124(2018).

    [67] A PARIHAR, M JERRY, S DATTA et al. Stochastic IMT (insulator-metal-transition) neurons: an interplay of thermal and threshold noise at bifurcation. Frontiers in Neuroscience, 210(2018).

    [68] P CHEN, X M ZHANG, Z H WU et al. High-yield and uniform NbOx-based threshold switching devices for neuron applications. IEEE Transactions on Electron Devices, 2391(2022).

    [69] Y M SUN, C SONG, S Q YIN et al. Design of a controllable redox-diffusive threshold switching memristor. Advanced Electronic Materials, 2000695(2020).

    [70] Z WANG, S JOSHI, S E SAVEL'EV et al. Memristors with diffusive dynamics as synaptic emulators for neuromorphic computing. Nature Materials, 101(2017).

    [71] X M ZHANG, W WANG, Q LIU et al. An artificial neuron based on a threshold switching memristor. IEEE Electron Device Letters, 308(2018).

    [72] D LEE, M KWAK, K MOON et al. Various threshold switching devices for integrate and fire neuron applications. Advanced Electronic Materials, 1800866(2019).

    [73] X WANG, C CHEN, L ZHU et al. Vertically integrated spiking cone photoreceptor arrays for color perception. Nature Communications, 3444(2023).

    [74] Y WANG, H XU, W WANG et al. A configurable artificial neuron based on a threshold-tunable TiN/NbO/Pt memristor. IEEE Electron Device Letters, 631(2022).

    [75] D F SPECHT. Probabilistic neural networks and the polynomial adaline as complementary techniques for classification. IEEE Transactions on Neural Networks, 111(1990).

    [76] Z X LI, X Y GENG, J WANG et al. Emerging artificial neuron devices for probabilistic computing. Frontiers in Neuroscience, 717947(2021).

    [77] R CARBONI, D IELMINI. Stochastic memory devices for security and computing. Advanced Electronic Materials, 1900198(2019).

    [78] K WANG, Q HU, B GAO et al. Threshold switching memristor-based stochastic neurons for probabilistic computing. Materials Horizons, 619(2021).

    [79] P BOUSOULAS, C TSIOUSTAS, J HADFIELD et al. Low power stochastic neurons from SiO2-based bilayer conductive bridge memristors for probabilistic spiking neural network applications-part I: experimental characterization. IEEE Transactions on Electron Devices, 2360(2022).

    [80] P BOUSOULAS, C TSIOUSTAS, J HADFIELD et al. Low power stochastic neurons from SiO2-based bilayer conductive bridge memristors for probabilistic spiking neural network applications-part II: modeling. IEEE Transactions on Electron Devices, 2368(2022).

    [81] S CHOI, G S KIM, J YANG et al. Controllable SiOx nanorod memristive neuron for probabilistic bayesian inference. Advanced Materials, 2104598(2022).

    [82] B J DANG, K Q LIU, J D ZHU et al. Stochastic neuron based on IGZO Schottky diodes for neuromorphic computing. APL Materials, 071114(2019).

    [83] H W MAO, Y L HE, C S CHEN et al. A spiking stochastic neuron based on stacked InGaZnO memristors. Advanced Electronic Materials, 2100918(2022).

    [84] L YAN, Y F PEI, J J WANG et al. High-speed Si films based threshold switching device and its artificial neuron application. Applied Physics Letters, 153507(2021).

    [85] J WANG, C TENG, Z ZHANG et al. A scalable artificial neuron based on ultrathin two-dimensional titanium oxide. ACS Nano, 15123(2021).

    [86] Y H CHEN, Y WANG, Y H LUO et al. Realization of artificial neuron using MXene bi-directional threshold switching memristors. IEEE Electron Device Letters, 1686(2019).

    [87] T KIM, S H KIM, J H PARK et al. An artificial neuron using a bipolar electrochemical metallization switch and its enhanced spiking properties through filament confinement. Advanced Electronic Materials, 2000410(2021).

    [88] Y TIAN, X ZHU, C SUN et al. Intrinsically stretchable threshold switching memristor for artificial neuron implementations. Journal of Inorganic Materials, 413(2023).

    [89] H LI, J HU, A CHEN et al. Single-transistor neuron with excitatory-inhibitory spatiotemporal dynamics applied for neuronal oscillations. Advanced Materials, 2207371(2022).

    [90] C CHEN, Y HE, H MAO et al. A photoelectric spiking neuron for visual depth perception. Advanced Materials, 2201895(2022).

    [91] Q WU, B DANG, C LU et al. Spike encoding with optic sensory neurons enable a pulse coupled neural network for ultraviolet image segmentation. Nano Letters, 8015(2020).

    [92] Y PEI, L YAN, Z WU et al. Artificial visual perception nervous system based on low-dimensional material photoelectric memristors. ACS Nano, 17319(2021).

    [93] S M YOON, E TOKUMITSU, H ISHIWARA. Ferroelectric neuron integrated circuits using SrBi2Ta2O9-gate FET's and CMOS Schmitt-trigger oscillators. IEEE Transactions on Electron Devices, 1630(2000).

    [94] L G GAO, P Y CHEN, S M YU. NbOx based oscillation neuron for neuromorphic computing. Applied Physics Letters, 103503(2017).

    [95] B ZHAO, J RAVICHANDRAN. Low-power microwave relaxation oscillators based on phase-change oxides for neuromorphic computing. Physical Review Applied, 014020(2019).

    [96] E CORTI, B GOTSMANN, K MOSELUND et al. Scaled resistively-coupled VO2 oscillators for neuromorphic computing. Solid-State Electronics, 107729(2020).

    [97] H LIU, T WU, X YAN et al. A tantalum disulfide charge-density- wave stochastic artificial neuron for emulating neural statistical properties. Nano Letters, 3465(2021).

    [98] L D WU, Z W WANG, L BAO et al. Implementation of neuronal intrinsic plasticity by oscillatory device in spiking neural network. IEEE Transactions on Electron Devices, 1830(2022).

    [99] S I KISELEV, J C SANKEY, I N KRIVOROTOV et al. Microwave oscillations of a nanomagnet driven by a spin-polarized current. Nature, 380(2003).

    [100] G BERTOTTI, C SERPICO, I D MAYERGOYZ et al. Magnetization switching and microwave oscillations in nanomagnets driven by spin-polarized currents. Physical Review Letters, 127206(2005).

    [101] K YOGENDRA, D FAN, K ROY. Coupled spin torque nano oscillators for low power neural computation. IEEE Transactions on Magnetics, 4003909(2015).

    [102] M A AZAM, D BHATTACHARYA, D QUERLIOZ et al. Resonate and fire neuron with fixed magnetic skyrmions. Journal of Applied Physics, 152122(2018).

    [103] X LIANG, X C ZHANG, J XIA et al. A spiking neuron constructed by the skyrmion-based spin torque nano-oscillator. Applied Physics Letters, 122402(2020).

    [104] L Z TANG, Y HUANG, C WANG et al. Halide perovskite memristor with ultra-high-speed and robust flexibility for artificial neuron applications. Journal of Materials Chemistry C, 14695(2022).

    [105] A A SHARMA, Y LI, M SKOWRONSKI et al. High-frequency TaOx-based compact oscillators. IEEE Transactions on Electron Devices, 3857(2015).

    [106] Y YU, B ZHAO, J M GOODWILL et al. Electrical and thermal dynamics of self-oscillations in TaOx-based threshold switching devices. ACS Applied Electronic Materials, 683(2020).

    [107] S KAKA, M R PUFALL, W H RIPPARD et al. Mutual phase- locking of microwave spin torque nano-oscillators. Nature, 389(2005).

    [108] M ROMERA, P TALATCHIAN, S TSUNEGI et al. Binding events through the mutual synchronization of spintronic nano- neurons. Nature Communications, 883(2022).

    [109] J WOO, P N WANG, S M YU. Integrated crossbar array with resistive synapses and oscillation neurons. IEEE Electron Device Letters, 1313(2019).

    [110] X ZHANG, Y ZHUO, Q LUO et al. An artificial spiking afferent nerve based on Mott memristors for neurorobotics. Nature Communications, 51(2020).

    [111] Y F LU, Y LI, H LI et al. Low-power artificial neurons based on Ag/TiN/HfAlOx/Pt threshold switching memristor for neuromorphic computing. IEEE Electron Device Letters, 1245(2020).

    [112] R YUAN, Q DUAN, P J TIW et al. A calibratable sensory neuron based on epitaxial VO2 for spike-based neuromorphic multisensory system. Nature Communications, 3973(2022).

    [113] Q HUA, H WU, B GAO et al. Low-voltage oscillatory neurons for memristor-based neuromorphic systems. Glob Chall, 1900015(2019).

    [114] J SHAMSI, M J AVEDILLO, B LINARES-BARRANCO et al. Hardware implementation of differential oscillatory neural networks using VO2-based oscillators and memristor-bridge circuits. Frontiers in Neuroscience, 674567(2021).

    [115] Y F YANG, H L LI. Tellurium-based artificial neuron: capturing biological complexity while keeping it simple. Advanced Electronic Materials, 2200094(2022).

    [116] Z R WANG, S JOSHI, S SAVEL'EV et al. Fully memristive neural networks for pattern classification with unsupervised learning. Nature Electronics, 137(2018).

    [117] Q DUAN, Z JING, X ZOU et al. Spiking neurons with spatiotemporal dynamics and gain modulation for monolithically integrated memristive neural networks. Nature Communications, 3399(2020).

    [118] X LI, J TANG, Q ZHANG et al. Power-efficient neural network with artificial dendrites. Nature Nanotechnology, 776(2020).

    [119] X ZHANG, J LU, Z WANG et al. Hybrid memristor-CMOS neurons for in-situ learning in fully hardware memristive spiking neural networks. Science Bulletin, 1624(2021).

    [120] Y Y FU, Y ZHOU, X D HUANG et al. Reconfigurable synaptic and neuronal functions in a V/VOx/HfWOx/Pt memristor for nonpolar spiking convolutional neural network. Advanced Functional Materials, 2111996(2022).

    [121] S DUTTA, A KHANNA, A S ASSOA et al. An Ising Hamiltonian solver based on coupled stochastic phase-transition nano- oscillators. Nature Electronics, 502(2021).

    [122] G CSABA, W POROD. Coupled oscillators for computing: a review and perspective. Applied Physics Reviews, 011302(2020).

    [123] M XIA, L WENG, Z WANG et al. Sequence memory based on an oscillatory neural network. Science China Information Sciences, 072203(2014).

    [124] A KHITUN, G LIU, A A BALANDIN. Two-dimensional oscillatory neural network based on room-temperature charge- density-wave devices. IEEE Transactions on Nanotechnology, 860(2017).

    [125] A VELICHKO, M BELYAEV, V PUTROLAYNEN et al. Modeling of thermal coupling in VO2-based oscillatory neural networks. Solid-State Electronics, 8(2018).

    [126] J NUNEZ, M J AVEDILLO, M JIMENEZ et al. Oscillatory neural networks using VO2 based phase encoded logic. Frontiers in Neuroscience, 655823(2021).

    [127] S B LAUGHLIN, RUYTER VAN STEVENINCK R R DE, J C ANDERSON. The metabolic cost of neural information. Nature Neuroscience, 36(1998).

    [128] C PULIDO, T A RYAN. Synaptic vesicle pools are a major hidden resting metabolic burden of nerve terminals. Science Advances, eabi9027(2021).

    [129] R J WU, S J JIA, T GOTOH et al. Screening switching materials with low leakage current and high thermal stability for neuromorphic computing. Advanced Electronic Materials, 2200150(2022).

    [130] T J HAMILTON, S AFSHAR, SCHAIK A VAN et al. Stochastic electronics: a neuro-inspired design paradigm for integrated circuits. Proceedings of the IEEE, 843(2014).

    Zongxiao LI, Lingxiang HU, Jingrui WANG, Fei ZHUGE. Oxide Neuron Devices and Their Applications in Artificial Neural Networks[J]. Journal of Inorganic Materials, 2024, 39(4): 345
    Download Citation