As the amount of data has grown exponentially with the advent of artificial intelligence and the Internet of Things, computing systems with high energy efficiency, high scalability, and high processing speed are urgently required. Unlike traditional digital computing, which suffers from the von Neumann bottleneck, brain-inspired computing can provide efficient, parallel, and low-power computation based on analog changes in synaptic connections between neurons. Synapse nodes in brain-inspired computing have been typically implemented with dozens of silicon transistors, which is an energy-intensive and non-scalable approach. Ion-movement-based synaptic devices for brain-inspired computing have attracted increasing attention for mimicking the performance of the biological synapse in the human brain due to their low area and low energy costs.
1. Introduction
Explosively increasing data set sizes in artificial intelligence (AI) and the Internet of Things have resulted in us facing limitations in energy efficiency and the challenges of the von Neumann bottleneck approaching the end of Moore’s law
[1][2][3][4][5]. In more detail, the AI algorithm that runs on the complementary metal oxide semiconductor (CMOS)-based von Neumann hardware seems to be somewhat inefficient
[6], since: (1) the separation of processor and memory causes heavy data traffic between devices, especially in data-intensive tasks; (2) CMOS uses a “0” and “1” binary logic system rather than a gradual weight change; (3) the connections of transistors in silicon chips are usually in two dimensions; (4) CMOS-based computers consume a thousand times as much energy as the human brain to perform the same task
[6][7]. For example, a supercomputer (IBM Watson)
[8] has 2880 computing cores (10 refrigerators’ worth in size and space) and requires about 80 kW of power and 20 tons of air-conditioned cooling capacity, while the human brain occupies a space of less than 2
l and consumes low power, of the order of 10 W
[9][10]. Additionally, if data storage and communication continue to increase at the current rate, the total energy consumed by binary operations using CMOS will reach ~10
27 J in 2040, surpassing the total energy produced worldwide
[11][12]. In order to improve the performance of computing systems in the so-called “big data” era
[13], it is necessary to fundamentally change the way computing is executed
[14]. People need to shift to a data-centric paradigm rather than a computer-centric one
[14].
The growth of computational power, the availability of big data, and the rapid development of training methods have resulted in significant advances in data-centric computing methods, such as the artificial neural network (ANN), which is inspired by the co-location of logic and memory, tolerance to local failures, hyper-connectivity, and parallel processing present in the human brain
[12][15][16]. The human brain is a massively parallel computing structure that processes input information by synaptic transmission. Each synaptic event consumes only around 1–10 fJ
[5][17]. The hardware in brain-inspired computing architecture is required to mimic stochastic behaviors by introducing a new logic device such as an orthogonator gate and to physically emulate synapses in the human brain at the small circuit or device levels, consuming significantly reduced energy
[12][18][19][20][21][22][23][24].
Recently, synaptic devices based on various types of resistive switching devices have been utilized for brain-inspired computing
[25][26][27][28][29][30]. Brain-inspired computing based on synaptic devices has achieved particular progress from ion-movement-based resistive switching mechanisms such as cation-movement-based filaments
[31][32][33][34][35][36], anion-movement-based filaments
[37][38][39][40][41][42][43], cation-movement-based ferroelectric polarization reversal
[44][45][46][47][48][49], and ion-movement-based electrochemical electrolytes
[50][51][52][53][54][55][56][57]. These ion-movement-based resistive switching devices can show a gradual change in conductance and nonvolatile characteristics, which have not been implemented in Mott-insulator-based resistive switching devices. Resistive switching based on the phase transition of Mott insulators under an electric field shows an abrupt change in conductance and volatile behaviors, which are suitable for neuron devices
[58][59][60]. In this entry, researchers summarize in detail the different ion-movement-based mechanisms and discuss the advances in the development of ion-movement-based resistive switching devices for artificial synaptic elements. In addition, researchers discuss the challenges that need to be addressed in future research on synaptic devices towards developing brain-inspired computing systems.
2. Biological Synapses
2.1. Properties of Biological Synapses
The brain contains billions of neurons, which are highly connected by trillions of synapses
[6]. Synapses are small gaps (20–40 nm) between the axon end of the presynaptic neuron and the dendrites of the postsynaptic neuron (
Figure 1a)
[61]. Neurons generate action potentials (spikes) with amplitudes of approximately 100 mV and durations in the range of 0.1–1 ms in their soma. The spikes propagate through the axon and are transmitted to the postsynaptic neurons through the synapses
[10]. The connection weights of the synapses between neurons can become stronger (potentiation) or weaker (depression) through a process called synaptic plasticity, as the brain adapts to new information. Synaptic plasticity is widely believed to play a key role in the learning and memory processes of the brain
[61].
Figure 1. Properties of a biological synapse. (a) Schematic image of the biological synapse structure. Typical synaptic weight changes in the cases of (b) LTP and LTD, (c) STP and STD, and (d) STDP.
2.2. Biological Synaptic Plasticity
Biological synaptic plasticity, which enables learning and memory, is the ability to continuously modulate synaptic weights in response to action potentials. In more detail, biological synaptic plasticity is the changed connection strength of a biological synapse, which is caused by the activities of a presynaptic neuron and a postsynaptic neuron.
[10] It includes long-term potentiation/depression, short-term potentiation/depression, and spike-timing-dependent plasticity (STDP). The biological synaptic weight can be persistently changed by modulating the amount of neurotransmitter presynaptically released across the synapse or the number of receptors present postsynaptically; this is so-called long-term plasticity. Specifically, the increases and decreases in synaptic weight are called long-term potentiation (LTP) and long-term depression (LTD), respectively (
Figure 1b)
[5][62]. Short-term potentiation (STP) and short-term depression (STD) are temporary increases and decreases in synaptic weight, respectively. STP and STD generally last from seconds to tens of minutes and then fade away to the initial values, in biological systems (
Figure 1c)
[5][63]. Spike-timing-dependent plasticity (STDP), a form of Hebbian learning, emerged as a new concept of cellular learning in the late 1990s
[10][64][65][66]. Different types of STDP exhibit different forms of dependency on the spiking time
Δt=tpre−tpost, where
tpre and
tpost are the arrival times of presynaptic and postsynaptic spikes, respectively. As the amplitude of
Δt becomes shorter, the change in synaptic weight becomes larger (
Figure 1d).
3. Synaptic Devices
3.1. Cation-Movement-Based Filamentary Two-Terminal Synaptic Devices
To mimic biological synaptic plasticity, it is essential to demonstrate repeatable analog switching with ultra-low power or energy consumption. The attractive characteristics of the ECM cell such as short switching time, scalability, and ultra-low power or energy consumption have driven the development of synaptic devices. To improve the performance of energy-efficient analog switching, emerging electrolytes for ECM cells such as 2D materials, nanowires, polymers, and ultra-thin films have been used
[31][32][33][34][67].
The Cu/MoS
2 bilayer/Au system has been reported for a synaptic device with ultra-low switching voltage (
Figure 2a,b)
[31]. In the MoS
2 bilayer between an active Cu top electrode and an inert Au bottom electrode, Cu has a lower migration barrier and diffusion activation energy than sulfur vacancies, leading to the operation of the synaptic device at ultra-low switching voltages. A pulse with a small amplitude of 0.6 V can cause a gradual increase and decrease in the device resistance, resulting in potentiation–depression curves (
Figure 2b). Such low switching voltages are important, especially for neuromorphic computing, which strives to operate with a power far lower than that required for digital computing
[31]. In addition, the STDP of the cation-movement-based filamentary two-terminal synaptic device was experimentally confirmed, as shown in
Figure 2c. The developed device reveals consistent analog switching and thus exhibits synapse-like learning behavior such as STDP, which was demonstrated for the first time in 2D-material-based vertical memristors. This demonstration of STDP combined with low switching voltage is promising for applications in neuromorphic circuits.
Figure 2. (
a) Schematic of the change in the cation–movement–based filament for the Cu/MoS
2 double-layer/Au with switching between HRS and LRS. (
b) Potentiation–depression curve obtained by consecutive pulses with a small amplitude of 0.6 V and (
c) STDP behaviors obtained by low–amplitude spiking for the Cu/MoS
2 double–layer/Au. Reprinted/adapted with permission from Ref.
[31]. 2019, American Chemical Society. (
d) The current response of frequency–dependent PPF and PPD obtained by input pulses (100 mV, 1 ms) in a cation–movement–based filamentary two–terminal synaptic device with protein nanowires. Reprinted/adapted with permission from Ref.
[32]. 2020, Springer Nature. (
e,
f) Schematic illustrations of growth and rupture of an uncompleted CF of Ag in an Ag/PZT/LSMO device in LRS and HRS, respectively. (
g) Potentiation behaviors obtained by stimulation pulses with different durations for an Ag/PZT/LSMO device. Reprinted/adapted with permission from Ref.
[33]. 2017, American Chemical Society.
Fu et al. demonstrated a type of diffusive memristor which is fabricated using protein nanowires harvested from the bacterium Geobacter sulfurreducens and operates at biological voltages of 40–100 mV
[32]. They demonstrated that a reduction in the switching voltage is obtained by using protein nanowires. The influx and efflux of Ag in the CF can also emulate Ca
2+ influx and extrusion in a biological synapse. The steady-state evolution of the CF and the resultant change in conductance can be used to emulate synaptic plasticity.
Figure 2d shows frequency-dependent paired-pulse facilitation (PPF) and paired-pulse depression (PPD) in a synaptic device operating at biological voltages. The features of the protein-nanowire-based filamentary devices are very similar to those of biological synapses in terms of signal amplitude and/or frequency range.
It has been reported that a synaptic Ag/PbZr
0.52Ti
0.48O
3 (PZT)/La
0.8Sr
0.2MnO
3 (LSMO) device with an ultra-thin ferroelectric PZT layer (~4 nm) serving as an electrolyte for cation migration can achieve very low energy consumption
[33]. The ferroelectric barrier width becomes thinner due to the growth of an uncompleted CF of Ag, leading to a higher tunneling transmittance and switching to a low on-state resistance, as shown in
Figure 2e. The rupture of the Ag CF takes place due to a thermally assisted electrochemical reaction (
Figure 2f). Then, the tunneling barrier width becomes thicker, and the device switches back to a high off-state resistance. The gradual change in the direct tunneling current of the Ag/PZT/LSMO is enabled by barrier-width control originating from the Ag ion migration. Both potentiation and depression can be induced in the Ag/PZT/LSMO device by short stimulation pulses with a duration of 100 ns, which are enabled by the combination of applied voltage and polarization bound charge, as shown in
Figure 2g. This characteristic could result in low programming energy (a potentiation energy consumption of ~22 aJ and a depression energy consumption of ~2.5 pJ) by minimizing the programming time.
Jang et al. demonstrated that the transition of the operation mode in a poly(1,3,5-trivinyl-1,3,5-trimethyl cyclotrisiloxane) (pV3D3)-based flexible memristor from conventional binary switching to synaptic analog switching can be achieved simply by reducing the size of the formed filament
[34]. The flexible pV3D3 memristor operates through the formation and rupture of the Cu CF inside the pV3D3, resulting in the LRS and HRS, respectively, as shown in
Figure 3a. Potentiation and depression curves can be induced by the conductance updates of the pV3D3 memristor under the application of consecutive pulses, as shown in
Figure 3b. Conductance updates with linear behavior are achieved by utilizing pulse trains with increasing amplitude in the range of 2~4 V (−1.2~−1.4 V) with a width of 60 ns (100 ns) for the potentiation (depression) process.
Figure 3. (
a) Schematic image of pV3D3-based flexible synaptic device using the formation and rupture of Cu ion-movement-based filament. (
b) Potentiation (depression) curve obtained by smart pulse scheme with increasing amplitude in the range of 2~4 V (−1.2~−1.4 V) with a width of 60 ns (100 ns) for a pV3D3-based flexible synaptic device. Reprinted/adapted with permission from Ref.
[34]. 2018, American Chemical Society. (
c,
d) A comparison of potentiation–depression curves of the Ag/SiN
x/a-Si/p
++ Si-based devices with unimplanted (
c) and implanted (
d) devices under varying numbers of stimulation pulses of 7.0 (−3.0) V for potentiation (depression). Reprinted/adapted with permission from Ref.
[36]. 2020, Springer Nature. (
e) Gradual current change and (
f) simultaneously obtained transmission electron microscope image of a Cu tip/SiO
2/W cell during injection of voltage with increased amplitude. Reprinted/adapted with permission from Ref.
[68]. 2017, American Chemical Society.
3.2. Anion-Movement-Based Filamentary Two-Terminal Synaptic Devices
The key advantages of anion-movement-based filamentary two-terminal synaptic devices include the compact structure, the CMOS compatibility, and the capability for hybrid or 3D integration, making them attractive for a broad range of applications including memory, analog devices, and reconfigurable circuits, as well as brain-inspired computing
[37][38].
Gong et al. implemented an anion-movement-based filamentary two-terminal synaptic device through a HfO
2-based resistive switching device
[41]. This device shows analog switching behavior, as shown in
Figure 4a. The conductance of the device gradually increases and decreases under 1000 consecutive positive and negative pulses, respectively. The progressive change in conductance in the HfO
2-based synaptic device is attributed to the modulation of the oxygen-vacancy-based filament by pulse stimulation.
Figure 4b shows a schematic of its operation mechanism. The movement of the oxygen vacancies in response to an electrical signal has a probabilistic nature, which emerges as an inherent randomness in the conductance weight updates, superimposed on the expected signal.
Figure 4. (
a) Gradual increase (decrease) in conductance behavior in the HfO
2-based resistive switching device induced by 1000 consecutive identical set (reset) pulses. (
b) A conceptual schematic of a CF confined in the HfO
2-based resistive switching device during switching corresponding to set and reset. Reprinted/adapted with permission from Ref.
[41]. 2018, Springer Nature. (
c) Cross-sectional TEM image of a 3D vertical structure based on HfO
x cells. (
d) Synaptic behavior with different initial resistances (~100 kΩ and 1 MΩ) of the HfO
2-based 3D vertical synaptic device. In the initial resistance of the 1 MΩ device, the energy consumption decreases below 1 pJ. Reprinted/adapted with permission from Ref.
[42]. 2014, American Chemical Society.
Gao et al. developed a synaptic device based on a 3D vertical structure including several parallel oxide-based resistive switching devices on the same nanopillar, for the application of brain-inspired computing with high device density and low energy consumption
[42].
Figure 4c shows a TEM image of a two-layer resistive switching device which has top and bottom HfO
x-based cells on the same pillar. The analog switching behavior is obtained through only a gradual reset process to mimic biological depression. The abrupt set process is considered as positive feedback between the oxygen vacancy generation rate and the temperature/local field strength, while the gradual reset process is considered as negative feedback
[37].
Figure 4d shows the gradual reset processes of the device, induced from two initial resistance states (~100 kΩ and 1 MΩ) by applying 500 consecutive negative identical pulses. For the case of an initial resistance state of ~1 MΩ, the maximum energy per spike drops to ~0.29 pJ. The reduced energy consumption is mainly attributed to the higher initial resistance of the device.
Yu et al. implemented an anion-movement-based filamentary two-terminal synaptic device with low energy consumption by stacking multiple layers of Pt/HfO
x/TiO
x/HfO
x/TiO
x/TiN
[37]. The analog switching behavior is obtained through only a gradual reset process to mimic biological depression. The abrupt set process is considered as positive feedback between the oxygen vacancy generation rate and the temperature/local field strength, while the gradual reset process is considered as negative feedback. The gradual reset processes of five different devices were induced from two initial resistance states (~500 Ω and ~20 kΩ) by applying 400 consecutive negative identical pulses. A system-level simulation using these device-level experimental results revealed that the brain-inspired computing system may be robust against synaptic device variation. In addition, the synaptic device operates with very low energy consumption, which decreases from 24 pJ to 0.85 pJ as the initial resistance increases.
3.3. Cation-Movement-Based Ferroelectric Two-Terminal Synaptic Devices
An ultra-thin ferroelectric material can act as a switching layer in cation-movement-based ferroelectric two-terminal resistive switching devices. The attractive advantages of ferroelectric two-terminal resistive switching devices such as fast switching speed and ultra-low power/energy consumption can lead to high performance in the synaptic devices based on them.
Ma et al. reported that a synaptic device with an ultra-short switching time (600 ps) can be implemented by using a Ag/BaTiO
3 (~2.4 nm)/Nb:SrTiO
3 ferroelectric tunnel junction
[47]. The upward and downward ferroelectric polarization directions correspond to the LRS and HRS, respectively. The switching between the two states is bipolar and, interestingly, not abrupt, leading to a broad range of intermediate resistance states.
Figure 5a shows the gradual resistance versus voltage pulse behaviors obtained under different negative voltage ranges (−18, −16, −14, and −12 V) with a fixed pulse duration of 600 ps. The ultra-short switching time can be induced by both the high Nb concentration in the Nb:SrTiO
3 semiconducting electrode and the low work function of the metal electrode.
Figure 5b shows 32 distinct resistive states of the device which can be maintained with no degradation for 10
4 s. To mimic biological synaptic plasticity, the sub-nanosecond (600 ps)-driven conductance change is measured, as shown in
Figure 5c. A gradual change in the conductance similar to biological synaptic plasticity can be induced by increasing the amplitude of the negative or positive voltage pulses.
Figure 5. (
a) Resistive switching with gradual change in Ag/BaTiO
3 (~ 2.4 nm)/Nb:SrTiO
3 ferroelectric tunnel junction under consecutive pulses (writing voltage = –18, –16, –14, and –12 V, fixed pulse duration = 600 ps). (
b) Retention characteristics of the Ag/BaTiO
3 (~ 2.4 nm)/Nb:SrTiO
3 ferroelectric tunnel junction. (
c) Analog switching behaviors of an ultra-thin ferroelectric-film-based synaptic device (Ag/BaTiO
3 (~ 2.4 nm)/Nb:SrTiO
3) under consecutive non-identical pulses with a sub-nanosecond (600 ps) duration. Reprinted/adapted with permission from Ref.
[47]. 2020, Springer Nature. (
d–
f) STDP curves of different forms in an ultra-thin ferroelectric-film-based synaptic device (Co/BFO/CCMO). The top and bottom panels show presynaptic and postsynaptic spikes and the change in conductance, respectively. Reprinted/adapted with permission from Ref.
[45]. 2017, Springer Nature.
Boyn et al. reported that STDP with an operation time of a few hundred ns can be emulated through ferroelectric domain dynamics
[45]. To mimic the various types of STDP shown in
Figure 5d–f, they applied different pulse waveforms to a synaptic device based on ferroelectric switching. This procedure allows the generation of biologically realistic, accelerated (
Figure 5d,e), or artificially designed (
Figure 5f) STDP learning curves. In addition,
Figure 5d–f show the excellent agreement between the conductance changes predicted using the nucleation-limited model of ferroelectric domains and the measured conductance variations associated with the various types of STDP.
Chanthbouala et al. reported that a ferroelectric synapse with ultra-short switching time (in the 10–200 ns range) can be implemented by using a Co (10 nm)/Au (10 nm)/BaTiO
3 (2 nm)/La
0.67Sr
0.33MnO
3 (30 nm) structure
[44]. The upward and downward ferroelectric polarization directions correspond to the LRS and HRS, respectively. The switching between the two states is bipolar and, interestingly, not abrupt; a broad range of intermediate resistance states are observed. The nucleation and growth of ferroelectric domains by systematic variation of the pulse can lead to various resistance states, resulting in synaptic plasticity. Synaptic behaviors based on ferroelectric switching are demonstrated by applying consecutive pulses with a fixed amplitude.
This entry is adapted from the peer-reviewed paper 10.3390/nano12101728