Wang et al. invented a double-sided wearable system that both enables multi-modal sensing and avoids the interference between various signals
. The system allows for multi-modal sensing of the electrophysiological signals (ECG, EMG, etc.), mechanical stimuli/movements (strain, pressure, proximity), concentrations of sodium ions (Na
), and has an energy collection and storage unit. The structure of the double-sided system enables the placement of skin-interacting sensors such as body temperature, electrophysiological, and ion sensors on the inside, while motion, room temperature, distance, and gas sensors, which interact with limbs and the external environment, are placed on the outside.
For those who have limited ability to care for themselves such as the elderly, disabled, and infants, health monitoring systems that not only provide long-term daily use but also feedback and alarm functions are especially crucial.
Considering the high rate of sudden infant death during sleep, Xu et al. developed a wearable system suitable for real-time health monitoring and the alerting of abnormal physical conditions of infants during sleep or in the intensive care unit
[18]. The system can monitor the sleeping postures, respiration rate, and diaper moisture wirelessly, and immediately provide an alarm if there are any abnormal situations. To continuously track the baby’s sleep status with high comfort, the whole flexible system (in addition to mobile signal analysis software) was integrated into the diaper using a customized layout. The system consisted of three components: flexible sensor sheets, a flexible processing circuit with a Bluetooth module, and a mobile phone with a signal analysis and alarm module. The flexible sensor sheets contained three kinds of sensors including a tilt sensor, a respiration sensor, and a humidity sensor. The tilt sensor was used to record sleeping postures. This encapsulates a non-toxic gallium-based liquid metal droplet in a laser etching hollow space with PDMS and bare LIG electrodes and uses its slide to feel the baby’s postures. To sense the sliding posture of the liquid metal droplet, eight pairs of LIG-based electrodes were realized using a two-step laser direct writing process, where the rough surface of LIG allows the liquid metal droplet to slide freely on it. The attachment and separation between the electrode and the liquid metal droplet caused by the different tilt directions of the sensor belonged to the “on” and “off” states, respectively. Eight pairs of electrodes could distinguish the eighteen tilt angles.
3. LIG-Based Wearable Systems for Multifunctional and Intelligent HCI
Human–computer interfaces, which serve as the foundation for the interaction between humans and machines, have been extensively utilized in various fields such as robot control, virtual reality (VR), augmented reality (AR), and autonomous driving. The growing interest in the metaverse in 2021 spotlighted the crucial role of HCI systems. Similar to the health care system above-mentioned, HCI systems are also developing toward a more wearable, multifunctional, and intelligent design due to several factors. (1) The miniaturization of the HCI system, which is necessary for long-term usage in daily life, can be achieved through advancements in device-integrated technology. Especially with the development of flexible sensors, actuators, and circuits, more and more HCI systems are becoming flexible and even stretchable. On one hand, this enhances the comfort of human objects in wearing the device, while on the other hand, it makes machine objects more adaptable, particularly on irregular surfaces that are challenging for conventional HCI devices [25][26]. (2) HCI systems are becoming increasingly multifunctional and equipped with a variety of sensors, actuators, and other interactive modules. This trend enables HCI systems to perform a wider range of tasks and cater to a diverse array of application objects including humans, animals, plants, and robots as well as various application environments such as land and sea [27][28][29][30]. (3) The integration of system functions and the improvement in system integration has led to increased information processing demands for HCI systems. In response to this trend, HCI systems have become more intelligent, utilizing intelligent algorithms to enhance the collection, transmission, and analysis of information. Additionally, there has been an emphasis on improving the information processing efficiency through the integration of sensing, storage, and computing capabilities in HCI systems [9][10][13][31].
3.1. LIG and Liquid Metal Integrated Multifunctional Wearable HCI System
The development of high-sensitivity motion detection is crucial for monitoring human movement, robot activity, and human–machine interaction. In particular, the development of HCI systems that can achieve highly sensitive motion interaction is of great significance for robot control, which can realize high-precision remote surgery, remote robot control, and so on.
Babatain et al. developed an integrated multifunctional wearable HCI system for motion monitoring and human–machine interfacing through the clever combination of LIG and liquid metal
[9]. The work also determined motion by detecting the contact between a sliding liquid metal droplet and the LIG electrode. However, the work improved the sensitivity of motion monitoring by using the principle of inertial sensing and improving the sliding ability of the liquid metal droplet on the PI-based flexible substrate. The LIG particles provided a 3D interpenetrated shell around the liquid metal droplet to prevent infiltration to laser-treated PDMS, PI, and LIG surfaces, which allowed the liquid metal droplet to slide in the sensing channel freely. Moreover, by designing the arc structure composed of the PI substrate, PDMS package, and LIG interfinger electrode, the liquid metal droplet could slide freely under the influence of acceleration and quickly return to the initial point thanks to gravity. This ensures accurate real-time acceleration monitoring and direct reading.
3.2. Electrooculography and Tactile Perception Collaborated 3D HCI System
Traditional HCI systems have limitations in their ability to perform well in multi-scene applications or 3D interactive experiences as they rely on a single type of device or signal.
To address this issue, Xu et al. proposed an electrooculography (EOG) and tactile perception collaborated wearable HCI system that could realize accurate and convenient interaction in three dimensions
[10]. The system consisted of two parts: the EOG interaction module and the tactile array module. Both LIG-based modules were made by transferring a laser-induced sensor pattern from the PI substrate onto a flexible and stretchable medical PU (polyurethane) adhesive film. The difference was that the EOG module used the LIG layer as the electrode and was in direct contact with the skin. The system, therefore, adopted a single-sided structure that was not encapsulated, while the capacitive 4 × 4 tactile array module consisted of two LIG-PU films stacked together in the same direction: one layer of PU film served as the encapsulation while the other was used as a dielectric layer. The resulting ultra-thin and soft PU substrate (45 μm) could be closely attached to the human skin for high-quality signal acquisition and comfortable wear.
3.3. The Machine Learning-Assisted Dual-Function Acoustic HCI System
Vocalization and hearing are important ways for people to communicate with the outside world; the ear and throat are natural “HCI systems” of humans. Due to its excellent acoustic properties, LIG has been increasingly used in the research of acoustic sensors and actuators
[32][33][34]. However, it is a challenge to combine the function of “hearing” and “speaking” and apply it to wearable HCI systems.
Sun et al. proposed a LIG-based dual-function transducer for human–robot interaction
[13]. The whole system was composed of a LIG artificial ear based on a triboelectric sensor and a LIG artificial mouth based on a thermoacoustic effect actuator. The artificial ear and the artificial mouth were all realized by the same device structure including a PI film with single-sided LIG, a polyethylene (PET) ring spacer, and a PI film with double-sided LIG. The LIG has excellent mechanical, electrical, and thermal properties, making it suitable for multifunctional integration. Furthermore, the whole device has a low-cost advantage (~0.0036 USD) that is suitable for large-scale applications.
3.4. Intelligent Speech Recognition and Motion Control System
The LIG, being thin, flexible, and inexpensive, presents benefits when utilized in popular wearable and HCI systems. Based on the excellent electrical, thermal, and mechanical properties of LIG, Zhang et al. leveraged its advantages to produce cost-effective yet high-performing HCI systems, and developed an intelligent speech recognition and motion control system
[15].
The fabrication process is as follows: a LIG-based sound detector was prepared on a 25 μm PI substrate with the help of a low-power laser machine (1.3 W). The porous structure of LIG is highly sensitive to vibrations caused by sound waves, making it an ideal material for sound detection. Furthermore, because of its good flexibility and electrical properties, LIG maintains good acoustic performance when it is attached to the curved surface of the human body or robot. Due to the principle difference between the LIG-based microphone and the traditional microphone, the research team designed an intelligent speech recognition algorithm based on one-dimensional CNN to efficiently and accurately recognize the language information received by the LIG-based microphone. To train the intelligent algorithm, the research team used the LIG-based microphone to record datasets of 10 numbers (0~9) and 20 commonly used sentences. By recording each word and sentence 50 times by the male and female, the team obtained 1500 speech samples. By using an end-to-end one-dimensional CNN, the important information in speech commands can be inferred. The intelligent algorithm successfully classified the sounds gathered using the LIG microphone with 98% accuracy.
3.5. Intelligent Artificial Throat
Most traditional sound sources and acoustic detectors are separated. However, to enhance integration and achieve a multifunctional acoustic HCI system, it is beneficial to incorporate both sound collection and generation functions into a single device.
Facing this need, Tao et al. invented a LIG-based intelligent artificial throat that could achieve functions of emitting and detecting sound by using a single LIG film, and its sound-detecting range and sound-emitting range could cover the range of human hearing
[25]. The artificial throat consisted of the LIG of the PI substrate made by the laser direct writing technique (450 nm laser). When the artificial throat was used as a sound source, it worked by using the thermoacoustic effects of the graphene. By applying periodic AC voltages to it, the LIG could produce a controllable sound in a wide frequency range (100 Hz~40 kHz), covering most of the frequency range of the human voice, and had good high-frequency characteristics. Additionally, research has revealed that the thinner the LIG, the greater the sound pressure level it can produce. By working as a strain sensor, the LIG device can be used as a sound receptor. It can distinguish vocalizations, hums, coughs, etc. by detecting the laryngeal vibration and laryngeal muscle movements with high sensitivity as well as identify different words and sentences spoken by different wearers.
3.6. Bioinspired Dual-Channel Speech Recognition System
Acoustic HCI systems based on microphones are often susceptible to interference from noisy environments, resulting in poor signal quality and further affecting the accuracy of HCI.
To address this issue, Tian et al. designed a dual-channel speech recognition system using LIG that combined both EMG and mechanical signals
[22]. When an expression is about to be produced, an action potential is generated in the motor cortex, and the electrical signal is transmitted to the epidermal muscles through the neurons and stimulates muscle fibers to contract. Ion channels in the muscle are opened to release the ions, and EMG electrodes attached to the skin can convert the ion current into the electrical current to acquire the EMG signal, while the deformation of the skin caused by the muscle contraction can be picked up by mechanical sensors. Therefore, both the EMG signal and the muscle movement signal of the larynx contain speech information, and combining the two signals for speech recognition can greatly improve the accuracy of speech analysis.
These layers include a hydrogel layer that reduces skin-electrode contact impedance and eliminates noise interference on EMG signals, a LIG-based EMG electrode, a PI separation layer that separates the EMG electrode and the mechanical sensor to prevent mutual interference, a LIG-based mechanical sensor, a PI substrate layer, and a thin-film PU tape to encapsulate and attach the system to the skin. Each patch contains a pair of EMG electrodes and two mechanical sensors that monitor one-channel EMG signals and two-channel strain signals.
3.7. Humidity-Based HCI System for Health Care and Non-Contact Interaction
Currently, HCI systems based on LIG are mainly based on piezoresistive sensors, self-powered sensors, visual sensors, and acoustic sensors. While these sensors are effective in various HCI applications, they are not as reliable for monitoring respiration
[35][36][37][38][39][40]. On the other hand, humidity sensors have a high level of reliability for respiratory monitoring, but there is limited research on HCI systems using humidity sensors.
To address this, Zou et al. proposed a humidity-based HCI system that consisted of a LIG-based humidity sensor and LIG-based acoustic device
[26]. The humidity sensor and the acoustic device were made on two sides of a Nomex fire-resistive paper. The acoustic device was made of LIG obtained by laser writing directly on the surface of the Nomex fire resistive paper, while the capacitive humidity sensor was made by a two-step process. The first step was to obtain a LIG-based interdigital electrode by laser writing directly on the paper. The second step was to apply a graphene oxide (GO) solution to electrodes to form a GO film.
The flexible humidity-based HCI system can be attached to a medical mask and operates in the following manner: the humidity sensor side of the system is aimed toward the wearer for continuous monitoring of respiratory signals, and the acoustic device side of the system is the outer side to ensure the sound emitting effect. In the case of abnormal breathing patterns such as respiratory arrest or rapid breathing, the system will trigger an alarm through the acoustic device.
3.8. Soft and Stretchable Gesture HCI System
To realize a closed-loop HCI function, the wearable HCI system not only needs sensitive and multi-mode sensing ability, but also execution ability. A device that can act as both a multi-mode motion sensor and a motion actuator is highly valuable for achieving a low-cost, multi-functional, and highly efficient motion HCI system.
Wang et al. proposed LIG-based soft and stretchable electronics with a PI/PDMS substrate for multi-mode sensing and human–machine interaction
[27]. Even though the system has three main applications (voice and motion sensors, gesture recognition gloves, and remotely controlled soft robots), all of the core components of the system were fabricated using the following method. This involved incorporating PI particles with a specific concentration into a PDMS solution, curing the mixture, and exposing the PI/PDMS substrate to an infrared laser to produce the porous LIG layer, which then resulted in the creation of the LIG-based multifunctional device. Moreover, the electromechanical properties of the device could be adjusted flexibly by adjusting the laser flux. Based on the softness and stretchability of the PI/PDMS substrate, the LIG-based wearable system could sustain a mechanical tension of over 15%, which was more suitable for wearable motion monitoring than the system with the PI substrate.