Multi-Sensor Monitoring of Human Stress: Comparison
Please note this is a comparison between Version 1 by Erik Vavrinsky and Version 2 by Karina Chen.

Many people live under stressful conditions which has an adverse effect on their health. Human stress, especially long-term one, can lead to a serious illness. Therefore, monitoring of human stress influence can be very useful. We can monitor stress in strictly controlled laboratory conditions, but it is time-consuming and does not capture reactions, on everyday stressors or in natural environment using wearable sensors, but with limited accuracy. Therefore, we began to analyze the current state of promising wearable stress-meters and the latest advances in the record of related physiological variables. Based on these results, we present the concept of an accurate, reliable and easier to use telemedicine device for long-term monitoring of people in a real life. In our concept, we ratify with two synchronized devices, one on the finger and the second on the chest. The results will be obtained from several physiological variables including electrodermal activity, heart rate and respiration, body temperature, blood pressure and others. All these variables will be measured using a coherent multi-sensors device. Our goal is to show possibilities and trends towards the production of new telemedicine equipment and thus, opening the door to a widespread application of human stress-meters. 

  • human stress
  • multi-sensor
  • telemedicine
  • electrodermal activity
  • monitoring
  • interdigital array of electrodes

1. Human Stress Phenomena

Stress in some forms affect people every day and the World Health Organization calls stress a “21st Century Health Epidemic” [1]. However, what does the word stress really mean? We can look at it from several angles. In the past, stress was viewed differently and this word is still used inconsistently between disciplines. Until the 16th century, this term was used directly for physical injuries. In the 17th century, stress was associated with sadness, misery, and suffering, while in the 18th and 19th centuries, the word stress was understood as tension, pressure, and effort due to the development of physics. In the 20th century, the view of stress was significantly influenced by wars, fatigue from fighting and nervous shocks suffered by soldiers. At the end of the 19th century, on the basis of significant experiments, the view began to focus on emotions, the homeostasis of the organism and stress started to be thought of as a burden that causes changes in mental health and affects a person’s physiology. At the beginning of the 20th century, the response to short-term stress after the secretion of adrenaline was concretized by Walter Cannon, who described prepares the organism for a rapid “fight or flight” response, and who made significant discoveries with respect to internal balance—homeostasis. On the other hand, Hans Selye known as the “father of stress”, focused on the chronic, long-term stress. He pointed to the role of the brain and the adrenal cortex in response to stress and identified several hormones that regulate the stress response. Unlike previous years, he emphasized the importance of psychological and social factors in inducing a stress response. He gave the first definition of stress, where it is referred to the mutual action of forces that take place in any part of the body, physical or mental and which represent a psychophysiological response of an individual mediated primarily by the autonomic nervous system (ANS) and the endocrine system [1][2][3][4]. Selye also described the “General Adaptation Syndrome” [2][4], which deals with changes in the body after exposure to stress, arguing that each stressor factor stimulates the same response in the body. Today, stress can be described as “any effect of a change in the environment on a living being that results in disruption of the homeostasis of that living being” [4].

Stress in some forms affect people every day and the World Health Organization calls stress a “21st Century Health Epidemic” [6]. However, what does the word stress really mean? We can look at it from several angles. In the past, stress was viewed differently and this word is still used inconsistently between disciplines. Until the 16th century, this term was used directly for physical injuries. In the 17th century, stress was associated with sadness, misery, and suffering, while in the 18th and 19th centuries, the word stress was understood as tension, pressure, and effort due to the development of physics. In the 20th century, the view of stress was significantly influenced by wars, fatigue from fighting and nervous shocks suffered by soldiers. At the end of the 19th century, on the basis of significant experiments, the view began to focus on emotions, the homeostasis of the organism and stress started to be thought of as a burden that causes changes in mental health and affects a person’s physiology. At the beginning of the 20th century, the response to short-term stress after the secretion of adrenaline was concretized by Walter Cannon, who described prepares the organism for a rapid “fight or flight” response, and who made significant discoveries with respect to internal balance—homeostasis. On the other hand, Hans Selye known as the “father of stress”, focused on the chronic, long-term stress. He pointed to the role of the brain and the adrenal cortex in response to stress and identified several hormones that regulate the stress response. Unlike previous years, he emphasized the importance of psychological and social factors in inducing a stress response. He gave the first definition of stress, where it is referred to the mutual action of forces that take place in any part of the body, physical or mental and which represent a psychophysiological response of an individual mediated primarily by the autonomic nervous system (ANS) and the endocrine system [6,7,8,9]. Selye also described the “General Adaptation Syndrome” [7,9], which deals with changes in the body after exposure to stress, arguing that each stressor factor stimulates the same response in the body. Today, stress can be described as “any effect of a change in the environment on a living being that results in disruption of the homeostasis of that living being” [9].

Nowadays, stress is categorized mainly as acute (short-term) and chronic (long-term) [5][6][7]. The human body responds differently to various durations of stress stimuli Acute stress can be for example a job interview, a fine for speed and more. Certainly, acute stress is unpleasant, but the reaction can be positively influenced by soothing breathing or rapid physical activity [8][9][10][11][12][13]. The problem arises when the stress is too intensive, the stressors accumulate and one cannot get rid of them. Persistent chronic stress may have a milder course, but the body is prepared for a stress response long time. Stress hormones are released and the body does not recover as fast as when it is at rest. This can lead to more severe physiological manifestations than those of acute stress. People might feel headaches, insomnia, fatigue, inattention, digestive problems, and memory impairment can occur [14][15][16][17][18][19][20][21]. Each individual respond to stress differently. Effective stress management involves the identification and management of both acute and chronic stress. And it is precisely to be aware of the stress response and subsequent compensation that it is possible to monitor a person’s physiological condition and change life for the better and predict disease [22]. While acute stress can stimulate a person to perform better, in chronic stress performance decreases rapidly. This also applies to stress in the workplace. Not only a person has physiological manifestations of stress, but also stress is reflected in the results of work done, loss of productivity, burnout, dissatisfaction with work and others [23][24][25][26][27]. Solving the issue of stress is very important from a human and economic point of view. According to The American Institute of Stress, work stress is a major source of stress for adult Americans and is on the rise. They reported that approximately 33% of people experience extreme stress. Stress is responsible for 80% of accidents and 120,000 deaths per year in the workplace. The Global Organization for Stress reported 75% of Americans and 91% of Australians exposed to stress. At work, 80% of American and 86% of Chinese workers experience stress. They are also reported 450,000 workers in Britain with stress-related illnesses. About half of people exposed to stress are affected by post-traumatic stress disorder (PTSD) and acute stress disorder. The downside is that it tends to get worse and no one is completely resistant to stress. An increasing number of people exposed to stress and the contraindications associated with stress show us that there is a need for equipment and methodology that would help detect stress and fluctuations in mental health and help reduce them [14][28][29][30][31][32][33][34][35][36]. The stress is affecting also the economy, and U.S. employers are spending health care and working days at $300 billion a year. In Britain, people miss out on 13.7 million working days a year because of the stress, and it costs them about $37 billion, and in Australia, stress is responsible for the loss of $14.2 billion. Stress in everyday life and in the workplace is related to anxiety and depression. Statistically, more than 300 million people suffer from depression and, along with anxiety, are the most common mental disorders. The annual global cost is estimated at $2.5 trillion and is very likely to increase in the coming years [30][31][32][34][35][36][37].

Nowadays, stress is categorized mainly as acute (short-term) and chronic (long-term) [10,11,12]. The human body responds differently to various durations of stress stimuli Acute stress can be for example a job interview, a fine for speed and more. Certainly, acute stress is unpleasant, but the reaction can be positively influenced by soothing breathing or rapid physical activity [13,14,15,16,17,18]. The problem arises when the stress is too intensive, the stressors accumulate and one cannot get rid of them. Persistent chronic stress may have a milder course, but the body is prepared for a stress response long time. Stress hormones are released and the body does not recover as fast as when it is at rest. This can lead to more severe physiological manifestations than those of acute stress. People might feel headaches, insomnia, fatigue, inattention, digestive problems, and memory impairment can occur [19,20,21,22,23,24,25,26]. Each individual respond to stress differently. Effective stress management involves the identification and management of both acute and chronic stress. And it is precisely to be aware of the stress response and subsequent compensation that it is possible to monitor a person’s physiological condition and change life for the better and predict disease [27]. While acute stress can stimulate a person to perform better, in chronic stress performance decreases rapidly. This also applies to stress in the workplace. Not only a person has physiological manifestations of stress, but also stress is reflected in the results of work done, loss of productivity, burnout, dissatisfaction with work and others [28,29,30,31,32]. Solving the issue of stress is very important from a human and economic point of view. According to The American Institute of Stress, work stress is a major source of stress for adult Americans and is on the rise. They reported that approximately 33% of people experience extreme stress. Stress is responsible for 80% of accidents and 120,000 deaths per year in the workplace. The Global Organization for Stress reported 75% of Americans and 91% of Australians exposed to stress. At work, 80% of American and 86% of Chinese workers experience stress. They are also reported 450,000 workers in Britain with stress-related illnesses. About half of people exposed to stress are affected by post-traumatic stress disorder (PTSD) and acute stress disorder. The downside is that it tends to get worse and no one is completely resistant to stress. An increasing number of people exposed to stress and the contraindications associated with stress show us that there is a need for equipment and methodology that would help detect stress and fluctuations in mental health and help reduce them [19,33,34,35,36,37,38,39,40,41]. The stress is affecting also the economy, and U.S. employers are spending health care and working days at $300 billion a year. In Britain, people miss out on 13.7 million working days a year because of the stress, and it costs them about $37 billion, and in Australia, stress is responsible for the loss of $14.2 billion. Stress in everyday life and in the workplace is related to anxiety and depression. Statistically, more than 300 million people suffer from depression and, along with anxiety, are the most common mental disorders. The annual global cost is estimated at $2.5 trillion and is very likely to increase in the coming years [35,36,37,39,40,41,42].

Stress from the perspective of medicine shows how stressors stimulate the human body to defend itself. The response to stress affects the whole biological system of the organism and physiological processes. This is manifested by various symptoms, often deleterious individual problems such as headaches, gastrointestinal disorders, anxiety, hypertension, coronary heart disease and depression [38]. It should be mentioned that the response on stress begins in the same way. During the stress response, the stress hormones adrenaline and noradrenaline, which are released by the sympathetic nervous system, and cortisol that is produced after activation of the hypothalamic-pituitary-adrenal axis, are released [39]. Cells in the body express receptors for stress hormones, so they are easily provided with information about the stress stimulus. Other factors such as adrenocorticotropin (ACTH), oxytocin and vasopressin, cytokines (interleukin-6 and interleukin-1β) also play a role in stress. The length and magnitude of action of these factors depend on the stressor type. Overall, the response to stress is still biologically consistent and these physiological symptoms are suitable for measurement [11][18][19][40][41][42][43]. Autonomic nervous system (ANS) plays main role in the response to stress, which cannot be controlled by our own will. It consists of sympathetic and parasympathetic systems; whose balance regulates the physiological degrees of “arousal” in the response to signals from the environment. The parasympathetic regimen regulates the maintenance of energy and the renewal of the organism; sympathetic one stimulates increased heart rhythm, blood pressure, dilated pupils, sweating and other physiological manifestations caused by the secretion of adrenaline and norepinephrine. These manifestations are visible even under stress [44], so we focused on the possibility of recording them as well as on the subsequent interpretation of a person’s condition [22][45][46][47][48][49]. The primary response to stress triggers a sympathetic nervous response that regulates the adaptation to the external environment. The hypothalamus secretes hormones that stimulate the pituitary gland and thus begin to regulate the stress response. The pituitary gland secretes adrenocorticotropic hormone (ACTH) into the blood. This hormone helps to balance the intensely regulated stress response. The amygdala, in turn, regulates emotional processes. Activities in the prefrontal cortex are temporarily suppressed (planning, attention, problem solving). Adrenaline and norepinephrine and cortisol are excreted. Serotonin, which regulates mood, especially depression and anxiety, is also secreted. The hypothalamic-pituitary-adrenal (HPA) axis enables the communication of three endocrine glands (hypothalamus, pituitary, adrenal gland), which ensure the stress response, but also digestion, mood, autoimmune system, energy, sexual cycles [28]. Inflammatory markers eluted approximately 90–120 min after the onset of acute stress, specifically IL-6, IL-1β and TNF-α. Acute stress induced an increase in the pro-inflammatory transcription factor NF-κB with the highest amount after 10 min. Chronic stress shows less inflammation, and available studies show elevated levels of TNF-α and CRP over an observation period of 3 years. Inflammatory cytokines and CRPs may play a role in increased amounts of secreted cortisol [50].

Stress from the perspective of medicine shows how stressors stimulate the human body to defend itself. The response to stress affects the whole biological system of the organism and physiological processes. This is manifested by various symptoms, often deleterious individual problems such as headaches, gastrointestinal disorders, anxiety, hypertension, coronary heart disease and depression [43]. It should be mentioned that the response on stress begins in the same way. During the stress response, the stress hormones adrenaline and noradrenaline, which are released by the sympathetic nervous system, and cortisol that is produced after activation of the hypothalamic-pituitary-adrenal axis, are released [44]. Cells in the body express receptors for stress hormones, so they are easily provided with information about the stress stimulus. Other factors such as adrenocorticotropin (ACTH), oxytocin and vasopressin, cytokines (interleukin-6 and interleukin-1β) also play a role in stress. The length and magnitude of action of these factors depend on the stressor type. Overall, the response to stress is still biologically consistent and these physiological symptoms are suitable for measurement [16,23,24,45,46,47,48]. Autonomic nervous system (ANS) plays main role in the response to stress, which cannot be controlled by our own will. It consists of sympathetic and parasympathetic systems; whose balance regulates the physiological degrees of “arousal” in the response to signals from the environment. The parasympathetic regimen regulates the maintenance of energy and the renewal of the organism; sympathetic one stimulates increased heart rhythm, blood pressure, dilated pupils, sweating and other physiological manifestations caused by the secretion of adrenaline and norepinephrine. These manifestations are visible even under stress [49], so we focused on the possibility of recording them as well as on the subsequent interpretation of a person’s condition [27,50,51,52,53,54]. The primary response to stress triggers a sympathetic nervous response that regulates the adaptation to the external environment. The hypothalamus secretes hormones that stimulate the pituitary gland and thus begin to regulate the stress response. The pituitary gland secretes adrenocorticotropic hormone (ACTH) into the blood. This hormone helps to balance the intensely regulated stress response. The amygdala, in turn, regulates emotional processes. Activities in the prefrontal cortex are temporarily suppressed (planning, attention, problem solving). Adrenaline and norepinephrine and cortisol are excreted. Serotonin, which regulates mood, especially depression and anxiety, is also secreted. The hypothalamic-pituitary-adrenal (HPA) axis enables the communication of three endocrine glands (hypothalamus, pituitary, adrenal gland), which ensure the stress response, but also digestion, mood, autoimmune system, energy, sexual cycles [33]. Inflammatory markers eluted approximately 90–120 min after the onset of acute stress, specifically IL-6, IL-1β and TNF-α. Acute stress induced an increase in the pro-inflammatory transcription factor NF-κB with the highest amount after 10 min. Chronic stress shows less inflammation, and available studies show elevated levels of TNF-α and CRP over an observation period of 3 years. Inflammatory cytokines and CRPs may play a role in increased amounts of secreted cortisol [55].

Also interesting is the connection between stress, CNS, ANS and voice output, which consists of three stages—breathing, phonation and resonance. Thus, ANS is responsible not only for the stress response but also for the creation of voice and speech. Even a shaking voice is our body’s response to stress. The voice can be a very sensitive indicator of a person’s emotions, attitudes, mental experience, depression, anxiety, tremor or physical fatigue. Voice quality can be the result of tension throughout the body, which also manifests itself locally as a specific tension in the external and internal laryngeal muscles [51]. It’s all about the vocal cords, which in this case affects the ANS. There are currently several studies that attempt to identify stress patterns of voice using neural networks and machine learning [52][53][54]. Some even combine speech signals with electrodermal activity [55] or use wearable devices with multi-sensors combining audio and physiological sensors together with deep neural learning networks to monitoring an individual’s well-being in a naturalistic environment [37][56][57].

Also interesting is the connection between stress, CNS, ANS and voice output, which consists of three stages—breathing, phonation and resonance. Thus, ANS is responsible not only for the stress response but also for the creation of voice and speech. Even a shaking voice is our body’s response to stress. The voice can be a very sensitive indicator of a person’s emotions, attitudes, mental experience, depression, anxiety, tremor or physical fatigue. Voice quality can be the result of tension throughout the body, which also manifests itself locally as a specific tension in the external and internal laryngeal muscles [56]. It’s all about the vocal cords, which in this case affects the ANS. There are currently several studies that attempt to identify stress patterns of voice using neural networks and machine learning [57,58,59]. Some even combine speech signals with electrodermal activity [60] or use wearable devices with multi-sensors combining audio and physiological sensors together with deep neural learning networks to monitoring an individual’s well-being in a naturalistic environment [42,61,62].

In order for stress to begin, an individual has to be first be exposed to a certain stressor, which initiates a stress response. Anything that forces the body to release stress hormones can be a stressor and cause stress. Stressors can be divided into psychological and physiological. Physiological effects on the body include, for example, very high/low temperatures, injuries, chronic diseases, infection or pain. Psychological (mental) stressors can be attributed to life situations, negative social communications, conflicts, failure to satisfy internal drives and others [12][14][58][59]. The division into physical and psychological stressors is also based on the scientific function of the organism, because these various stressors activate every other part of the brain, and the trace they leave can be used back to concretize the stressor [12]. On the other hand, stressors can also be divided into absolute stressors, which would be evaluated by everyone who is exposed to them as stress (objective stress factors such as natural disasters) and relative stressors, where we can include effects that only part of the population would declare as the stress initiators (subjective stress factors such as time pressure, tax payment, school exam) [6][11][60][61][62][63]. However, all stressors activate the same biological response of the body [39]. To determine the stress to which a person is exposed, the “Social Readjustment Rating Scale” (SRRS) was released in 1967 [64], but it was not ideal because it offered a very subjective view.

In order for stress to begin, an individual has to be first be exposed to a certain stressor, which initiates a stress response. Anything that forces the body to release stress hormones can be a stressor and cause stress. Stressors can be divided into psychological and physiological. Physiological effects on the body include, for example, very high/low temperatures, injuries, chronic diseases, infection or pain. Psychological (mental) stressors can be attributed to life situations, negative social communications, conflicts, failure to satisfy internal drives and others [17,19,63,64]. The division into physical and psychological stressors is also based on the scientific function of the organism, because these various stressors activate every other part of the brain, and the trace they leave can be used back to concretize the stressor [17]. On the other hand, stressors can also be divided into absolute stressors, which would be evaluated by everyone who is exposed to them as stress (objective stress factors such as natural disasters) and relative stressors, where we can include effects that only part of the population would declare as the stress initiators (subjective stress factors such as time pressure, tax payment, school exam) [11,16,65,66,67,68]. However, all stressors activate the same biological response of the body [44]. To determine the stress to which a person is exposed, the “Social Readjustment Rating Scale” (SRRS) was released in 1967 [69], but it was not ideal because it offered a very subjective view.

The stress monitoring techniques used today are based on several variables as self-assessment, measurement of behavior and cognitive functions, and finally on physiological manifestations. In our study, we focus mainly on physiological manifestations, because they are an objective manifestation of the organism [23][27][44][65][66].

The stress monitoring techniques used today are based on several variables as self-assessment, measurement of behavior and cognitive functions, and finally on physiological manifestations. In our study, we focus mainly on physiological manifestations, because they are an objective manifestation of the organism [28,32,49,70,71].

2. Advanced Wearable Stress-Meters

Current human stress monitoring devices are usually very inaccurate or rely on a strictly controlled laboratory environment. The concept proposed in this paper is based on our long-term experience in this scientific field in which we have been operating for the last 10 years [67]. In this work, we focused on a multi-sensor device, because one separate sensor is not able to determine whether a person is really exposed to stress. Simply put, the electrical conductivity of EDA actually only responds to brain activity. Using memory is less energy-intensive than inventing new things. As an example, a lie detector can be used. It works on the principle that when person telling the truth, the brain is not so burdened (EDA drops) as when a person lies, invents and the brain is more congested (EDA increases). The EDA does not distinguish whether the increase in conductivity actually occurs due to real stress or only increased physical or mental activity. A single sensor does not know if the change in finger temperature is caused by stress or the outside temperature. It does not know if posture affects respiration or HRV. Therefore, a reliable and accurate stress monitor that includes not only long-term stress but also acute short-term stress must be multi-sensor. The result must be supplemented by other physiological variables in order to obtain the most comprehensive view of the overall situation of a subject under test. Our aim is to create a multi-sensor device for sensing several physiological variables. An advanced stress meter must be something like a portable lie detector, which also captures blood pressure, pulse, respiration in addition to skin conductivity.

Current human stress monitoring devices are usually very inaccurate or rely on a strictly controlled laboratory environment. The concept proposed in this paper is based on our long-term experience in this scientific field in which we have been operating for the last 10 years [179]. In this work, we focused on a multi-sensor device, because one separate sensor is not able to determine whether a person is really exposed to stress. Simply put, the electrical conductivity of EDA actually only responds to brain activity. Using memory is less energy-intensive than inventing new things. As an example, a lie detector can be used. It works on the principle that when person telling the truth, the brain is not so burdened (EDA drops) as when a person lies, invents and the brain is more congested (EDA increases). The EDA does not distinguish whether the increase in conductivity actually occurs due to real stress or only increased physical or mental activity. A single sensor does not know if the change in finger temperature is caused by stress or the outside temperature. It does not know if posture affects respiration or HRV. Therefore, a reliable and accurate stress monitor that includes not only long-term stress but also acute short-term stress must be multi-sensor. The result must be supplemented by other physiological variables in order to obtain the most comprehensive view of the overall situation of a subject under test. Our aim is to create a multi-sensor device for sensing several physiological variables. An advanced stress meter must be something like a portable lie detector, which also captures blood pressure, pulse, respiration in addition to skin conductivity.

2.1. Multi-Sensor Monitors Overview

A large number of scientists have been interested in the idea of using the coherence of several sensors to determine stress in their laboratories [68][69][70][71]. For example it is worth to mention the classifier of negative emotion induced by a visual stimulation evaluated from EDA, ECG and skin temperature [72], multimodal emotion evaluation from combination of EDA, ECG and EMG [73], driver anxiety detection using EDA, PPG, EEG and pupil information [74], identification of cognitive tasks by machine learning from EDA and HRV [75], evaluating of mental workload during web browsing from EDA, PPG and EEG [76][77]. Nowadays, the trend is the use of virtual reality [78][79].

A large number of scientists have been interested in the idea of using the coherence of several sensors to determine stress in their laboratories [148,180,181,182]. For example it is worth to mention the classifier of negative emotion induced by a visual stimulation evaluated from EDA, ECG and skin temperature [183], multimodal emotion evaluation from combination of EDA, ECG and EMG [184], driver anxiety detection using EDA, PPG, EEG and pupil information [185], identification of cognitive tasks by machine learning from EDA and HRV [186], evaluating of mental workload during web browsing from EDA, PPG and EEG [156,187]. Nowadays, the trend is the use of virtual reality [145,188].

In the current scene of wearable devices usable in the diagnosis of human stress, we have discovered several promising commercially available multi-sensor systems. Smart health watches are very widespread in the today’s population. Since early 2010s, the CPU computational power and the overall performance have been high enough to run sophisticated machine learning algorithms, and such devices are able to derive stress from HR. Actually, the most popular way to detect stress today is using wrist wearables. WHOOP’s Recovery metric uses HRV, resting HR, sleep and respiratory rate to determine the state of recovery after body underwent stressful endurance physical training [80]. Nowadays, smartwatches and trackers from Garmin [81] such as Vivoactive 4, Vivosmart 4, Fenix 6, from Samsung [82] Galaxy Watch and Galaxy Watch Active 2, from Apple Watch Series 6 [83], Google Wear smartwatches [84] such as Fossil Gen 5, Fossil Sport, TicWatch E2 and Skagen Falster 3 and Fitbit products [85][86] such as Charge 4, Versa 3 and Ionic are worth mentioning devices on the market. An interesting solution from the Fitbit Company in the Sense product is the possibility to measure also the SCL of EDA after placing your second hand over the watch thanks multi-path electrical sensor [85]. Using Fitbit Sense, you can make a mental well-being practice. Clinical studies have shown that such meditation is very effective in reducing stress [28]. Last but not least, Withings Scanwatch [87] with medical grade ECG and oximeter and two devices from company Empatica: Embrace 2 and E4 should be mentioned [88][89][90]. Both are in the form of wristband and can stream the following variables in real time: EDA, wrist temperature and accelerometric signal. E4 is enhanced further by employing a PPG sensor. Embrace 2 was especially designed for epilepsy monitoring, sleep/rest management and physical activity tracking. E4 is more suitable for lab or home recording, real-time clinical observation and raw data analysis. Very interesting is also Samsung health device concept Simband with Simsense [91], which includes PPG, EDA, skin temperature, 3D accelerometer and ECG lead. Today’s advances in miniaturization allow us to monitor physiology with a ring. Perfect example is the Oura health ring, which includes PPG and temperature sensors together with an accelerometer and a gyroscope encapsulated in an attractive package [92]. Another very common form of recording human physiology are chest-belts. A typical representative is, for example, Zephyr Bioharness 3 that includes HR, RR and accelerometric monitoring [93]. One can also appreciate the design of the non-traditional Qardiocore chest holter [94] that captures ECG, RR, temperature and activity recognition, as well as Wearable biosensor from Philips [95], which contains an ECG sensor together with an accelerometer and a skin temperature sensor. A chapter in themselves are headband neurotrackers like Neurosky Mindwave [96], Muse 2 EEG [97], and Flowtime [98] that monitors EEG and helps to reduce stress through meditation. Muse 2 and Flowtime have also an integrated PPG sensor. Spire Health Tag [99] is also worth mentioning. This device can be adhered inside clothes and detect heart rate, breathing patterns, and body movements to assess the emotional and mental well-being of a person. Detailed parameters of the selected wearable devices suitable for stress-detection can be found in

In the current scene of wearable devices usable in the diagnosis of human stress, we have discovered several promising commercially available multi-sensor systems. Smart health watches are very widespread in the today’s population. Since early 2010s, the CPU computational power and the overall performance have been high enough to run sophisticated machine learning algorithms, and such devices are able to derive stress from HR. Actually, the most popular way to detect stress today is using wrist wearables. WHOOP’s Recovery metric uses HRV, resting HR, sleep and respiratory rate to determine the state of recovery after body underwent stressful endurance physical training [189]. Nowadays, smartwatches and trackers from Garmin [190] such as Vivoactive 4, Vivosmart 4, Fenix 6, from Samsung [191] Galaxy Watch and Galaxy Watch Active 2, from Apple Watch Series 6 [192], Google Wear smartwatches [193] such as Fossil Gen 5, Fossil Sport, TicWatch E2 and Skagen Falster 3 and Fitbit products [194,195] such as Charge 4, Versa 3 and Ionic are worth mentioning devices on the market. An interesting solution from the Fitbit Company in the Sense product is the possibility to measure also the SCL of EDA after placing your second hand over the watch thanks multi-path electrical sensor [194]. Using Fitbit Sense, you can make a mental well-being practice. Clinical studies have shown that such meditation is very effective in reducing stress [33]. Last but not least, Withings Scanwatch [196] with medical grade ECG and oximeter and two devices from company Empatica: Embrace 2 and E4 should be mentioned [197,198,199]. Both are in the form of wristband and can stream the following variables in real time: EDA, wrist temperature and accelerometric signal. E4 is enhanced further by employing a PPG sensor. Embrace 2 was especially designed for epilepsy monitoring, sleep/rest management and physical activity tracking. E4 is more suitable for lab or home recording, real-time clinical observation and raw data analysis. Very interesting is also Samsung health device concept Simband with Simsense [200], which includes PPG, EDA, skin temperature, 3D accelerometer and ECG lead. Today’s advances in miniaturization allow us to monitor physiology with a ring. Perfect example is the Oura health ring, which includes PPG and temperature sensors together with an accelerometer and a gyroscope encapsulated in an attractive package [201]. Another very common form of recording human physiology are chest-belts. A typical representative is, for example, Zephyr Bioharness 3 that includes HR, RR and accelerometric monitoring [202]. One can also appreciate the design of the non-traditional Qardiocore chest holter [203] that captures ECG, RR, temperature and activity recognition, as well as Wearable biosensor from Philips [204], which contains an ECG sensor together with an accelerometer and a skin temperature sensor. A chapter in themselves are headband neurotrackers like Neurosky Mindwave [205], Muse 2 EEG [206], and Flowtime [207] that monitors EEG and helps to reduce stress through meditation. Muse 2 and Flowtime have also an integrated PPG sensor. Spire Health Tag [208] is also worth mentioning. This device can be adhered inside clothes and detect heart rate, breathing patterns, and body movements to assess the emotional and mental well-being of a person. Detailed parameters of the selected wearable devices suitable for stress-detection can be found in

Table 1. Within some experiments, scientists have developed their own designs. One of these offers stress detection from portable ECG and EDA, where authors use two channels EDA and ECG to suppress undesired artifacts [100]. Another example is the activity recognition system (mental, physical and emotions) based on combination of ECG and respiration sensor, and EDA gloves [101]. Systems using speech analysis also appear to be very promising for stress analysis purposes. These systems can be easily incorporated into modern mobile phones [102]. In the research of Jin et al. [37], in addition to the speech analysis itself, they included behavioral signals (3D accelerometer and 3D angle sensor) and propose an attention-based deep-learning architecture for a more accurate classification of mental state. Nowadays, there are even systems that perform the analysis of biomarkers from sweat and saliva directly during sports activities [103]. The current literature summary of stress assessment using wearable multi-sensors in the natural environment includes: emotion recognition by neural networks from portable eyetracker and Empatica E4 [104], ANS research using again E4 but now with ECG and respiration sensors [105], development of cognitive load tracker using machine learning [106], smart stress reduction system using E4 combined with accelerometers [107], validation of wireless sensors for psychophysiological studies and stress detection [108][109], prediction of relative physical activity [110], real-time monitoring of passenger psychological stress [111], classification of calm/distress condition [112], assessment of mental stress of fighters [113], and others. A comprehensive overview about pain and stress detection using available wearable sensors was actually made very recently by Jerry Chen et al. [114]. They mention, stress monitoring using mobile EEG head set MindWave [115], ECG and EMG DataLOG [116], using a combination of MindWave EEG (NeuroSky, San Jose, CA, USA), Zephyr BioHarness 3 chest belt (Medtronic, Boulder, CO, USA), Shimmer Sensor (Shimmer Sensing, Dublin, Ireland) [117] and mobile sensors suite AutoSense (National Institutes of Health, Bethesda, MD, USA) [118]. Mental health monitoring using ubiquitous wearable sensors [119] and machine learning [120][121] has been also described.

. Within some experiments, scientists have developed their own designs. One of these offers stress detection from portable ECG and EDA, where authors use two channels EDA and ECG to suppress undesired artifacts [108]. Another example is the activity recognition system (mental, physical and emotions) based on combination of ECG and respiration sensor, and EDA gloves [209]. Systems using speech analysis also appear to be very promising for stress analysis purposes. These systems can be easily incorporated into modern mobile phones [210]. In the research of Jin et al. [42], in addition to the speech analysis itself, they included behavioral signals (3D accelerometer and 3D angle sensor) and propose an attention-based deep-learning architecture for a more accurate classification of mental state. Nowadays, there are even systems that perform the analysis of biomarkers from sweat and saliva directly during sports activities [211]. The current literature summary of stress assessment using wearable multi-sensors in the natural environment includes: emotion recognition by neural networks from portable eyetracker and Empatica E4 [212], ANS research using again E4 but now with ECG and respiration sensors [213], development of cognitive load tracker using machine learning [109], smart stress reduction system using E4 combined with accelerometers [214], validation of wireless sensors for psychophysiological studies and stress detection [100,215], prediction of relative physical activity [216], real-time monitoring of passenger psychological stress [147], classification of calm/distress condition [217], assessment of mental stress of fighters [218], and others. A comprehensive overview about pain and stress detection using available wearable sensors was actually made very recently by Jerry Chen et al. [150]. They mention, stress monitoring using mobile EEG head set MindWave [219], ECG and EMG DataLOG [220], using a combination of MindWave EEG (NeuroSky, San Jose, CA, USA), Zephyr BioHarness 3 chest belt (Medtronic, Boulder, CO, USA), Shimmer Sensor (Shimmer Sensing, Dublin, Ireland) [221] and mobile sensors suite AutoSense (National Institutes of Health, Bethesda, MD, USA) [222]. Mental health monitoring using ubiquitous wearable sensors [223] and machine learning [224,225] has been also described.

Table 1.

Technical parameters of selected wearable devices suitable for stress-detection.
Garmin Vivoactive 4 [81][190]
Sensors: PPG 1, accelerometer, gyroscope, compass, barometer, thermometer, microphone, ambient light, GPS, GLONASS, Galileo
Physiology variables: HR, spO2, stress 2, respiration 2 (meditation), sleep and activity tracking, body battery energy
Connectivity: Bluetooth, Wi-Fi, NFC, ANT+, Waterproof: 5 ATM; Form: Watch
Samsung Galaxy Watch Active 2 [82][191]
Sensors: PPG 1, ECG 3, accelerometer, gyroscope, compass, barometer, microphone, ambient light, GPS, GLONASS, Galileo, Beidou
Physiology variables: ECG 3, HR, BP 3, stress 2 (meditation), sleep and activity monitoring
Connectivity: Bluetooth, Wi-Fi, NFC; Waterproof: 5 ATM; Form: watch
Google Fossil Gen 5 [84][193]
Sensors: PPG 1, accelerometer, gyroscope, compass, barometer, microphone, ambient light, GPS
Physiology variables: HR, stress 2 (meditation), sleep and activity monitoring
Connectivity: Bluetooth, Wi-Fi, NFC; Waterproof: 3 ATM; Form: watch
Apple Watch 6 [83][192]
Sensors: PPG 1, ECG 3, accelerometer, gyroscope, compass, barometer, microphone, ambient light, GPS, GLONASS, Galileo
Physiology variables: ECG 3, HR, spO2, sleep and activity monitoring
Connectivity: Bluetooth, Wi-Fi, NFC; Waterproof: 5 ATM; Form: watch
Withings Scanwatch [87][196]
Sensors: PPG 1, ECG 3, accelerometer, gyroscope, compass, barometer, ambient light
Physiology variables: ECG 3, HR, spO2 (medical grade), sleep and activity tracking
Connectivity: Bluetooth Low Energy, USB; Waterproof: 5 ATM; Form: watch
Fitbit Sense [86][195]
Sensors: PPG 1, ECG 3, EDA 3, thermometer, accelerometer, gyroscope, barometer, microphone, ambient light, GPS, GLONASS
Physiology variables: ECG 3, HR, spO2, peripheral temperature, stress (meditation), sleep and activity monitoring
Connectivity: Bluetooth Low Energy, Wi-Fi, NFC; Waterproof: 5 ATM; Form: watch
Samsung Simband [91][200]
Sensors: PPG 1, ECG 3, EDA, bioimpedance, thermometer, accelerometer
Physiology variables: ECG 3, HR, EDA, bioimpedance (blood flow), peripheral temperature, activity tracking
Connectivity: Bluetooth, USB; Form: watch
Empatica Embrace 2 [90][199]
Sensors: EDA, temperature, accelerometer, gyroscope
Physiology variables: EDA (clinical grade), peripheral temperature, stress, sleep and activity tracking
Connectivity: Bluetooth Low Energy; Waterproof: 0.1 ATM; Form: wristband
Empatica E4 [90][199]
Sensors: PPG 1, EDA, infrared temperature, accelerometer, event maker
Physiology variables: HR, spO2, EDA, peripheral temperature, activity tracking
Connectivity: Bluetooth Low Energy, USB 2.0, Raw data analysis; Waterproof: 0.1 ATM; Form: wristband
Zephyr Bioharness 3 [93][202]
Sensors: HR, RR, accelerometer
Physiology variables: HR, RR, activity monitoring
Connectivity: Bluetooth Low Energy; Form: chest-belt
Quardiocore [94][203]
Sensors: ECG, skin temperature, accelerometer, gyroscope, compass
Physiology variables: ECG, HR, RR, body core temperature, activity tracking
Connectivity: Bluetooth 4.0; Form: chest-belt
Philips Wearable biosensor [95][204]
Sensors: ECG, skin temperature, accelerometer
Physiology variables: ECG, HR, RR, body core temperature, activity tracking
Connectivity: Bluetooth; Form: chest-belt
Oura health ring [122][232]
Sensors: PPG 4, accelerometer, gyroscope, NTC thermometer
Physiology variables: HR, RR 2, peripheral temperature, stress (meditation), sleep and activity tracking
Connectivity: Bluetooth Low Energy; Waterproof: 10 ATM; Form: ring
Neurosky MindWave [96][205]
Sensors: EEG
Physiology variables: EEG
Connectivity: Bluetooth/Bluetooth Low Energy dual mode; Form: headband
Muse 2 EEG [97][206]
Sensors: EEG, PPG 1, accelerometer, gyroscope
Physiology variables: EEG (emotions), HR, stress (meditation) and activity tracking
Connectivity: Bluetooth 4.2, USB; Form: headband
Flowtime EEG [98][207]
Sensors: EEG, PPG 1
Physiology variables: EEG, HR, stress tracking (active/neutral/calm)
Connectivity: Bluetooth; Form: headband
Spire Health Tag [99][208]
Sensors: PPG 1, accelerometer
Physiology variables: HR, RR 2, stress (calm/focus/tension), sleep and activity tracking
Connectivity: Bluetooth; Form: adhered to clothes; Washer and dryer proof
Multi-sensor concept
Sensors: ECG, PPG 4, respiration, EDA (IDA microelectrodes), 2× infrared temperature, 2× accelerometer, gyroscope, compass
Physiology variables: ECG, HR, spO2, EDA, respiration, peripheral and body core temperature (heat gradient), BP (derived from ECG and PPG), stress, sleep and activity monitoring
Connectivity: Bluetooth Low Energy, USB; Form: ring and chest-belt

2.2. The Proposed Multi-Sensor Concept

Based on the analysis described in the previous sections, we still see points where current multi-sensor monitoring systems can be improved, and therefore we come up with our own concept. From practical reasons, the main idea behind the concept is to divide the stress-meter system into two separate sub-systems (

Figure 1). We consider appropriate to place one sub-system on bottom parts of non-dominant hand, ideally on fingers (smart-ring) as depicted in

7). We consider appropriate to place one sub-system on bottom parts of non-dominant hand, ideally on fingers (smart-ring) as depicted in

Figure 1a. The second part of sensors should be placed on the chest in the heart area, most probably in the form of a smart sticker or a tiny chest belt, as depicted in

7a. The second part of sensors should be placed on the chest in the heart area, most probably in the form of a smart sticker or a tiny chest belt, as depicted in

Figure 1b. The keystone lays in the precise time synchronization of those two sub-systems.

7b. The keystone lays in the precise time synchronization of those two sub-systems.

Figure 17.

Concept of new stress-meter: (

a

) smart ring, (

b

) chest holter.
Let us start with a smart ring illustrated in

Figure 7

a. The basis component, as in most other stress detection devices, should be an exosomatic EDA sensor stored in a smart-ring (

Figure 7a). For practical reasons of long-term monitoring, we choose dry electrodes and harmonic signal. However, instead of conventional macroelectrodes, we recommend using optimized microelectrodes in the form of symmetrical IDA microelectrodes of dimensions between 100/100 and 200/200 μm (finger/gap). In this way, we will be able to obtain the EDA signal from a smaller area and the measure signal will be more tied to nerve activity and stress. In the first research phases, we would not even ignore the possibility of measuring the complex impedance at different frequencies. From our experience a harmonic input signal with the frequency value about 1 kHz and the amplitude between 1.5 and 3 V is recommended. Since dry microelectrodes are intended to be used, there will be a need to minimize the motion artifacts. Despite the fact that we have high hopes for software filters, built in circuity as a part of a standard physical sensor is assumed. A simple accelerometer seems to be the most suitable choice, but using the piezoelectric pressure sensor we can obtain direct information about the contact force between the electrodes and the skin. Another essential part of this sensor sub-system must be the optical HR sensor, where conventional PPG sensor can be used. As confirmed in the previous analysis, monitoring of blood oxygenation is not necessary, but at the present COVID-19 time, will certainly not be redundant. The transmittance principle of PPG used on fingers has been suggested in [123], which is more reliable compared to the reflective principle. The last sensor in the ring/watch sub-system should be a reliable thermometer, whether it is a contact thermocouple or an optical one. It should not be a problem to place all these sensors in a still compact ring of about 1.5 cm thickness. An area of about 2 cm

a). For practical reasons of long-term monitoring, we choose dry electrodes and harmonic signal. However, instead of conventional macroelectrodes, we recommend using optimized microelectrodes in the form of symmetrical IDA microelectrodes of dimensions between 100/100 and 200/200 μm (finger/gap). In this way, we will be able to obtain the EDA signal from a smaller area and the measure signal will be more tied to nerve activity and stress. In the first research phases, we would not even ignore the possibility of measuring the complex impedance at different frequencies. From our experience a harmonic input signal with the frequency value about 1 kHz and the amplitude between 1.5 and 3 V is recommended. Since dry microelectrodes are intended to be used, there will be a need to minimize the motion artifacts. Despite the fact that we have high hopes for software filters, built in circuity as a part of a standard physical sensor is assumed. A simple accelerometer seems to be the most suitable choice, but using the piezoelectric pressure sensor we can obtain direct information about the contact force between the electrodes and the skin. Another essential part of this sensor sub-system must be the optical HR sensor, where conventional PPG sensor can be used. As confirmed in the previous analysis, monitoring of blood oxygenation is not necessary, but at the present COVID-19 time, will certainly not be redundant. The transmittance principle of PPG used on fingers has been suggested in [226], which is more reliable compared to the reflective principle. The last sensor in the ring/watch sub-system should be a reliable thermometer, whether it is a contact thermocouple or an optical one. It should not be a problem to place all these sensors in a still compact ring of about 1.5 cm thickness. An area of about 2 cm

2

is sufficient for EDA electrodes, LED and photodiode placed opposite each other and the thermal sensor occupy only a few tens of mm

2. The battery and the transmitter are the largest parts. If there is a requirement for further integration, we have experience with the use of transparent metals for EDA electrodes [124]. Such a design would allow the placement of optical sensors directly behind EDA electrodes.

. The battery and the transmitter are the largest parts. If there is a requirement for further integration, we have experience with the use of transparent metals for EDA electrodes [116]. Such a design would allow the placement of optical sensors directly behind EDA electrodes.
The second multi-sensor sub-system (

Figure 7b) should definitely contain an ECG sensor. The quality of the ECG itself is not important, we are dominantly interested only in the exact estimate of the R peak in the QRS complex. From this information we obtain HR and, thanks to the precise synchronization with the first sensor sub-system and the PPG, also pulse transition time (PTT) which is relative to BP. If the quality of ECG is high enough, it will definitely not hurt. ECG holters are the most commonly used telemedicine devices and they can also monitor other cardiovascular parameters that can more accurately determine the physiological condition. We have good experience with chips from Texas Instruments (TI 1292R) [125], which also integrate a reliable respiration impedance sensor, so in this way, the second important physiological parameter—the respiration could be obtained. Biosignals can be measured using Ag/AgCl adhesive electrodes with the sufficient mutual distance of 5 cm. Another important sensor is an IMU sensor (3-axis accelerometer, gyroscope and compass). There are an infinite series of IMU sensors. Since the IMU sensor will be placed on the chest, the best overview of posture and physical activity of the body can be extracted. An IMU sensor on your hands or feet would not be reliable enough. Information on overall human activity will help us better understand the very important phasic response of the EDA signal. We know that in some situations, especially with higher physical activity, the signal from the accelerometer so-called seismocardiographic signal, can replace the ECG signal in determining HR [126]. The last used sensor here is again a body core thermal sensor.

b) should definitely contain an ECG sensor. The quality of the ECG itself is not important, we are dominantly interested only in the exact estimate of the R peak in the QRS complex. From this information we obtain HR and, thanks to the precise synchronization with the first sensor sub-system and the PPG, also pulse transition time (PTT) which is relative to BP. If the quality of ECG is high enough, it will definitely not hurt. ECG holters are the most commonly used telemedicine devices and they can also monitor other cardiovascular parameters that can more accurately determine the physiological condition. We have good experience with chips from Texas Instruments (TI 1292R) [227], which also integrate a reliable respiration impedance sensor, so in this way, the second important physiological parameter—the respiration could be obtained. Biosignals can be measured using Ag/AgCl adhesive electrodes with the sufficient mutual distance of 5 cm. Another important sensor is an IMU sensor (3-axis accelerometer, gyroscope and compass). There are an infinite series of IMU sensors. Since the IMU sensor will be placed on the chest, the best overview of posture and physical activity of the body can be extracted. An IMU sensor on your hands or feet would not be reliable enough. Information on overall human activity will help us better understand the very important phasic response of the EDA signal. We know that in some situations, especially with higher physical activity, the signal from the accelerometer so-called seismocardiographic signal, can replace the ECG signal in determining HR [141]. The last used sensor here is again a body core thermal sensor.

From the all sensors used, the following physiological variables will be obtained: ECG and chest temperature, HR and finger temperature, EDA, EDA motion artefacts, respiration, posture and physical activity. Synchronization is now entering the scene. For sub-systems synchronization and external communication we plan to use Bluetooth Low Energy. By comparing the temperature of the finger and chest, one can get information about the heat gradient and so-called “circulating shock” level. From the determination of the time shift between the ECG and PPG signals, continuous information about the blood flow rate will be available, which in our case can be considered as BP. Here is the key to accurate synchronization. We estimate that an inaccuracy of 5 ms corresponds to a blood pressure error of 1 mmHg corresponding to the average person when using a ring. We should try to achieve a sync error of about 1 ms [127]. Additional information on systolic and diastolic pressure can also be obtained by analyzing the shape of the PPG curve [128][126][129]. In addition to bluetooth connectivity, the concept can be also connected via USB. The device will have integrated an internal memory (micro SD card), real-time clock and battery management circuitry. The battery management is one of issues to be investigated further. Here, energy harvesting systems generating electrical energy from ambient environment represent a promising solution towards enhancing the battery lifetime or avoiding the necessity of battery change that might be very impractical and inconvenient in some applications [130][131] could be effectively employed to provide a self-powered (at least partially) electronic system. Detailed parameters of proposed multi-sensor concept are summarized at the end of

From the all sensors used, the following physiological variables will be obtained: ECG and chest temperature, HR and finger temperature, EDA, EDA motion artefacts, respiration, posture and physical activity. Synchronization is now entering the scene. For sub-systems synchronization and external communication we plan to use Bluetooth Low Energy. By comparing the temperature of the finger and chest, one can get information about the heat gradient and so-called “circulating shock” level. From the determination of the time shift between the ECG and PPG signals, continuous information about the blood flow rate will be available, which in our case can be considered as BP. Here is the key to accurate synchronization. We estimate that an inaccuracy of 5 ms corresponds to a blood pressure error of 1 mmHg corresponding to the average person when using a ring. We should try to achieve a sync error of about 1 ms [228]. Additional information on systolic and diastolic pressure can also be obtained by analyzing the shape of the PPG curve [124,141,229]. In addition to bluetooth connectivity, the concept can be also connected via USB. The device will have integrated an internal memory (micro SD card), real-time clock and battery management circuitry. The battery management is one of issues to be investigated further. Here, energy harvesting systems generating electrical energy from ambient environment represent a promising solution towards enhancing the battery lifetime or avoiding the necessity of battery change that might be very impractical and inconvenient in some applications [230,231] could be effectively employed to provide a self-powered (at least partially) electronic system. Detailed parameters of proposed multi-sensor concept are summarized at the end of

Table 1

.
After designing a device, which is the main development goal in the near future, the experimental part will follow. The biggest challenge will be to examine the coherence of all the measured physiological variables during different situations in human life. Some mutual relations have been already analyzed within the previous analysis, however, skillful programmers and the use of neural networks and machine learning will be in high demand. Of course, one cannot avoid laboratory and simulated situations supplemented by standard psychological tests and stress assessments, whether by standardized questionnaires or by measuring hormone levels to fine-tune the device.