1. Changes in Daily Bahavioral Patterns Observed in MCI and AD Based on Performance- and Questionnarie-Based Assessments
Many reports evaluating daily behavioral changes in individuals with MCI and AD using performance-based assessments or informant-based or self-assessment questionnaires have been noted
[1]. Regarding the performance-based instruments, the Direct Assessment of Functional Status was the best measure for detecting differences in global instrumental ADL functioning between MCI and healthy controls
[1]. This measure is a standardized observation-based checklist designed to assess the functional capabilities of adults with AD, dementia, and schizophrenia. The examiner needs the evaluation form, pen or pencil, and ADL materials for testing. Simulated daily tasks are observed in the seven following areas: time orientation, communication, transportation, finance, shopping, grooming, and eating
[2]. Using the Direct Assessment of Functional Status, Pereira et al.
[3] found that patients with MCI performed significantly worse than healthy controls and better than patients with AD. Financial and shopping skills were the items that differentiated patients with MCI from healthy controls.
For the informant-based questionnaire, the Alzheimer’s Disease Cooperative Study scale for ADL in MCI seems to be a useful tool for global instrumental ADL assessment
[1]. This questionnaire assesses the competence of patients with MCI in basic and instrumental ADL (covering 18 areas). It can be completed by a caregiver in a questionnaire format or administered by a clinician/researcher as a structured interview with caregivers
[4]. Moreover, Perneczky et al.
[5] used this questionnaire for measuring instrumental ADL in MCI. The overall score of this scale was significantly lower in the MCI group where the impaired ADL (14 out of 18 activities) were found. Activities involving memory or complex reasoning were particularly impaired, whereas more basic activities were unimpaired. In another paper, Perneczky et al.
[6] examined whether this scale could be a significant predictor of the MCI diagnosis. They demonstrated that this scale discriminated well between patients and healthy controls with a sensitivity and specificity of 0.89 and 0.97, respectively, using receiver operator curve analysis.
The Seoul-Instrumental ADL and Lawton and Brody’s Instrumental ADL were used for the self-assessment questionnaires
[7][8]. For example, Pérès et al.
[8] assessed for instrumental ADL (telephone, transport, medication, and finances) in patients with MCI and dementia using Lawton and Brody’s Instrumental ADL. Patients with MCI were more frequently instrumental ADL-restricted (34.3%) than healthy controls (5.4%) but less than those with dementia (91.1%). Interestingly, the instrumental ADL-restricted subjects with MCI were more likely to develop dementia in >2 years (30.7%) than those with non-instrumental ADL-restricted MCI (7.8%)
[8]. In addition, the odds ratios for dementia were 7.4 and 2.8 in instrumental ADL-restricted and non-instrumental ADL-restricted MCI, respectively, compared with healthy controls
[8].
The instrumental ADL deficits were also analyzed between MCI subtypes. Moreover, MCI can be classified according to the presence/absence of episodic memory impairments (amnestic or non-amnestic) and the number of affected cognitive domains (single or multiple domains)
[9]. A systematic review exhibited that the instrumental ADL deficits tended to be more pronounced in amnestic MCI than in non-amnestic MCI. The instrumental ADL deficits were more pronounced in the multiple-domain MCI than in the single-domain MCI
[1].
Overall, changes in daily behavior are likely to be consistently present even in individuals with MCI in both the performance- and questionnaire-based methods. Furthermore, patients with MCI with instrumental ADL deficits seem to have a higher risk of converting to dementia than patients without ADL deficits. Thus, assessment of daily behavior (in particular, the instrumental ADL) is useful for early MCI detection and prognosis prediction.
Concerning the nature of changes in daily behavioral patterns (instrumental ADL deficits), Bruderer-Hofstetter et al.
[10] recently developed a comprehensive model of ADL functioning that depicts the relevant influencing factors. In their studies, various factors are thought to be involved in these functional changes in patients with MCI. The relevant influencing factors include five cognitive factors (i.e., memory, attention, executive function, and two executive function subdomains (problem solving/reasoning and organization/planning)), five physical factors (i.e., seeing functions, hearing functions, balance, gait/mobility functions, and functional mobility functions), two environmental factors (i.e., social network/environment and support of social network/environment), and one personal factor (i.e., education)
[10].
2. Changes in Daily Behavioral Patterns in MCI and AD Based on Nonwearable Sensor-Based In-Home Assessment
2.1. Digital Technologies for Monitoring of Daily Behavioral Patterns
In general, two main categories of sensors (i.e., wearable and nonwearable sensors) are used to monitor human behavior
[11][12][13]. The two kinds of sensors have been used extensively in various systems. Wearable sensors are usually attached to a person directly (e.g., bracelet or cardio sensors) or to their clothes (e.g., an accelerometer or a step counter) to measure location, pulse rate, body temperature, blood pressure, and other important metrics as well as motion characteristics
[11]. Conversely, nonwearable sensors are usually deployed in stationary locations of a house or a room and can detect a person and his movements and activities. Nonwearable sensors can specify the operational status of objects, measure water flow, room temperature, or door/cupboard opening/closings
[11]. The types and characteristics of nonwearable sensors are summarized in
Table 1.
Table 1. Types and characteristics of nonwearable sensors.
Sensor |
Measurement Type |
Characteristics |
Infrared sensors |
Motion |
- Most frequently used nonwearable sensors - Discover human presence in a room - Detect motion in a specific area - Locate a human within a house |
Ultrasonic sensors |
Motion |
- Person detection and localization by measuring distances to objects |
Photoelectric sensors |
Motion |
- Detect a light source and output a signal |
Vibration sensors |
Vibration |
- Detect a person falling, interaction with various objects, flushing toilets, and water flows |
Pressure sensors |
Pressure on object |
- Detect the presence of a person, steps, and fall events - Deploy in the form of floor mats and smart tiles |
Magnetic switches |
Opening or closing |
- Detect opening and closing of doors or cupboards - Provide information on users accessing particular rooms and opening dressers, refrigerators, or trash cans |
Audio sensors |
Activity-related sound |
- Detect sounds in a house - Discriminate between different types of sounds |
Wattmeter and other sensors |
Consumption information |
- Measure electricity consumption of domestic appliances and light |
Wearable sensors have the advantage of higher localization accuracy and tracking. Additionally, wearable sensors are much more available and provide a timely and economical fashion for detecting MCI and AD compared with nonwearable sensors
[11]. However, wearable sensor-based monitoring is more intrusive and demands that older adults with various degrees of cognitive levels to remember wear the devices as well as the need for regular charging of the devices
[14]. In contrast, nonwearable sensors are less intrusive and can monitor activities in a real life and naturalistic environment without causing any interference to an individual’s daily routines
[14]. From these characteristics, it seems that nonwearable sensors are more suitable for the monitoring and detection of patients with MCI and AD. Thus, we focused on research using nonwearable sensor-based in-home assessment.
2.2. Changes in Daily Bahavioral Patterns Observed in MCI and AD Based on Nonwearable Sensor-Based In-Home Assessment
Several studies have investigated one of the daily behaviors (e.g., walking, sleeping, and going out) in patients with MCI and AD (
Table 2). For example, Hayes et al.
[15] investigated the walking speed and daily activity of patients with MCI and healthy elderly people living independently and alone in the community using unobtrusive sensors (passive infrared motion sensors for each room and magnetic contact door sensors for each door) at home for at least 6 months. Walking speed was more variable in the MCI group than in the healthy group. In addition, the day-to-day activity pattern was more variable in patients with MCI. Dodge et al.
[16] also examined in-home walking speeds using passive infrared sensors fixed in a series on the ceiling of homes of patients with amnestic MCI and non-amnestic MCI and healthy controls for >3 years. Patients with non-amnestic MCI were characterized by a reduced walking speed. Furthermore, two distinct trajectories (the highest and lowest variability) were predominantly associated with non-amnestic MCI. These studies suggest the alteration of walking behavior in patients with MCI. Moreover, Hayes et al.
[17] explored the relationship between sleep disturbances and patients with MCI in community-dwelling seniors using wireless passive infrared motion sensors in each room of the home (bedroom, bathroom, kitchen, living room, and hallway-entry areas) and magnetic contact door sensors for each door over 6 months. Consequently, patients with amnestic MCI and non-amnestic MCI, and cognitively intact volunteers showed different patterns of sleep disturbance-. In particular, patients with amnestic MCI had less disturbed sleep than both those with non-amnestic MCI and healthy subjects. These differences in sleep disruption between amnestic MCI and non-amnestic MCI may be related to differences in the pathology underlying these MCI subtypes. Petersen et al.
[18] investigated the relationship between time out-of-home and cognitive status, physical ability, and emotional state in patients with MCI and healthy elderly using pyroelectric infrared motion sensors in each room and contact sensors on the refrigerator and doors of the home for up to 1 year. They found that cognitive status was significantly associated with time out-of-home. Furthermore, patients with MCI spent an average of 1.67 h more inside the home than healthy elderly.
Recent studies focused on changes in daily behavioral patterns in general, rather than just one daily activity (
Table 2). Urwyler et al.
[19] investigated differences in daily behavioral pattern performance between patients with dementia and healthy controls using unobtrusive sensors for 20 consecutive days. An unobtrusive sensor network comprising 10 wireless sensor boxes was installed in the home (
Figure 1). Each sensor box consisted of five sensors (temperature, humidity, luminescence, presence (passive infrared radiation), and acceleration). Consequently, a significant difference in daily behavioral patterns was observed between patients with dementia and healthy controls. Specifically, patients with dementia revealed unorganized behavior patterns (
Figure 2). Rawtaer et al.
[20] examined changes in behaviors in patients with MCI using the multiple sensor system (passive infrared motion sensors, proximity beacon tags, a sensor-equipped medication box, a bed sensor, and a wearable sensor) for >2 months. Patients with MCI were less active than healthy subjects and had more sleep interruptions per night. In addition, patients with MCI had forgotten their medications more times per month than healthy subjects. Overall, changes in various kinds of daily behavioral functions were observed even in patients with MCI.
Figure 1. Floor plan of an apartment showing the placement of sensor boxes (red circles). The figure is adapted from Urwyler et al.
[19] (CC BY 4.0).
Figure 2. Activity maps of a healthy control (
left) and a patient with dementia (
right) visualized from data continuously measured for 20 consecutive days. Activity maps of patients with dementia reveal unorganized behavior patterns, and heterogeneity differed significantly between the healthy control and the patient. The figure is adapted from Urwyler et al.
[19] (CC BY 4.0).
References |
Participants and Study Protocol (1. Study Design; 2. Participants; 3. Sensor Type; 4. Duration; 5. Machine Learning Technique) |
Main Findings |
Hayes et al. [26] |
-
Observational cross-sectional study
-
Healthy (n = 7; mean age: 90.0 y; F:M = 5:2); MCI (n = 7; mean age: 88.4 y; F:M = 4:3)
-
Passive infrared motion sensors and magnetic contact door sensors
-
Six months
|
- Walking speed was more variable in patients with MCI. - Day-to-day pattern of activities was more variable in patients with MCI. |
Dodge et al. [27] |
|
- Daily walking speeds and their variability were associated with non-amnestic MCI. |
Hayes et al. [28] |
-
Observational cross-sectional study
-
Healthy (n = 29; mean age: 87.5 y; F:M = 26:3); amnestic MCI (n = 6; mean age: 84.8 y; F:M = 5:1); non-amnestic MCI (n = 10; mean age: 86.5 y; F:M = 9:1)
-
Wireless passive infrared motion sensors and magnetic contact door sensors
-
Six months
|
- Patients with amnestic MCI showed less sleep disturbance than both those with non-amnestic MCI and healthy elderly. |
Petersen et al. [29] |
|
- Patients with MCI spent an average 1.67 h more inside the home than healthy elderly. |
Urwyler et al. [30] |
-
Observational study
-
Healthy (n = 10; mean age: 73.9 y; F:M = 7:3); dementia (n = 10; mean age: 76.7 y; F:M = 7:3)
-
A wireless-unobtrusive sensors (temperature, humidity, luminescence, presence [passive infrared radiation], and acceleration)
-
Twenty consecutive days
|
- Patients with dementia showed unorganized behavior patterns. |
Rawtaer et al. [31] |
-
Observational cross-sectional study
-
Healthy (n = 21; mean age: 73.0 y; F:M = 14:7); MCI (n = 28; mean age: 75.1 y; F:M = 19:9)
-
Multiple sensor system (passive infrared motion sensors, proximity beacon tags, a sensor equipped medication box, a bed sensor, and a wearable sensor)
-
Two months
|
- Patients with MCI were less active than healthy subjects and had more sleep interruptions per night. - Patients with MCI had forgotten their medications more times per month than healthy subjects. |
Akl et al. [34] |
-
Observational longitudinal study
-
Healthy (n = 79; mean age: not clear; F:M = not clear); MCI (n = 18; mean age: not clear; F:M = not clear)
-
Passive infrared motion sensors and wireless contact switches
-
Three years
-
Support vector machine, random forest
|
- Variabilities in weekly walking speed, morning and evening walking speeds, and subjects’ age and gender were the most important for the process of detecting MCI. - This study autonomously detected MCI with receiver operating characteristic curve (0.97) and precision–recall curve (0.93) using a time windows of 24 weeks. |
Akl et al. [35] |
-
Observational longitudinal study
-
Healthy (n = 59; mean age: not clear; F:M = not clear); amnestic MCI (n = 11; mean age: not clear; F:M = not clear); non-amnestic MCI (n = 15; mean age: not clear; F:M = not clear)
-
Passive infrared motion sensors and wireless contact switches
-
Three years
-
Clustering (affinity propagation)
|
- This study automatically detected MCI (F0.5 score, 0.856) and non-amnestic MCI (F0.5 score, 0.958). |
Alberdi et al. [36] |
-
Observational longitudinal study
-
Healthy (n = 13; mean age: 82.85 y; F:M = 9:4); at risk (n = 10; mean age: 86.20 y; F:M = 10:3); MCI (n = 6; mean age: 84.50 y; F:M = 5:1)
-
Passive infrared motion sensors
-
Two years
-
Regression: support vector regression, linear regression, K nearest neighbors; Classification: support vector machine, adaboost, multilayer perceptron, random forest
|
- Sleep and overnight patterns along with daily routine features contributed to the prediction of several health assessments. - All algorithms could build statistically significant prediction models. |
Nakaoku et al. [37] |
-
Observational study
-
Normal cognition (n = 55; mean age: 75.0 y; F:M = 18:37); cognitive impairment (n = 23; mean age: 78.0 y; F:M = 6:17)
-
Unobtrusive in-house power monitoring system (air conditioner, microwave oven, washing machine, rice cooker, television, and induction heater)
-
One year
-
Generalized linear model
|
- Three independent power monitoring parameters (air conditioner, microwave oven, and induction heater) representing activity behavior were associated with cognitive impairment. - The prediction model with power monitoring data had better predictive ability (accuracy, 0.82; sensitivity, 0.48; and specificity, 0.96). |
ADL activities of daily living, MCI mild cognitive impairment, AD Alzheimer’s disease.
2.3. Machine Learning–Based Prediction Model for Detecting Individuals with MCI
Machine learning is a subdiscipline of artificial intelligence and has been extensively used in recent studies to predict behavioral/cognitive abnormalities utilizing sensor-based activity data
[21][22]. Several studies have been noted to apply these methods to MCI differentiation
[23][24][25][26] . Moreover, support vector machine and random forest were the most commonly used techniques, although a wide variety of machine learning techniques were employed. Several metrics are used to evaluate prediction models (e.g., area under the receiver operator characteristic and precision–recall curves) and the F-score
[21][22][23][24][25][26].
ADL activities of daily living, MCI mild cognitive impairment, AD Alzheimer’s disease.
Akl et al.
[23] explored the ability of signal processing along with machine learning algorithms to autonomously detect MCI using home-based unobtrusive sensing technologies (passive infrared motion sensors in rooms, wireless contact switches on doors, and motion sensors on the ceiling). They found that variabilities (i.e., weekly walking speed, morning and evening walking speeds, and subjects’ age and gender) were the most important factors in the process of detecting MCI. The authors autonomously detected MCI with receiver operator characteristic and precision–recall curves of 0.97 and 0.93, respectively, using a time window of only 24 weeks
[23]. A clustering-based method to automatically detect MCI using estimated generalized linear models of their home activity was proposed by Akl et al. in another study
[24]. Continuous monitoring was conducted via unobtrusive sensing technologies (passive infrared motion sensors in the room and wireless contact switches on the doors). The authors automatically detected MCI and non-amnestic MCI with F0.5 scores of 0.856 and 0.958, respectively
[24]. Moreover, Alberdi et al.
[25] assessed the possibility of detecting changes in psychological, cognitive, and behavioral symptoms of MCI by making use of unobtrusively collected smart home behavior data and machine learning techniques. They found that sensor-based activity observations (e.g., sleep and overnight patterns) and daily routine features contributed significantly to the prediction of several health assessments. All algorithms could build statistically significant prediction models
[25]. In addition, Nakaoku et al.
[26] investigated whether unobtrusive in-house power monitoring technologies could be used to predict cognitive impairment. Daily activity data were collected using a well-established unobtrusive in-house power monitoring system installed in the participants’ homes. Several electric appliances (air conditioner, microwave oven, washing machine, rice cooker, television, and induction heater) were monitored. Three independent power monitoring parameters (air conditioner, microwave oven, and induction heater) representing activity behavior were associated with cognitive impairment. Regarding the prediction models for cognitive impairment, the model with power monitoring data had a better predictive ability (accuracy, 0.82; sensitivity, 0.48; and specificity, 0.96) than the model without power monitoring data (accuracy, 0.76; sensitivity, 0.30; and specificity, 0.95)
[26]. From the findings of these studies, combining data collection by sensors and machine learning are useful to detect patients with MCI.