1. Introduction
The global internet (Internet of Things, IoT) and innovative information and communication technologies (IT/ICT) are already ubiquitous in the social and individual lives of people
[1][2][3][4][5][6]. Among them, a very significant role is played by Extended Reality (XR) and its classic components such as Virtual (VR), Augmented (AR) and Mixed (MR) Reality
[7][8][9][10][11]. There are many indications that these modern technologies (XR, i.e., VR/AR/MR, and 3D printing/scanning, holography, artificial intelligence and machine learning, robotics or online (VR) tele-medicine) will be the basis and determinants of the organization and functioning of contemporary and future generations
[12][13][14][15][16][17]. Most likely, they will increasingly affect everyday life, culture, advertisement, business, military, sports, education, science and medicine
[18][19][20][21][22][23][24].
This is because these technologies inspire ideas and the possible development of contemporary advanced algorithmic sciences, models of computation, data mining or big data science, and modern (bio) (medical) (neuro) information and communication technologies tools
[25][26][27][28]. The findings of neuroscience research focus on the nervous system, especially the brain, its structure and functions, and its importance in both health and disease, simply enabling the implementation of IT/ICT in, for example, sports, education, or basic/clinical neuroscience and computation medicine
[29][30][31][32][33][34][35]. On the other hand, these innovative technologies are becoming an increasingly important element in creating new directions of research, from neurobiology, neurogenetics, neurophysiology, neuropsychology, neuropsychiatry, neuropedagogy, and neurogeriatry, through neurotherapy and neurorehabilitation, to (bio)neuroinformatics
[36][37][38][39][40][41].
2. Basic Features, Importance and Possibilities of Virtual Exercise and Training
Modern fast-developed game-based virtual reality technologies offer many VR environments as a very interesting and attractive form of serious games; this applies to both cognitive tasks and the physical engagement of participants in such VR worlds. The difference between these professional systems and other games of this type is that the exerciser’s activity is not random, but designed and adapted to the individual’s abilities or needs, and in addition the user and the researcher or therapist can control and even modify the individual (personal) training, and track the VR scores on/offline. In addition, databases of tasks and exercises are prepared and tested in collaboration with various specialists and experts, therapists and neuroscientists
[42], including the consideration of the latest finding in neuroscience, such as those on (meta) neuroplasticity, brain asymmetry or mirror neurons phenomena
[43][44][45][46][47][48][49][50].
Computer systems with virtual environments enable the graded difficulty and differentiation of individual tasks, which allows better use of cognitive-motor learning strategies
[51][52][53]. Hence, researchers even suggest that these IT/ICT technologies have advantages over the conventional models of improvement in implementing motor learning principles and applying sensory biofeedback
[54][55][56][57].
Figure 1 presents an example of a menu for selecting the parameters of the Syllables exercise, such as the number of rounds (repetitions), the difficulty level of the task, and the range of movement. Based on the scores obtained by the trainees, the relevant statistics of the measurement parameters are prepared, as well as on/offline partial and summary reports. It is also possible to record actual sessions, and then all materials can be used for further in-depth mathematical and statistical analysis and evaluation of the results and effects obtained. Subsequent degrees of task difficulty involve, among other things, additional cognitive and/or motor elements, and modification of the exercise/test conditions, as well as the addition of distracting elements (distractors). The presence of distractors is significant because it requires greater concentration on the task. For example, studies by Negut’s or Buxbaum’s teams have shown the negative impact of visual and auditory distractors on attentional performance in children with ADHD in the VC test
[58], and USN patients in the VRLAT
[59] or AD patients in the VR coffee task
[60]. Similarly, in
theour modeling studies with healthy adults
[61][62][63][64],
rwe
searchers observed a decrease in performance at the highest difficulty levels of exercise with additional elements such as various distractions or other parameters of training sessions (such as shorter exposure/decision time, the greater number of VR objects or commands/tasks).
Figure 1. The view of the menu of the Syllables exercise parameters, regarding the selection of the number of rounds, level of difficulty, and range of movement in the VR NEUROFORMA system, and also the view of its version with the posturography platform and safety barriers (materials from ouresearchers' lab repository, with permission of Titanis Ltd.).
Based on the results of a number of neuroscientific studies, researchers and clinicians point out that diagnostic tests using the virtual reality environment have high accuracy, sensitivity and specificity in identifying various dysfunctions and/or deficits in examining subjects with serious illnesses such as neurodevelopmental disorders (e.g., attention-deficit hyperactivity disorder), schizophrenia spectrum (e.g., schizophrenia), mood (e.g., depressive disorders), anxiety (e.g., panic and phobias), trauma- and stressor-related disorders (e.g., post-traumatic stress disorder), neurocognitive (e.g., Alzheimer’s and memory cognitive impairment diseases) and neuromuscular disorders (e.g., multiple sclerosis, amyotrophic lateral sclerosis). Moreover, VR environments can be not only a diagnostics tool, but also an effective (neuro) therapeutic method. In addition, VR systems are increasingly being incorporated into the study of natural aging processes and the estimation of effective support in (neuro) geriatric care (e.g., effective cognitive intervention or prevention of falls in the elderly).
For example, the research group of Msika and co-workers
[65], in an interesting study involving healthy young and older adults, proposed using the non-immersive VR REALSoCog task to assess social cognition in normal aging. A total of 27 situations were selected to assess the participants’ social cognitive processes: 11 control/neutral situations and 16 experimental ones. The experimental situations were specifically developed to investigate social norms by displaying conventional and moral transgressions. The researchers found that the REALsoCog task enabled the assessment of several socio-cognitive processes, such as the ability to make moral and conventional judgments, emotional empathy, affective and cognitive ToM (theory of mind), and the propensity to act in a socially appropriate or inappropriate way. The authors noted that the traditional socio-cognitive tasks can evaluate these processes separately and lack ecological validity, and showed that the new virtual approach is an interesting integrative measure of socio-cognitive functioning that better reflects social behavior in daily living.
Equally interesting research is being conducted by the Kourtesis group
[66][67] in the immersive environment of the Virtual Reality Everyday Assessment Lab (VR-EAL) using the HTC Vive HMD, which simulates tasks similar to real life to assess prospective memory, episodic memory, executive functions, and selective visual, visuospatial and auditory attention. It is noteworthy that all VR-EAL tasks significantly correlated with relevant ecologically justified paper-and-pencil tests; therefore, performing the VR tasks can be a predictor of the true real-world functioning of individuals. Moreover, the results showed that age and education did not correlate with scores on VR-EAL and paper-and-pencil tests (participants aged 18–45)
[66]. The gaming experience was strongly and positively associated with the VR experience, with gamers completing the assessment faster than non-gamers, not only in VR tasks but also in the paper-and-pencil tests. The researchers reported that the VR-EAL is the first immersive VR neuropsychological battery with increased ecological validity for the assessment of everyday cognitive functions, offering an enjoyable testing experience without inducing cybersickness. The authors emphasized that the VR-EAL meets the criteria of the National Academy of Neuropsychology (NAN) and American Academy of Clinical Neuropsychology (AACN), solves some methodological problems and provides benefits in neuropsychological testing. The studies demonstrate that the VR-EAL can be an effective, reliable and ecologically valid tool for assessing (everyday) cognitive function in both research and clinical practice.
In turn, Aubin and colleagues
[68] examined how virtual scores of VAP-S relate to the scores of a shopping task in a real-life supermarket. To use VAP-S, participants sat or stood in front of a computer screen and interacted with the virtual environment using a mouse and keyboard. The screen showed instructions and items to buy. During the shopping task, an error was automatically recorded if the participant tried to add an item to the shopping cart that was not on the shopping list or tried to make a purchase more than once. In the next step, the user had to go to checkout and make a payment by clicking on the wallet icon. If the subject did not pay for these purchases, an error was recorded in the test report. The task was completed when the participant left the supermarket with the shopping cart. The authors found that the scores in both environments were generally similar based on the scores of the observational (classical) assessment tool. The researchers noted that when subjects had difficulty with cognitive strategy in the VR supermarket, they also had similar difficulties in the ecological/naturalistic supermarket.
Another team, Zając-Lamparska and colleagues
[69], presented the GRANDYS game with the Oculus Rift DK2 and Vbox 6DOF control pad in healthy and MCI older adults. The GRANDYS system is VR-based cognitive training with four modules: attention, memory, language and visuospatial processing. The storyline of each module scenario consists of tasks inspired by daily life. Each module has three levels of difficulty. The game software included a tutorial module to help participants learn how to operate the game interface. In each module, the participants started at the lowest difficulty level and moved up to a higher level in the next session once they had reached 75% accuracy in the previous one. If accuracy fell below 50%, participants returned to a lower difficulty level. Subjects were accompanied by a training assistant throughout the session. This study showed training progress in older adults, larger in the healthy control. Improvements were observed in visuospatial processing, visual aspects of memory and working memory.
The next proposal of the Virtual Reality Lateralized Attention Test (VRLAT) from Buxbaum’s group
[59] required participants to navigate a virtual, unbranched path, either propelling themselves using a joystick (the participant condition) or passively viewing the surroundings while the examiner navigated the path at a constant speed (the examiner condition). Participants were asked to identify virtual objects on either side of the path and avoid collisions with them. The software signals collisions with virtual objects, with auditory feedback corresponding to obstructed progress. The VRLAT includes three array conditions (simple, complex, and enhanced), each with 20 target objects (10 on each side of the path). The scoring system adapted in VRLAT awarded points based on the quality of the answers given, e.g., one point for items named specifically and correctly and zero points for any other answer. The maximum possible score for each side at each level would therefore be 20 points (a 20-point scale). These researchers emphasized that patients with a wide range of cognitive and physical ability levels could perform the VRLAT. The authors pointed out that the VRLAT is an easy-to-administer, computerized task that can be run on any standard personal computer without the need for specialized equipment. Moreover, it is not only a diagnostics method but also a useful assessment tool in studies evaluating response to treatment or natural recovery processes after central nervous system injures.
TheOur modeling research focuses on functional brain asymmetry in VR NEUROFORMA
[61][62][63][64]. After an initial phase of exercises and learning tasks in this system, healthy subjects practiced the virtual test training sessions at least twice on both hands, the right and left hand, and the same exercises were performed in the full, right and left ranges of motion on a posturographic platform (in random order for each subject). Participants stood in front of a screen with a 3D Kinect camera and saw themselves mirrored among VR objects, and their task was to catch, avoid, track and hit these visuals. The algorithm system awards points for the task performance, estimating scoring distribution as a very good performance in the range of 95–100 points and a good performance in the range of 90–95 points; less than 90 points is not sufficient to advance to a higher level of the exercise. The obtained results indicate that cognitive-motor training in VR with the posturographic platform is a very sensitive and promising tool for recognizing/assessing functional asymmetries of the right-left side of the body, not only in impaired lateralization but also in training sessions of healthy subjects. The primary application of the VR NEUROFORMA system is the role as an innovative and effective therapeutic method that can support conventional (neuro) therapy and/or (neuro) rehabilitation, as demonstrated by Stryla and Banas’ study in ischemic stroke patients
[70]. The researchers reported that the VR environment has a motivating effect on patients and allows them to combine an enjoyable time with effective therapeutic exercises/rehabilitation programs. This computer system (similar to others) offers a variety of interesting virtual exercises combining cognitive and motor tasks in a unique dual-task paradigm with the creation of user training in virtual reality, which supports the process of physical and cognitive training/therapy with dynamic biofeedback in the form of attractive serious mini-games (
Figure 2).
Figure 2. The presentation of examples of various exercises in the VR NEUROFORMA environment, such as (A) the arithmetic operations executive exercise, (B) the opposing boxing motor exercise, (C) the market products cognitive-motor exercise based on the dual task, (D) mirror paths exercise (materials from ouresearchers' lab repository, with the permission of Titanis Ltd.).
Current VR applications indicate an important auxiliary role in improving motor functions, such as joint mobility, muscle strength and endurance, hand-eye coordination, synchronization and control of movement, reaction speed, coordination of opposing movements or balance training with load distribution. Additionally, among the improvements in cognitive functions are effective assistance in focusing attention, inhibiting reflex reactions, exercising memory, improving knowledge management, supporting visual perception, problem-solving, counting and reading, and decision-making processes. In addition, new studies are already emerging showing the beneficial therapeutic effects of not only the classical VR approach, but also the more effective use of mirror VR sessions/training, which are based on the phenomenon of mirror neuron plasticity
[71]. Examples of various proposed virtual tasks/exercises that can impact cognitive and motor functions used in the upper limbs and balance control training are shown in
Figure 2.
To sum up, new digital technologies are a real hope in view of the prevalence of civilization diseases and the rapid aging of modern societies. As already highlighted, an undoubted benefit of virtual technologies is that they can be used in the home environment. This is particularly evident when opportunities for movement or direct contact with specialists/therapists are limited, e.g., such as during the lockdown caused by the COVID-19 pandemic. Many researchers point to the need to test and validate innovative virtual reality environments and tasks for use in basic and clinical neuroscience
[72][73], and thus to formulate recommendations for the design and implementation of VR in clinical screening, diagnosis and therapeutic rehabilitation
[74][75][76][77][78]. It should be noted that virtual reality-based assessment can be a good alternative to classical or computer-based neuropsychological assessment due to its greater ecological validity
[67][79][80][81]. The basis of physiotherapy is systematic physical exercises adapted to both the severity of the disease and the patient’s effort tolerance. Note that the virtual reality environment allows for safe and systematic exercises, taking into account the capabilities of both healthy individuals and patients. Hence, medical versions of virtual reality are dedicated to a very wide range of users, including different groups of patients. There are a great number of VR interfaces and systems that can be helpful in hospitals, rehabilitation centers and other institutions, providing therapy, rehabilitation or health promotion and disease prevention, especially for the elderly, as shown in
Table 1 [18][20][21][22][23][82][83]. Current evidence of the advantages of virtual rehabilitation over traditional exercise is still insufficient, but such training is already a valuable complement to conventional therapy and rehabilitation. Of course, medical applications are of particular importance, raising great hopes in clinical neuroscience, because innovative technologies have huge potential for the unlimited simulation of various situations, individually selected both in terms of exercise/training and the capabilities of each participant.
Table 1.
The summary of VR applications and equipping virtual environments used in basic and clinical neuroscience.