You're using an outdated browser. Please upgrade to a modern browser for the best experience.
Submitted Successfully!
Thank you for your contribution! You can also upload a video entry or images related to this topic. For video creation, please contact our Academic Video Service.
Version Summary Created by Modification Content Size Created at Operation
1 Brianna Fitapelli + 8267 word(s) 8267 2022-01-24 08:31:47 |
2 Roll back entry to make some changes. Brianna Fitapelli -1534 word(s) 6733 2022-01-27 10:09:41 | |
3 Format correct Vicky Zhou -905 word(s) 5828 2022-02-07 03:49:16 | |
4 Format correct Vicky Zhou -904 word(s) 5829 2022-02-07 03:50:15 | |
5 Format correct Vicky Zhou -5 word(s) 5824 2022-02-07 04:11:16 |

Video Upload Options

We provide professional Academic Video Service to translate complex research into visually appealing presentations. Would you like to try it?
No, upload directly Yes

Confirm

Are you sure to Delete?
Yes No
Cite
If you have any further questions, please contact Encyclopedia Editorial Office.
Fitapelli, B. Cognitive Remediation Training in Schizophrenia. Encyclopedia. Available online: https://encyclopedia.pub/entry/18790 (accessed on 05 December 2025).
Fitapelli B. Cognitive Remediation Training in Schizophrenia. Encyclopedia. Available at: https://encyclopedia.pub/entry/18790. Accessed December 05, 2025.
Fitapelli, Brianna. "Cognitive Remediation Training in Schizophrenia" Encyclopedia, https://encyclopedia.pub/entry/18790 (accessed December 05, 2025).
Fitapelli, B. (2022, January 25). Cognitive Remediation Training in Schizophrenia. In Encyclopedia. https://encyclopedia.pub/entry/18790
Fitapelli, Brianna. "Cognitive Remediation Training in Schizophrenia." Encyclopedia. Web. 25 January, 2022.
Cognitive Remediation Training in Schizophrenia
Edit
This entry is adapted from the peer-reviewed paper 10.3390/brainsci12020129

Cognitive Remediation Training (CRT) in schizophrenia has made great strides since its introduction in the 1990s. CRT was developed with the aim of improving the everyday functioning of individuals living with cognitive impairment.

cognitive remediation schizophrenia cognitive functioning cognitive training

1. Introduction

Cognitive impairment is a core feature of schizophrenia. Evidence has shown a strong association between cognitive impairment and functioning in daily life, such as employment, interpersonal relationships, and independent living [1]. Further, individuals with impaired cognitive functioning may also struggle to adequately respond to various forms of rehabilitation that aim to improve self-care, social skills, and job skills [1]. Cognitive deficits can impede nearly all aspects of life and are therefore an important target for further study and treatment [1]. Psychopharmacological interventions generally do not address cognitive dysfunctions, hence the need for alternative interventions [2][3].
Cognitive remediation training (CRT) is an evidence-based treatment that has been shown to produce improvements in cognition in individuals with schizophrenia [1][4]. When CRT is combined with other forms of psychiatric rehabilitation, improvements in functional outcomes have also been shown [4]. According to the Cognitive Remediation Experts Workshop, cognitive remediation therapy for schizophrenia is “a behavioral training-based intervention that aims to improve cognitive processes (attention, memory, executive function, social cognition, or metacognition) with the goal of durability and generalization [5].” However, improvements seen with CRT have varied, due to a number of implementation and measurement factors [1], the targeted patient population [6] and intrinsic limitations in generalizability [5]. There has been a large variability in how CRT is implemented (paper/pencil, computerized, error-free learning), in the different cognitive outcomes targeted, and in different functional and long-term outcomes measured [1][4][5][6]. Another factor contributing to the variability in reported results may be due to the degree that targeted interventions transfer what was learned in CRT to real world cognitive tasks and to the inclusion of meta-cognitive goals in CRT [3][4].
Although there have been a number of methodologically rigorous meta-analyses completed over the course of the past decade regarding CRT in schizophrenia, new data has since emerged that has not been previously analyzed. Moreover, the scope covers numerous aspects of CRT, some of which were not examined in previous meta-analyses that utilized a narrower approach.

2. Advances in Cognitive Remediation Training in Schizophrenia

A total of 26 studies, with 1646 participants, fulfilled all inclusion criteria (see Table 1). Study samples consisted of individuals with a mean age of 37.29 (SD = 6.69). The mean percentage of males was 68.30 (SD = 11.41) and that of females was 31.70 (SD = 11.41). Of the 26 studies, 10 were outpatient studies, 11 included inpatients, and 5 included both inpatients and outpatients. The mean duration of cognitive remediation interventions was 11.23 weeks (SD = 5.35) with a total mean number of sessions of 31.97 (SD = 17.41). The mean duration of individual sessions was 76.77 min (SD = 35.98).

Table 1. Summary of articles herein included.
Study Design Active (A) and Control/Comparator (C) Number of Participants Duration (wks) Target Outcome and Measures Results
d’Amato et al. (2011) [7] Single-blind RCT A: RehaComC: Waitlist 77 7 weeks plus 12-week follow-up Neurocognition: Cogtest Battery Test
Community		 Verbal Learning: d = 1.55
Attention: d = 0.42, d = 0.48
Verbal Memory: d = 0.52
Working Memory: d = 0.41
Functioning: Social Autonomy Scale Functioning: ns
Wolwer et al. (2011) [8] Single-blind RCT A: Training of Affect Recognition
C: CogPack		 38 6 Social Cognition: Pictures of Facial Affect; Geneva Vocal Emotion Expression Stimulus; Theory of Mind Questionnaire; Role-play task Prosodic affect
recognition: d = 0.89
Theory of Mind: d = 1.14
Social Functioning: Social and Occupational Functioning Assessment Scale Social competence: d = 0.75
Social functioning: d = 0.58
Gharaeipour & Scott (2012) [9] Single-blind RCT A: Adapted CRT
C: Group supportive therapy		 42 8 Neurocognition: Rey Auditory Verbal Learning Test; Wisconsin Card Sorting Test; Auditory Consonant Trigrams; Rey-Osterrieth Complex Figure Test; Trail Making Test A and B Cognitive composite: d = 0.37
Attention: p = 0.044
Processing Speed: p = 0.013
Visual Learning and Memory: p = 0.020, p = 0.014
Executive Function: 0.039
Verbal Working Memory: p = 0.023
Verbal Learning: p = 0.020
Lindenmayer et al. (2012) [10] RCT A: CogPack plus Mind Reading: Interactive Guide to Emotions (MRIGE)
C: CogPack		 59 12 Neurocognition: MATRICS Consensus Cognitive Battery Cognitive Composite: d = 0.30
Processing Speed: d = 0.32
Attention/Vigilance: d = 0.26
Working Memory: d = 0.32
Social Cognition: Facial Emotion Identification Test; Facial Emotion Discrimination Test; Mayor-Salovey-Caruso Emotional Intelligence Test Social Cognition: d = 0.73
Emotion
Perception: d = 1.24, d = 1.27
Social Functioning: Personal and Social Performance Scale Social Functioning: d = 0.47
Rass et al. (2012) [11] Three-arm parallel, single-blind RCT A: Posit Science
C: Watch movies/television
C: TAU		 44 10 weeks plus 20-week follow-up Neurocognition: MATRICS Consensus Cognitive Battery Global Cognition: ns
Keefe et al. (2012) [12] Single-blind randomized-controlled feasibility and pilot trial A: Posit Science Brain Fitness
C: Computer games and healthy lifestyles group		 53 12 Neurocognition: MATRICS Consensus Cognitive Battery Global Cognition: ns
Lu et al. (2012) [13] RCT A: Frontal/Executive Program
C: TAU		 126 12 Neurocognition: Wisconsin Card Sorting Test Cognitive
Functioning: p = 0.019
Social Functioning: Scale of Social Skills of chronic schizophrenia Inpatients Functioning: ns
Hubacher et al. (2013) [14] Randomized-controlled pilot trial A: Brainstim
C: Waitlist		 29 4 Neurocognition: Verbal Fluency Test; Selective Reminding Test; Spatial Recall Test; Symbol Digit Modalities Test; Test Battery for Attention Performance; Wechsler Memory Scale-Revisied; Paced Auditory Serial Addition Test Verbal
Working Memory: d = 1.04
Sánchez et al. (2014) [15] Single-blind RCT A: REHACOP
C: Drawing, reading, and constructing objects		 84 12 Neurocognition: Wechsler General Intelligence Scale-III; Hopkins Verbal Learning Test; Semantic and Phonological Fluency Subtests from Barcelona Test Processing speed: d = 0.63
Working Memory: d = 0.88
Verbal Learning: d = 0.88
Global Functioning: Global Assessment of Functioning; Clinical Global Impressions; Disability Assessment Schedule-World Health Organization Social Competence: d = 0.56
Vocational Outcome: d = 0.47
Family Contact: d = 0.50
Mendella et al. (2015) [16] Randomized-controlled pilot trial A: Compensatory Cognitive Training
C: TAU		 27 12 Neurocognition: MATRICS Consensus Cognitive Battery Cognitive
Composite: η2p = 0.350
Processing Speed: η2p = 0.178
Social Cognition: Mayor-Salovey-Caruso Emotional Intelligence Test Social Cognition: η2p = 0.170
Global Functioning: University of California, San Diego Performance Based Skill Assessment-Brief Version Functioning: ns
Kurtz et al. (2015) [17] Single-blind RCT A: CogRem plus Social Skills Training
C: Computer games plus Social Skills Training		 56 23 Neurocognition: Wechsler Adult Intelligence Scale-III/IV; Penn Continuous Performance Test; California Verbal Learning Test Attention
and Working Memory: d = 0.46
Social Functioning: Social Skills Performance Assessment; Quality of Life Scale-Brief Empathy: d = 0.67
Matsuda et al. (2016) [18] Single-blind randomized-controlled feasibility trial A: Japanese Cognitive Rehabilitation Programme for Schizophrenia
C: TAU		 62 12 Neurocognition: Brief Assessment of Cognition in Schizophrenia-Japanese Cognitive Composite: p = 0.047
Verbal Memory: p = 0.008
Social Functioning: Life Assessment Scale for Mentally Ill Functioning: ns
Peña et al. (2016) [19] Single-blind, parallel-group RCT A: REHACOP
C: Occupational group activities		 111 16 Neurocognition: Hopkins Verbal Learning Test; Stroop Test; Wechsler Adult Intelligence Scale-III; Accentuation Reading Test
Based Skill Assessment		 Cognitive
Composite: η2p = 0.138
Social Cognition: Happé Test; Mayer-Salovery-Caruso Emotional Intelligence Test-Spanish; Situational Feature Recognition Test; Attributional Style Questionnaire Theory of Mind: η2p = 0.148
Social Perception: η2p = 0.082
Emotion
Perception: η2p = 0.071
Managing
Emotions: η2p = 0.066
Global Functioning: Global Assessment of Functioning; University of California, San Diego Performance Functional Competence: η2p = 0.154
Global
Functioning: η2p = 0.154
Fan et al. (2017) [20] Single-blind RCT A: Computerized CRT
C: TAU		 23 8 Neurocognition: MATRICS Consensus Cognitive Battery Processing Speed: p = 0.01
Lindenmayer et al. (2018) [21] Single-blind, parallel-group RCT A: CogPack or Brain Fitness plus MRIGE
C: CogPack or Brain Fitness alone		 78 12 Neurocognition: MATRICS Consensus Cognitive Battery Cognitive Composite: d = 2.37
Visual Learning: d = 1.51
Working Memory: d = 1.50
Processing Speed: d = 1.93
Social Cognition: Facial Emotion Identification Test; Facial Emotion Discrimination Test; Dynamic Social Cognition Battery; Penn Emotion Recognition Task Emotion Recognition: d = 0.85
Emotion Perception: d = 1.21
Global Functioning: University of California, San Diego Performance Based Skill Assessment-Brief Version Functioning: ns
Bryce et al. (2018) [22] Parallel, single-blind RCT A: CogPack
C: Computer games		 56 10 weeks plus 12-week follow-up Neurocognition: MATRICS Consensus Cognitive Battery Cognitive Composite: d = 0.68
Global Functioning: Independent Living Skills Survey-Self Report Functioning: ns
Kukla et al. (2018) [23] Single-blind RCT A: Posit Science Brain Fitness and Insight plus Cognitive Behavioral Therapy (CBT)
C: CBT		 75 26 weeks plus 48-week follow-up Neurocognition: MATRICS Consensus Cognitive Battery Cognitive Composite: p = 0.002
Verbal Learning: p = 0.003
Social Cognition: Mayer-Salovery-Caruso Emotional Intelligence Test Social Cognition: p = 0.006
Work Outcome: Work Behavior Inventory Worked more hours: p = 0.02
Cassetta et al. (2018) [24] Three-arm parallel, double-blind RCT A: BrainGymmer: Working Memory
A: BrainGymmer: Processing Speed
C: TAU		 71 10 Neurocognition: N-Back; Maintenance and Manipulation Task; Digit Span; Delis-Kaplan Executive Function System Working Memory: ns
Processing Speed: η2p = 0.107
Executive
Function: η2p = 0.112 and 0.132
Social Cognition: Hinting Task; Geneva Emotion Recognition Test Social Cognition: η2p = 0.146
Global Functioning: Cognitive Failures Questionnaire; University of California, San Diego Performance Based Skill Assessment-Brief Version; Social and Occupational Functioning Assessment Scale Functioning: η2p = 0.139
Contreras et al. (2018) [25] Single-blind RCT A: CogPack plus Visual Processing Training
C: CogPack alone		 20 10 Neurocognition: MATRICS Consensus Cognitive Battery Visual Learning: d = 0.88
Working Memory: d = 0.44
Social Cognition: Mayor-Salovey-Caruso Emotional Intelligence Test Social Cognition: d = 0.50
Ventura et al. (2019) [26] RCT A: Adapted Neuropsychological Educational Approach to Remediation
(NEAR) and Neurocognitive Enhancement Therapy
(NET)
C: Healthy Behaviors Training		 80 24 weeks plus 24 weeks of booster sessions Social Functioning: UCLA Social Attainment Survey Social Functioning: p = 0.05
Jahshan et al. (2019) [27] Three-arm parallel, RCT A: Brain Fitness
A: CogPack
C: Sporcle Computer games		 99 12 Neurocognition: MATRICS Consensus Cognitive Battery Cognitive Composite: ns
Social Cognition: Mayor-Salovey-Caruso Emotional Intelligence Test Social Cognition: p = 0.008
Global Functioning: University of California, San Diego Performance Based Skill Assessment Functioning: ns
Linke et al. (2019) [28] RCT A: CogPack
C: Relaxation training, integration games, and lectures		 66 6 Neurocognition: MATRICS Consensus Cognitive Battery Cognitive Composite: ns
Social Cognition: Mayor-Salovey-Caruso Emotional Intelligence Test Social Cognition: ns
Global Functioning: Global Assessment of Functioning Functioning: ns
Molina et al. (2020) [29] Parallel-group RCT A: BrainHQ
C: Computer games		 42 10–12 Neurocognition: MATRICS Consensus Cognitive Battery Cognitive
Composite: R2 = 0.31
Attention/Vigilance: R2 = 0.18
Working Memory: R2 = 0.17
Sampedro et al. (2021) [30] Parallel, single-blind RCT A: REHACOP
C: Occupational group activities		 94 20 Neurocognition: Modified Wisconsin Card Sorting Test; Wechsler Adult Intelligence Scale-III; Stroop Color and Word Test; Hopkins Verbal Learning Test Processing Speed: η2p = 0.190
Working Memory: η2p = 0.074
Verbal Memory: η2p = 0.166
Social Cognition: Happé Test; Social Attribution Task-Multiple Choice; Bell Lysaker Emotion Recognition Test Theory of Mind: η2p = 0.293
Emotion
Processing: η2p = 0.137
Global Functioning: University of California, San Diego Performance Based Skill Assessment; Social Functioning Scale Functioning: η2p = 0.253
Hatami et al. (2021) [31] Single-blind RCT A: CogPack
C: TAU		 62 4–5 Neurocognition: Cambridge Neuropsychological Test Automated Battery Visual Memory: d = 0.14–0.71
Global Functioning: Global Assessment of Functioning Functioning: p = 0.034
Zhu et al. (2021) [32] Three-arm parallel, single-blind RCT A: CogSMARTA: CogSMART plus Medication Self-Management Skills Training
C: TAU		 72 4 Neurocognition: Brief Assessment of Cognition in Schizophrenia Cognitive
Composite: η2p = 0.275
Verbal Learning: η2p = 0.373
Medication Adherence: Medication Adherence Questionnaire Medication
Adherence: η2p = 0.127

Legend of Abbreviations: wks, Weeks; CRT, Cognitive Remediation Training; RCT, Randomized-Controlled Trial; TAU, Treatment as Usual; d, Cohen’s d Effect Size; ns, Non-Significant; p, Statistical Significance p-value; η2p, Partial eta-Squared; R2, r-squared Coefficient of Determination. Note. Only statistically significant findings are presented in the results column. When effect sizes were not given, p-values were included. Secondary outcome targets and results that were out of the scope were omitted.

 

2.1. CRT Methodologies

CRT programs of late have shifted from the traditional paper-and-pencil format to a computerized format. Out of the 26 studies included, two included a paper-and-pencil format that had dropout rates of 0 [7] and 8 [8]. Twenty-three studies included a computerized CRT program with dropout rates ranging from 0 to 53 [9][10][11][12][13][14][15][16][17][18][19][20][21][22][23][24][25][26][27][28][29][30][31]. One study compared paper-and-pencil and computerized CRT to one another and had 9 total dropouts [32]. It is unclear from these results if computerized CRT programs are superior to paper-and-pencil. In two meta-analyses, Wykes et al. (2011) and Vita et al. (2021) found no effect on cognitive outcomes with computer-assisted CRT programs compared with traditional approaches [6][33].
Both group and individual formats implementing CRT were found from the search. Of the 26 articles, nine studies used an individual format [9][12][13][14][15][23][24][28][30] and 17 used a group format [10][7][11][8][16][17][18][19][20][21][22][32][25][26][27][29][31]. One study [22] had participants complete homework exercises in their own homes, but the CRT program itself was implemented in a group outpatient setting. Group formats may be advantageous considering that fewer staff are needed to facilitate a group of patients compared with an individual format, thereby reducing the staffing cost of CRT administration. Group facilitation, given the proper training and supervision of group leaders, may also benefit the participant’s awareness of others and motivation to complete the task at hand.

Bottom-Up versus Top-Down Approaches

As most CRT programs are considered to use “top-down” approaches, it is not surprising that approximately 75% of the studies included followed this format. Top-down approaches to CRT target higher-order neurocognitive operations, such as working memory, strategy learning, and problem-solving [34]. It is proposed that focusing on these higher order executive functions can induce functional and structural brain changes (i.e., increased activation in the prefrontal cortex) by training more complex abilities such as attention and speed of processing [34]. Bottom-up approaches are less common but are gaining much more attention of late. These neuroplasticity-based interventions help to train perceptual processes while concurrently engaging working memory and attentional operations [35]. Throughout prefrontal-temporo-parietal systems, bottom-up approaches are designed to drive adaptive plastic change. For example, intensive auditory or visual training within CRT can improve perceptual abilities and generate restoration of prefrontal functions and higher-order cognition [34][36]. Examples of studies that have implemented both approaches are further described below.

2.2. Moderating Variables

2.2.1. Bridging Groups

Bridging groups are groups focusing on the transfer and application of cognitive skills learned in CRT to everyday living situations and were implemented in four of the 22 studies. Typically, bridging groups are coordinated by a trained therapist who facilitates the process of the group. In addition to the CRT intervention, two studies [18][21] implemented a separate group session that met once per week for 12 weeks. The groups were designed to facilitate connections between a computerized CRT program and work performance or daily life, and to assist in tracking and setting individualized goals for life and work within the community. These groups included a discussion on what tasks participants found easy or difficult within the CRT program and the strategies that could be used to complete the tasks. Preparatory conversations regarding community living were discussed, as well as how the role of cognition is incorporated into job performance, and compensatory strategies for challenges that often arise within the workplace. Both studies used strategies from the “Thinking Skills for Living Group” method [37][38][39].
The remaining three studies [25][27] that implemented bridging groups utilized the “Neuropsychological Educational Approach to Remediation” (NEAR) to teach participants how to apply the cognitive skills acquired from the CRT program to daily tasks, to promote group identity and to promote socialization. In all the above studies, bridging groups were highly structured with detailed manuals, and were facilitated by trained and qualified staff. Bridging groups have been shown to ameliorate the transfer of cognitive gains from CRT programs into real-world settings, more so than purely drill-and-practice strategies alone This last point is further confirmed by a recent meta-analysis by Vita et al. (2021), which found that CRT conducted with trained therapists is clearly more efficacious than CRT conducted without a trained therapist [33].

2.2.2. The Role of Metacognition in CRT

Rather than a drill-and-practice approach alone, several studies used a drill-and-strategy-based approach to enhance metacognition. Metacognition is cognition of one’s own awareness and understanding of one’s own thought process [4]. CRT that incorporates strategies that help participants understand the abstract principles underlying specific tasks has been shown to be superior in comparison to drill-and-practice strategies alone [4]. For example, one study [18] developed an original CRT program by adapting COGPACK to meet the needs of a Japanese population called JCORES, or the Japanese Cognitive Rehabilitation Program. While participants were partaking in the cognitive exercises, therapists guided the process by asking questions aimed at enhancing metacognition and information processing. Such a strategy-based approach was implemented in several other studies that included performance feedback, encouragement to practice new strategies in future sessions, and compensatory strategies relevant to the individual’s needs [7][8][16][22][25][27][29][30][31]. One study allotted 10 min before and after each CRT session for participants to socially interact and share learning strategies [32]. Although the authors did not follow the stringent procedures of a bridging group, a significant improvement in overall cognition and psychosocial functioning was found.

2.2.3. The Role of Adding Other Rehabilitative Interventions

Many CRT studies were conducted in settings where CRT was embedded in a more comprehensive rehabilitative setting. This embeddedness provides opportunities for participants to practice new cognitive skills and to reinforce their acquisition through practical tasks of daily living [1]. The beneficial moderating effect of embedding CRT into a rehabilitation program has been further confirmed by the recent meta-analysis from Vita et al. (2021) where a significant effect on functioning was found [33]. Further, Bowie et al. (2012) compared functional skills training alone to cognitive remediation alone and to a combination of the two interventions. Only when CRT was provided was there a benefit noted. However, the strongest effect was found when the two therapies were provided together [40]. Similarly, McGurk et al. (2009) examined the effects of adding CRT to a vocational services program and found significantly greater improvements in cognition over 3 months and better work outcomes at a 2-year follow-up in the CRT plus vocational services program compared with vocational services alone [38].
CRT programs have also been augmented by adding other targeted interventions to CRT, such as social skills and social cognition training. Two studies combined CRT with a social cognition training program called MRIGE and compared it to CRT alone, showing significant improvements in emotion perception, emotion recognition, and greater gains in neurocognition as compared to CRT alone [11][21]. Three studies [8][19][29] utilized a cognitive CRT program, REHACOP, which combined cognitive remediation, social cognitive intervention, and functional skills training all embedded within the computerized software. The authors found significant improvements in social cognition, neurocognition, and functioning in the REHACOP group as compared to the control [8][19][29]. Kurtz et al. (2015) augmented a social skills training program with CRT and found significant improvements in attention, working memory, and social functioning, specifically in empathy [17]. These results suggest that the addition of social skills or social-cognitive training with CRT will augment the cognitive domains that contribute to improved social functioning related to the understanding of another person’s emotions, feelings, and perspectives.
Few double-blind studies have examined pharmacological augmentation of CRT, although a case can be made for the synergistic effects of a biological intervention together with a cognitive practice effect [41]. Stimulant medications have the potential to improve attention and processing speed, which in turn may increase participants’ ability to concentrate on cognitive training tasks [41]. Combining cognitive remediation with pharmacological compounds has been termed as Pharmacologically Augmented Cognitive Therapies (PACT) by Swerdlow (2011) [42]. Michalopoulou et al. (2015) reported on a trial using modafinil (200 mg; a wakefulness-promoting medication for narcolepsy) as the pharmacological augmenting agent in 49 participants with chronic schizophrenia in a double-blind, placebo-controlled study [43]. All participants engaged in a concomitant cognitive training program for 10 consecutive days. The primary outcome measure was the performance of the trained tasks, and secondary outcome measures included the MATRICS cognitive battery. There were no differences found between the two groups in terms of cognitive measures [43]. In contrast, Swerdlow et al. (2011) treated patients with schizophrenia with 10 mg of amphetamine or placebo in a double-blind cross-over design before and after 60 min of auditory training [42]. Compared to placebo, amphetamine treatment had a substantial benefit on gains during auditory training, suggesting that session-by-session administration of cognition-enhancing compounds can lead to greater attentional gains with CRT.
Augmentation of CRT with anti-psychotic medications has been tested by Kantrowitz et al. (2016), who reported on a multicenter, rater-blinded, randomized, controlled study of auditory-focused cognitive remediation (BrainFitness) combined with lurasidone (40 to 80 mg daily) of 120 outpatients with schizophrenia [44]. Auditory processing cognitive remediation combined with lurasidone did not lead to differential improvement over lurasidone and nonspecific video games.
More recently, several research compounds with a partial agonistic effect on N-methyl-d-aspartate glutamatergic receptors and alpha-7 nicotinic agonist are being tested as augmentations of CRT, however, results are modest [45].
Finally, CRT has been combined with direct neuro-modulatory interventions, such as concurrent transcranial direct current stimulation (tDCS), to enhance participants’ cognitive gains [46]. Andrews et al. (2011) applied tDCS to the left dorsolateral prefrontal cortex (DLPFC), which has been previously found to improve working memory, in 10 healthy participants. Those who received tDCS plus cognitive training with a working memory task showed a greater improvement in performance compared with sham tDCS and active tDCS alone [46]. These results provide promising data on the benefits of neuro-modulatory interventions with CRT; however, further research is needed for individuals with schizophrenia.

2.3. Efficacy of CRT

Three meta-analyses [1][6][33] found moderate improvements in neuropsychological test performance with 12,106 participants in their mid-thirties undergoing CRT for 12.8 to 16.7 weeks. McGurk et al. (2007) found CRT to be associated with significant improvements in cognitive performance with a medium effect size (d = 0.41), psychosocial functioning (d = 0.36), and symptomatology (d = 0.28) [1]. Wykes et al. (2011) found CRT to have durable effects on global cognition and functioning, yet symptom effects were small and not sustained [6]. Vita et al. (2021) found CRT to be effective on global cognition (d = 0.29) and functioning (d = 0.22) with small effect sizes [33]. When studies provided adjunctive psychiatric rehabilitation and strategic approaches to CRT, psychosocial functioning and cognition showed greater improvements [1][6][33]. However, hours of training, duration, and computer use were not associated with overall cognitive outcomes.
From the analysis, composite scores of baseline-to-endpoint neurocognitive assessments revealed 11 studies with significant but heterogenous improvements, with effects sizes ranging from d = 0.19 to 1.23 [7][11][12][13][16][19][21][22][31]. Two studies did not publish effect sizes, but composite scores were significant when compared to the control group, measured by the Brief Assessment of Cognition in Schizophrenia (BACS; F = 4.11, p = 0.047) [18] and the MATRICS Consensus Cognitive Battery (MCCB; F = 11.50, p = 0.002) [23]. Of the 11 studies, seven administered the full MCCB [11][12][13][16][21][22][23], two utilized the BACS [18][31], and one study measured cognition with the Rey Auditory Verbal Learning Test (RAVLT), Wisconsin Card Sorting Test (WCST), the Rey-Osterrieth Complex Figure Test (ROCF), Trial Making Tests Part A and B (TMT-A/B; a measure from the MCCB), and the Auditory Consonant Trigrams (ACT) [7]. The final study [19] administered the Accentuation Reading Test, the Stroop Test, and three measures from the MCCB: the Hopkins Verbal Learning Test (HVLT) and the Digit Span and Digit Symbol subtests from the Wechsler Adult Intelligence Scale-III (WAIS-III). Lu et al. (2012) administered one cognitive battery, the WCST, and found a statistically significant difference (p = 0.019) between the control and CRT condition [14].
For improvement in specific cognitive domains, five studies showed improvements in verbal learning, with effect sizes ranging from 0.88 to 1.55 [9][8][31]. Two studies reported significant improvements in verbal learning but did not publish effect sizes: (p = 0.020) [7] and (p = 0.003) [23]. Working memory improved in nine studies that reported effect sizes [9][11][8][21][22][24][32][28][29] ranging from 0.32 to 0.88. Five studies found improvements in verbal working memory, with effect sizes ranging from d = 0.52 to 1.04 [9][15][29] and statistically significant outcomes of (p = 0.023) [7] and (p = 0.008) [18]. Visual learning was improved in two studies [21][32] with effect sizes ranging from d = 0.88–1.51. Gharaeiour et al. (2012) also found a significant improvement in visual learning (p = 0.014). Visual memory, measured by the Neuropsychological Test Automated Battery, was improved in one study [30] with effect sizes ranging from 0.14 to 0.71 on various subscales of the measure.
Six studies [11][8][16][21][24][29] reported significant effects on speed of processing ranging from 0.27 to 1.93, and two studies [7][20] reported a statistically significant improvement in speed of processing (p = 0.013 and p = 0.010). Four studies found significant effect sizes on attention ranging from 0.26 to 0.90 [9][11][17][28]. Gharaeipour and Scott (2012) reported a significant improvement in attention assessed by Part A (p = 0.044) and Part B (p = 0.013) of the Trail Making Test (TMT) but did not report effect sizes [7].
In summary, the results showed moderate improvements in overall global cognition. Of the various cognitive domains examined, working memory benefited most from CRT in 35% of studies reporting significant improvements. Speed of processing improved in 23% of the studies included. Attention, verbal learning, and verbal working memory improved in 19% of studies. Visual learning and memory improved in only 0.03–0.07% of studies. Finally, problem solving and reasoning did not improve in any studies included here.

2.3.1. Persistence of Cognitive Improvements

After completion of CRT, five of the 26 studies included longitudinal follow-ups ranging from 3 months [9][12][22][23][25]. All but one study [12] observed sustained improvements in neurocognition. Sustained improvements in functional work outcomes [23] and social cognition [23] and functioning [25] were also shown. Of note, Ventura et al. (2019) implemented CRT for six months and then administered booster sessions for another six months [25]. Booster sessions can be a beneficial strategy to produce larger and more robust improvements in neurocognition and social and functional outcomes over time. There is a great need for future studies to implement longitudinal trials, as the ultimate goal of CRT is to improve cognitive functions in a sustained fashion. In addition, short-term trials may not be adequate to ascertain how cognitive gains will transfer to daily life.

2.3.2. Generalization of Cognitive Improvements to Other Non-Trained Cognitive Functions

An important question is whether CRT generalizes improvements to other non-trained functions, which patients need in their daily lives. These effects appear to be modest, even when only studies are considered, which provided an embedded format within a psychiatric rehabilitation setting. The meta-analysis by Vita et al. (2021) showed overall low effect sizes for non-trained functions, such as global function (d = 0.22), social cognition (d = 0.24), and the lowest effect on overall psychiatric symptoms (d = 0.14) [33]. In general, the best results regarding transfer of skills achieved with CRT are seen when CRT is delivered within a psychiatric rehabilitation setting.

2.3.3. Predictors of Cognitive Response

As with other interventions, not all patients respond to CRT. Predictor studies have identified a number of response predictors. The meta-analysis by Vita et al. (2021) identified fewer years of education and lower global functioning, lower premorbid IQ, and higher symptom severity level at baseline as predictors of better response to CRT [33]. Global functioning, unlike global cognition, is the degree to which the symptoms of schizophrenia affect social, occupational, and psychological functioning. Thus, global functioning may be an important target to measure before CRT. These predictors are to some degree unexpected, given the level of cognitive tasks participants must practice. One explanation may be that there is more room for improvement for patients who start out at a lower level of cognitive functioning. In fact, some studies have found different predictors, such as better baseline speed of processing and attention, better working memory, younger age and better education level predicting better response to CRT [37]. Clearly, a prerequisite for optimal information intake during CRT exercises is the ability to be attentive and to process information [37].

2.3.4. Social Cognition and Social Functioning as Trained Outcomes

Along with the cognitive domains targeted, CRT can be used to augment and target several other outcomes. Specifically, social cognition and social functioning have gained increased attention due to their strong association with real-world outcomes [47].
Social cognition improved in several studies that embedded social cognition training within the CRT program, used an adjunctive social cognition or a social skills training program alongside CRT, or did not target social cognition at all. Three studies used REHACOP, which embeds social cognition training within the CRT program. The authors found moderate to large effect sizes in social cognition (Theory of Mind: η2p = 0.148 [19] and η2p = 0.293 [29], social perception: η2p = 0.082, emotion perception: η2p = 0.071, managing emotions: η2p = 0.066 [19], and emotion processing: η2p = 0.137 [29]). Social cognition was improved in two studies that implemented an adjunctive social cognition training program to CRT [11][21] with effect sizes ranging from 0.73 to 1.27. One study [10] randomized participants to either the Training of Affect Recognition (TAR) program or to CRT and found an improvement in prosodic affect recognition with a large effect size (d = 0.89), ToM (d = 1.14), social competence (d = 0.75), and a medium effect in the Social and Occupational Functioning Scale (d = 0.58). Three studies [16][24][32] that did not include any social cognitive training found significant effects on social cognition with effect sizes ranging from 0.50 to 0.91. Jahshan et al. (2019) also did not include a social cognitive training program but reported a significant improvement in social cognition (p = 0.008) [26]. One study [23] did not report an effect size but observed a significant improvement in social cognition in favor of CRT, plus vocational job training at a 12-month follow-up (p = 0.006). Not only did the CRT group in this study improve in social cognition, but they also found individuals in the CRT condition to work significantly more hours (p = 0.020) at their place of employment [23].
In terms of targeting social functioning, one study showed improvements in functioning for the CRT condition in social competence (d = 0.56) [8]. Kurtz et al. (2015) showed that the CRT group improved more in empathy compared to the control group with a medium effect size (d = 0.67). Measured by the Personal and Social Performance scale, one study [11] found a significant improvement in social functioning with a medium effect size (d = 0.47) and another [19] found a significant improvement in the UCSD Performance-Based Skills Assessment with a η2p = 0.154 effect size. Of note, the REHACOP program has shown improvements in social functioning using a multi-dimensional approach, which went beyond CRT. This integrative program targets cognition, social cognition, and functioning, and reciprocally boosts the effect of treatment. Three studies [8][27][29] implementing REHACOP showed improvements in social functioning (social competence: d = 0.56, vocational outcome: d = 0.47, family contact: d = 0.50 [8], global functioning: η2p = 0.154 [19] and η2p = 0.253 [29], and functional competence: η2p = 0.154 [19]). Given the vast evidence of the benefits of combining different cognitive and social cognition training approaches and the known association between social cognition and functional outcomes [19], integrative programs have the potential to ameliorate the transfer of cognitive gains to real world outcomes.

3. Conclusions

The conclusion of the effectiveness of CRT for the treatment of cognitive symptoms of schizophrenia confirms results reported in three previous meta-analyses [1][6][33]. While the effect sizes of these cognitive results are of medium strength, they are robust and have been repeatedly confirmed. The strongest effects are seen in global cognition and in the cognitive domains of verbal learning and working memory, followed by lesser effects on attention and processing speed and minimal effects on problem solving and reasoning, establishing CRT as a valid treatment for cognitive dysfunction in patients with schizophrenia. The studies included reflect a wide range of patient samples in terms of illness phase, age, and level of function of patients, and in terms of in- vs outpatient status. Herein also found that the effectiveness of CRT is significantly moderated by the four core elements of CRT, proposed by the expert working group [5]: (1) the presence of a trained therapist; (2) repeated practice of cognitive exercises; (3) structured development of cognitive strategies and (4) the use of techniques for transfer to the real world.
The effects of CRT are more robust if conducted with a trained CRT therapist, either on an individual level or in a group setting with a bridging group developing cognitive strategies and facilitating the transfer of learned cognitive skills to everyday life. Cognitive exercises should be practiced over many sessions with increasing levels of difficulty, adapted to the cognitive level of the participant. Results appear not to differ depending on the methodology, which can be paper-and-pencil-based or use a computerized program. However, there are no definite studies to inform on the precise duration of the treatment, nor on the frequency of CRT sessions. All three meta-analyses [1][6][33] find that the type of CRT does not appear to affect the cognitive outcomes of participants. Mechanistically, CRT approaches have been categorized as either top-down or bottom-up approaches. Both types of approaches appear to reach the same cognitive results but differ in terms of their respective outcome measures.
Another core element of CRT is the provision of a structured system of cognitive strategies. CRT studies, which include a focus on strategy development and elements of metacognitive training tend to show better results. Effective CRT studies do include the availability of techniques for the transfer to the real world. It appears that the most effective transfer technique is when CRT is embedded in a psychiatric rehabilitation program, which provides opportunities for participants for the transfer of cognitive skills to everyday functioning. CRT will aid in the gains from psychiatric rehabilitation, which in turn can boost the effectiveness of CRT. Another tool for the transfer of cognitive gains into real world function is the inclusion of bridging groups in CRT. Participants can practice new skills, which may aid the generalizability of CRT to other non-trained functions.
Herein found that results on the predictors of response to CRT were heterogenous. While the meta-analysis of Vita et al. (2021) found unexpectedly that less education and lower global functioning, lower premorbid IQ and higher symptom severity were predictors of better response to CRT [33], some studies have found that younger age and better baseline cognitive function predicted better outcome. The conclusion is that CRT can be beneficial both for more ill inpatients as well as for higher-functioning outpatients.
The effects of CRT on other function domains are weaker, as seen for the effects on social functions and social cognition. These outcomes are evidently more distant to cognitive outcomes and are typically not being trained by CRT. However, one could expect to see an effect by CRT, as cognitive functions are necessary to perceive and correctly identify emotion expressions in others and are required to function in real world settings.
However, effect sizes for social cognition and social function were low. Studies that also included a training intervention on social cognition or on social function achieved a higher effect size. Herein conclude that an effective intervention to address these other domains would be a combination of CRT and a social cognition program.
Interestingly, the role of antipsychotic concomitant medication during CRT is rarely examined. While most participants in all CRT studies are taking antipsychotic medications, there are few studies examining the specific type of antipsychotics used or any dose effects, which may reduce the effects of CRT. There has been interest, however, in the effects of concomitant anticholinergic medications, which are often co-prescribed to treat extrapyramidal symptoms in patients with schizophrenia. Vinogradov et al. (2009) examined the deleterious anticholinergic burden on cognitive functions and found significant negative effects during CRT [35].

Barriers and Future Developments

It is surprising that CRT has not moved more forcefully from its use in research settings to common clinical routine use. Several factors may have limited its full introduction in the US. First, CRT is not a billable intervention by most insurance carriers, as pharmacotherapy and psychotherapy are, making it more difficult for clinicians and mental health providers to be reimbursed for this service. Its limited transfer to real world functions may be another barrier hindering its routine implementation. There is limited data on the durability of the achieved gains in cognitive functions after CRT. It is not clear whether “booster” sessions may be needed after a certain time after completion of CRT. There is a lack of formal education of CRT therapists in training programs for mental health providers, making it more difficult in finding well-trained CRT providers. Finally, there may be less awareness among clinical providers of the cognitive deficits in their patients, as they are dealing with the very visible positive symptoms of schizophrenia, while cognitive deficits are more discrete.
There are promising developments in CRT, which may help its future dissemination to a larger user base. There are several pro-cognitive drugs in development which may eventually provide significant augmentation strategies to CRT. Augmentation effects with tDCS and other neuro-modulatory interventions are being explored. Finally, studies are exploring further bottom-up approaches by training auditory and visual perception in the context of CRT [34][36].

Hereby confirms results reported in previous meta-analyses of the efficacy of CRT for individuals suffering from schizophrenia [1][6][33]. Effect sizes of these cognitive results are of medium strength, with the strongest effects in global cognition and in the cognitive domains of verbal learning and working memory. The effects of CRT are more robust if conducted with a trained CRT therapist, in a group setting with a bridging group or embedded in a general rehabilitation setting, which facilitates the transfer of learned cognitive skills to everyday life. Remaining questions that need further study are the persistence of gains achieved with CRT, the facilitation of transfer of cognitive gains to real world function, and the transfer of CRT from research settings to general clinical practice. A promising future development is the application of synergistic effects of pro-cognitive medications with CRT interventions.

References

  1. d’Amato, T.; Bation, R.; Cochet, A.; Jalenques, I.; Galland, F.; Giraud-Baro, E.; Pacaud-Troncin, M.; Augier-Astolfi, F.; Llorca, P.-M.; Saoud, M.; et al. A randomized, controlled trial of computer-assisted cognitive remediation for schizophrenia. Schizophr. Res. 2011, 125, 284–290.
  2. Wolwer, W.; Frommann, N. Social-cognitive remediation in schizophrenia: Generalization of effects of the training of affect recognition (tar). Schizophr. Bull. 2011, 37 (Suppl. S2), S63–S70.
  3. Gharaeipour, M.; Scott, B.J. Effects of cognitive remediation on neurocognitive functions and psychiatric symptoms in schizophrenia inpatients. Schizophr. Res 2012, 142, 165–170.
  4. Lindenmayer, J.-P.; McGurk, S.R.; Khan, A.; Kaushik, S.; Thanju, A.; Hoffman, L.; Valdez, G.; Wance, D.; Herrmann, E. Improving social cognition in schizophrenia: A pilot intervention combining computerized social cognition training with cognitive remediation. Schizophr. Bull. 2012, 39, 507–517.
  5. Rass, O.; Forsyth, J.K.; Bolbecker, A.R.; Hetrick, W.P.; Breier, A.; Lysaker, P.H.; O’Donnell, B.F. Computer-assisted cognitive remediation for schizophrenia: A randomized single-blind pilot study. Schizophr. Res. 2012, 139, 92–98.
  6. Keefe, R.S.; Vinogradov, S.; Medalia, A.; Buckley, P.F.; Caroff, S.N.; D’Souza, D.C.; Harvey, P.D.; Graham, K.A.; Hamer, R.M.; Marder, S.M.; et al. Feasibility and pilot efficacy results from the multisite cognitive remediation in the Schizophrenia Trials Network (CRSTN) randomized controlled trial. J. Clin. Psychiatry 2012, 73, 1016–1022.
  7. Lu, H.; Li, Y.; Li, F.; Jiao, X.; Shi, W.; Guo, K.; Liu, P. Randomized controlled trial on adjunctive cognitive remediation therapy for chronically hospitalized patients with schizophrenia. Shanghai Arch. Psychiatry 2012, 24, 149–154.
  8. Hubacher, M.; Weiland, M.; Calabrese, P.; Stoppe, G.; Stöcklin, M.; Fischer-Barnicol, D.; Opwis, K.; Penner, I.-K. Working memory training in patients with chronic schizophrenia: A pilot study. Psychiatry J. 2013, 2013, 154867.
  9. Sánchez, P.; Peña, J.; Bengoetxea, E.; Ojeda, N.; Elizagárate, E.; Ezcurra, J.; Gutiérrez, M. Improvements in negative symptoms and functional outcome after a new generation cognitive remediation program: A randomized controlled trial. Schizphr. Bull. 2014, 40, 707–715.
  10. Mendella, P.D.; Burton, C.Z.; Tasca, G.A.; Roy, P.; St. Louis, L.; Twamley, E.W. Compensatory cognitive training for people with first-episode schizophrenia: Results from a pilot randomized controlled trial. Schizophr. Res. 2015, 162, 108–111.
  11. Kurtz, M.M.; Mueser, K.T.; Thime, W.R.; Corbera, S.; Wexler, B.E. Social Skills training and computer-assisted cognitive remediation in schizophrenia. Schizophr. Res. 2015, 162, 35–41.
  12. Matsuda, Y.; Morimoto, T.; Furukawa, S.; Sato, S.; Hatsuse, N.; Iwata, K.; Kimura, M.; Kishimoto, T.; Ikebuchi, E. Feasibility and effectiveness of a cognitive remediation programme with original computerised cognitive training and group intervention for schizophrenia: A multicentre randomised trial. Neuropsychol. Rehabil. 2016, 28, 387–397.
  13. Peña, J.; Ibarretxe-Bilbao, N.; Sánchez, P.; Iriarte, M.B.; Elizagarate, E.; Garay, M.A.; Gutiérrez, M.; Iribarren, A.; Ojeda, N. Combining social cognitive treatment, cognitive remediation, and functional skills training in schizophrenia: A randomized controlled trial. NPJ Schizophr. 2016, 2, 16037.
  14. Fan, F.; Zou, Y.; Tan, Y.; Hong, L.E.; Tan, S. Computerized cognitive remediation therapy effects on resting state brain activity and cognition in Schizophrenia. Sci. Rep. 2017, 7, 4758.
  15. Lindenmayer, J.-P.; Khan, A.; McGurk, S.R.; Kulsa, M.K.; Ljuri, I.; Ozog, V.; Fregenti, S.; Capodilupo, G.; Buccellato, K.; Thanju, A.; et al. Does social cognition training augment response to computer-assisted cognitive remediation for schizophrenia? Schizophr. Res. 2018, 201, 180–186.
  16. Bryce, S.D.; Rossell, S.L.; Lee, S.J.; Lawrence, R.J.; Tan, E.J.; Carruthers, S.P.; Ponsford, J.L. Neurocognitive and self-efficacy benefits of cognitive remediation in schizophrenia: A randomized controlled trial. J. Int. Neuropsychol. Soc. 2018, 24, 549–562.
  17. Kukla, M.; Bell, M.D.; Lysaker, P.H. A randomized controlled trial examining a cognitive behavioral therapy intervention enhanced with cognitive remediation to improve work and neurocognition outcomes among persons with schizophrenia spectrum disorders. Schizophr. Res. 2018, 197, 400–406.
  18. Cassetta, B.D.; Tomfohr-Madsen, L.M.; Goghari, V.M. A randomized controlled trial of working memory and processing speed training in schizophrenia. Psychol. Med. 2018, 49, 2009–2019.
  19. Contreras, N.A.; Tan, E.J.; Lee, S.J.; Castle, D.J.; Rossell, S.L. Using visual processing training to enhance standard cognitive remediation outcomes in schizophrenia: A pilot study. Psychiatry Res. 2018, 262, 494–499.
  20. Ventura, J.; Subotnik, K.L.; Gretchen-Doorly, D.; Casaus, L.; Boucher, M.; Medalia, A.; Bell, M.D.; Hellemann, G.S.; Nuechterlein, K.H. Cognitive remediation can improve negative symptoms and social functioning in first-episode schizophrenia: A randomized controlled trial. Schizophr. Res. 2019, 203, 24–31.
  21. Jahshan, C.; Vinogradov, S.; Wynn, J.K.; Hellemann, G.; Green, M.F. A randomized controlled trial comparing a “bottom-up” and “top-down” approach to cognitive training in schizophrenia. J. Psychiatr. Res. 2019, 109, 118–125.
  22. Linke, M.; Jankowski, K.S.; Wichniak, A.; Jarema, M.; Wykes, T. Effects of cognitive remediation therapy versus other interventions on cognitive functioning in schizophrenia inpatients. Neuropsychol. Rehabil. 2019, 29, 477–488.
  23. Molina, J.L.; Thomas, M.L.; Joshi, Y.B.; Hochberger, W.C.; Koshiyama, D.; Nungaray, J.A.; Cardoso, L.; Sprock, J.; Braff, D.L.; Swerdlow, N.R.; et al. Gamma oscillations predict pro-cognitive and clinical response to auditory-based cognitive training in schizophrenia. Transl. Psychiatry 2020, 10, 405.
  24. Sampedro, A.; Peña, J.; Sánchez, P.; Ibarretxe-Bilbao, N.; Gómez-Gastiasoro, A.; Iriarte-Yoller, N.; Pavón, C.; Tous-Espelosin, M.; Ojeda, N. Cognitive, creative, functional, and clinical symptom improvements in schizophrenia after an integrative cognitive remediation program: A randomized controlled trial. NPJ Schizophr. 2021, 7, 52.
  25. Hatami, S.; Mirsepassi, Z.; Sedighnia, A.; Tehranidoost, M.; Masoomi, M.; Sharif, V. A short course computer-assisted cognitive remediation in patients with schizophrenia spectrum disorders: A randomized clinical trial. Basic Clin. Neurosci. 2021, 12, 551–562.
  26. Zhu, X.; Song, H.; Chang, R.; Chen, B.; Song, Y.; Liu, J.; Wang, K. Combining compensatory cognitive training and medication self-management skills training, in inpatients with schizophrenia: A three-arm parallel, single-blind, randomized controlled trial. Gen. Hosp. Psychiatry 2021, 69, 94–103.
More
© Text is available under the terms and conditions of the Creative Commons Attribution (CC BY) license; additional terms may apply. By using this site, you agree to the Terms and Conditions and Privacy Policy.
Upload a video for this entry
Information
Subjects: Medicine, Research & Experimental
Contributor MDPI registered users' name will be linked to their SciProfiles pages. To register with us, please refer to https://encyclopedia.pub/register : Brianna Fitapelli
View Times: 1.0K
Revisions: 5 times (View History)
Update Date: 07 Feb 2022
Table of Contents
    1000/1000
    Hot Most Recent
    Notice
    You are not a member of the advisory board for this topic. If you want to update advisory board member profile, please contact office@encyclopedia.pub.
    OK
    Confirm
    Only members of the Encyclopedia advisory board for this topic are allowed to note entries. Would you like to become an advisory board member of the Encyclopedia?
    Yes
    No
    Academic Video Service
    Feedback