Abstract
This study analyzed the effectiveness of an integrative cognitive remediation program (REHACOP) in improving neurocognition, social cognition, creativity, functional outcome, and clinical symptoms in patients with schizophrenia. In addition, possible mediators predicting improvement in functional outcomes were explored. The program combined cognitive remediation with social cognitive training and social and functional skill training over 20 weeks. The sample included 94 patients, 47 in the REHACOP group and 47 in the active control group (occupational activities). Significant differences were found between the two groups in change scores of processing speed, working memory, verbal memory (VM), inhibition, theory of mind, emotion processing (EP), figural creative strengths, functional competence, disorganization, excitement, and primary negative symptoms. A mediational analysis revealed that changes in VM, inhibition, and EP partially explained the effect of cognitive remediation on functional competence improvement. This study provides initial evidence of the effect of integrative cognitive remediation on primary negative symptoms and creativity.
Similar content being viewed by others
Introduction
Schizophrenia is considered to be one of the most disabling diseases in the world1. People who suffer from it have a high level of dependency in multiple functional domains at very early ages2,3, and this functional disability has a major impact on the quality of life of both patients and caregivers or relatives4. In spite of the advances in pharmacological treatment, this has not shown to be effective at improving functional outcome5. Therefore, functional impairment remains the most significant and challenging treatment target in this disorder.
In an attempt to develop interventions that improve functional disability, many studies have focused on hindering factors6,7,8,9. Studies have indicated that deficits in neurocognition and social cognition, as well as clinical symptoms, are the most important factors in predicting functional outcome10,11,12,13,14,15,16. In addition, it has been suggested that other positive personal resources such as creative capacity may have an influence on the functional outcome of people with this disease9,17,18. All these findings suggest that interventions aimed at improving these factors could improve functional outcomes. In the last two decades, various meta-analyses have concluded that cognitive remediation is effective in improving not only neurocognition and social cognition, but also clinical symptoms and functional outcomes of people with schizophrenia19,20,21,22,23.
It has also been shown that combining different kinds of interventions results in greater improvements than the implementation of cognitive remediation alone24. For instance, some studies have combined cognitive remediation with social cognitive training25,26,27,28,29,30,31 and others have employed a combination of cognitive remediation with social skill training32, with functional skill training33, or with both social and functional skill training34,35. There is also evidence of improvement after cognitive remediation combining cognitive training, social cognitive training, and social and functional skill training36. However, the benefits of combining different training forms have only been reported by a heterogeneous and small number of studies. Moreover, some of these studies have suggested that future research should improve several methodological issues that have been raised25,26,27,32,36, including the kind of measures used for the assessment of social cognition, functional outcome, and negative symptoms, as well as the inclusion of an active control group. In addition, owing to the heterogeneity of intervention types, there is no consensus as to how to combine different trainings. Considering that patients with schizophrenia show impairment in numerous domains (e.g., neurocognition, social cognition, social skills, and functional outcome), we expect that combining training in all of these domains would be more effective than, for example, combining only neurocognition and social cognition or neurocognition and social skills training. Furthermore, it is possible that interventions that include social skills training may have an especially beneficial effect on negative symptoms, such as asociality, apathy, or anhedonia37.
Another relevant factor that seems to influence functional outcomes among patients with schizophrenia is creativity9,17. Several studies have shown that the creative performance of patients with schizophrenia is partly explained by multiple neurocognitive and social cognitive domains38,39,40,41. In other words, patients with a better capacity in neurocognition and social cognition (e.g., executive functions, processing speed (PS), or theory of mind (ToM) seem to evidence better creative performance. This suggests that patients who improve cognitive functioning could also improve creative capacity, and so if cognitive remediation improves cognition, it is also possible that this improvement may indirectly improve creative ability in this disease. As far as the authors are aware, only one study42 to date has analyzed whether cognitive remediation could improve creativity in people with schizophrenia, although as this study lacked a patient control group, more research is needed.
Despite the effectiveness of cognitive remediation in improving functional outcomes, still little is known about the mechanisms through which cognitive remediation proves effective43. This is important both for the development of more personalized treatment plans44 and for the proper use of healthcare resources24. Specifically, research on the cognitive changes associated with functional improvement has tended to be scarce and specific associations are still uncertain43. Some of the cognitive domains where changes have been associated with improved functional outcomes include executive functioning45,46, working memory (WM)47, verbal memory (VM)15,48, PS15,47, and emotional management46. Few studies have explored the cognitive changes related to functional improvement after cognitive remediation combined with other trainings15,35,46. For instance, in the study by Eack et al.46, improvement in VM, executive functions, and emotional management mediated the relationship between receiving cognitive remediation and functional outcome improvement. In another study15, change in VM and PS mediated between receiving cognitive remediation and improvement in functional outcome. Moreover, taking into account the results of other cross-sectional studies that have analyzed predictors of functional outcome9,10,11,12,13, it would be expected that improvement in other neurocognitive and social cognitive domains, as well as in clinical symptomatology—mainly negative symptoms— could predict improvement in functional outcome. For example, in the study by Sánchez et al.35, improvement in negative symptoms was associated with improvement in functional outcome after cognitive remediation, although no mediation hypothesis was tested.
Taken together, although cognitive remediation has been shown to improve multiple domains in schizophrenia, few studies have encompassed a combination of training in neurocognition, social cognition, social and functional skills. Moreover, some of these studies have reported limitations in the measures employed for social cognition and negative symptoms25,36. As far as the authors are aware, no study to date has explored whether integrative cognitive remediation can also improve creativity and primary negative symptoms in people with schizophrenia compared with an active control group.
Therefore, the main aim of this study was to analyze the effectiveness of an integrative group-based cognitive remediation program (REHACOP) that combines training in neurocognition, social cognition, and social and functional skills among patients with schizophrenia in multiple domains: neurocognition, social cognition, creativity, functional outcome, and clinical symptoms. An additional aim was to assess the mechanisms through which functional outcome improves after implementing the integrative cognitive remediation program.
Results
Eighty-one patients completed the post-treatment evaluation, resulting in an attrition rate of 13.82% (Fig. 1). Statistical analyses were performed with the 94 randomized patients, following the intention-to-treat (ITT) principle. In addition, per-protocol analyses were also performed only with participants who had completed the post-treatment assessment (Supplementary Tables 1–4). The baseline sociodemographic and clinical characteristics of the REHACOP group and the active control group can be found in Table 1. No significant differences between both groups were found in any of these variables. Statistically significant differences were found between inpatients and outpatients in VM (F = 4.034, p = 0.048), positive symptoms (F = 14.766, p < 0.001), primary negative symptoms (F = 5.031, p = 0.027), disorganization (F = 4.847, p = 0.030), and excitement (F = 4.672, p = 0.033) change scores. Specifically, inpatients showed greater improvement in clinical symptoms, whereas outpatients showed greater improvement in VM. The hospitalization status variable was, therefore, introduced as a covariate in the subsequent analyses with these change scores. Regarding satisfaction with the treatment received, the REHACOP group showed greater overall satisfaction compared to the active control group (U = 772.00, p = 0.010).
Changes in neurocognition, social cognition, and creativity
Significant differences between the REHACOP group and the active control group at baseline were only found in verbal creativity (U = 805.00, p = 0.023), with the REHACOP group showing higher scores in this domain (Table 2).
Statistically significant differences in change scores between the REHACOP group and the active control group were found in PS, WM, VM, inhibition, ToM, EP, and figural creative strengths (Table 4), in which the REHACOP group improved compared with the active control group. The effect size was medium-large for all these measures, except for figural creative strengths, with a small effect size.
Changes in clinical symptoms and functional outcome
Significant differences between the REHACOP group and the active control group at baseline were only found in positive symptoms (t = −2.14, p = 0.035), with the REHACOP group showing higher scores in baseline positive symptoms (Table 3). Analysis of covariance showed statistically significant differences in change scores between the REHACOP group and the active control group in functional competence, primary negative symptoms, disorganization, and excitement (Table 4). The effect size was large for functional outcome, medium for primary negative symptoms and disorganization, and small for excitement.
Mediational model explaining improvement in functional outcome
A mediational analysis was performed on the change score of functional competence. A model with a path analysis was estimated which included only those mediating variables that had had a significant correlation with the change in functional competence: VM, inhibition, EP, and primary negative symptoms. The independent variable was the group (REHACOP group vs active control group). Based on previous literature49,50,51,52, the baseline score of functional competence as well as age and IQ were included to control their possible influence. The model had a good fit, SB χ2 (7, N = 94) = 2.670, Comparative Fit Index (CFI) = 1.000, non-normed fit index (NNFI) = 1.000, and standard residual mean square root (SRMR) = 0.033.
The covariance between the group and baseline score for functional competence, the covariance between the mediating variables, the paths from age and IQ to the mediating and outcome variables, and the path from change score in primary negative symptoms to the outcome variable were not statistically significant. Therefore, in order to obtain a more parsimonious model, a new model was estimated that included only the significant paths, omitting those variables that were not associated with mediators or outcome variables (age, IQ, and change score in primary negative symptoms). The final model obtained is shown in Fig. 2. As can be seen, group (for the REHACOP group) was positively related to changes in VM, inhibition, and EP, and these three mediating variables were positively associated with change in functional competence. In addition, the group was directly and positively associated with a change in functional competence. Finally, baseline functional competence was also directly and negatively associated with a change in functional competence, indicating that a lower baseline score was related to greater change in functional outcome after the intervention. The model also had a good fit, SB χ2 (7, N = 94) = 4.282, CFI = 1.00, NNFI = 1.00, and SRMR = 0.052. Next, the significance of the mediational paths was examined via 5,000 bootstrapping samples. The results revealed that change in VM (1.260; 95% confidence interval [1.260, 1.296]), change in inhibition (0.854; 95% confidence interval [0.838, 0.870]), and change in EP (1.306; 95% confidence interval [1.285, 1.326]) acted as mediating variables between group and change in functional competence.
Discussion
The first aim of this study was to analyze the effectiveness of an integrative group-based cognitive remediation program (REHACOP) that combined training in neurocognition, social cognition, as well as social and functional skills among patients with schizophrenia. In line with previous studies carried out with integrative interventions combining training in neurocognition with social cognition and/or social and functional skills25,27,28,31,34,35,36, patients from the REHACOP group showed significantly greater improvement than patients from the active control group in neurocognition, social cognition, creativity, functional outcome, and clinical symptoms.
As expected and consistent with previous research25,27,28,31,34,35,36, the REHACOP group showed improvements in numerous neurocognitive and social cognitive domains. In particular, very large effect sizes were found in PS, VM, ToM, and emotion processing (EP). The significant results obtained in social cognition are particularly interesting, since they reinforce the findings of previous studies that used different types of measures25,31,36 (e.g., paper-and-pencil tasks instead of videos). Contrary to some previous studies, no significant results were found for cognitive flexibility (CF)25,53,54 and social perception (SP)36,55. Nevertheless, SP has received little attention in studies, and those that have assessed it have done so in different ways.
Regarding creativity, although this capacity was not directly trained in the intervention, we hypothesized that it would be indirectly improved through enhancements in social cognition and neurocognition38,39,40,41. In fact, some of the abilities trained in the REHACOP included novel problem solving and CF, which is closely related to creativity38,40. Significant differences between groups were found only in the change scores of figural creative strengths. Although the REHACOP group showed only a very small improvement in figural creative strengths at post-treatment, the active control group showed a decrease in this creativity variable. The fact that significant results were not found in the other creativity domains could be partly due to the kind of occupational activities that the active control group performed (e.g., handicrafts, painting, and music), which are closely related to creativity. The lack of research makes it difficult to compare these results with other studies. Kiritsis42 found an improvement in creativity after cognitive remediation in patients with schizophrenia, but their results were not compared with a patient control group.
With respect to functional outcome and in line with previous studies carried out with integrative cognitive interventions28,34,36, the REHACOP group showed significantly higher change scores in functional competence, with a very large effect size. Significant results were not found for other functional outcome measures, which could be partly due to the smaller sample size of these measures. In addition, the COVID-19 pandemic may have influenced these results, as some of the social activities that were assessed may have been undermined by lockdown measures, which were especially restrictive when sessions with several intervention groups were held. Other studies that have applied a combined intervention did not find significant results in functional outcome measured through similar dimensions, such as social functioning and hedonic capacity29,30, and so cognitive remediation could benefit from also including direct intervention in social functioning (pro-social activities, recreation, etc.) and hedonic capacity.
With regard to clinical symptoms, the REHACOP group showed a significant reduction in excitement, disorganization, and primary negative symptoms compared to the active control group, with small and medium effect sizes. The improvement in disorganization and negative symptoms in the REHACOP group was in line with some previous studies25,31,35,36, but not with others26,29,34. Nevertheless, it is worth mentioning that these previous studies did not assess primary negative symptoms separately, but rather, primary and secondary symptoms together. The improvement in primary negative symptoms found in this study is an important result that indicates that the effects of cognitive remediation can be generalized to other domains that are not directly trained. It may be possible for the inclusion of training in social skills to have a particular beneficial effect on improving these symptoms37. However, since different cognitive remediation interventions were not compared in this study, this idea should be considered with caution. There is less evidence about the improvement in excitement after cognitive remediation56. The lack of improvement in positive symptoms was congruent with previous studies26,29,34,35,36.
Interestingly, several differences were found between outpatients and inpatients in VM and several clinical symptom change scores. Whereas outpatients benefited more in terms of VM, inpatients showed a greater improvement in clinical symptoms. These differences in change scores cannot be attributed to the baseline scores or to the medication dosage, since baseline significant differences between outpatients and inpatients were only found in excitement and this was entered as a covariate. Regarding the greater improvement in clinical symptoms of inpatients, this may be partly attributed to the hospital care routine that may have contributed to the stabilization of symptoms (e.g., defined schedules for daily activities, healthier lifestyle habits, personal care, etc.)57, in contrast to some outpatients that may have a more disorganized daily routine. The greater improvement found in outpatients in VM is in contrast with results from Cella et al.22, a meta-analysis in which it is suggested that the inpatient may gain greater benefit in cognition compared with community samples. Nevertheless, the sample size of this study does not allow us to draw conclusions as to the influence of hospitalization status.
The second objective of this study was to explore the mediating mechanisms through which integrative cognitive remediation improved functional outcomes. In this study, changes in VM, inhibition, and EP partially mediated the association between receiving the intervention and improvement in functional competence. In addition, lower baseline functional competence scores were related to a greater change in this domain. The finding that the group variable in the mediational model continued to have a direct association with change in functional competence was expected since the REHACOP group included training in functional skills. The few studies that have assessed the association between baseline functioning and functional improvement after cognitive remediation in schizophrenia33,51,52,58,59 have multiple methodological differences (e.g., measurement of functional outcome or type of intervention), which does not allow suitable comparison of results. For instance, among those studies in which a performance-based measure of functional competence was used (e.g., UPSA), Twamley et al.52 found lower baseline functional competence to be related to greater changes in functional competence. However, this study included patients with other disorders in addition to schizophrenia, such as schizoaffective disorder, and the intervention involved compensatory cognitive training rather than a drill and practice cognitive remediation. In contrast, Kurtz51 found that higher baseline functional competence was related to greater functional competence at post-treatment assessment, although this study also included both patients with schizophrenia and schizoaffective disorder who had engaged in computerized cognitive remediation or computer-skills training. Given the great disparity found among these studies, more research is needed44.
Regarding the predicting role of cognitive changes, previous studies have also found changes in VM15,46,48 and executive functions45,46 to predict change in functional outcome. Similar to EP, Eack et al.46 found improvement in emotion management to influence change in functional outcome. Interestingly, in the study by Eack et al.46, changes in VM, executive functions, and emotional management were also the only domains that predicted change in functional outcome. In the present study, change scores in primary negative symptoms did not mediate improvement in functional competence, which was in line with the limited literature available15. In contrast, in the study by Sánchez et al.35, improvement in negative symptoms was associated with improvement in functional outcome after cognitive remediation, although no mediation hypothesis was tested. As a whole, these results suggest that cognitive remediation should emphasize training in VM, executive functions, and EP. Nevertheless, findings of this topic are heterogeneous among studies and therefore, more research is needed before conclusions can be drawn. For instance, in the study by Peña et al.15, executive functions, which were assessed using the same measure as in this study, failed to explain the functional improvement. Nor did EP, although this was measured using a different instrument15.
Several limitations should be considered in this study. First, the sample size may have limited the significance of some results, especially for some functional outcome measures which included a smaller sample size, and therefore, more data had to be imputed. Second, the sample was skewed towards men, although there were no sex differences between both groups. Third, the COVID-19 pandemic caused several patients to drop out and some intervention sessions had to be temporarily suspended, although they were successfully resumed at a later stage. Fourth, the power analysis was only conducted for neurocognitive domains and thus, the rest of the domains should be considered as exploratory outcomes. Fifth, patients were not blind to the treatment condition received, although they were instructed not to mention what type of treatment they would receive or had received during evaluations, to ensure masking of the evaluators. The fact that patients from the active control group were aware of being in the control condition may have influenced the results. Therefore, future studies should try to ensure all participants remain blind to the treatment condition. However, it is worth mentioning that this study ensured that the active group received as much social interaction as the REHACOP group.
Bearing these limitations in mind, these findings support previous evidence of the effectiveness of integrative cognitive remediation in improving multiple domains, while overcoming some methodological issues raised in previous studies25,26,27,32,36. Moreover, the study provides preliminary relevant evidence of the —somewhat slight effectiveness—of integrative cognitive remediation in a creative capacity. In addition, this study shows that integrative cognitive remediation is effective at improving primary negative symptoms. All these results have relevant implications for the design of treatment plans for patients with schizophrenia. A major implication is that these findings provide strong evidence to suggest that integrative cognitive remediation combining training in neurocognition, social cognition, and social and functional skills should be included as a key intervention in the treatment plans for patients with schizophrenia, as this intervention is even capable of ameliorating the primary negative symptoms that are so resistant to pharmacological treatment. A second implication is linked to the future lines of research that these results open up. Considering that creativity is a key factor in the functional outcome of these patients9 and that cognitive remediation has been shown to produce a slight beneficial effect on it, a second step would be to study whether including training in creativity in combination with this integrative cognitive intervention could improve creativity, and in turn increase benefits in terms of functional outcome. Furthermore, it would be interesting for future studies to analyze whether creativity is a valued outcome in patients with schizophrenia. Moreover, future studies could start including training not only in creativity but also in other positive personal resources, such as humor60 or resilience12, within integrative cognitive remediation, to see whether these abilities produce greater benefits. In fact, the inclusion of training in these positive resources could increase motivation and adherence to treatment. Another implication is that findings from this study, in line with those of Eack et al.46, suggest that cognitive remediation should reinforce training in VM, executive functions, and EP with a view to obtaining a greater benefit in terms of functional competence. This reinforces the idea that interventions benefit from combining training in both neurocognition and social cognition. Finally, future studies might benefit from separately analyzing the effect of cognitive remediation in outpatients and inpatients in order to gain a more-detailed understanding of the type of patients who benefit most.
Methods
Participants
The sample consisted of 94 patients diagnosed with schizophrenia who were recruited from the Psychiatric Hospital of Álava and the Mental Health Network in Álava (Spain). All patients had been diagnosed with schizophrenia according to the Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition (DSM-5)61. In addition, all patients showed cognitive impairment. The exclusion criteria were as follows: (a) clinical instability according to the criteria of Csernansky et al.62; (b) relevant modifications in the antipsychotic treatment in the previous 3 months due to an increase in the severity of clinical symptoms; (c) cognitive impairment caused by another disease; (d) diagnosis of an active major affective disorder; (e) being in another specific cognitive remediation program; and (f) Substance Use Disorder (DSM-5)61 within the 3 months before screening. The sample included both outpatients and inpatients. The inpatient study sample consisted of patients hospitalized at a psychiatric rehabilitation unit at the Psychiatric Hospital of Álava who were anticipating imminent hospital discharge to the community setting.
Procedure
The sample size was determined through an a priori power analysis, based on a previous study on REHACOP36, which used the G*Power 3 software63. In order to obtain an effect size of d = 0.77 to see group differences in neurocognition, with 90% power and a 5% level of significance, a sample size of 76 subjects, 38 in each group, was deemed adequate. The rest of the outcome measures were considered to be exploratory.
The study design was a parallel-group randomized trial, forming part of a larger project that has been later expanded to include an additional arm (a group receiving intense physical exercise). The cognitive remediation arm has been completed, while the physical exercise arm is ongoing. Therefore, in the present study, only the cognitive remediation group and the active control group were included. The participants were randomly assigned to each group (Fig. 1), this being done via an online computer-generated randomization system (http://www.randomization.org). Randomization was performed by a Study Coordinator who was not involved in the assessment, study interventions, or statistical analyses. All participants underwent a neuropsychological and psychiatric assessment at pre-treatment and at a 5-month follow-up, with post-treatment evaluation being conducted within the first three weeks following the end of the intervention. All raters were blind to the experimental treatment condition and had no other role in the study (they had no clinical responsibility for the participants during the completion of the study and were not involved in administering the cognitive remediation or occupational activities) that could undermine the trial blinding. Moreover, participants were instructed not to mention what type of treatment they would receive or had received during evaluations.
The study protocol received the approval of the Clinical Research Ethics Committees of the Autonomous Region of the Basque Country in Spain (PI2017044), and the project is registered with clinicaltrials.gov (NCT03509597). All patients participated voluntarily, providing written informed consent to take part, and did not receive any monetary reward for participating in the project.
Measures
The evaluation of neurocognition included measurement of the following domains: CF, PS, WM, VM, and inhibition. All the scores were converted into Z scores based on the study sample and some scores were adjusted to make higher scores indicate better cognitive performance. A composite score was calculated using the number of categories completed and the number of perseverative errors obtained using the Modified Wisconsin Card Sorting Test64 for assessment of CF (Cronbach’s alpha = 0.74). PS was measured by the Symbol-Coding from the Wechsler Adult Intelligence Scale-III (WAIS-III)65 and the Stroop Color and Word Test (SCWT)66 (Word and Color scores) (Cronbach’s alpha = 0.80). The Backward Digit Span from the WAIS-III65 was used for assessment of WM, whereas VM was measured using a composite score obtained from the three learning trials and the delayed recall trial in accordance with the Hopkins Verbal Learning Test Revised (version 2 at baseline and 4 at post treatment)67 (Cronbach’s alpha = 0.84). Finally, the SCWT66 (Word-Color and Interference scores) was used for inhibition (Cronbach’s alpha = 0.84).
Social cognition was measured through ToM, SP, and EP. The Happé Test “Strange Stories Task”68 was used for the assessment of ToM (four different stories at baseline and follow-up). SP was measured through the Social Attribution Task-Multiple Choice (version 2 at baseline and 1 at post-treatment)69, a video of a social drama enacted by geometric figures. EP was evaluated through the Spanish adaptation of the Bell Lysaker Emotion Recognition Test (version 2 at baseline and 1 at post-treatment)70, a video showing an actor portraying different effects.
Creativity was evaluated using two subtests from the Torrance Test of Creative Thinking71,72 (version A at baseline and version B at post-treatment). Figural creativity was assessed with the Picture Completion subtest. The total figural creativity score was calculated by adding scores for originality, elaboration, fluency, resistance to premature closure, the abstractness of titles, and flexibility. In addition, a figural creative strengths score was obtained according to the manual72. The Unusual Uses subtest was used for the assessment of verbal creativity. Total verbal creativity score was calculated by adding scores for the originality, fluency, and flexibility dimensions. A more-detailed explanation of these tests has been provided elsewhere39.
The assessment of functional outcome included the following tests. Functional competence was measured by the Spanish Version of the University of California, San Diego, Performance-Based Skills Assessment73, assessing the performance of everyday activities in different areas. Social functioning was evaluated by means of the short Spanish version of the Social Functioning Scale74, whereas the Spanish adaptation of the Anticipatory and Consummatory Interpersonal Pleasure Scale-Adult version75 was used to assess hedonic capacity for social interactions. General self-efficacy was measured using the Spanish adaptation of the General Self-Efficacy Scale76. Sample size with pre-treatment assessment on the Social Functioning Scale, the Anticipatory and Consummatory Interpersonal Pleasure Scale-Adult version, and the General Self-Efficacy Scale was smaller (n = 42 for the REHACOP group and n = 24 for the active control group).
Regarding clinical symptoms, the Positive and Negative Syndrome Scale77 was employed to measure positive symptoms, disorganization, excitement, and depression, according to the five-factor solution proposed by Wallwork et al.78. As recommended by the NIMH-MATRICS Consensus Statement on Negative Symptoms79,80, primary negative symptoms were assessed using the Brief Negative Symptom Scale81.
Satisfaction with the received treatment was assessed through the Spanish adaptation of the Consumer Reports Effectiveness Scale82.
Premorbid IQ was measured by the Word Accentuation Test83, a Spanish version of the National Adult Reading Test84. Premorbid IQ was estimated using raw scores that were converted using the full-scale IQ of Gomar et al.85.
Handedness was assessed by means of the Edinburgh Handedness Inventory86. The following formula was used to estimate handedness consistency: right−left/right+left.
Intervention
REHACOP is a group-based integrative cognitive remediation program that combines training in neurocognition, social cognition, social skills, and functional skills87. It integrates top–down and bottom–up strategies and includes paper-and-pencil tasks, active group discussions, and role-playing. REHACOP is highly structured, which minimizes the effect of being administered by different therapists. This intervention program includes up to 300 different tasks that are divided into different units and subtypes of abilities. Tasks within each unit are hierarchically ordered according to a subtype of abilities and levels of complexity to ensure a gradual increase in cognitive demand (further explanation about REHACOP is provided elsewhere35).
In this study, sessions were arranged for nine groups of between four and eight patients each, at various centers which formed part of the Mental Health Network in Álava (the Psychiatric Hospital of Álava, the Association of Relative and Patients with Mental Illness from Ayala, and the Community Rehabilitation Service Center). The clinical team who conducted the intervention was trained in administering REHACOP and used the same materials and instructions in all the groups, with the 60-minute sessions being held 3 days a week over 20 weeks. The REHACOP intervention group trained the following units: Attention unit (4 weeks), with training in selective, sustained, alternating, and divided attention; Learning and Memory unit (4 weeks), including visual and verbal learning, recall, recognition memory, WM, and compensatory strategies; Language unit (3 weeks) focused on syntax, vocabulary, grammar, verbal comprehension, verbal fluency, and abstract language; Executive Functions unit (3 weeks), including cognitive and objective planning, novel problem solving, CF, reasoning, categorization, and conceptualization; Social Cognition unit (3 weeks), with training in EP, social reasoning, moral dilemmas, and ToM; Social Skills unit (2 weeks); and Functional Skills unit (1 week), including activities involved in daily living. In addition, several tasks were timed to train PS throughout the first four units.
The active control group carried out occupational group activities (gardening, sewing, handicrafts, painting, and music) with the same duration and frequency as the REHACOP group. In addition, as part of the standard treatment, patients from both the experimental and active control groups received psychoeducation sessions.
If a patient missed one or more sessions for various reasons (e.g., vacation or leave), they received individual training in the contents that had been trained in the group session or alternatively, received feedback through homework afterward. This allowed the patient to meet the objectives of all the training sessions missed. The patient then rejoined the experimental group. Therefore, patients made up all the missed sessions. Moreover, the maximum number of sessions missed permitted was six (2 weeks). Patients who stopped attending sessions and did not return were considered dropouts (please see Fig. 1). Owing to the COVID-19 pandemic, several experimental (n = 13) and active control (n = 2) groups were temporarily discontinued at the beginning of the interventions. Therefore, individual booster sessions were conducted for 2 weeks before intervention groups were resumed.
Data analyses
IBM SPSS version 26.0 (SPSS Inc., Chicago, USA) was used for statistical analyses. Statistical analyses were carried out according to the ITT principle (N = 94). In addition, per-protocol analyses were also performed (Supplementary Tables 1–4) only with those participants who had completed the post-treatment assessment (N = 81). The expectation-maximization algorithm was used to impute missing values. The Little’s Missing Completely at Random test showed that the missing data were missing completely at random (X2 [6412] = 2800.45, p = 1.000). The Shapiro–Wilk test was used to test data for normality. Differences between groups in terms of sociodemographic, cognitive, creative, functional outcome, and clinical variables at baseline were assessed by a two-tailed independent t test or Mann–Whitney U test. Differences between groups in categorical data were analyzed using the Chi-squared (X2) test.
An analysis of covariance was used to analyze the effectiveness of the cognitive remediation, with baseline scores being entered as covariates. Specifically, analysis of covariance was applied to compare change scores (post-treatment−baseline) between the REHACOP group and the active control group on each of the cognitive, creative, functional outcome, and clinical variables, controlling baseline scores. A bootstrapping procedure88 was performed (1000 samples) to obtain adjusted mean differences in change scores, using the Bonferroni adjustment. Effect sizes were calculated using partial eta squared (\({\eta_p^2}\)) and this was considered small (0.01), medium (0.06), or large (0.14)0.89 The significance level was set at 0.05, and all tests were two-tailed.
In order to analyze predictors of functional outcome, Spearman’s Rho and Pearson’s r correlation analyses were first carried out between those neurocognitive, social cognitive, creative, and clinical change variables and functional outcome variables that had shown improvement after the intervention. LISREL 9.290 was then used to perform a path analysis which was conducted to assess the mediating role of these change scores in the relationship between receiving integrative cognitive remediation (vs active control group) and improvement in functional outcome. The robust maximum likelihood method was used, which requires an estimate of the asymptotic covariance matrix of the variances and covariates of the sample, including the scaled χ2 Satorra-Bentler index (SB χ2). The CFI, NNFI, and SRMR were used to evaluate the goodness of fit of the model. According to Hu and Bentler (1999), CFI and NNFI values higher than 0.90 and SRMR values smaller than 0.08 indicate a good fit91.
Reporting summary
Further information on research design is available in the Nature Research Reporting Summary linked to this article.
Data availability
The data that support the findings of this study are available from the corresponding author on reasonable request. The data are not publicly available due to them containing information that could compromise research participant privacy or consent.
References
Vos, T. et al. Global, regional, and national incidence, prevalence, and years lived with disability for 328 diseases and injuries for 195 countries, 1990-2016: a systematic analysis for the Global Burden of Disease Study 2016. Lancet 390, 1211–1259 (2017).
Conus, P., Cotton, S., Schimmelmann, B. G., McGorry, P. D. & Lambert, M. The first-episode psychosis outcome study: premorbid and baseline characteristics of an epidemiological cohort of 661 first-episode psychosis patients. Early Interv. Psychiatry 1, 191–200 (2007).
Harvey, P. D. Disability in schizophrenia: contributing factors and validated assessments. J. Clin. Psychiatry 75, 15–20 (2014).
Fleischhacker, W. W. et al. Schizophrenia-Time to commit to policy change. Schizophr. Bull. 40, S165–94 (2014).
Green, M. F., Horan, W. P. & Lee, J. Nonsocial and social cognition in schizophrenia: current evidence and future directions. World Psychiatry 18, 146–161 (2019).
Galderisi, S. et al. The influence of illness-related variables, personal resources and context-related factors on real-life functioning of people with schizophrenia. World Psychiatry 13, 275–287 (2014).
Bowie, C. R. et al. Predicting schizophrenia patients’ real-world behavior with specific neuropsychological and functional capacity measures. Biol. Psychiatry 63, 505–511 (2008).
Green, M. F. Impact of cognitive and social cognitive impairment on functional outcomes in patients with schizophrenia. J. Clin. Psychiatry 77, 8–11 (2016).
Sampedro, A. et al. The impact of creativity on functional outcome in schizophrenia: a mediational model. npj Schizophr. 7, 1–8 (2021).
Strassnig, M. T. et al. Determinants of different aspects of everyday outcome in schizophrenia: the roles of negative symptoms, cognition, and functional capacity. Schizophr. Res. 165, 76–82 (2015).
Ojeda, N. et al. An outcome prediction model for schizophrenia: a structural equation modelling approach. Rev. Psiquiatr. Salud Ment. 12, 232–241 (2019).
Galderisi, S. G. et al. The influence of illness-related variables, personal resources and context-related factors on real-life functioning of people with schizophrenia. World Psychiatry 13, 275–287 (2014).
Fervaha, G., Foussias, G., Agid, O. & Remington, G. Impact of primary negative symptoms on functional outcomes in schizophrenia. Eur. Psychiatry 29, 449–455 (2014).
Fu, S., Czajkowski, N., Rund, B. R. & Torgalsbøen, A. K. The relationship between level of cognitive impairments and functional outcome trajectories in first-episode schizophrenia. Schizophr. Res. 190, 144–149 (2017).
Peña, J. et al. Mechanisms of functional improvement through cognitive rehabilitation in schizophrenia. J. Psychiatr. Res. 101, 21–27 (2018).
Green, M. F., Kern, R. S., Braff, D. L. & Mintz, J. Neurocognitive deficits and functional outcome in schizophrenia: are we measuring the ‘right stuff’? Schizophr. Bull. 26, 119–136 (2000).
Nemoto, T., Kashima, H. & Mizuno, M. Contribution of divergent thinking to community functioning in schizophrenia. Prog. Neuro-Psychopharmacol. Biol. Psychiatry 31, 517–524 (2007).
Nemoto, T. et al. Cognitive training for divergent thinking in schizophrenia: a pilot study. Prog. Neuropsychopharmacol. Biol. Psychiatry 33, 1533–1536 (2009).
McGurk, S. R., Twamley, E. W., Sitzer, D. I., McHugo, G. J. & Mueser, K. T. A meta-analysis of cognitive remediation in schizophrenia. Am. J. Psychiatry 164, 1791–1802 (2007).
Wykes, T., Huddy, V., Cellard, C., McGurk, S. R. & Czobor, P. A meta-analysis of cognitive remediation for schizophrenia: Methodology and effect sizes. Am. J. Psychiatry 168, 472–485 (2011).
Revell, E. R., Neill, J. C., Harte, M., Khan, Z. & Drake, R. J. A systematic review and meta-analysis of cognitive remediation in early schizophrenia. Schizophr. Res 168, 213–22 (2015).
Cella, M. et al. Cognitive remediation for inpatients with psychosis: a systematic review and meta-analysis. Psychol. Med. 50, 1062–1076 (2020).
Cella, M., Preti, A., Edwards, C., Dow, T. & Wykes, T. Cognitive remediation for negative symptoms of schizophrenia: a network meta-analysis. Clin. Psychol. Rev. 52, 43–51 (2017).
Cella, M., Reeder, C. & Wykes, T. Cognitive remediation in schizophrenia — now it is really getting personal. Curr. Opin. Behav. Sci. 4, 147–151 (2015).
Mueller, D. R., Schmidt, S. J. & Roder, V. One-year randomized controlled trial and follow-up of integrated neurocognitive therapy for schizophrenia outpatients. Schizophr. Bull. 41, 604–616 (2015).
Lindenmayer, J. P. et al. Does social cognition training augment response to computer-assisted cognitive remediation for schizophrenia? Schizophr. Res. 201, 180–186 (2018).
Bechi, M. et al. Combined social cognitive and neurocognitive rehabilitation strategies in schizophrenia: neuropsychological and psychopathological influences on Theory of Mind improvement. Psychol. Med. 45, 3147–3157 (2015).
Fisher, M. et al. Supplementing intensive targeted computerized cognitive training with social cognitive exercises for people with schizophrenia: an interim report. Psychiatr. Rehabil. J. 40, 21–32 (2017).
Fernandez-Gonzalo, S. et al. A new computerized cognitive and social cognition training specifically designed for patients with schizophrenia/schizoaffective disorder in early stages of illness: a pilot study. Psychiatry Res. 228, 501–509 (2015).
Hooker, C. I. et al. Neural activity during emotion recognition after combined cognitive plus social-cognitive training in schizophrenia. Schizophr. Res 139, 53–59 (2012).
Eack, S. M. et al. Cognitive enhancement therapy for early course schizophrenia: effects of a two-year randomized controlled trial. Psychiatr. Serv. 60, 1468–1476 (2009).
Galderisi, S. et al. Social skills and neurocognitive individualized training in schizophrenia: comparison with structured leisure activities. Eur. Arch. Psychiatry Clin. Neurosci. 260, 305–315 (2010).
Bell, M., Zito, W., Greig, T. & Wexler, B. E. Neurocognitive enhancement therapy and competitive employment in schizophrenia: Effects on clients with poor community functioning. Am. J. Psychiatr. Rehabil. 11, 109–122 (2008).
Bowie, C. R., Mcgurk, S. R., Mausbach, B., Patterson, T. L. & Harvey, P. D. Combined cognitive remediation and functional skills training for schizophrenia: effects on cognition, functional competence, and real-world behavior. Am. J. Psychiatry 169, 710–718 (2012).
Sánchez, P. et al. Improvements in negative symptoms and functional outcome after a new generation cognitive remediation program: a randomized controlled trial. Schizophr. Bull. 40, 707–715 (2014).
Peña, J. et al. Combining social cognitive treatment, cognitive remediation, and functional skills training in schizophrenia: a randomized controlled trial. npj Schizophr. 2, 16037 (2016).
Granholm, E., Holden, J., Link, P. C. & Mcquaid, J. R. Randomized clinical trial of cognitive behavioral social skills training for schizophrenia: improvement in functioning and experiential negative symptoms. J. Consult. Clin. Psychol. 82, 1173–1185 (2014).
Sampedro, A. et al. Mediating role of cognition and social cognition on creativity among patients with schizophrenia and healthy controls: revisiting the shared vulnerability model. Psychiatry Clin. Neurosci. 74, 1–7 (2019).
Sampedro, A. et al. Neurocognitive, social cognitive, and clinical predictors of creativity in schizophrenia. J. Psychiatr. Res. 129, 206–213 (2020).
Abraham, A., Windmann, S., McKenna, P. & Güntürkün, O. Creative thinking in schizophrenia: the role of executive dysfunction and symptom severity. Cogn. Neuropsychiatry 12, 235–258 (2007).
Jaracz, J., Patrzała, A. & Rybakowski, J. K. Creative thinking deficits in patients with schizophrenia: neurocognitive correlates. J. Nerv. Ment. Dis. 200, 588–593 (2012).
Kiritsis, P. Preserving the creative advantages of schizophrenia: a quantitative pretest-posttest study on the effects of cognitive remediation training on creativity. (Sofia University, 2018).
Barlati, S. et al. Factors associated with response and resistance to cognitive remediation in schizophrenia: a critical review. Front. Pharmacol. 9, 1–11 (2019).
Seccomandi, B., Tsapekos, D., Newbery, K., Wykes, T. & Cella, M. A systematic review of moderators of cognitive remediation response for people with schizophrenia. Schizophr. Res. Cogn 19, 10060 (2020).
Wykes, T. et al. Developing models of how cognitive improvements change functioning: mediation, moderation and moderated mediation. Schizophr. Res. 138, 88–93 (2012).
Eack, S. M., Geile, M. F. P., Greenwald, D. P., Hogarty, S. S. & Keshavan, M. S. Mechanisms of functional improvement in a 2 year trial of cognitive enhancement therapy for early schizophrenia Mechanisms of functional improvement in a 2-year trial of cognitive enhancement therapy for early schizophrenia. Psychol. Med. 41, 1253–1261 (2011).
Rispaud, S. G., Rose, J. & Kurtz, M. M. The relationship between change in cognition and change in functional ability in schizophrenia during cognitive and psychosocial rehabilitation. Psychiatry Res. 244, 145–150 (2016).
Fiszdon, J. M., Choi, J., Goulet, J. & Bell, M. D. Temporal relationship between change in cognition and change in functioning in schizophrenia. Schizophr. Res. 105, 105–113 (2008).
Seccomandi, B. et al. Can IQ moderate the response to cognitive remediation in people with schizophrenia? J. Psychiatr. Res. 133, 38–45 (2021).
Seccomandi, B. et al. Exploring the role of age as a moderator of cognitive remediation for people with schizophrenia. Schizophr. Res. 228, 29–35 (2021).
Kurtz, M. M., Wexler, B. E., Fujimoto, M., Shagan, D. S. & Seltzer, J. C. Symptoms versus neurocognition as predictors of change in life skills in schizophrenia after outpatient rehabilitation. Schizophr. Res. 102, 303–311 (2008).
Twamley, E. W., Burton, C. Z. & Vella, L. Compensatory cognitive training for psychosis: who benefits? who stays in treatment? Schizophr. Bull. 37, 55–62 (2011).
Wykes, T. et al. Cognitive remediation therapy (CRT) for young early onset patients with schizophrenia: an exploratory randomized controlled trial. Schizophr. Res. 94, 221–230 (2007).
Twamley, E. W., Savla, G. N., Zurhellen, C. H., Heaton, R. K. & Jeste, V. Cognitive training intervention for people with psychosis. Am. J. Psychiatr. Rehabil. 11, 144–163 (2009).
Kurtz, M. M., Gagen, E., Rocha, N. B. F., Machado, S. & Penn, D. L. Comprehensive treatments for social cognitive deficits in schizophrenia: A critical review and effect-size analysis of controlled studies. Clin. Psychol. Rev. 43, 80–89 (2016).
Ahmed, A. O. et al. A randomized study of cognitive remediation for forensic and mental health patients with schizophrenia. J. Psychiatr. Res. 68, 8–18 (2015).
Kalinowska, S. et al. The association between lifestyle choices and schizophrenia symptoms. J. Clin. Med. 10, 165 (2021).
Farreny, A. et al. Baseline predictors for success following strategy-based cognitive remediation group training in schizophrenia. J. Nerv. Ment. Dis. 204, 585–589 (2016).
Bell, M. D., Choi, K. H., Dyer, C. & Wexler, B. E. Benefits of cognitive remediation and supported employment for schizophrenia patients with poor community functioning. Psychiatr. Serv. 65, 469–475 (2014).
Cai, C., Yu, L., Rong, L. & Zhong, H. Effectiveness of humor intervention for patients with schizophrenia: a randomized controlled trial. J. Psychiatr. Res. 59, 174–178 (2014).
American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders. (American Psychiatric Association, 2013).
Csernansky, J. G., Mahmoud, R. & Brenner, R. A comparison of risperidone and haloperidol for the prevention of relapse in patients with schizophrenia. N. Engl. J. Med. 346, 16–22 (2002).
Faul, F., Erdfeldel, E., Lang, A.-G. & Buchner, A. G*Power 3: a flexible statistical power analysis program for the social, behavioral, and biomedical. Behav. Res. Methods 39, 175–191 (2007).
Schretlen, D. Modified Wisconsin Card Sorting Test professional manual. (PAR, 2010).
Wechsler, D. WAIS-III Manual: Wechsler Adult Intelligence Scale-III. (Psychological Corporation, 1997).
Golden, C. J. STROOP: Test de colores y palabras. (2010).
Brandt, J. & Benedict, R. Hopkins Verbal Learning Test– Revised. (Psychological Assessment Resources, 2001).
Happé, F. G. An advanced test of theory of mind: understanding of story characters’ thoughts and feelings by able autistic, mentally handicapped, and normal children and adults. J. Autism Dev. Disord. 24, 129–154 (1994).
Johannesen, J. K., Lurie, J. B., Fiszdon, J. M. & Bell, M. D. The social attribution task-multiple choice (SAT-MC): a psychometric and equivalence study of an alternate form. ISRN Psychiatry 2013, 1–9 (2013).
Bell, M., Bryson, G. & Lysaker, P. Positive and negative affect recognition in schizophrenia: a comparison with substance abuse and normal control subjects. Psychiatry Res. 73, 73–82 (1997).
Torrance, E. P. The Torrance Tests of Creative Thinking — Norms-Technical Manual Research Edition—Verbal Tests, Forms A and B— Figural tests, Forms A and B. (Personnel Press, 1966).
Torrance, E. P. Torrance Tests of Creative Thinking. (Scholastic Testing Service. Inc., 2016).
Garcia-Portilla, M. P. et al. Validation of a European Spanish-version of the University of California performance Skills Assessment (Sp-UPSA) in patients with schizophrenia and bipolar disorder. Schizophr. Res. 150, 421–426 (2013).
Alonso, J. et al. Desarrollo y validación de la versión corta de la Escala de Funcionamiento Social en esquizofrenia para su uso en la práctica clínica. Actas Esp. Psiquiatr. 36, 102–110 (2008).
Gooding, D. C., Fonseca-Pedrero, E., Pérez De Albéniz, A., Ortuño-Sierra, J. & Paino, M. Adaptación española de la versión para adultos de la Escala de Placer Interpersonal Anticipatorio y Consumatorio. Rev. Psiquiatr. Salud Ment. 9, 70–77 (2016).
Sanjuán Suárez, P., Pérez García, A. M. & Bermúdez Moreno, J. Escala de autoeficacia general: Datos psicométricos de la adaptación para población española. Psicothema 12, 509–513 (2000).
Kay, S. R., Fiszbein, A. & Opler, L. A. The positive and negative syndrome scale (PANSS) for schizophrenia. Schizophr. Bull. 13, 261–276 (1987).
Wallwork, R. S., Fortgang, R., Hashimoto, R., Weinberger, D. R. & Dickinson, D. Searching for a consensus five-factor model of the Positive and Negative Syndrome Scale for schizophrenia. Schizophr. Res. 137, 246–250 (2012).
Carpenter, W. T., Blanchard, J. J. & Kirkpatrick, B. New standards for negative symptom assessment. Schizophr. Bull. 42, 1–3 (2016).
Kirkpatrick, B., Fenton, W. S., Carpenter, W. T. & Marder, S. R. The NIMH-MATRICS consensus statement on negative symptoms. Schizophr. Bull 32, 214–219 (2006).
Kirkpatrick, B. et al. The brief negative symptom scale: psychometric properties. Schizophr. Bull. 37, 300–305 (2011).
Feixas, G. et al. Escala de satisfacción con el tratamiento recibido (CRES-4): la versión en español. Rev. Psicoter. 23, 51–58 (2012).
Del Ser, T., Gonzalez-Montalvo, J. I., Martinez-Espinosa, S., Delgado-Villapalos, C. & Bermejo, F. Estimation of premorbid intelligence in Spanish people with the word accentuation test and its application to the diagnosis of dementia. Brain Cogn. 33, 343–356 (1997).
Nelson, H. E. & Willison, J. National Adult Reading Test (NART). (1991).
Gomar, J. J. et al. Validation of the Word Accentuation Test (TAP) as a means of estimating premorbid IQ in Spanish speakers. Schizophr. Res. 128, 175–176 (2011).
Oldfield, R. C. The assessment of handedness: the Edinburgh inventory. Neuropsychologia 9, 97–113 (1971).
Ojeda, N. & Peña, J. REHACOP: programa de rehabilitación neuropsicológica en psicosis. (Parima Digital, 2012).
Efron, B. & Tibshirani, R. An Introduction to the Bootstrap. (Chapman & Hall, 1993).
Cohen, J.Statistical Power Analysis for the Behavioral Sciences. (1988).
Jöreskog, K. & Sörbom, D. LISREL 9.20 for Windows [Computer software]. (2015).
Hu, L. T. & Bentler, P. M. Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct. Equ. Model. 6, 1–55 (1999).
Acknowledgements
This work was supported by the Carlos III Health Institute of the Spanish Ministry of Economy and Competitiveness (PI16/01022); the Department of Education and Science of the Basque Government (Team A) (IT946‐16); the Fundación Tatiana Pérez de Guzmán el Bueno (to AS); and the University of the Basque Country (UPV/EHU) (PIF 19/40 to MTE). The funding agencies had no role in the design, data collection, and analysis, decision to publish, or preparation of the study. The authors thank all the participants and clinical teams who were involved in this study as well as the English language editing service. Our special thanks to Amaia Ortiz de Zarate, Edorta Elizagárate, and Isabel Hervella for all the support in the recruitment and management of patients.
Author information
Authors and Affiliations
Contributions
N.O., N.I.B., J.P., and P.S. designed the study and wrote the protocol. A.S., P.S., N.I.Y., A.G.G., M.T.E., and C.P. performed the clinical and neuropsychological evaluations. A.S. and J.P. managed the literature searches and undertook the statistical analysis. A.S. and J.P. wrote the first draft of the manuscript. All authors contributed to the writing and revision of the manuscript. All authors have approved the final manuscript.
Corresponding author
Ethics declarations
Competing interests
N.O. and J.P. are co-authors and copyright holders of the REHACOP program of cognitive remediation, published by Parima Digital, SL (Bilbao, Spain).
Additional information
Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary information
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Sampedro, A., Peña, J., Sánchez, P. et al. Cognitive, creative, functional, and clinical symptom improvements in schizophrenia after an integrative cognitive remediation program: a randomized controlled trial. npj Schizophr 7, 52 (2021). https://doi.org/10.1038/s41537-021-00181-0
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41537-021-00181-0
- Springer Nature Limited
This article is cited by
-
Reexamination of the relationships among neurocognition, self-defeatist beliefs, experiential negative symptoms, and social functioning in a sample of patients diagnosed with chronic schizophrenia and schizoaffective disorder
BMC Psychiatry (2024)
-
Differential effect of pre and post cognitive skills training program: a study on healthy young children
Smart Learning Environments (2022)