key: cord-0918173-tci7q1h5 authors: Mendelson, Daniel; Thibaudeau, Élisabeth; Sauvé, Geneviève; Lavigne, Katie M.; Bowie, Christopher R.; Menon, Mahesh; Woodward, Todd S.; Lepage, Martin; Raucher-Chéné, Delphine title: Remote group therapies for cognitive health in schizophrenia-spectrum disorders: Feasible, acceptable, engaging date: 2021-12-06 journal: Schizophr Res Cogn DOI: 10.1016/j.scog.2021.100230 sha: 1533246d7a491897839345aaf2e6b81920f4f80d doc_id: 918173 cord_uid: tci7q1h5 Severe cognitive impairments and cognitive distortions are core to schizophrenia-spectrum disorders (SSDs) and are associated with deteriorated social functioning. Despite well-established efficacy of group psychosocial therapies targeting cognitive health in SSDs, dissemination of these programs remains limited. Remote delivery offers a promising strategy for increasing the programs' accessibility. Yet, little research has evaluated group therapies for cognitive health delivered in this way. Thus, we aimed to assess, from participants' and therapists' perspectives, the feasibility, acceptability, as well as levels and process of engagement in a videoconference delivery of group psychosocial therapies for SSD patients' cognitive health. Participants, outpatients, attended Action Based Cognitive Remediation or Metacognitive Training, both adapted for videoconference. Then, participants and therapists completed post-therapy questionnaires. Of the 28 participants attending at least one session, 75% completed more than half of sessions and seven dropped out. Technology did not appear to significantly hinder participation in the programs. All completing participants reported a positive experience with therapy, 67% were not bothered by the distance from the therapist, and 77% trusted that the information shared was kept confidential. Therapist-rated levels of attention M = 7.5/9 (SD = 1.04), participation M = 6.91/9 (SD = 1.32), and social interactions M = 5.31/9 (SD = 1.96) were satisfactory. Nonetheless, participants indicated that they would have appreciated more social interactions with group members. These positive results validate the earliest stage in the implementation process for remote group therapies targeting cognitive health in SSDs. Remote delivery promises to improve access to therapies targeting cognitive health and, ultimately, facilitate functional recovery for SSD patients. Schizophrenia-spectrum disorders (SSDs) are some of the most debilitating mental disorders, imposing tremendous burdens on patients, their families, and communities (Chong et al., 2016; Goeree et al., 2005) . Symptom relapses and deteriorations in social functioning are common in SSDs (Carpenter and Strauss, 1991; Leucht et al., 2003) . Moreover, most with an SSD show substantial cognitive impairments like difficulties in verbal memory, executive functions, and attention (Schaefer et al., 2013) . Additionally, cognitive distortions present in psychosis regularly result in biases and errors in reasoning, as well as misinterpretations when processing information (Dudley et al., 2016; Moritz and Woodward, 2005; Ross et al., 2015) . These cognitive impairments and distortions are core SSD elements, adversely impacting clinical symptoms (Bell et al., 2006) and functioning (Lepage et al., 2014; Sauvé et al., 2020; Sheffield et al., 2018) . Currently, no pharmacotherapy reliably improves cognitive health for people with SSDs (for review see Harvey, 2009; Nielsen et al., 2015; Sheffield et al., 2018) . Given its importance in outcomes, several psychosocial therapies targeting cognitive health have been developed. Cognitive Remediation, a group of interventions using cognitive exercises to improve cognitive health and functional outcomes , is one example. Related psychosocial group therapies, Action Based Cognitive Remediation (ABCR; Bowie, 2018) and Metacognitive Training (MCT; Moritz and Woodward, 2007) are feasible, acceptable (Bowie et al., 2017; Eichner and Berna, 2016) , and effective for improving cognitive health and general functioning when delivered inperson (Bowie et al., 2017 , Eichner and Berna, 2016 , Lejeune et al., 2021 , Penney et al., 2021 , Philipp et al., 2019 , Vita et al., 2021 . Note that feasibility is the capacity of patients to participate in therapy and that of therapists to administer therapy (Proctor et al., 2011) . Acceptability is the subjective impressions of the therapy, i.e., satisfaction and believed appropriateness (Bowen et al., 2009; Proctor et al., 2011) . Despite reliable effectiveness, these interventions are not yet widely implemented in clinical settings. Implementing group psychosocial therapies for cognitive health remotely is promising, remote therapy may reach people unwilling to attend in-person therapy, and/or those in isolated areas (Gentry et al., 2019; Lecomte et al., 2020) . However, little is known about the feasibility or acceptability of remote group therapies for cognitive health in SSD patients. Preliminary work on related remote therapies has evaluated either individual therapies targeting cognitive health (reviewed by Best, 2020) , therapies targeting cognitive health using a combination of in-person groups and individual online homework (Medalia et al., 2021) , or group therapies not specifically targeting cognitive health (Cognitive Behavioural Therapy for psychosis: Lecomte et al., 2020, Acceptance and Commitment Therapy: Wood et al., 2020) . Generally, these studies have found the programs feasible, acceptable, and as efficacious as in-person; similar to what has been found with other populations (see Gentry et al., 2019) . However, Medalia et al. (2021) reported that technological access and abilities were lacking in the SSD population, considerably hindering the feasibility of remote therapy. Another potential concern of the remote setting is engagement, the extent to which participants get involved in therapy (by participating, being attentive, interacting with others; Tetley et al., 2011) . Engagement is important to consider as it may be hindered in remote settings (Casey and Clough, 2016) , and since engagement predicts treatment gains (Barrett et al., 2008; Best et al., 2020; Tetley et al., 2011) . As few studies have assessed remote group therapies targeting cognitive health in the SSD population, we aimed to evaluate, from participants' and therapists' perspectives, the feasibility, acceptability, as well as levels and process of engagement in a videoconference delivery of ABCR and MCT. This investigation is a crucial first step in implementating remote group therapies for SSD patients' cognitive health (Bowen et al., 2009; Pearson et al., 2020; Proctor et al., 2011) . Criteria for participation included being 18 years or older, speak English or French, and be an outpatient followed/treated for a psychotic disorder at a psychiatric hospital. Participants were required to provide an emergency contact and their primary clinician must have considered them symptomatically stable, able to participate in group therapy, able to access and use digital technology, and have access to a private space. Exclusion criteria included current hospitalization, having an intellectual disability, a history of brain trauma, or a neurological disorder. To improve the generalizability of therapists' feedback, eight therapists were involved in this project (for therapist characteristics, see Table 1 ; for characteristics by therapy group see supplemental Table S1 ). No therapist administered both ABCR and MCT. This article presents data from the initial stages of a pragmatic trial regarding the implementation and efficacy of remotely delivered group therapies for cognitive health in SSDs. Reported here are feedback from participants and therapists regarding feasibility, acceptability, and engagement (measures described below). Assessments were completed remotely via teleconferencing or internet questionnaires (using Zoom for Healthcare™ or Castor electronic data capture™, respectively). Participants were compensated with a $25 gift card upon completing each evaluation (see supplemental Fig. S1 for study timeline). Efficacy data from this study are beyond the scope of this article. After pre-therapy assessments, participants chose between ABCR and MCT, both delivered via videoconference (Zoom for Healthcare™). ABCR, developed by Bowie et al. (2017) , targets neurocognitive performance with computerized cognitive exercises, therapist led-group discussions to develop problem-solving strategies, and role-plays to apply cognitive skills and strategies to daily life (for meta-analyses of cognitive remediation see Vita et al., 2021) . Note that in adapting for remote delivery, ABCR's role-plays were modified, and some were replaced with group discussions. MCT, developed by Moritz and Woodward (2007) , targets cognitive biases (e.g., jumping to conclusions, bias against disconfirmatory evidence) via psychoeducation and group exercises to foster reflections about how participants come to conclusions and integrate new information (for narrative review see Moritz et al., 2014 , meta-analyses: Penney et al., 2021 , Philipp et al., 2019 , Sauvé et al., 2020 . Robust evidence supports both programs' efficacy. Sessions occurred twice a week. ABCR sessions lasted 90 min for seven to 8 weeks (14 to 16 sessions, see supplement). MCT sessions lasted 45-60 min for 6 weeks (10 sessions plus introduction and conclusion sessions). If desired, participants could take part in both interventions successively; only data from the first intervention were analyzed. In addition to research participants, 18 patients attended one of the therapy programs offered by this project without consenting to participate in research. Homework exercises were assigned in both programs but were not required. As suggested by an expert working group , both programs were administered by two trained clinicians-including at least one licensed neuropsychologist-and included cognitive exercises, procedures to develop problem-solving strategies, and procedures to promote transfer to real-world functioning. To facilitate attention and foster engagement in the remote setting, feedback from previous cohorts was considered and slight changes were made to the presentation's style and the groups' administration. To keep content nearly identical to that of the respective therapy manuals, changes were made in concert with , 1990 , , Ostergaard et al., 2016 and the Personal and Social Performance scale (PSP; Morosini et al., 2000) , were used to assess SSD symptoms and general functioning, respectively; both measures are clinician-rated. The Cambridge Neuropsychological Test Automated Battery (CANTAB), completed online, was used to measure spatial working memory (SWMBE468), executive functions (OTSPFC), and attention (RVPA'; see Backx et al., 2020) . The California Verbal Learning Test II (CVLT-II) measured verbal memory (Woods et al., 2006; Thiruselvam and Hoelzle, 2020) . All cognitive measurements were age and sex standardized. Diagnoses, age at onset, duration of illness, and medication information were retrieved from consenting participants' medical charts. The number of completers, the percentage of sessions attended, and the number of dropouts-including, when available, reasons for discontinuing therapy-were used as measures of feasibility. Participants completing more than 50% of therapy sessions were considered completers. Dropouts were those who attended at least one session but fewer than half of sessions (as in Bowie et al., 2017 , Connell et al., 2006 . The Acceptability, Usability, Safety, and Impact Questionnaire (adapted from Alvarez-Jimenez et al., 2013) consists of 18 items regarding participants' experiences with the therapy; each item rated from one (strongly disagree) to five (strongly agree). This questionnaire also includes an open-ended item regarding factors that would potentially facilitate interest in therapy. The Satisfaction with Therapy Questionnaire (STQ) assessed acceptability with five subsections: 1) Expectations and perceptions of progress made during therapy; 2) Beliefs of the extent to which they gained cognitive behavioural therapy skills and knowledge from the therapy; 3) Perception of the usefulness of homework; 4) Ratings of therapists' attributes; and 5) Satisfaction with therapy (Lawlor et al., 2017) . Each item is rated on a five-point Likert scale (higher scores reflecting a better evaluation of therapy); each sections' items are averaged representing subscores. Therapists, after every session, and for each participant in attendance, rated participant's levels of attention, participation, and social interactions in therapy. Each type of engagement was rated from one to nine; higher scores indicate more engagement (see Appendix II in supplemental materials). Scores were averaged across sessions then across participants. The eTherapy Attitudes and Process questionnaire (eTAP; Clough et al., 2019a) assessed participants' process of engagement in the remote therapy. The questionnaire, based on the Theory of Planned Behavior (Ajzen, 1991) , measures: perceived behavioural control; behavioural intentions; attitudes towards engaging in remote therapy (behavioural attitudes); and the perceived social pressure to-or not to-engage with therapy (subjective norm). Each construct contains four items rated on a seven-point Likert scale ("strongly disagree" to "strongly agree"); each construct's items are averaged for a subscore. In theory, higher scores indicate a higher likelihood of engaging in therapy. . Each of these measures includes four items rated on a five-point Likert scale from "completely disagree" to "completely agree." Each measure's items were averaged, for the measure's total score. Therapists also completed a Therapist's Questionnaire developed for this study by an experienced psychiatrist/psychologist (DRC) based on the Theoretical Domains Framework-a framework for the implementation of psychosocial therapies (Atkins et al., 2017; Birken et al., 2017; Huijg et al., 2014) . This questionnaire consists of eight items rated on a five-point Likert scale, assessing the feasibility and acceptability of the therapies from the therapist's perspectives. Lastly, the eTherapy Attitudes and Process questionnaire Therapist version (eTAP-T; Clough et al., 2019b) assessed the therapist's process of engagement in therapy. This questionnaire measures domains identical to eTAP (above). Participant and therapist responses were analyzed using descriptive statistics. Responses to the open-ended question were grouped and related to domains relevant to the implementation of remote psychosocial interventions Borghouts et al., 2021) . Chisquared statistics and Mann-Whitney-Wilcoxon ranked tests were used as appropriate to compare groups. Spearman rank correlations were conducted between baseline cognition and measures of engagement as such associations have been previously discussed Bonnín et al., 2021; Thomas et al., 2018) . Twenty-eight participants attended at least one therapy session, see Fig. 1 for CONSORT diagram (Moher et al., 2001) . Table 2 shows participants' pre-therapy characteristics: participants were symptomatically stable (PANSS-6: M = 13.2, SD = 4.4) and had marked difficulties in at least one functioning domain (PSP: M = 52.2, SD = 17.0). Dropouts had a lower age of onset (U(19,7) = 104, p = .03). For baseline characteristics by therapy condition and completion status, see supplemental Tables S2-S3. Results from both ABCR and MCT are described together as these groups did not differ on measures of feasibility, acceptability, or engagement outcomes (see supplemental Tables S4-S10 and Figs. S2-S3). All eight therapists completed questionnaires. Twenty-one participants (75%) completed therapy and seven (25%) dropped out. On average, completers attended 79% of therapy sessions. Fig. 2 shows results for the Acceptability, Usability, Safety, and Impact Questionnaire. Notably, all participants reported having a positive experience with therapy and most (67%) were not bothered by the distance with the therapist. When asked what factors would facilitate interest in these therapies, the most frequent responses were more social interactions (e.g., getting to know other group members better, inperson meetings; 12%); a willingness to learn (12%); therapist training and positive therapist characteristics (e.g., compassion; 9%); holding sessions in the evening (6%); encouraging and congratulating participants (6%); and financial help (e.g., for internet; 6%; see supplement for complete data). On the STQ, participants rated therapist attributes at M = 4.64/5 (SD = 0.37); overall satisfaction M = 4.44/5 (SD = 0.62); expectation and perception of progress M = 4.33/5 (SD = 0.36); usefulness of homework M = 4.33/5 (SD = 0.59); and the extent to which they gained cognitive behavioural therapy skills/knowledge M = 3.53/5 (SD = 0.56). As rated by clinicians, engagement during therapy sessions was generally high: attention M = 7.57/9 (SD = 1.04), participation M = 6.91/9 (SD = 1.32), with social interactions rated somewhat lower M = 5.31/9 (SD = 1.96). Regarding participants' processes of engagement, depicted in Fig. 3a , subjective norms were rated highest M = 6.21/7 (SD = 0.67) and behavioural attitudes rated lowest M = 4.33/7 (SD = 2.05). No correlations between baseline cognitive measures and engagement scores were significant when controlling for multiple comparisons (see supplemental Table S11 ). Therapists rated these remote group therapies highly for the feasibility of intervention M = 4.81/5 (SD = 0.29), acceptability of intervention M = 4.69/5 (SD = 0.42), and appropriateness of the intervention M = 4.41/5 (SD = 0.48). As Fig. 4 illustrates, the therapist questionnaire results were similarly as positive. Moreover, therapists reported that the ability to encourage participants to complete exercises and experience using videoconferencing was helpful. Regarding processes of engagement, therapists rated all processes highly: perceived behavioural control was highest M = 5.68/7 (SD = 0.91) and intention of engaging with therapy was lowest M = 4.74/7 (SD = 1.04), see Fig. 3b . Results of therapist feedback by program administered are reported in supplemental Figs. S4-S5 and Tables S12-S14. This preliminary study suggests that remote group therapies targeting cognitive health in SSDs are feasible and acceptable for participants and therapists. Levels of engagement were also satisfactory in this remote group setting. Participant feedback indicated that increased social interactions with the group members would be appreciated. Despite differences in therapeutic activities, ABCR and MCT did not appear to differ on feasibility, acceptability, nor engagement. Thus, our results suggest that various therapies for SSD patients' cognitive health can be feasible, acceptable, and engaging when delivered remotely. The feasibility of these therapies was clearly established. Attendance and dropout rates were in line with those found for in-person therapy (e. g., Bowie et al., 2017; Eichner and Berna, 2016) . Many reasons for dropping out have been previously reported in studies of in-person therapies (e.g., Jensen et al., 2014) and, therefore, are not inherently linked to technology. Further, while access to technology was a prerequisite for participation in this study, only eight patients of the 60 assessed were excluded for that reason. Indeed, a significant portion of patients appear to have the required technological access and ability to join, participate, and benefit from remote group therapies; a conclusion supported by previous reports (e.g., Lal et al., 2015; Miu et al., 2020; Wood et al., 2020; Young et al., 2020) and a systematic review and metaanalysis by Firth et al. (2016) . While access to technology did not significantly hinder the feasibility of our study of therapies for SSD patient's cognitive health, this was not the case for a previous study by Medalia et al. (2021) . Three characteristics of the present study may explain the difference between our conclusions and those of Medalia et al. (2021) . Firstly, Medalia et al. (2021) 's sample appears older than ours. Older age has been associated with less access to technology (Firth et al., 2016; Young et al., 2020) . Regarding technological ability, while some participants in our study required technological assistance from therapists, no technological problems impeded participants from completing therapy. Second, in the present study, participants successfully attended and completed videoconference therapy and its activities from a computer or smartphone; Medalia et al. (2021) 's study appears to have required access to a computer. Perhaps smartphones are more accessible than laptop or desktop computers, and therefore, improve feasibility of remote therapies (in line with Keshavan, 2020, Young et al., 2020) . While it is plausible that the effectiveness of remote therapy is moderated by the type of technological device used, this remains an open question. Third, it is possible that access to technology differs for SSD populations in Canada and in the United States of America. Lal et al. (2015) , surveying from the same pool of Canadian patients as those recruited for this study, found that the majority had Table 2 Pre-therapy participant characteristics. Completers (n = 21) Dropouts (n = 7) Sex: (male/female) 12/9 3/4 Age: M (SD) 33.9 (11.8) 27.1 (5.9) Age of onset: M (SD) 27.5 (6.7) ‡ 19.0 (8.9)* Duration of illness: M (SD) 7.8 (9.9) ‡ 8.0 (6.9) Chlorpromazine equivalents ( access to a laptop device (70% of their 67 participants), a desktop at home (52%), and at least 44% had access to a smartphone. This latter result is higher than the 35% of psychosis patients with smartphone access reported by Firth et al. (2016) 's review, despite being reported in similar years. Ultimately, the differences between our findings and those of Medalia et al. (2021) 's suggest that feasibility of remote therapies for cognition in the SSD population may depend on participant characteristics, the remote programs' technical requirements, and the country. Participants' feedback regarding these remote therapies was very positive: most were not bothered by the distance from the therapists and would recommend the therapy to others. This feedback resembles that of the homologous in-person group therapies (Eichner and Berna, 2016) . Moreover, we found that group cohesiveness-a key element of group therapy (Lecomte et al., 2016) -could be retained in the remote group setting: most participants felt like the information shared in the remote group remained confidential, with many sharing personal and private experiences in the group. Similarly, therapists found these remote group therapies acceptable, believing them to be useful and important for patients. Such positive impressions are crucial for the implementation and further development of such programs (Atkins et al., 2017; Stirman et al., 2016) . Participants were attentive, participated well, and enjoyed many social interactions during these remote therapies. In line with past findings, we did not find statistically significant associations between baseline cognition and measures of engagement (Bonnín et al., 2021) . To improve engagement, it is important to explore how participants' beliefs regarding therapy can be improved-this process of engagement was rated lowest by participants. Though the non-specific nature of group therapies may dampen beliefs of personal benefits, emphasizing links between therapy and everyday life may improve these beliefs . The participants' and therapists' processes of engagement appeared to be different, the perceptions of both groups should be kept in mind when implementing remote therapies for cognitive health. The results strongly suggest that participants would appreciate more social interactions with the group members: quantitative responses regarding social interactions were often more ambiguous than other responses (e.g., feelings of social connectedness) and social interactions were a common theme when asked what might facilitate interest in these therapies. Previous studies of remote group therapies in this population and others have reported similarly (Gentry et al., 2019 , Wood et al., 2020 , for suggestions regarding adaptations for the remote setting see Dark et al., 2021) . It is worth considering how to foster social interactions in a remote group setting, particularly as increased group cohesion improves engagement in remote therapies (Borghouts et al., 2021) . Further, while the digital medium places different constraints on social interactions, it may also provide new opportunities for promoting interactions (e.g., breakout rooms, instant messages, additional cotherapists, addition of ice-breaker activities, see Appendix I in supplement for our list of changes). The small sample is the chief limitation of this study; a limitation inherent to preliminary studies like these (e.g., Lecomte et al., 2020; Wood et al., 2020) . To use our small sample optimally, we combined therapy programs when interpreting our results. While specific therapy programs may differ on feasibility, acceptability and engagement, our supplemental analyses did not reveal considerable differences between therapy groups on these outcomes. Additional data would strengthen inferences. Second, no comparisons to in-person group programs were conducted in this study. Besides the difficulty of such groups in the context of COVID-19 health restrictions, the broader study that this article reports on was designed to address the implementation and dissemination of these group therapies; comparison to in-person therapies was beyond the study's scope. Thirdly, most of the therapists involved in this study have research interests and may not properly represent those working as full-time clinicians. This may explain, for example, why therapists rated eTAP-T's intention process of engagement as lowest: these therapists may not intend on administering these therapies regularly simply due to their professional interests. This result may say little about the remote therapies themselves. Studies involving more full-time clinicians would help with generalizations to purely clinical settings. Fourthly, the therapist-rated engagement scales have yet to be validated, limiting the interpretation of these scores. However, this clinical tool is based on precise scoring criteria, was developed by group therapists at the Douglas Mental Health University Institute and remains in use for clinical group settings. This preliminary study validates the earliest stage of the implementation process for remote group therapies targeting cognitive health in SSD. In addition to assessing the effectiveness of these remote group therapies, with consideration to the type of technological device used, future work should include larger samples with diverse clinical teams. Further, adapting these therapies for the remote group setting-paying special attention to improving social interactions-is warranted. This work is likely to ensure SSD patients' access to therapies for cognitive health, ultimately facilitating functional recovery. This study was approved by the Douglas Mental Health University Institute Research Ethics Board (IUSMD-20-25). A Knowledge Mobilization grant (3c-KM-56) from Healthy Brains Healthy Lives supported this study. ML is supported by a James McGill Professorship. KL is supported by a Mitacs accelerate fellowship. É T is supported by a Canadian Institutes of Health Research postdoctoral fellowship (#171198). The theory of planned behavior On the HORYZON: moderated online social therapy for long-term recovery in first episode psychosis A guide to using the theoretical domains framework of behaviour change to investigate implementation problems Comparing webbased and lab-based cognitive assessment using the Cambridge neuropsychological test automated battery: a within-subjects counterbalanced study Early withdrawal from mental health treatment: implications for psychotherapy practice The Therapeutic Use of Digital Technologies in Psychosis. A Clinical Introduction to Psychosis Explaining delusions: a cognitive perspective CIHR Knowledge Synthesis: Examining the Efficacy of Evidence-based Psychosocial Interventions for Schizophrenia-spectrum Disorders Delivered Through Virtual Care Motivation and engagement during cognitive training for schizophrenia spectrum disorders Combined use of the consolidated framework for implementation research (CFIR) and the theoretical domains framework (TDF): a systematic review Does cognitive impairment in bipolar disorder impact on a SIMPLe app use? Barriers to and facilitators of user engagement with digital mental health interventions: systematic review How we design feasibility studies Action-based Cognitive Remediation Cognitive remediation for schizophrenia: an expert working group white paper on core techniques Action-based cognitive remediation for individuals with serious mental illnesses: effects of realworld simulations and goal setting on functional and vocational outcomes The prediction of outcome in schizophrenia. IV: eleven-year follow-up of the Washington IPSS cohort Making and keeping the connection: Improving consumer attitudes and engagement in e-mental health interventions Global economic burden of schizophrenia: a systematic review Development of the eTAP: a brief measure of attitudes and process in e-interventions for mental health Development of the eTAP-T: a measure of mental health professionals' attitudes and process towards e-interventions Client initiated termination of therapy at NHS primary care counselling services Adapting evidence-based group therapies following COVID-19 restrictions É chelle de syndrome positif et negatif (PANSS): Manuel de cotation (abrégé) Psychosis, delusions and the "Jumping to Conclusions" reasoning bias: a systematic review and meta-analysis Acceptance and efficacy of metacognitive training (MCT) on positive symptoms and delusions in patients with schizophrenia: a meta-analysis taking into account important moderators Mobile phone ownership and endorsement of "mHealth" among people with psychosis: a metaanalysis of cross-sectional studies Evidence for telehealth group-based treatment: a systematic review The economic burden of schizophrenia in Canada in 2004 Pharmacological cognitive enhancement in schizophrenia Discriminant content validity of a theoretical domains framework questionnaire for use in implementation research Drop-out from a psychodynamic group psychotherapy outpatient unit Technology access and use among young adults with a first episode of psychosis Service user satisfaction with cognitive behavioural therapy for psychosis: associations with therapy outcomes and perceptions of the therapist Group therapy via videoconferencing for individuals with early psychosis: a pilot study Essential Elements of Group Therapy A meta-analysis of cognitive remediation for schizophrenia: efficacy and the role of participant and treatment factors Neurocognition: clinical and functional outcomes in schizophrenia Relapse prevention in schizophrenia with new-generation antipsychotics: a systematic review and exploratory meta-analysis of randomized, controlled trials Feasibility and acceptability of remotely accessed cognitive remediation for schizophrenia in public health settings Teletherapy with serious mental illness populations during COVID-19: telehealth conversion and engagement The CONSORT statement: revised recommendations for improving the quality of reports of parallel-group randomised trials Sowing the seeds of doubt: a narrative review on metacognitive training in schizophrenia Jumping to conclusions in delusional and nondelusional schizophrenic patients Metacognitive training for schizophrenia patients (MCT): a pilot study on feasibility, treatment adherence, and subjective efficacy Development, reliability and acceptability of a new version of the DSM-IV Social and Occupational Functioning Assessment Scale (SOFAS) to assess routine social functioning Second-generation antipsychotic effect on cognition in patients with schizophrenia-a meta-analysis of randomized clinical trials PANSS-6: a brief rating scale for the measurement of severity in schizophrenia Guidance for conducting feasibility and pilot studies for implementation trials In preparation. Efficacy, Maintenance Effects, and Moderators of Metacognitive Training (MCT) for Psychosis: A Systematic Review and Meta-analysis Effectiveness of metacognitive interventions for mental disorders in adults-A systematic review and meta-analysis (METACOG) Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda Jumping to conclusions about the beads task? A meta-analysis of delusional ideation and data-gathering Efficacy of psychological interventions targeting cognitive biases in schizophrenia: a systematic review and meta-analysis The global cognitive impairment in schizophrenia: consistent over decades and around the world Cognitive deficits in psychotic disorders: a lifespan perspective Bridging the gap between research and practice in mental health service settings: an overview of developments in implementation theory and research A systematic review of measures of therapeutic engagement in psychosocial and psychological treatment Refined measurement of verbal learning and memory: application of item response theory to California Verbal Learning Test -Second Edition (CVLT-II) learning trials Targeted cognitive training improves auditory and verbal outcomes among treatment refractory schizophrenia patients mandated to residential care COVID-19, mobile health and serious mental illness Effectiveness, core elements, and moderators of response of cognitive remediation for schizophrenia: a systematic review and meta-analysis of randomized clinical trials Psychometric assessment of three newly developed implementation outcome measures Group teletherapy for first-episode psychosis: piloting its integration with coordinated specialty care during the COVID-19 pandemic The California Verbal Learning Test -second edition: test-retest reliability, practice effects, and reliable change indices for the standard and alternate forms Mobile phone and smartphone use by people with serious mental illness The authors have declared no conflicts of interest regarding this study. ML reports grants from Otsuka Lundbeck Alliance, diaMentis, personal fees from Otsuka Canada, personal fees from Lundbeck Canada, grants and personal fees from Janssen, and personal fees from MedAvante-Prophase, outside of the submitted work. CRB reports grants from Lundbeck, Takeda, and diaMentis, outside of the submitted work. Supplementary data to this article can be found online at https://doi. org/10.1016/j.scog.2021.100230.