key: cord-0067066-zu8l613z authors: Hayward, Mark; Berry, Katherine; Bremner, Stephen; Jones, Anna-Marie; Robertson, Sam; Cavanagh, Kate; Gage, Heather; Berry, Clio; Neumann, Suzanne; Hazell, Cassie M; Fowler, David; Greenwood, Kathryn; Strauss, Clara title: Increasing access to cognitive–behavioural therapy for patients with psychosis by evaluating the feasibility of a randomised controlled trial of brief, targeted cognitive–behavioural therapy for distressing voices delivered by assistant psychologists: the GiVE2 trial date: 2021-08-19 journal: BJPsych Open DOI: 10.1192/bjo.2021.983 sha: 08637a12ded47f3e6dfc570def92b5057d71f117 doc_id: 67066 cord_uid: zu8l613z BACKGROUND: Cognitive–behavioural therapy (CBT) is recommended for all patients with psychosis, but is offered to only a minority. This is attributable, in part, to the resource-intensive nature of CBT for psychosis. Responses have included the development of CBT for psychosis in brief and targeted formats, and its delivery by briefly trained therapists. This study explored a combination of these responses by investigating a brief, CBT-informed intervention targeted at distressing voices (the GiVE intervention) administered by a briefly trained workforce of assistant psychologists. AIMS: To explore the feasibility of conducting a randomised controlled trial to evaluate the clinical and cost-effectiveness of the GiVE intervention when delivered by assistant psychologists to patients with psychosis. METHOD: This was a three-arm, feasibility, randomised controlled trial comparing the GiVE intervention, a supportive counselling intervention and treatment as usual, recruiting across two sites, with 1:1:1 allocation and blind post-treatment and follow-up assessments. RESULTS: Feasibility outcomes were favourable with regard to the recruitment and retention of participants and the adherence of assistant psychologists to therapy and supervision protocols. For the candidate primary outcomes, estimated effects were in favour of GiVE compared with supportive counselling and treatment as usual at post-treatment. At follow-up, estimated effects were in favour of supportive counselling compared with GiVE and treatment as usual, and GiVE compared with treatment as usual. CONCLUSIONS: A definitive trial of the GiVE intervention, delivered by assistant psychologists, is feasible. Adaptations to the GiVE intervention and the design of any future trials may be necessary. Approximately 300 000 people in England and Wales have a diagnosis of psychosis. 1 The overall annual cost of psychosis in England has been estimated at £11.8 billion. 2 Cognitive-behavioural therapy (CBT) for psychosis is recommended by the National Institute for Health and Care Excellence (NICE) for the treatment of psychosis, 3 but is offered to only 26% of patients with psychosis. 4 One reason for this lack of access is limited resources, 5 as CBT for psychosis is resource-intensive in its duration (minimum of 16 sessions recommended by NICE) and delivery (by highly trained therapists, typically CBT therapists or clinical psychologists), and NICE has recommended research to explore how resources could be reduced. 3 Our response has been twofold: first, we conducted a meta-analysis suggesting that CBT for psychosis could effectively treat the symptoms of psychosis when offered in fewer than 16 sessions; 6 and second, consistent with recent developments favouring the targeting of single psychosis symptoms, 7 we developed a brief, CBT-informed intervention for distressing voice hearing experi-ences ('Guided self-help CBT intervention for voices', referred to as GiVE). GiVE is a structured and workbook-based intervention 8 derived from our self-help book, 9 and has the potential to be delivered by a cost-effective and widely available workforce of psychology graduates (assistant psychologists). We initially evaluated GiVE when delivered by clinical psychologists, with promising results. 10 Our next step was to explore the efficacy of GiVE when delivered by assistant psychologists. Before seeking funding for a definitive randomised controlled trial (RCT), we needed to demonstrate the feasibility of engaging patients, clinicians, assistant psychologists and service managers in the delivery of such a trial. The aims of this feasibility study were to assess the acceptability of GiVE to clinicians and patients, and the ability of assistant psychologists to adhere to therapy and clinical supervision protocols. An estimate of the standard deviation of outcomes was also sought to facilitate a sample size calculation for use within a definitive trial. The published study protocol 11 is briefly described here. This was a feasibility RCT with a three-arm, parallel-group design and 1:1:1 allocation, comparing GiVE and treatment as usual (the study intervention) to supportive counselling and treatment as usual (the control intervention) to treatment as usual alone, recruiting across two sites, with blinded post-treatment and follow-up assessments. Clinical outcomes were assessed at baseline (pre-randomisation, time point 0), 16 weeks (post-intervention, time point 1) and 28 weeks (follow-up, time point 2; this assessment was only offered to participants who reached the 28-week post-randomisation milestone before the end of the data collection period). A mixedmethods process evaluation captured participants', clinicians' and assistant psychologists' experiences of the study and the interventions, and their views on the facilitators and barriers to the implementation of GiVE within routine psychosis care pathways. Findings from the process evaluation will be reported in a separate paper. There were minimal changes to the design after trial commencement, and details are reported in the study protocol. 11 The trial was registered with the ISRCTN registry (number 16166070) on 5 February 2019 (http://www.isrctn.com/ISRCTN16166070). Participants were recruited over 12 months from community mental health teams and early intervention in psychosis services at two sites within the UK National Health Service (NHS): Sussex Partnership NHS Foundation Trust and Pennine Care NHS Foundation Trust. Inclusion criteria were: aged 16 years or older in contact with NHS mental health services and under the care of a consultant psychiatrist; experiencing current voice hearing (a score of 1 or more ['At least once a day'] on item 1 ['How frequently did you hear a voice or voices?'] of the Hamilton Program for Schizophrenia Voices Questionnaire; HPSVQ); 11 distressed by hearing voices (operationalised by participants scoring at least 8 out of 16 on the negative voice impact scale of the HPSVQ); 12 meeting DSM-5 research criteria for schizophrenia spectrum or other psychotic disorders (assessed by the Structured Clinical Interview for DSM-5 disorders 13 ); and willing and able to provide written informed consent. Exclusion criteria were: established organic cause for distressing voices (e.g. brain disease or injury); primary diagnosis of substance misuse; currently detained in hospital under a section of the Mental Health Act; have completed a full course (minimum of 16 h) of CBT for psychosis during the past year; currently participating, or confirmed to participate, in another interventional study in which the participant is receiving an intervention that utilises psychological therapy; English speaking to the degree that the participant is unable to fully understand and answer assessment questions and give informed consent; severe intellectual disability (assessed with the Test of Premorbid Functioning -UK) 14 ; and deemed to be at immediate and serious risk to self or others. Following a referral to the research team by a patient's clinician, a study research assistant contacted the potential participant to discuss the study and arrange a consent and eligibility meeting. A patient information sheet was given to the potential participant at least 24 h before the meeting. If participants consented to take part in the study, they completed a baseline (time point 0) assessment at a separate meeting. The authors assert that all procedures contributing to this work comply with the ethical standards of the relevant national and institutional committees on human experimentation and with the Helsinki Declaration of 1975, as revised in 2008. All procedures involving patients were approved by an NHS Research Ethics Committee (London -Surrey, reference number 18/LO/ 2091). Written informed consent was obtained from all participants. The GiVE intervention was delivered by an assistant psychologist and followed a workbook 8 that was based upon the Overcoming Distressing Voices self-help book. 9 Participants were given a copy of both the workbook and the self-help book at the commencement of therapy, and asked to read both and complete the workbook with the support of the assistant psychologist in sessions. They also had the opportunity to access the 'Choices' mobile phone application, a publicly available app with interactive elements linked to the content of the self-help book. GiVE consists of three core modules: beliefs about the self, beliefs about voices and relationships with voices and others. There is also an introductory session on coping with voices and a final session to consolidate learning and identify next steps. Assistant psychologists delivered GiVE within eight 1-h sessions, over a maximum of 16 weeks. The supportive counselling intervention followed the therapy protocol that was used by assistant psychologists in the full RCT of AVATAR therapy. 15 It was delivered over the same number and duration of sessions as GiVE, with the aim of equalising the duration of total therapist contact time across both arms. Supportive counselling offered a supportive and non-judgemental space for the discussion of topics and issues determined by the participant. The supportive counselling therapy protocol contained specific guidance for the assistant psychologist on how to respond to participant disclosure of distressing voices in a manner that did not provide specific intervention strategies. The intervention was delivered within eight 1-h sessions, over a maximum of 16 weeks. The same assistant psychologists delivered GiVE and supportive counselling, to minimise therapist effects. Treatment as usual was provided by the usual care team and typically included medication management and support and monitoring, with psychological therapies offered occasionally. Assistant psychologists received a 5-day training in GiVE and supportive counselling (1 introductory day, 2 days on GiVE and 2 days on supportive counselling), delivered by clinical psychologists with experience of CBT for psychosis and an experienced counselling psychologist, respectively. Weekly clinical supervision was provided by these clinical psychologists for the GiVE intervention, with a mixture of 1:1 and group supervision offered face to face or remotely. The counselling psychologist offered remote group supervision for the supportive counselling intervention on a weekly basis. Therapeutic drift and contamination were minimised by the use of highly detailed therapy protocols and close supervision of the assistant psychologists by experienced psychologists. Adherence to therapy protocols was assessed through assistant psychologists completing a checklist at the conclusion of each session. The competence of assistant psychologist delivery of the interventions was assessed by the rating of a random selection of session recordings by independent experts. GiVE sessions were rated by a CBT expert, using the Cognitive Therapy Rating Scale for Psychosis. 16 Supportive counselling sessions were rated by a supportive counselling expert, using the Counselling Adherence Scale. 17 Outcomes Feasibility outcomes prespecified in the published study protocol were as follows: number of care coordinators willing to refer their patients, number (percentage) of referred patients found to be eligible, number (percentage) of consenting participants retained within the study who offer full data-sets, proportion of nonmissing items for each variable, number (percentage) of consenting participants within the GiVE and supportive counselling arms who reach the point of therapy 'exposure' (attend at least six out of eight therapy sessions), and assistant psychologist adherence to therapy protocols and clinical supervision protocols. For primary outcomes for a definitive trial, two candidate measures were used to assess voice-related distress at time points 0, 1 and 2: the five-item distress scale of the Psychotic Symptom Rating Scales (PSYRATS auditory hallucinations subscale) 18 ('amount of negative voice content', 'degree of negative voice content', 'amount of distress', 'intensity of distress' and 'controllability of voices') and the four-item negative voice impact scale of the HPSVQ 11 ('How bad are the things voices say to you?', 'How much do the voices interfere with your daily activities?', 'How distressing are the voices that you hear?' and 'How bad do the voices make you feel about yourself?'). A range of secondary outcomes were assessed at time points 0, 1 and 2, and evaluated mental health problems commonly experienced by people with psychosis, including anxiety and depression (Hospital Anxiety and Depression Scale 19 ) and paranoia (Paranoid Thoughts Scale 20 ); variables that have been associated with the impact of voice hearing, such as negative beliefs about the self (Self Scale of the Brief Core Schema Scale) 21 , negative beliefs about voices (Beliefs About Voices Questionnaire -Revised 22 ) and negative relating to voices (Voice and You 23 ) and other people (Persons Relating to Others Questionnaire 24 ); and a range of personal and social recoveryoriented outcomes (psychological recovery [CHOICE-SF], 25 the positive impact of voices [Voice Impact Scale] (Strauss C, personal communication, 2018), engagement in meaningful activity [Work and Social Adjustment Scale] 26 and social functioning [Social and Occupational Functioning Scale] 27 ). We assessed participants' expectations for therapy following the commencement of the intervention between time point 0 and time point 1 (Therapy Credibility and Expectancy Questionnaire) 28 and the quality of the therapeutic relationships at time point 1 (Scale to Assess Therapeutic Relationships). 29 Health economic outcomes were measured by the EQ-5D-5L, 30 the Client Service Receipt Inventory 31 and the Short Form 12 Version 2. 32 Following recommendations for designing feasibility trials that aim to detect a small-to-medium (Cohen's d = 0.2-0.5) standardised effect size (where the definitive trial will be designed with 90% power and two-sided 5% significance), this study aimed to recruit 90 participants (30 per treatment arm). [33] [34] [35] [36] Randomisation and blinding Following the completion of the baseline assessment, participants were randomly allocated by the trial manager using the Sealed Envelope online service (https://www.sealedenvelope.com/), incorporating stratification by site (Sussex or Pennine) and type of service (community mental health team or early intervention in psychosis) by using random block lengths and 1:1:1 allocation. The online randomisation procedure was set up and tested by the trial statistician. The research assistants were blind to the allocation sequence and remained so for all future assessments. Measures were put in place to maintain blinding, and 'blind' awareness and education was promoted throughout the study. The trial statistician was also blind to participant allocation throughout the analysis. Reported breaks in blinding were recorded. Outcome assessments were re-blinded by re-allocating blind research assistants to collect and score participant responses. Participant characteristics, feasibility outcomes and baseline clinical outcomes were summarised with descriptive statistics such as count, mean, s.d., median, 25% and 75% quartiles, interquartile range, minimum and maximum. Analyses were of available cases, following the intention-to-treat principle. All clinical outcomes were summarised at time points 0, 1 and 2 for each treatment arm. Primary and secondary outcomes were modelled with linear mixed models (to allow for covariate adjustment), with random effects for individuals and fixed effects for treatment group (treatment as usual, GiVE and supportive counselling), time (time points 1 and 2) and the group×time interaction with the baseline score, site and service type entered as covariates. Contrasts were used for the following comparisons: GiVE versus treatment as usual, GiVE versus supportive counselling, and supportive counselling versus treatment as usual at time points 1 and 2. 95% and 75% confidence intervals for all estimates of unstandardised between-group effect sizes were calculated. For each contrast we were interested in whether the minimum clinically important difference (MCID) was contained in the confidence interval. The MCIDs are two points for the HPSVQ negative voice impact scale and three points for the PSYRATS distress scale. Standardised effect sizes (Cohen's d) were also calculated and interpreted as follows: 0.2 = small, 0.5 = medium and 0.8 = large effect. 33 As this was a feasibility study, Pvalues from the models are not reported. The level of missing data was summarised at each time point, but not treated. All analyses were conducted in Stata (version 16 for Mac). 37 Adverse event reporting and harms Any unfavourable and unintended sign, symptom or illness that developed or worsened during the period of the study was classified as an adverse event, whether or not it was considered to be related to the study treatment and was either expected or unexpected. Serious adverse events (SAEs) were those considered to be life-threatening. The number (events and individuals) and nature of all events (adverse events and SAEs) reported to blind and unblind members of the research team were recorded. All SAEs were reviewed for causality and expectedness by an independent rater and the sponsor's representative. The onset of the pandemic in March 2020 required all assessments and therapy sessions to be delivered remotely by phone or video call. At time point 1, 21 out of 68 (31%) assessments were completed remotely. For time point 2, this figure was 15 out of 46 (33%) assessments. Regarding intervention delivery, 11 participants who were receiving sessions face to face at the onset of the pandemic were offered remote sessions (seven for GiVE and four for supportive Increasing access to CBT for psychosis counselling), and a further two participants (one for GiVE and one for supportive counselling) received all sessions remotely. A total of 151 patients were referred to the study over a 12-month period between 13 February 2019 and 24 February 2020. A total of 101 (66.9%) patients were screened, of whom 79 (78.2%) consented, completed a time point 0 assessment and were randomised as follows: 27 to treatment as usual, 26 to supportive counselling and 26 to GiVE. Time point 1 and time point 2 assessments were completed between July 2019 and July 2020. See Fig. 1 for CONSORT diagram illustrating the flow of participants through the study. The study was concluded as planned, on 30 August 2020. The final 6 months of the study were conducted during the COVID-19 pandemic. Table 1 . Aim 1: to assess the acceptability to clinicians of the GiVE intervention delivered by assistant psychologists (will they refer patients to the study?) Patients were referred to the study by 102 different clinicians (50 from the Pennine site and 52 from the Sussex site). Of the 101 patients who consented and were assessed for eligibility, 83 (82%, 95% CI 73.3-89.1%) were found to be eligible. The views of some of the referring clinicians were explored within the process evaluation and will be reported in a separate paper. We randomised 79 (88%) of our target of 90 participants. Of those randomised, 68 (86%) participants completed time point 1 assessments and 46 (74%) participants who reached the 28-week postrandomisation milestone completed time point 2 assessments. In terms of therapy exposure, 23 (88%) participants attended at least six sessions in the GiVE arm (the predetermined level of exposure), and this was the case for 19 (73%) participants in the supportive counselling arm. The experiences of some of the participants who received the GiVE and supportive counselling interventions were explored within the process evaluation and will be reported in a separate paper. Aim 3: to assess the ability of assistant psychologists to adhere to the therapy and clinical supervision protocols All attended sessions of GiVE were self-rated for adherence by assistant psychologists, using therapy checklists, and adherence was indicated for 83% of items. There was some variability by therapist (range 72-97%) and by session (range 70-88%). For supportive counselling, all but one attended session was rated by assistant psychologists and adherence was indicated for 95% of items. There was some variability in adherence by therapist (range 89-100%) and by session (range 92-97%). With regard to assistant psychologist competence, the independent raters were external to the NHS organisations that were hosting the trial. Changes to the policies of the NHS organisations relating to the transfer of patient identifying information created complexities for the secure transfer of the audio recordings outside of these organisations. We were not able to overcome these complexities before the end of the trial. Additionally, during the COVID-19 pandemic it was not possible to record sessions delivered remotely because of home working. At the Sussex site, 58 GiVE sessions were recorded (out of a total of 185 sessions delivered; 31%) and 50 supportive counselling sessions were recorded (out of a total of 162 sessions delivered; 31%). Six audio recordings of randomly selected GiVE sessions (3%) from the Sussex site were independently rated with the Cognitive Therapy Rating Scale -Psychosis. The mean was 31.7 (s.d. 3.8) out of a maximum of 60. The mean score for general skills was 17.5 (s.d. 3.1) out of a maximum of 30. The mean score for technical skills was 14.2 (s.d. 2.1) out of a maximum of 30. The ratings revealed that although assistant psychologists demonstrated skills in general understanding and interpersonal skills, they were less able to link sessions though homework and feedback. Ratings were completed for five supportive counselling sessions (3%) using the Counselling Adherence Scale, and the mean was 17Á8 (s.d. 2.4) out of a maximum of 28, which equates to moderate-to-good evidence of competence. To assess for drift between the interventions, the supportive counselling session recordings were assessed by the independent CBT rater against the session checklists for the GiVE intervention. For three of the recordings, the rater found 'no evidence' of items from the GiVE checklists. On the remaining two recordings, there was 'negligible evidence' of items from the GiVE checklists. These assessments suggest that any drift from the GiVE intervention to the supportive counselling intervention was minimal. Adherence to clinical supervision protocols was assessed through the recording of attendance at weekly supervision sessions for each of the four assistant psychologists. Attendance rates were as follows: 89.0%, 91.6%, 96.4% and 98.0%. Items were mostly at least 90% complete, except for the Scale to Assess Therapeutic Relationships -Patient version (missing data was 79% owing to measures not being posted back by participants), the Therapy Credibility and Expectancy Questionnaire (missing data was 25%), the Short Form 12 Version 2 (missing data was 53% at time point 0, 92% at time point 1 and 100% at time point 2 [owing to administration errors]), and some of the sociodemographic characteristics. The descriptive summary for the candidate primary and selected secondary outcomes at time points 1 and 2 are shown in Table 2 . Results from the intention-to-treat analyses of the candidate primary outcomes are shown in Table 3 . Details regarding the secondary outcomes and the health economic outcomes are provided in the Supplementary material available at https://doi.org/10.1192/ bjo.2021.983. Increasing access to CBT for psychosis All 95% confidence intervals included their respective outcome's MCID. For the candidate primary outcomes at time point 1, estimated effects were in favour of GiVE compared with both supportive counselling and treatment as usual. For these comparisons, Cohen's d standardised effect sizes ranged from medium to large. At time point 2 for HPSVQ negative voice impact: estimated effects were in favour of supportive counselling compared with both GiVE (small effect) and treatment as usual (small to medium effect); effects for GiVE were favourable compared with treatment as usual (small effect). For PSYRATS distress at time point 2: estimated effects were in favour of GiVE compared with both supportive counselling (negligible effect) and treatment as usual (medium effect); supportive counselling was favourable to treatment as usual (small to medium effect). One break in blinding was reported. In this instance, the assessment was completed by a blinded researcher who was not part of the research team. SAEs were reported by 11 participants on a total of 16 occasions. The most frequently recorded SAE code was 'suicidal ideation and intent to act' (3). The SAEs were distributed evenly across the three arms. Independent assessment suggested that no SAEs were related to the trial or its procedures. Adverse events were reported by 20 participants on a total of 30 occasions. The most frequently recorded adverse event codes were 'deterioration in mental health' (n = 10), 'general medical assessment/procedure' (n = 8), 'suicidal ideation' (n = 6) and 'self-harm' (n = 4). The adverse events were evenly distributed across the three arms. This study has demonstrated that a definitive RCT of the GiVE intervention delivered by assistant psychologists to patients with psychosis is feasible. Clinicians were willing to refer their patients, the majority of participants completed interventions and were retained at follow-up, and assistant psychologists were adherent to therapy and supervision protocols. The interventions appeared to be safe and the MCIDs for the candidate primary outcomes were captured in the 95% confidence intervals for the betweengroup differences in the means at time point 1. The favourable levels of referrals and recruitment suggest a willingness on behalf of clinicians and patients with psychosis to engage with a trial when the intervention is delivered by briefly trained assistant psychologists. Once randomised, participants demonstrated further willingness to engage in the study by attending therapy sessions and time point 1 assessments. The level of therapy exposure was highest for the participants receiving the GiVE intervention (88%), with an exposure rate higher than comparable trials where CBT for psychosis was delivered by highly trained therapists (e.g. 72% 38 ). Attendance at time point 2 assessments was lower than at time point 1. Although noteworthy, attempts were made to engage only a subset of participants (as planned) in the time point 2 assessments, and the limited attendance may, in part, be attributable to the COVID-19 pandemic, which led to all assessments being conducted remotely during the final 6 months of data collection. Willingness to engage with the trial was also required by the other important stakeholder groupthe assistant psychologists. To our knowledge, no studies have previously explored the adherence of this workforce to therapy and supervision protocols when working with patients with psychosis. Consequently, rigorous assessment was required. Findings were encouraging, with each of the assistant psychologists attending most of the weekly clinical supervision sessions offered. Self-rated adherence to the therapy protocols was also high, but with variation across particular sessions indicating areas for additional training within a future trial. The rating of competence was restricted by the limited availability of session recordings as a result of information governance issues and the COVID-19 pandemic. The former issues will need to be addressed before a future trial. The available ratings suggested that assistant psychologists could achieve competence in the delivery of both GiVE and supportive counselling. However, the ratings for the GiVE intervention suggested some areas for improvement, including the linking of learning during and between sessions, which could be addressed in a future trial with specific training and supervision on this issue. The assessment of contamination between the interventions suggested that the assistant psychologists had been able to prevent the GiVE techniques from drifting into the supportive counselling sessions. Findings were also encouraging with respect to the candidate primary outcomes. Medium-to-large estimated effects were found in favour of GiVE compared with both supportive counselling and treatment as usual at time point 1. The effect sizes were in line with prior expectations of detecting small-to-medium effects with some inflation owing to the small sample size. Although effects detected in small feasibility studies, such as this one, are likely to be imprecise and biased, the size and magnitude of our detected effects support further testing in a powered RCT. The findings at time point 2 were less clear as the estimated effects favoured supportive counselling compared with GiVE and treatment as usual with (negligible-small and medium effects, respectively). However, GiVE was still favourable compared with treatment as usual negligible-medium effects at time point 2. The findings at time point 2 were attributable, in part, to a reduction of benefits for GiVE during the follow-up period (from time point 1 to time point 2), and may indicate the need for the intervention to be extended and/or for the addition of booster sessions. This reduction in benefit for GiVE during the follow-up period also raises the question of the potential place of this intervention within a therapeutic pathway for patients with psychosis, e.g. as part of a modular pathway where other single-symptom interventions could build upon the learning generated by GiVE, or vice versa. A modular pathway for the psychological treatment of paranoia has recently been evaluated and generated encouraging findings, albeit with the interventions delivered by highly trained therapists. 39 The findings of increased benefits for supportive counselling during the follow-up period are similar to those reported by the recently completed RCT of AVATAR therapy. 14 Those authors suggested that supportive counselling is a control condition with non-specific factors that, compared with treatment as usual, can be effective in its own right. This is a possibility that is worthy of further investigation. This study has limitations in a number of respects. First, the follow-up data were available for only a subsample of the participants (as planned), thereby limiting the learning about the durability of benefits from the interventions. Second, the self-reported adherence ratings of the assistant psychologists were not assessed and would benefit from independent assessment within a future trial. Furthermore, the competence ratings of the assistant psychologists were limited to a small selection of session recordings. Further learning about the competence of assistant psychologists within a future trial will be crucial, and any barriers to the rating of competence must be addressed a priori. Finally, the findings may have been influenced by the COVID-19 pandemic. Some of the therapy sessions and assessments were conducted remotely during the final 6 months of the study, but any impact of remote delivery and/or the more general impact of the pandemic upon participants could not be established because of the small sample size. The main implication of this trial is that a definitive RCT is feasible and is now required to provide evidence regarding the efficacy of a brief, CBT-informed intervention for distressing voices when delivered to patients with psychosis by assistant psychologists. If found to be efficacious in future trials, CBT for psychosis offered in these less resource-intensive forms has the potential to generate benefits for individual patients (reduced distress and enhanced recovery), service-level patient benefits (increased access to evidence-based psychological therapies) and economic benefits to the NHS (in terms of the reduced use of high-impact mental health services). M.H., C.H. and C.S. are authors of the self-help book and the companion workbook that was used to assist the delivery of the GiVE intervention within this study. Each author receives a small royalty for each copy of the book and companion workbook that is sold. Program for Schizophrenia Voices Questionnaire; PSYRATS, Psychotic Symptoms Rating Scale Hospital Anxiety and Depression Scale; CHOICE-SF, Choice in Outcome in CBT for Psychoses Healthcare Quality Improvement Partnership and Royal College of Psychiatrists Effective Interventions in Schizophrenia the Economic Case: A Report Prepared for the Schizophrenia Commission Psychosis and Schizophrenia in Adults: Treatment and Management (CG178). National Institute for Health and Care Excellence National Clinical Audit of Psychosis -National Report for the Core Audit A systematic review of the implementation of recommended psychological interventions for schizophrenia: rates, barriers, and improvement strategies A systematic review and meta-analysis of low intensity CBT for psychosis A systematic review and discussion of symptom specific cognitive behavioural approaches to delusions and hallucinations An Introduction to Self-Help for Distressing Voices Overcoming Distressing Voices Guided self-help cognitive-behaviour intervention for voices (GiVE): results from a pilot randomised controlled trial Increasing access to CBT for psychosis patients: a feasibility, randomised controlled trial evaluating brief, targeted CBT for distressing voices delivered by assistant psychologists (GiVE2) Quantifying self-reports of auditory verbal hallucinations in person with psychosis Structured Clinical Interview for DSM-5 Disorders (SCID-5) The Test of Premorbid Functioning (TOPF). The Psychological Corporation AVATAR therapy for auditory verbal hallucinations in psychosis patients: a single-blind randomized controlled trial An investigation into the psychometric properties of the Cognitive Therapy Scale for Psychosis (CTS-Psy) Manual for the selection, training and supervision of counsellors in the IAPT programme Scales to measure dimensions of hallucinations and delusions: the Psychotic Symptom Rating Scales (PSYRATS) The Hospital Anxiety and Depression Scale Measuring ideas of persecution and reference: the Green et al Paranoid Thought Scales (G-PTS) The Brief Core Schema Scale (BCSS): psychometric properties and associations with paranoia and grandiosity in non-clinical and psychosis samples The revised Beliefs About Voices Questionnaire (BAVQ-R) The Voice and You: development and psychometric evaluation of a measure of relationships with voices A cross national comparison of a shorter version of the Person's Relating to Others Questionnaire Exploring the development, validity and utility of the short form version of the Choice of Outcome in CBT for Psychoses (CHOICE-SF): a patient reported outcome measure of psychological recovery The Work and Social Adjustment Scale: a simple measure of impairment in functioning Social and Occupational Functioning Assessment Scale (SOFAS) Psychometric properties of the credibility/expectancy questionnaire A new scale to assess the therapeutic relationship in community mental health care: STAR EuroQol: the current state of play International Outcome Measures in Mental Health SF-12: How to Score the SF-12 Physical and Mental Health Summary Scales. The Health Institute A power primer Estimating a sample size for a pilot randomised trial to minimise the overall trial sample size for the external pilot and the main trial for continuous outcome variable The size of a pilot study for a clinical trial should be calculated in relation to considerations of precision and efficiency Sample size requirements to estimate key design parameters from external pilot randomised controlled trials: a simulation study StataCorp. Stata Statistical Software: Release 16. StataCorp Group mindfulness-based intervention for distressing voices: a pragmatic randomized controlled trial Comparison of a theoretically driven cognitive therapy (the Feeling Safe Programme) with befriending for the treatment of persistent persecutory delusions: a parallel, single-blind, randomised controlled trial We are grateful to the participants who helped us to learn from their experiences. We also thank the researchers who worked tirelessly to maximise our learning: Ben Cameron, Sophie Green, Emogen Campbell, Sacha Stone, Debra Sheffield, Maisha Murshed, Peter Garwood, Jake Ellwood and Kate Arnold. Supplementary material is available online at https://doi.org/10.1192/bjo.2021.983 The data that support the findings of this study are available from the corresponding author, M.H., upon reasonable request.