key: cord-0032224-jj1pzypj
authors: Eilert, Nora; Wogan, Rebecca; Leen, Aisling; Richards, Derek
title: Internet-Delivered Interventions for Depression and Anxiety Symptoms in Children and Young People: Systematic Review and Meta-analysis
date: 2022-05-12
journal: JMIR Pediatr Parent
DOI: 10.2196/33551
sha: 9f7af45972e8f6337ae7cde43743a1357a6efc74
doc_id: 32224
cord_uid: jj1pzypj

BACKGROUND: Mental health difficulties in children and adolescents are highly prevalent; however, only a minority receive adequate mental health care. Internet-delivered interventions offer a promising opportunity to increase access to mental health treatment. Research has demonstrated their effectiveness as a treatment for depression and anxiety in adults. This work provides an up-to-date examination of the available intervention options and their effectiveness for children and young people (CYP). OBJECTIVE: In this systematic review and meta-analysis, we aimed to determine the evidence available for the effectiveness of internet-delivered interventions for treating anxiety and depression in CYP. METHODS: Systematic literature searches were conducted throughout November 2020 using PubMed, PsycINFO, and EBSCO academic search complete electronic databases to find outcome trials of internet-delivered interventions treating symptoms of anxiety and/or depression in CYP by being either directly delivered to the CYP or delivered via their parents. Studies were eligible for meta-analysis if they were randomized controlled trials. Risk of bias and publication biases were evaluated, and Hedges g between group effect sizes evaluating intervention effects after treatment were calculated. Meta-analyses used random-effects models as per protocol. RESULTS: A total of 23 studies met the eligibility criteria for the systematic review, of which 16 were included in the meta-analyses, including 977 participants in internet-delivered treatment conditions and 1008 participants in control conditions across 21 comparisons. Random-effects models detected a significant small effect for anxiety symptoms (across 20 comparisons; Hedges g=−0.25, 95% CI −0.38 to −0.12; P<.001) and a small but not significant effect for depression (across 13 comparisons; Hedges g=−0.27, 95% CI −0.55 to 0.01; P=.06) in favor of internet-delivered interventions compared with control groups. Regarding secondary outcomes, there was a small effect of treatment across 9 comparisons for impaired functioning (Hedges g=0.52, 95% CI 0.24-0.80; P<.001), and 5 comparisons of quality of life showed no effect (Hedges g=−0.01, 95% CI −0.23 to 0.21; P=.94). CONCLUSIONS: The results show that the potential of internet-delivered interventions for young people with symptoms of anxiety or depression has not been tapped into to date. This review highlights an opportunity for the development of population-specific interventions and their research to expand our current knowledge and build an empirical base for digital interventions for CYP. TRIAL REGISTRATION: PROSPERO CRD42020220171; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=220171

Depression and anxiety disorders rank high among the difficulties for children and young people (CYP), contributing to significant disability, and are associated with lasting intellectual, academic, and social impairment [1] [2] [3] . Mental health issues, which often first present at a young age [4] , can contribute to lifelong physical health difficulties and reduced quality of life in adulthood [5, 6] . Failure to access treatment at such a critical developmental stage can result in serious negative consequences for functioning or even long-term disability [7] . Despite the high prevalence rates and worldwide recognition of the importance of strengthening mental health in CYP, demand still surpasses the capacity of services [8] and only a minority receive adequate mental health care [9] . In one study, after 4 weeks of referral, only 20% received treatment [10] , presenting a major issue, as long waiting times have been associated with poorer outcomes, worsening of symptoms, and a greater chance of families disengaging from treatment [11] .

Global inadequacies in the provision of mental health services have been attributed to three areas: access to services, implementation, and policy issues [9] . In England, mental health services for CYP are historically underfunded, seeing service cuts of up to 75% even as demand increases at a rate of approximately 11% per annum [12] . One core issue of access, which inhibits the expansion of service provision, is the scarcity of highly trained therapists and supporters to deliver therapeutic content [13] , especially in relation to CYP [14] . In a 2017 review of mental health services for CYP in the United Kingdom, CYP reported concerns that the staff members were not adequately trained to meet their needs [15] . Additional personal barriers to young people receiving care can involve location-based or finance-based inaccessibility of services, feelings of embarrassment and perceived stigma, desire to be more self-reliant, and difficulties in recognizing mental health concerns [16] .

Internet-delivered interventions are an increasingly popular way to address some of the barriers to access owing to their scalability, efficiency, and potential for personalization [17] . Furthermore, given young people's familiarity and avid consumption of technology and the internet [18] , digital interventions present a possible way to reach larger numbers of young people. Young people use the internet to access information regarding mental health issues, to obtain support for issues when in need, and to connect with peers [19] . In addition to increasing access to care, the use of technology-based treatments has improved patient and family outcomes and quality of life [9] . Evidence has shown comparable effectiveness of internet-delivered interventions and face-to-face brief psychological interventions in treating depression and anxiety in adults (Palacios J, unpublished data, April 2022) [20] and some evidence for their use in CYP [21] .

In general, studies of internet-delivered interventions for CYP have lagged behind adult equivalents, and previous systematic reviews have sought to address this [22, 23] . However, the update from Grist et al [22] included any technology-delivered treatments, such as video games, which can vary substantially in the mode of delivery and support provided, not to mention design or psychotherapeutic approach, and therefore likely have different effects or mechanisms of change [13] . Hollis et al [17] also conducted a metareview including young adults aged ≥18 years but ≤25 years and defined broad inclusion criteria for therapy delivered over technological devices, such as CD-ROM, SMS text messaging, or videoconferencing. Considering the broad and highly varied nature of the interventions under this rubric, Hollis et al [17] recommended evaluating evidence-based, core components of digital-delivered interventions (ie, active ingredients of interventions associated with uptake, adherence, and clinical outcomes).

It is still not clear whether internet-delivered interventions are effective in treating depression and anxiety in CYP. Internet-delivered mental health interventions are rapidly advancing; therefore, we conducted a systematic review to provide an up-to-date analysis of the available intervention options and their effectiveness. Specifically, the aims of this systematic review are (1) to evaluate the current state of evidence for the effectiveness of internet-delivered interventions for childhood and adolescence anxiety and depression symptoms and (2) to assess whether internet-delivered interventions are effective in treating symptoms of anxiety and depression in children and adolescents.

This systematic review and meta-analysis was completed in line with the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) statement [24] ; for the corresponding checklist, refer to Multimedia Appendix 1. Its protocol was prospectively registered at PROSPERO (reference number CRD42020220171). A systematic literature search for English language articles was conducted in early November 2020, and the final searches were conducted on November 19, 2020, across three electronic databases: PubMed, PsycINFO, and EBSCO academic search complete. Each database was searched individually with search terms specified by population, presenting the problem, intervention, and intervention medium (refer to Table 1 for examples of the search terms used across databases). In addition, we reviewed references of other relevant review papers, checked trial registers for recent publications related to eligible trial protocols identified through the database searches, and drew on the expertise of the last author (DR) in the field to identify publications that may have been missed. 

Child a or adolescent a or parent a or parenting a Population Depression a or anxiety a or mental health a Presenting problem Therapeutics a or psychotherapy a or intervention b or psychoeducat b or manag b or train b Intervention Internet a or computer b or web b or online b or technolog b or phone application b or app b or mobile b Medium a MeSH (Medical Subject Headings) term.

b Key concept in PsycINFO or title term in PubMed.

After duplicates were deleted via the reference manager Mendeley, entirely off-topic studies were excluded based on the title by one researcher (AL). Eligibility screening of the remaining papers was conducted by two researchers (NE and AL), and discrepancies were resolved via discussion between the researchers and consultation with a senior researcher (DR). The grounds for exclusion of studies were recorded according to a predefined hierarchy.

To be included in the systematic review, studies had to (1) be outcome studies, providing at least pretreatment and posttreatment clinical outcome data pertaining to anxiety or depression; (2) be implementing a transdiagnostic or disorder-specific low-intensity intervention delivered remotely via the internet (eg, high-intensity interventions such as videoconference psychotherapy or CD-ROM-based interventions were excluded), targeting symptoms of anxiety and/or depression in children or young people (intervention could be delivered directly to the child or young person or via their parents or guardians); (3) report the average age of the CYP, for whose symptoms the intervention was primarily intended, to be aged ≤18 years; and (4) have only included CYP who presented with symptoms of anxiety and/or depression (individual study inclusion criteria needed to include current symptoms of anxiety and/or depression assessed via self-report measures or clinical interviews). Furthermore, to be included in the meta-analysis, studies needed to be individually randomized controlled trials (RCTs).

Extracted data from studies included (1) participant characteristics (percentage female, mean age, and age range of the sample), (2) study characteristics (country of setting, recruitment strategy, clinical eligibility criteria implemented, and type of control group), (3) intervention characteristics (intervention focus of anxiety and/or depression, intervention delivery to youth and/or parents, intervention theoretical orientation, intervention support delivered, number of modules in intervention and length of treatment, and average amount of the intervention completed by participants), and (4) means and SDs or equivalent intention-to-treat metrics facilitating the calculation of posttreatment and follow-up between-group effect sizes where applicable. Data were extracted by one researcher (AL or RW) and checked for accuracy by another researcher (NE).

For outcome data extraction, we created a hierarchy of instruments for our constructs of interest (primary: depression and anxiety; secondary: impaired functioning and quality of life) before data extraction to facilitate uniformity for studies implementing multiple measures for the same construct. Each hierarchy was composed of a list of relevant outcome measures ranked by their properties of interpretability, reliability, and validity. Given the primary interest in generic anxiety in this meta-analysis, generic anxiety measures were given preference over disorder-specific ones (eg, in 1 study [25] , the Beck Anxiety Inventory was selected over the Social Phobia Screening Questionnaire for Children). Where there were multiple forms completed of the same measure (eg, Spence Children's Anxiety Scale-Parent Version and Child Version), the scores were averaged.

The risk of bias was determined for each study included in the meta-analysis based on the CLEAR NPT (Checklist to Evaluate a Report of a Nonpharmacological Trial) checklist [26] , which evaluates the quality of RCTs addressing nonpharmacological trials. This checklist has been successfully used in previous meta-analytic studies of internet-delivered interventions for depression [27] and anxiety [28] . This checklist features 10 questions and 5 subquestions, predominantly requiring an answer of yes, no, or unclear. The questions concerned the adequacy of randomization; availability of details of the interventions; appropriateness of supporters' skills; treatment adherence measurement; blinding of those involved or, if not, notification of steps taken to prevent bias; consistency across conditions' follow-up schedules; and whether an intention-to-treat principle of analysis was followed. Two researchers (RW and AL) independently completed the CLEAR NPT checklist for all studies on the primary outcomes of depression and anxiety. Conflicts were resolved by checking and discussing the given study and, if further clarity was required, by consulting the first author (NE). Risk of bias assessments were detailed narratively rather than incorporated into meta-analytic models, as the CLEAR NPT checklist does not provide an overall degree of study quality.

Effect sizes were calculated either from observed means and SDs or estimated marginal means, SEs, and Cohen d, if available, with the latter taking precedence if both were reported within a given study. The formulas provided by Borenstein et al [29] were used to calculate Hedges g and its SE. In 3-arm trials in which either both active arms met the inclusion criteria or 2 different types of control groups were implemented, the sample sizes of the group that was to be entered into the analysis twice was halved to allow for the calculation of separate effect sizes by trial arm [30] . For effect size, we implemented the following cut-off points: 0-0.32 for a small effect, 0.33-0.55 for a moderate effect, and 0.56-1.2 for a large effect [31] .

All analyses were conducted in R (R Foundation for Statistical Computing) using the meta, metafor, and dmeta packages [32] [33] [34] . In line with the protocol [35] , random-effects models were used to pool effect sizes to account for the anticipated moderate to high levels of between-study heterogeneity. Between-study variance was estimated via restricted maximum likelihood, and heterogeneity was assessed using the Q value, I² statistic, and prediction intervals (PIs). According to Higgins and Thompson [36] , an I² value of 0% indicates no heterogeneity, 25% indicates low heterogeneity, 50% indicates moderate heterogeneity, and 75% indicates high heterogeneity. The presence of outliers and model fit was assessed using diagnostic plots and statistics. Owing to the inclusion of studies with narrow and wide focus on intervention aim and content, forest plots detailing primary outcomes by intervention focus (anxiety, low mood and/or depression, or transdiagnostic) were selected to ensure reporting clarity. In a deviation from the registered protocol [35] , follow-up between-group effects were assessed through the same models as posttreatment effects, where this was feasible (ie, a sufficient number of studies included relevant data). Where multiple follow-up time points were available for one study, the longest follow-up time point was selected. To explore various potential moderators, mixed-effect models of primary outcomes (anxiety and depression) using the Knapp-Hartung method to reduce the chance of a type 1 error were conducted. Moderators were only explored statistically if there were at least six moderate to large studies with data available for any continuous moderator and four moderate to large studies per subgroup for categorical moderators [37] . Funnel plots and Egger [38] test were used to explore publication bias.

The database searches resulted in 1014 articles, whereas an additional 11 results were obtained from other sources (refer to the Literature Search section). Duplicate removal left 874 articles, 645 of which were excluded based on the title. The full-text versions of the remaining 236 articles were assessed for potential eligibility, of which 213 did not meet the eligibility criteria and were excluded. Finally, 23 studies were deemed eligible for the systematic review, and an additional 7 studies were excluded from the meta-analysis because of not having conducted an RCT. A total of 16 studies met the inclusion criteria for meta-analysis. The study selection process and reasons for exclusion are summarized in Figure 1 . 

This review reports 16 RCTs and 7 non-RCTs published in English, the main characteristics of which are presented in Tables 2 and 3 . A total of 6981 participants were included, ranging in age from 3 to 21 years and recruited through school, email, flyers, websites, local media (radio, newspaper, etc), social media, youth centers, guardians, or parent groups. A total of 11 studies involved recruitment from different care settings such as general practitioners, mental health professionals, mental health services, and clinics. Moreover, 6 studies were conducted in Sweden; 6 in Australia; 5 in the Netherlands; and 1 each in China, Canada, Denmark, Iran, New Zealand, and the United States. 

Self-report (mild to moderate depressive and/or anxiety symp- Table 3 . Description of recruitment strategies and interventions used within studies included in meta-analyses.

Intervention engagement Support Number of modules and intervention duration

Youth completed an average of 8.86 out of 10 sessions; parents Weekly emails and one 15-minute telephone call with clinician 15-16 (10 youth and 5-6 parent modules) over 12 weeks

Recruited via advertising in the media and referrals from guidance officers and mental health professionals iCBT a for anxiety disorders delivered to youth and parents (n=132) completed an average of 4.76 out of 5 or 5.74 out of 6 sessions if assigned 6.

Youth completed an average of 6.7 out of 10 sessions; parents

Weekly web-based contact and one short phone call with a therapist 16 (10 youth and 6 parent modules) over 10 weeks 

Average number of modules accessed was 4 out of 8. Support-on-demand (psychologist)

Recruited via web-based advertising and flyers distributed to preschool services iCBT (Cool Little Kids online) for anxiety delivered to parents (n=215)

-Unsupported with 90minute group meetings to obtain youth feedback on intervention 8 modules (duration: N/A) Recruited via flyers, advertisements, and social networking iCBM for social anxiety delivered to only youth, only parent, or youth and parents concurrently (n=18)

4 out of 31 participants completed less than half of the modules, 2 completed more than half, and 25 completed all modules.

Adolescent subgroup recruited via email, posters, media, schools, health professionals, and youth organizations Spirituality-informed e-mental health tool for major depression delivered to youth (n=18)

Average number of modules completed was 5.

Telephone or face-to-face support (if needed) 6-9 modules over 6-18 weeks Referral via guardian, clinic, and self-referral Tailored iCBT for anxiety disorders delivered to youth (n=11)

Average number of sessions completed was 7.5 out of 10 for youth and 4.48 out of 5 for parents.

Email feedback after each session and one 15minute phone review call by therapist 15 (10 youth and 5 parent session) over 12 weeks

Recruited via media advertising and referrals from school guidance officers, GPs, and mental health professionals iCBT for anxiety disorders delivered to youth and parents (n=44)

Youth completed on average 4-4.75 out of 10 sessions, and parents completed on average 4.32 out of 6 or 3.18 out of 5 sessions.

Email feedback after each session and one 15minute phone review call by therapist 15-16 (10 youth and 5-6 parent sessions) over 12 weeks Recruited via schools, parent groups, mental health professionals, guidance officers, the media, and self-referral Social anxiety-specific iCBT (n=47) and generic iCBT for anxiety (n=48) delivered to youth and parents

iCBM participants completed on average 8.5 out of 20 sessions.

No support 20 over 10 weeks Recruited via 24 schools iCBM for social anxiety delivered to youth (n=86)

Average number of sessions completed by youth was 4.48 out of 10; it was 4.3 out of 6 for parents of children, and 2.3 out of 5 for parents of adolescents.

Feedback to child and parent and one 30-minute phone call with therapist 15-16 modules (10 youth and 5-6 parent) over 12 weeks Recruited through referrals from GPs and school public health nurses iCBT for anxiety disorders delivered to youth (n=42)

Participants completed on average 5.4 out of 8 modules (excluding 2 participants who dropped out).

Weekly phone calls (average 20 mins) with therapist 8 modules over 14 weeks

Recruited via advertising and referrals from local health services iCBT (ChilledOut online) for anxiety delivered to youth (n=35)

Participants finished on average 2.9 out of 9 modules.

Email feedback after each homework assignment by therapist 9 modules over 9 weeks Recruited via advertising newspapers and in schools iCBT for social anxiety delivered to youth (n=10) 

Those who started iCBT completed an average of 3.96 out of 6 sessions; 9.9% did not start iCBT.

Clinical psychologist offered feedback after each session 6 modules over 6 weeks Recruited through 13 secondary schools and 2 universities Rumination-focused iCBT for anxiety disorder and major depression prevention delivered to youth (n=84)

Average number of modules completed was 9.7 out of 11.

Web-based messages or feedback, 3 phone calls, and optional additional calls with therapist 11 (4 youth and 7 parent) modules over 10 weeks 

Across RCT studies, sample sizes ranged from 19 [25] to 433 [49] , with 977 in internet-delivered treatment conditions and 1008 in control conditions. There were 21 comparisons conducted across the 16 RCTs, 13 of which featured a wait-list control and 8 implemented active controls (2 placebo bias modification programs, 2 attention controls, 1 internet-delivered child-directed play, 1 internet supportive contact, 1 face-to-face CBT, and 1 group CBT). A total of 12 active treatment comparisons implemented a form of internet-delivered cognitive behavioral therapy (iCBT), 3 featured internet-delivered cognitive or attentional bias modification interventions (internet-delivered cognitive bias modification [iCBM] or internet-delivered attentional bias modification), 1 implemented a problem-solving therapy, 1 implemented an affect-focused psychodynamic therapy, and 1 implemented a spirituality-informed intervention. Most of these interventions were delivered to CYP, and 5 interventions were also delivered to the parents; however, 1 intervention was delivered to parents only [49] . The RCTs included participants with at least mild to moderate symptoms or those who met the diagnostic criteria for a primary disorder of anxiety or depression assessed via structured clinical interviews or self-report measures. Most studies (12/16, 75%) provided some form of regular scheduled feedback or assistance from a therapist, psychologist, or mental health professional. One study provided support only when requested by participants [49] . Support provided across the range of studies consisted of email, treatment platform chat, or phone calls, or no support. The duration of treatment ranged from 4 weeks [41, 42] to 8 months [44] , whereas the number of intervention modules ranged from 5, offered to CYP only [43] , to 16, offered to both parents and CYP [40, 54] . Tables 2 and 3 provide an overview of these findings.

Of the studies not eligible for inclusion in the meta-analysis (n=7), the sample sizes ranged from 11 [52] to 4425 [47] . A total of 5 studies implemented a form of iCBT and 2 studies implemented iCBM, with treatment periods ranging from 6 [52] to 20 weeks [47] , whereas the number of modules ranged from 6 [52] to 20 [55] . All non-RCTs used a clinical measure of the constructs of interest, either in a self-report format or through clinical interviews, to establish their eligibility criteria, which ranged from mild to moderate symptoms of depression or anxiety to diagnosis of clinical symptoms. Most interventions were website-based platforms, and 4 interventions provided some form of support from a qualified or soon-to-be qualified therapist, psychiatrist, or clinician. The aim of support was mainly to offer feedback, motivation, or assistance with the treatment content and consisted of email, webpage messaging, and telephone calls, and 1 study provided face-to-face support if needed. However, 3 non-RCTs were unsupported. The majority of interventions were delivered to CYP, 2 studies delivered the intervention to parents as well as CYP, and 1 of these included a comparison condition delivering the intervention to parents only [50] .

On the basis of 20 comparisons (across 15 studies), including anxiety-focused interventions (n=8), depression-focused interventions (n=3), and transdiagnostic interventions (n=4), a small effect on anxiety symptoms in favor of internet-delivered treatment was detected (Hedges g=−0.25, 95% CI −0.38 to −0.12; P<.001). Heterogeneity in the observed effect sizes appeared moderate (Q 19 =32.42; P=.03; I 2 =41.4%), with the PI crossing the zero line of no effect (95% PI −0.66 to 0.15). Model diagnostics suggested one potential outlier [59] (CBT group-treatment control arm). Excluding this study from the analysis resulted in a reduction of heterogeneity, a moderate effect estimate (Hedges g=−0.50, 95% CI −0.40 to −0.20;

P<.001; Q 18 =23.29; P=.18; I 2 =22.7%), and a narrower PI no longer crossing zero (95% PI −0.41 to −0.19). Testing for subgroup differences between anxiety-focused interventions, depression-focused interventions, and transdiagnostic interventions revealed significantly different effect estimates by intervention focus (Q 2 =6.13; P=.046). Figure 2 [21, 25, [40] [41] [42] [43] [44] [45] [46] 49, 53, 54, [57] [58] [59] shows the meta-analysis outcomes overall and by intervention focus. Figure 2 . Posttreatment standardized mean difference (Hedges g) between internet-delivered treatment and control groups for anxiety outcomes by intervention focus [21, 25, [40] [41] [42] [43] [44] [45] [46] 49, 53, 54, [57] [58] [59] . CBT: cognitive behavioral therapy; GT: group treatment; iCBT-GEN: generic internet-delivered cognitive behavioral therapy; iCBT-SAD: internet-delivered cognitive behavioral therapy for social anxiety disorder; NT: no treatment; PL: placebo; PWT-iCBM: picture-word training internet-delivered cognitive bias modification; ST-iCBM: scenario training internet-delivered cognitive bias modification; WL: wait-list.

Drawing on 13 comparisons (across 10 studies) and assessing depressive symptoms in the context of depression or low mood interventions (n=4), anxiety-focused interventions (n=2), and transdiagnostic interventions (n=4), a small effect bordering significance and favoring internet-delivered treatment was observed (Hedges g=−0.27, 95% CI −0.55 to 0.01; P=.06). There was a high amount of heterogeneity (Q 12 =42.02; P<.001; I 2 =71.4%), resulting in a wide PI spanning the zero line of no effect (95% PI −1.27 to 0.73). The model diagnostics suggested the absence of outliers. Subgroup analyses suggested that effect sizes differed by intervention focus (Q 2 =7.75; P=.02), with depression-focused interventions presenting with the largest effect estimate (Hedges g=−0.68, 95% CI −1.10 to −0.27; P=.001). Refer to Figure 3 [25, [41] [42] [43] [44] 46, 51, [57] [58] [59] for further details. . Posttreatment standardized mean difference (Hedges g) between internet-delivered treatment and control groups for depression outcomes by intervention focus [25, [41] [42] [43] [44] 46, 51, [57] [58] [59] . GT: group treatment; NT: no treatment; PL: placebo; PWT-iCBM: picture-word training internet-delivered cognitive bias modification; ST-iCBM: scenario training internet-delivered cognitive bias modification; WL: wait-list.

The overall effect of treatment on levels of functioning across the 9 comparisons (7 studies) was moderate (Hedges g=0.52, 95% CI 0.24-0.80; P<.001). Heterogeneity was moderate to high (Q 8 =23.27; P=.003; I 2 =65.6%), and the PI was wide (95% PI −0.38 to 1.43). One potential outlier [40] was detected, whose removal resulted in a smaller effect estimate (Hedges g=0.38, 95% CI 0.22-0.54; P<.001) but significantly improved heterogeneity (Q 7 =9.25; P=.16; I 2 =29.6%, 95% PI 0.06-0.70). Refer to Figure S1 in Multimedia Appendix 2 [21, [40] [41] [42] [43] [44] [45] [53] [54] [55] 57, 59] for further details.

In terms of quality of life, outcomes across the 5 comparisons 

Moderator analyses suggested a relationship between the percentage of a study's sample that was identified as female and the depression effect sizes observed in these studies (F 1,11 =6.04; P=.03). Higher percentages of females in the study were associated with larger between-group effect sizes for depression outcomes (b=−0.03, SE=0.01), accounting for 33.93% of the observed heterogeneity. All other moderator analyses were either insignificant (refer to Table S1 in Multimedia Appendix 2) or not feasible owing to a limited number of studies falling into specific categories (ie, intervention delivered to parents only, iCBM intervention, and face-to-face treatment control group).

Following screening based on the criteria outlined in the CLEAR NPT checklist, the methodological quality assessment ratings were satisfactory across the included studies. The allocation sequence generation was considered adequate in 88% (15/17) of the studies; all studies provided clear descriptions of the intervention administered, and all studies quantitatively assessed participant adherence. All but one study [21] analyzed the outcomes using an intention-to-treat principle. The percentage of studies that adequately detailed their allocation concealment method was 82% (14/17) . Clear documentation that care providers had appropriate experience or skill was given in 82% (14/17) of the studies, whereas for 18% (3/17) of the studies, this remained unclear.

As, by their nature, nonpharmacological trials and self-report outcome measures do not facilitate adequate blinding of participants, care providers, or outcome assessors to treatment allocation, this was often not feasible within the included studies. Therefore, the associated checklist items had the lowest quality ratings. Participants and care providers were blinded in only 18% (3/17) of the studies, with attempts made to blind outcome assessors in 65% (11/17) of studies. To aid in minimizing the risk of bias associated with inadequate blinding, subitems on the CLEAR NPT assessed the following items: for studies in which participants and care providers were not blinded, the provision of all other treatments and care in each randomized group were the same within 79% (11/14) of studies, and the number of participants withdrawn or lost to follow-up was the same in 71% (10/14) of studies. Where outcome assessors were not blinded, none of the studies provided a clear description of the specific methods used to avoid ascertainment bias, that is, systematic differences in outcome assessment. Only 53% (9/17) of studies adhered to the same follow-up schedule for randomized groups, with discrepancies often related to the provision of treatment to wait-list groups, perhaps owing to ethical considerations regarding the withholding of treatment. Refer to Figure S5 in Multimedia Appendix 2 for the quality assessment ratings of the included studies.

Neither funnel plots nor Egger tests suggested the presence of any significant publication bias for anxiety (Egger funnel plot asymmetry: t 18 =−0.29; P=.77) and depression outcomes (t 11 =−0.96; P=.36). Refer to Figures S6A and S6B in Multimedia Appendix 2 for further details. Owing to fewer studies addressing functional impairment and quality of life, it was not feasible to assess publication bias across these constructs.

The study sought to evaluate the state of published evidence for the effectiveness of internet-delivered interventions in treating symptoms of anxiety and depression in CYP compared with control groups. We identified 23 studies of adequate quality examining internet-delivered treatments for anxiety and/or depression in CYP; only 16 of these were RCTs, and hence, they were included in the meta-analysis. Across these controlled comparisons, the anxiety posttreatment effect sizes were small (Hedges g=0.3) and favored internet-delivered interventions. Depression outcomes were mixed, with the overall effect estimate based on anxiety-focused interventions, depression-focused interventions, and transdiagnostic interventions remaining insignificant. Among low mood and depression-specific interventions, the effect estimate was significant and large (Hedges g=0.7), but given the limited number of studies (n=4) falling into this subgroup, this finding should be considered preliminary. With regard to secondary outcomes, internet-delivered interventions were associated with moderate benefits (Hedges g=0.5) in overall levels of functioning; however, no such effects were observed in terms of quality-of-life outcomes. Among the few studies that included controlled follow-up comparisons, there was no evidence for the continuance of the effects of internet-delivered interventions on anxiety and depression symptoms into follow-up.

The small to moderate effect sizes observed in this study are somewhat smaller than those reported by previous meta-analyses comparing technology-delivered interventions with wait-list controls (Hedges g=0.45-0.68 [21, 22] ) but more in line with equivalent comparisons against active control groups (Hedges g=0.07-0.29 [21, 22] ). Overall, this study appears to paint a more pessimistic picture of the potential of internet-delivered interventions as they currently stand than previous meta-analyses. Specifically, the nonsignificant improvements in depression symptoms are in contrast with the previous findings of depression treatment effects (Hedges g=0.56 [23] ). Heterogeneity was considerable within the posttreatment analyses, especially regarding depression outcomes, which may have been due to the wide range of interventions included in the analyses on the one hand and the limited number of studies including depression-focused interventions on the other hand. Indeed, only the posttreatment anxiety outcome was assessed over a comprehensive number of studies and thus might be considered relatively robust (15 studies: 20 comparisons); however, the effect size was so small that one could question the clinical utility of the interventions. With regard to this, we note our more focused inclusion criteria compared with previous meta-analyses, in that we only included internet-delivered interventions (rather than interventions delivered via any form of technology) and we only included studies whose samples presented with current depression or anxiety symptoms (rather than studies that provided population-level or preventive intervention to entire classes in schools, for example). Our preliminary, yet inconclusive, evidence is reminiscent of the review by Hollis et al [17] , who noted several methodological limitations preventing them from making definitive conclusions regarding digital health interventions for CYP.

The results of this study do not encourage the effectiveness of digitally delivered interventions for treating symptoms of depression and anxiety in CYP, with robust and consistent between-group effect sizes being a common requirement for the endorsement of digital health interventions in routine care [60] . Furthermore, with little or no evidence for improving the quality of life or having sustained benefits, their utility is questionable. Considering the recent advances in building an evidence base for internet-delivered interventions for anxiety and depression in adults [20, 61] , this study highlights the lack of equivalent interventions for CYP. Recent systematic reviews and meta-analyses of digitally delivered CBT interventions for depression and anxiety in adults have included over 40 robust trials, yielding strong posttreatment and follow-up effects [27, 62] . In contrast, the results from this review and analysis were weak in terms of the number of studies included, their robustness, and the effect sizes we observed. This is surprising given the advances in technology and research [63] as well as the high rates of CYP engagement with technology [64] .

Owing to the large heterogeneity in the format of internet-delivered interventions, Vigerland et al [21] outline the apparent uncertainty in the literature regarding the optimal way to treat CYP and recommend consistency in reporting of advantageous factors. Much of the literature supporting internet-delivered interventions focuses on or provides evidence for CBT-based options [21] [22] [23] , with the evidence sparser for other theoretical perspectives. There is great scope for future research to explore what works for whom in digitally delivered psychological interventions for CYP populations. Further comparisons of specific types of interventions or particular aims of the intervention may be informative and warranted once more research involving this population has been conducted. Here, exploring the differential effectiveness of parent versus CYP-delivered interventions, treatment versus preventive interventions, or between interventions with varying theoretical bases may be particularly interesting. For example, Pennant et al [65] found medium between-group effects for CBT-based digital treatment of symptoms and small effect sizes for prevention across general populations. In contrast, attentional bias modification-based or cognitive bias modification-based interventions were associated with smaller or no effects [22, 65] .

As mentioned above, increasing access to effective treatment is imperative. It is essential that studies consider accessibility, engagement, and cost-effectiveness. In line with best practice, and as supported iCBT has been associated with larger effects in adults than unsupported iCBT [66] , the fact that most included studies provided a form of support is encouraging. However, no studies mentioned any specialist training in delivering treatment to CYP, a potential inadequacy of care.

Furthermore, access of caregivers to the treatment content may have a significant effect on outcomes [22, 67] , particularly for internet-delivered interventions that involve less therapist support and are usually completed at home, not at a clinic or dedicated practice. Active parental participation was incorporated into 9 of the included studies, whereas, in general, behind the scenes parental involvement could encompass any form of social support such as technical help and time management. Parental support given to the CYP completing the intervention may aid engagement with the programs, understanding and learning of content, and the application of new skills [68] . Although this was not a focus of our review, with less than half of the studies directly addressing active parental involvement through delivery to parents alone or in conjunction with the CYP, future reviews should consider the important influence of active and indirect parental involvement on CYP outcomes following internet interventions.

An important limitation of this review was the small number of studies, particularly those assessing depression outcomes. Thus, these results should be interpreted cautiously and may not be a meaningful representation of the potential efficacy of internet-delivered interventions in treating childhood depression and anxiety. Similarly, owing to the limited number of studies, we could not properly evaluate the influence of various moderators, such as the effects of the type of intervention or control group, on our findings. In addition, the effect sizes after treatment were based on only 16 controlled studies, and we did not report any within-group comparisons. Therefore, this evidence must be considered as preliminary. In summary, more high-quality studies analyzing the outcomes for CYP are required. Future studies should include well-established outcome assessments, ensure adequate blinding of participants and outcome assessors when feasible, and balance differences between the treatment and control groups such as posttreatment assessment schedules. Perhaps, this would facilitate more detailed analyses and better estimate specific intervention effectiveness and factors associated with improved outcome analyses, such as type or format of intervention and degree of parental involvement.

Internet-delivered interventions have the potential to increase the availability and access of CYP to much-needed mental health support. These interventions may be effective, but adult-associated effect sizes are often moderate to large and comparable with face-to-face treatments. This study potentially highlights an insufficient customization of the intervention for CYP needs. This remains a largely underresearched area, and it is important to investigate how interventions can effectively reach and support CYP experiencing anxiety and depressive symptoms. Identifying variables that benefit or interfere with successful treatment outcomes will aid in adapting and enhancing internet-delivered interventions. Future work on the development and research of digital interventions for this population should consider the value of incorporating caregivers and other allied health professionals in the lives of CYP.

The data set and code used for analysis in this study are available upon request by emailing the corresponding author (NE). 

Life course outcomes of young people with anxiety disorders in adolescence

The long-term course of depression: development of an empirical index and identification of early adult outcomes

Adolescent mental health. World Health Organization

Lifetime prevalence and age-of-onset distributions of DSM-IV disorders in the National Comorbidity Survey Replication

The associations between depression, health-related quality of life, social support, life satisfaction, and disability in community-dwelling US adults

Quality of life in the anxiety disorders: a meta-analytic review

Adolescents' health-related quality of life (HRQoL) changes over time: a three year longitudinal study. Health Qual Life Outcomes

The Children and Young People's Improving Access to Psychological Therapies (CYP IAPT) Programme in England

Provision of mental healthcare for children and adolescents: a worldwide view

Covid-19: children's mental health services in England are "nowhere near sufficient," says commissioner

The effect of waiting time on youth engagement to evidence based treatments

Child-and Parent-reported Outcomes and Experience from Child and Young People's Mental Health Services

The Lancet Psychiatry Commission on psychological treatments research in tomorrow's science

| iss. 2 | e33551 | p

Future directions in the design, development, and investigation of technology as a service delivery vehicle

About the Care Quality Commission -What we do

Perceived barriers and facilitators to mental health help-seeking in young people: a systematic review

Annual Research Review: digital health interventions for children and young people with mental health problems -a systematic and meta-review

Children -and-Young-People-Mental-Health-in-the-Digital-Age.pdf

The internet as a setting for mental health service utilisation by young people

A pragmatic randomized waitlist-controlled effectiveness and cost-effectiveness trial of digital interventions for depression and anxiety

Internet-delivered cognitive behavioural therapy for children with anxiety disorders: a randomised controlled trial

Technology delivered interventions for depression and anxiety in children and adolescents: a systematic review and meta-analysis

Internet and computer-based cognitive behavioral therapy for anxiety and depression in youth: a meta-analysis of randomized controlled outcome trials

Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement

A randomized trial of internet-delivered treatment for social anxiety disorder in high school students

A checklist to evaluate a report of a nonpharmacological trial (CLEAR NPT) was developed using consensus

Computer-assisted cognitive-behavior therapy for depression: a systematic review and meta-analysis

The effectiveness of Internet-delivered treatment for generalized anxiety disorder: an updated systematic review and meta-analysis

Introduction to Meta-Analysis

Including variants on randomized trials | Cochrane Training

The efficacy of psychological, educational, and behavioral treatment

How to perform a meta-analysis with R: a practical tutorial

Conducting Meta-Analyses in with the package

Doing Meta-Analysis with R: A Hands-On Guide

Systematic review of internet-delivered interventions for childhood and adolescence anxiety and depression symptoms Internet

Quantifying heterogeneity in a meta-analysis

Conducting quantitative synthesis when comparing medical interventions: AHRQ and the effective health care program

Bias in meta-analysis detected by a simple, graphical test

Working alliance in online cognitive behavior therapy for anxiety disorders in youth: comparison with clinic delivery and its role in predicting outcome

Efficacy of an internet-based CBT program for children with comorbid high functioning autism spectrum disorder and anxiety: a randomised controlled trial

Imagine the bright side of life: a randomized controlled trial of two types of interpretation bias modification procedure targeting adolescent anxiety and depression

Online visual search attentional bias modification for adolescents with heightened anxiety and depressive symptoms: a randomized controlled trial

Effects of internet-based guided self-help problem-solving therapy for adolescents with depression and anxiety: a randomized controlled trial

Effectiveness of a culturally attuned Internet-based depression prevention program for Chinese adolescents: a randomized controlled trial

Efficacy and cost-effectiveness of therapist-guided internet cognitive behavioural therapy for paediatric anxiety disorders: a single-centre, single-blind, randomised controlled trial

Affect-focused psychodynamic internet-based therapy for adolescent depression: randomized controlled trial

Large-scale dissemination of internet-based cognitive behavioral therapy for youth anxiety: feasibility and acceptability study

Examining the effectiveness of a web-based intervention for depressive symptoms in female adolescents: applying social cognitive theory

Internet-delivered parenting program for prevention and early intervention of anxiety problems in young children: randomized controlled trial

Interpretation bias modification for youth and their parents: a novel treatment for early adolescent social anxiety

Evaluation of a spirituality informed e-mental health tool as an intervention for major depressive disorder in adolescents and young adults -a randomized controlled pilot trial

Individually tailored internet-based cognitive behavior therapy for adolescents with anxiety disorders: a pilot effectiveness study

A randomized controlled trial of online versus clinic-based CBT for adolescent anxiety

Generic versus disorder specific cognitive behavior therapy for social anxiety disorder in youth: a randomized controlled trial using internet delivery

Cognitive bias modification versus CBT in reducing adolescent social anxiety: a randomized controlled trial

Delivering solid treatments on shaky ground: feasibility study of an online therapy for child anxiety in the aftermath of a natural disaster

A randomized controlled trial examining the efficacy of an internet-based cognitive behavioral therapy program for adolescents with anxiety disorders

Evaluating the efficacy of internet-delivered cognitive behavioral therapy blended with synchronous chat sessions to treat adolescent depression: randomized controlled trial

Prevention of anxiety disorders and depression by targeting excessive worry and rumination in adolescents and young adults: a randomized controlled trial

Evidence standards framework for digital health technologies. National Institute of Health and Care Excellence

Internet-delivered transdiagnostic and tailored cognitive behavioral therapy for anxiety and depression: a systematic review and meta-analysis of randomized controlled trials

Computer therapy for the anxiety and depression disorders is effective, acceptable and practical health care: an updated meta-analysis

Role of digital therapeutics and the changing future of healthcare

Computerised therapies for anxiety and depression in children and young people: a systematic review and meta-analysis

The impact of guidance on internet-based mental health interventionsa systematic review

Different types and acceptability of psychotherapies for acute anxiety disorders in children and adolescents: a network meta-analysis

Treatment of child anxiety disorders via guided parent-delivered cognitive-behavioural therapy: randomised controlled trial

NE and DR contributed to the conceptualization and development of the study methodology. NE led the execution of the study in terms of data curation, investigation, formal analysis, data visualization, and write-up. AL and RW contributed toward data curation and writing of the paper, with RW also being involved in the analysis and validation of results. DR provided supervision for the conduct of the study and contributed toward the reviewing and editing of the study write-up. All authors approved the final version of the manuscript.

NE, RW, AL, and DR are or were employees of SilverCloud Health and developers of computerized psychological interventions for depression, anxiety, stress, and comorbid long-term conditions. Commercial departments within SilverCloud Health played no role in the design, collection, analysis, or interpretation of the data; manuscript preparation; or submission of the manuscript for publication. Since 2021, SilverCloud Health is a subsidiary of Amwell. DR is a shareholder in Amwell. Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Pediatrics and Parenting, is properly cited. The complete bibliographic information, a link to the original publication on https://pediatrics.jmir.org, as well as this copyright and license information must be included.