key: cord-0033115-mhxf90pt
authors: Toulany, Alene; Kurdyak, Paul; Gandhi, Sima; Fu, Longdi; Grewal, Seena; Kulkarni, Chetana; Saunders, Natasha; Vigod, Simone; Guttmann, Astrid; Chiu, Maria; Pignatiello, Antonio
title: Health System-Level Evaluation of Tele-Mental Health Services Among Children and Adolescents in Ontario, Canada
date: 2021-09-27
journal: Can J Psychiatry
DOI: 10.1177/07067437211043395
sha: c7ee617bec7b532736fc5e260b95f036c28d5ac1
doc_id: 33115
cord_uid: mhxf90pt

OBJECTIVE: To describe the characteristics of children and adolescents receiving tele-mental health services in Ontario, Canada and examine access to a psychiatrist, in-person or via tele-mental health services, following a mental health and addictions (MHA)-related emergency department (ED) visit or hospitalization. METHOD: Using linked health and administrative data, we described two cohorts: (1) children and adolescents (1–18 years) who used a provincial tele-mental health programme from January 1, 2013 to March 31, 2017, comparing their MHA-related service use (outpatient, ED, hospitalization) in the 1 year prior to and the 1 year following initial consultation; (2) children and adolescents with high mental health service needs, defined as those with an incident MHA-related ED visit or hospitalization between January 1, 2013 and December 31, 2016, examining their 1-year follow-up with telemedicine and other health care utilization. RESULTS: In the first cohort, 7,216 children and adolescents (mean age 11.8 [±3.8] years) received tele-mental health services. The proportion of MHA-related ED visits [15.1% pre vs. 12.6% post (test statistic 23.57, P < 0.001)] or hospitalizations [10.2% pre vs. 8.7% post (test statistic 11.96, P < 0.001)] declined in the year following tele-mental health consultation, while local psychiatry visits increased [8.4% pre vs. 17.0% post (test statistic 298.69, P < 0.001)]. In the second cohort (n = 84,033), only 1.5% received tele-mental health services, 40.7% saw a psychiatrist in-person, and 32.5% received no MHA-related outpatient care in follow-up. CONCLUSIONS: Tele-mental health services were rarely used in Ontario, even among high-needs children and adolescents, despite their association with increased access to care and less need for acute mental health care.

Mental illness in young people is characterized by substantial morbidity, mortality, and negative economic impact. Between 15% and 25% of Canadian children and adolescents suffer from a mental disorder, however, only about one in five of those in need actually receive psychiatric care. [1] [2] [3] [4] [5] [6] [7] The last 10 years have seen a large increase in hospitalizations and emergency department (ED) visits for mental illness in children and adolescents, 8 and the gap between mental health care needs and available resources is growing. Reasons for this include a lack of health human resources trained to effectively deliver needed mental health care; archaic mental health service silos operating in parallel to usual healthcare; and inadequate availability of effective and appropriate child and youth mental health care at the primary care level. 3, [9] [10] [11] Rural and remote communities specifically suffer from a severe shortage of child and youth mental health practitioners and resources. 12, 13 As a result, tele-mental health services have been implemented to bridge these geographical disparities and improve access to psychiatric care.

The TeleLink Mental Health Programme (TLMHP), a paediatric telepsychiatry service based in a large Canadian inner-city, follows a consultation model where the telepsychiatrist provides a formulation and immediate recommendations to the referring provider who maintains ongoing patient care. Its mandate is to provide specialist care to rural, remote, and underserviced areas. Services are delivered through child psychiatrists, social workers, nurse practitioners and psychologists, and are free of charge to patients ≤18 years. Referrals come from directly primary care physicians (PCPs), child and youth mental health community agencies and school boards. Referring parties are responsible for the implementation of recommendations, ongoing patient care, and facilitating further medical and pharmacological interventions. 14, 15 While the evidence base in the field of tele-mental health services demonstrates a high degree of practitioner satisfaction, enhanced capacity of practitioners and families in rural communities to manage mental health in their practices, and overall therapeutic success, 16 few studies have evaluated the extent of utilization at a broad health system-level. Recent Canadian data suggest tele-mental health services are underutilized for adult psychiatric populations, and there is no clearly defined systematic rationale for the organization of its delivery to match patient needs. 17 Population-level healthcare utilization has not been examined in children and youth in Canada and was the focus of this study.

With the recent and rapid shift from in-person to virtual modes of mental health care service delivery precipitated by the coronavirus-2019 (COVID-19) pandemic, assessing how tele-mental health services has been previously used may help guide strategies to mitigate barriers to mental health service access. This study aimed to describe the characteristics and healthcare utilization patterns of children and adolescents who received tele-mental health services in Ontario, Canada between 2013 and 2017 through a provincially funded tele-mental health programme. In addition, we examined access to a psychiatrist, either in-person or by tele-mental health services, within one year following a MHA-related ED visit or hospitalization. Individuals who have MHA-related ED visits or hospitalizations represent a population with high mental health needs who, on balance, would benefit from access to mental health services. Our first objective describes the status of tele-mental health services; the second measures the extent to which tele-mental health services are meeting the needs of children and adolescents with high demand for psychiatrist services.

This was a retrospective population-based pre-post-study of all children and adolescents (age 1-18 years) receiving telemental health services through TLMHP in Ontario, Canada from January 1, 2013 to March 31, 2017. In 2017, the children and adolescent (age 0-19 years) population in Ontario, Canada was 3,095,381. 18 Using linked administrative health data available at ICES Institute for Clinical Evaluative Sciences (ICES), an independent, non-profit research institute that evaluates universal health care services in the province of Ontario, Canada (population approximately 14 million), we examined MHA-related service use (outpatient visits, ED use, hospitalizations) one year prior to and following initial tele-mental health consultation. We excluded those who did not have publicly funded health insurance coverage for at least one year prior to the date of the initial tele-mental health consult. Children and adolescents without a valid health card number were also excluded as their records are not linkable to other health administrative databases.

In addition, we created a second cohort of paediatric patients with high mental health care needs to contextualize utilization patterns. It included children and adolescents (age 1-18 years) who had an incident MHA-related ED visit or hospitalization between January 1, 2013 and December 31, 2016, defined as no prior MHA-related ED visit or hospitalization in the year prior. We assessed follow-up with a psychiatrist; in-person or through telemental health; within one year. In addition to the exclusions noted above, we also excluded children and adolescents with an Ontario Health Insurance Plan (OHIP) telemedicine claim (B100 or B200) with a mental health outpatient diagnosis code in the year prior to the incident MHA event, as this care was provided outside of the provincial TLMHP.

The use of data in this project was authorized under section 45 of Ontario's Personal Health Information Protection Act, which does not require review by a Research Ethics Board and informed consent. STROBE reporting guidelines were used. 19 

Population-based health administrative and clinical databases at ICES were linked using unique encoded identifiers. The legal status of ICES under Ontario's health information privacy law allows the research institute to collect and analyze health care and demographic data, without consent, for health system evaluation and improvement.

The TLMHP database includes data on children and adolescents who received mental health services through a provincial tele-mental health services programme. Data elements include referral characteristics as well as clinical data collected at the time of consultation, including major mental health concerns at referral, diagnoses, medication and dosages, counseling history, and recommendations. The TLMHP dataset was used to identify all children and youth that received tele-mental health services between January 1, 2013 and March 31, 2017, using their initial consultation as a start date.

The OHIP database was used to capture all outpatient physician visits except those recorded in the TLMHP dataset. The National Ambulatory Care Reporting System and the Discharge Abstract Database were used to identify MHA-related ED discharge data and hospital admissions, respectively, using the primary discharge diagnosis fields. Diagnostic codes were determined using the International Classification of Diseases, 10th Revision (Supplement Material). Hospital admissions to Ontario psychiatric inpatient facilities were obtained using the Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition Axis I diagnostic field in the Ontario Mental Health Reporting System (Supplement Material).

The Registered Persons Database (RPDB) provides demographic characteristics for all Ontario residents eligible for public health insurance and was used to obtain age and sex. Postal codes were linked to the 2016 Canadian Census to obtain area-based measures of neighbourhood income quintile and rurality.

A tele-mental health visit was measured as the first recorded visit in the TLMHP dataset. MHA-related ED visits and hospitalizations were identified using the primary discharge diagnosis, defined as any code from the Mental and Behavioural Disorders Chapter of the International Classification of Diseases 10th edition. Conditions were categorized as substance-related, schizophrenia, mood and affective disorders, anxiety disorders, and deliberate selfharm. Conditions including attention deficient hyperactivity disorder, conduct disorder and oppositional defiant disorder were all captured under the overall "any MHA diagnosis" category and not examined under separate strata like we did for other mental health conditions.

MHA-related outpatient visits to paediatricians and family physicians (FP) were determined using OHIP diagnostic and specialist codes based on a previously validated administrative data algorithm (Supplement Material), while all psychiatry visits were considered MHA-related. Tele-mental health consultations were defined as any record with a valid appointment start date in the TLMHP dataset.

The outcome for the high-needs cohort was a follow-up by a psychiatrist in the year following an MHA-related incident ED visit or hospitalization. We created mutually exclusive categories of outpatient follow-up to define appointment type, using the following hierarchy: (1) tele-mental health consultation and in-person psychiatry visit; (2) tele-mental health consultation only; (3) in-person psychiatry visit only; (4) MHA-related FP or paediatric follow-up visit; and (5) no MHA-related follow-up visit.

Using the initial consultation date in the TLMHP database as the index for the tele-mental health cohort, we examined baseline demographic characteristics of children and adolescents that received a tele-mental health service consultation. MHA-related ED visits, hospitalizations, and outpatient visits were compared in the year prior and following the index tele-mental health consultation. Pre-and postdifferences were tested using paired t-tests and McNemar's tests for continuous and binary variables, respectively.

For the second high-needs cohort, the date of the MHA-related event was used to define the index event. We created mutually exclusive categories to identify children and adolescents with an incident (no MHA-related event in the year prior) MHA-related ED visit that resulted in a discharge home, while those who were hospitalized, whether preceded by a transfer from the ED or not, were categorized as having an incident MHA-related hospitalization. MHA-related hospitalizations also included elective hospitalizations (i.e. not preceded by an ED visit). We then looked forward 1 year for MHA-related follow-up in an outpatient setting stratified by the type of MHA-related index event. Statistical analyses were performed using SAS 9.4

Between January 1, 2013 and March 31, 2017, 7,216 children and adolescents had a tele-mental health consultation ( Table 1 ). The mean age of tele-mental health patients was 11.8 ± 3.8 years; 6.1% were age one to five years; 43.2% were between six to 12 years; and 50.7% were between the ages of 13 and 18 years. Among all patients that received a tele-mental health consultation, slightly more than half were male (52.9%); with slightly higher representation from the lowest neighbourhood income quintile (24.6%). More tele-mental health consultations were for patients living in urban versus rural settings; 56.8% and 42.7%, respectively.

In the year prior to receiving tele-mental health services, approximately 15.1% of children and adolescents had at least one MHA-related ED visit (Table 2) . Overall, the proportion of individuals with an ED visit declined following an initial tele-mental health consultation, particularly for anxiety-related disorders [6.7%-5.1% (test statistic 20.42, P < 0.001)] and mood disorders [3.8%-3.2%, (test statistic 4.12, P=0.04)], which were among the most common reasons for ED visits. Approximately 10.2% had a MHA-related hospitalization prior to tele-mental health consultation, among which mood disorder was the most common reason for admission, compared with 8.7% following consultation (test statistic 11.96, P < 0.001).

The proportion of children and adolescents who had a psychiatrist visit nearly doubled [8.4%-17.0% (test statistic 298.69, P < 0.001)] in the year following tele-mental health consultation. There was a small increase in the proportion with a MHA-related visit to a paediatrician [30.5%-33.4% (test statistic 29.95, P < 0.001)] while no differences were seen for MHA-related visits to family physicians. Table 3) . The mean age of children and adolescents in the high-needs cohort was 14.9 years ± 3.1. There was a higher proportion of females (58.5%) and youth from urban settings (85.2%). Only 1.5% (N = 1,241) of children and adolescents with high mental health care needs received a tele-mental health consultation within one year following their incident MHA-related event (Table 4) . Overall, 40.7% received care by a local psychiatrist in follow-up only; compared to 25.3% who only saw a FP or paediatrician. Approximately one-third (32.5%) of youth identified as having high mental health care needs had no MHA-related follow-up within one year. Children and adolescents with an incident MHA-related hospitalization were more likely than those with an incident ED visit to have a follow-up with a local psychiatrist (59.0% vs. 35.5%). Conversely, the proportion of children and adolescents that received MHA follow-up from family physicians or paediatricians, or had no follow-up, was higher among those with an incident ED visit compared to those hospitalized.

The key findings emerging from our health system-level evaluation indicate that provincially delivered tele-mental health services are largely utilized by younger youth (mean age 11.8 ± 3.8 years) with a significant proportion from rural areas (42.7%), reflecting areas with low psychiatrist supply and need for access to care through virtual means.

In the year following initial tele-mental health consultation, a modest decrease in acute mental health care service use and improved access to psychiatrists was observed in our cohort. Among children and adolescents with high mental health care needs, only 1.5% accessed care through telemental health services and 32.5% received no mental health care at all in the year following an incident MHA-related ED visit or hospitalization. These findings indicate that although tele-mental health care is meeting its mandate to deliver care to a number of children and adolescents across the province including rural settings, the volume of service is relatively low and it is not being used to support access to psychiatrist care for high-needs children and youth.

While tele-mental health services have been shown to be similarly effective as in-person care, 20,21 there are few macrosystem-level evaluations of utilization and accessibility. Findings from our study highlight opportunities for enhancing tele-mental health care and systematically aligning services with the needs of children and adolescents. The TLMHP is only one of several routes available to support children's and adolescents' mental health in the province of Ontario. The programme's role is to enhance on-the-ground, local carenot be a substitute for itand support primary care providers in the community, especially those in rural, remote and indigenous communities. While the programme does provide some urgent care consultations, it is not a front line, urgent care programme. The predominant reasons for ED visits and hospitalizations in the TLMHP cohort were for mood and anxiety disorders. This pattern is consistent with previously reported findings. 8, 22 There is, unfortunately, a significant gap between the ED and community mental health follow-up for many children and adolescents presenting with acute mental health care needs. 23 Unfortunately, this causes a barrier to accessing telemental health care services as many children and adolescents are not connecting with their local mental health centre following an acute care visit. The TLMHP programme does not accept referrals directly from the ED. In the future, this could be a potential area of focus for improvement initiatives.

As the COVID-19 pandemic evolves, access to mental health care for children and adolescents will become increasingly important and will stimulate the field to utilize innovations in mental health care delivery during the crisis and beyond. 24, 25 While physical distancing measures have mandated the rapid uptake of tele-mental health services use during the pandemic, 26, 27 an iterative approach is warranted for its implementation and evaluation with broad system-level considerations in order to ensure access matches the current and changing needs of the population. Furthermore, child and youth mental health services have long been under-resourced, 28 with many accessing the mental health care system for the first time in the ED. 29 Risk factors for first contact mental health ED visit include social deprivation and living in a rural region. 29 This partly reflects limited access to both specialist and primary care for mental health issues. The pandemic may further exacerbate these access issues and, thereby, hinder the detection of symptoms consistent with mental health disorders.

Our study fills a significant gap in the literature on health system-level evaluation of a child and adolescent tele-mental health programme by using administrative datasets to provide insight into a large population of children and adolescents with high mental health care needs. However, there are a number of inherent limitations including potential coding errors, deficiency of supporting clinical data, and lack of data on community mental health services provided by other clinicians including psychologists and social workers. Moreover, comparison of health service utilization prior to and following a tele-mental health contact shows associations between receipt of tele-mental health services and changes in acute mental health service use, but does not imply causation between tele-mental health services access and changes in acute mental health service use.

Tele-mental health services have been expanding in the past decade to improve access to psychiatric care and address critical shortages in the psychiatric workforce. However, our study indicates that these virtual services are vastly underutilized at a population-level in Ontario, Canada, especially among children and adolescents with high mental health care needs. In the context of growing mental health care demand, an under-resourced system with limited access to specialist care, and a need to physically distance during the COVID-19 pandemic, we must ensure tele-mental health care better aligns with patient need and does not further widen existing health care inequities. Tele-mental health services will continue to be a critical strategy for mental health care access and service delivery during and after the pandemic to support children and adolescents with pre-existing mental health problems, as well as those with new mental health care needs. Health system-level planning is needed for more effective implementation to optimize access to psychiatrist care for those who need it most.

The human face of mental health and mental illness in Canada

ON: Minister of Public Works and Government Services of Canada

A report on mental illnesses in Canada (Catalogue no. 0-662-32817-5)

Out of the shadows at last: transforming mental health, mental illness and addiction services in Canada

Bringing children's mental health "out of the shadows"

Prevalence of mental disorders in children and youth. A research update prepared for the Ministry of Children and Family Development

Ontario Child Health Study findings: policy implications for Canada

Six-month prevalence of mental disorders and service contacts among children and youth in Ontario: evidence from the 2014 Ontario Child Health Study

Deconstructing the rise in mental health-related ED visits among children and youth in Ontario

Facing the challenge of care for child and youth mental health in Canada: a critical commentary, five suggestions for change and a call to action

Mentally ill youth: meeting service needs

Child psychiatric epidemiology and Canadian public policy-making: the state of the science and the art of the possible

Child psychiatry in Canada: physician resources position statement of the Canadian Academy of Child Psychiatry

Use of telepsychiatry for child psychiatric issues: first 500 cases

Telelink mental health: The Hospital for Sick Children (SickKids)

Lessons learned in a physician referral to pediatric telemental health services program

Youth at ultra high risk for psychosis: using the revised network episode model to examine pathways to mental health care

Implementation and utilisation of telepsychiatry in Ontario: a population-based study

Table 17-10-0005-01 population estimates on July 1st, by age and sex. 2021

The strengthening the reporting of observational studies in epidemiology (STROBE) statement: guidelines for reporting observational studies

The empirical evidence for telemedicine interventions in mental disorders

Review of key telepsychiatry outcomes

Mental health service use among children and youth in Ontario: population-based trends over time

Mental health and addictions system performance in Ontario: an updated scorecard

COVID-19 impacts on child and youth anxiety and depression: challenges and opportunities

From pandemic to progression: an educational framework for the implementation of virtual mental healthcare for children and youth as a response to COVID-19

Rapid scale-up of telehealth during the COVID-19 pandemic and implications for subspecialty care in rural areas

51.17 Telehealth in the time of COVID-19: experience from the Consortium of Academic Programs for Telehealth

Children are being failed by substandard mental health services

Emergency department as a first contact for mental health problems in children and youth

The authors would like to thank Keshini Devakandan, Clinical Research Project Coordinator, for her invaluable support in helping this manuscript for submission.

Parts of this material are based on data and/or information compiled and provided by Canadian Institute for Health Information. Reasonable requests for access to the data should be directed to the corresponding authors.

The authors declared the following potential conflicts of interest with respect to the research, authorship, and/or publication of this article: Co-author Dr Vigod receives royalties from UpToDate Inc for authorship of materials related to depression and pregnancy. The remaining authors declare that there are no conflicts of interest.

The authors disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: Financial support for this project was provided by ICES, which is funded by an annual grant from the Ontario Ministry of Health (MOH). The opinions, analyses, results, and conclusions included in the report are those of the authors and are independent from the funding and data sources. No endorsement by ICES or the MOH is intended or should be inferred.

Alene 

Supplemental material for this article is available online.