key: cord-0931368-5muquepw
authors: Occhipinti, Jo-An; Skinner, Adam; Carter, Samantha; Heath, Jacinta; Lawson, Kenny; McGill, Katherine; McClure, Rod; Hickie, Ian B.
title: Federal and state cooperation necessary but not sufficient for effective regional mental health systems: insights from systems modelling and simulation
date: 2021-05-27
journal: Sci Rep
DOI: 10.1038/s41598-021-90762-x
sha: 2f753eaa1d0d755d6c4b6d13937584f5b511a84f
doc_id: 931368
cord_uid: 5muquepw

For more than a decade, suicide rates in Australia have shown no improvement despite significant investment in reforms to support regionally driven initiatives. Further recommended reforms by the Productivity Commission call for Federal and State and Territory Government funding for mental health to be pooled and new Regional Commissioning Authorities established to take responsibility for efficient and effective allocation of ‘taxpayer money.’ This study explores the sufficiency of this recommendation in preventing ongoing policy resistance. A system dynamics model of pathways between psychological distress, the mental health care system, suicidal behaviour and their drivers was developed, tested, and validated for a large, geographically diverse region of New South Wales; the Hunter New England and Central Coast Primary Health Network (PHN). Multi-objective optimisation was used to explore potential discordance in the best-performing programs and initiatives (simulated from 2021 to 2031) across mental health outcomes between the two state-governed Local Health Districts (LHDs) and the federally governed PHN. Impacts on suicide deaths, mental health-related emergency department presentations, and service disengagement were explored. A combination of family psychoeducation, post-attempt aftercare, and safety planning, and social connectedness programs minimises the number of suicides across the PHN and in the Hunter New England LHD (13.5% reduction; 95% interval, 12.3–14.9%), and performs well in the Central Coast LHD (14.8% reduction, 13.5–16.3%), suggesting that aligned strategic decision making between the PHN and LHDs would deliver substantial impacts on suicide. Results also highlighted a marked trade-off between minimising suicide deaths versus minimising service disengagement. This is explained in part by the additional demand placed on services of intensive suicide prevention programs leading to increases in service disengagement as wait times for specialist community based mental health services and dissatisfaction with quality of care increases. Competing priorities between the PHN and LHDs (each seeking to optimise the different outcomes they are responsible for) can undermine the optimal impact of investments for suicide prevention. Systems modelling provides essential regional decision analysis infrastructure to facilitate coordinated federal and state investments for optimal impacts.

| (2021) 11:11209 | https://doi.org/10.1038/s41598-021-90762-x www.nature.com/scientificreports/ 764 (13.7 per 100,000) deaths from suicide and self-inflicted injuries, which was higher than both NSW (10.5 per 100,000) and Australia (12.2 per 100,000) for the same time period 19 . These high rates of suicide in the region prompted the two LHDs (Hunter New England LHD and Central Coast LHD that fall within the PHN catchment) to come together with the HNECC PHN to explore how best to invest in coordinated actions to reduce suicidal behaviour and other key mental health indicators in the region. The functions and responsibilities of PHNs (formally known as Medicare Locals) and LHDs (also known as Local Health Networks) in the Australian context is well described 21,22 . Model structure, inputs, and outcome indicators. A system dynamics model was developed using a participatory modelling approach (described in Additional file 1, along with details of the core model structure, parameter estimates, data sources and assumptions). The core model structure was similar to a model previously described 9 and included: (1) a population component, capturing changes over time in the size of the population resulting from births, migration, and mortality; (2) a psychological distress component that models flows of people to and from states of low or no psychological distress (Kessler 10 [K10] scores below 15) , and moderate to very high psychological distress (K10 score 16-50); (3) a mental health services component that models the movement of psychologically distressed people through one of several possible service pathways across the primary to tertiary service continuum involving (potentially) general practitioners, psychiatrists and allied mental health professionals (including psychologists, mental health nurses, social workers etc.), psychiatric inpatient care, community mental health centres, and online services; and (4) a suicidal behaviour component that captures self-harm hospitalisations (used as a proxy for suicide attempts-see limitations) and suicide deaths. Figure 1 provides a high-level overview of the causal structure and pathways of the model. Primary model outputs included total (cumulative) numbers of self-harm hospitalisations and suicide deaths, and self-harm hospitalisation and suicide rates per 100,000 population. The model also provided estimates of the prevalence of moderate to very high psychological distress and the total (cumulative) mental health-related ED presentations and psychiatric hospitalisations, and a range of measures of mental health service usage (e.g., mental health-related general practice consultations, psychiatrist or allied mental health services capacity, services www.nature.com/scientificreports/ waiting times, and the numbers of psychologically distressed consumers that have disengaged from treatment). All outputs were calculated every 0.4375 days (i.e., one sixteenth of a week) over a period of 28 years, starting from 1 January 2011, permitting comparisons of model outputs with historic data from 2011 to 2017 and forecasts of the impacts of intervention scenarios described below simulated over a 10-year period from 2021 to 2031. Parameter values that could not be derived directly from available data or published research were estimated via constrained optimisation, implemented in Stella Architect ver. 1.9.4, using historical time series data on the prevalence of psychological distress, self-harm hospitalisations and suicide rates, and mental health-related service usage (subsidised general practice consultations and allied mental health services claimed per year, psychiatric bed occupancy). Powell's method was employed to obtain the set of (optimal) parameter values minimising the sum of the mean absolute percent error calculated for each time series separately (i.e., the mean of the absolute differences between the observed time series values and the corresponding model outputs, where each difference is expressed as a percentage of the observed value).

Modelled programs, services, and initiatives. In addition to the ability to scale up or down mental health services capacity captured in the core model structure, a range of mental health and suicide prevention programs and initiatives selected by the participating stakeholders were integrated into the model (Table 1) . These programs and initiatives were identified based on current local priorities, contextual relevance, and feasibility of implementation. Details of each program, service and initiative, their default parameter estimates, and the data and evidence used to inform these estimates are provided in Additional file 1, Table S1 . A model interface was developed to facilitate comparison of the impact of intervention scenarios against a baseline (business as usual) scenario, in which existing policies and programs remain in place and mental health services capacity continues to increase at current rates.

Potential discordance in the best-performing intervention scenarios across mental health outcomes and between the two LHDs was assessed by examining reductions in total (cumulative) numbers of suicides, mental health-related ED presentations, and patients disengaging from services under all (495) possible combinations of four interventions selected from the 12 programs, services and initiatives modelled. Differences in projected numbers of suicides, ED presentations, and disengagements from services between the baseline scenario and each intervention scenario across the PHN and in the two LHDs were calculated for the period 2021-2031. We identified the best-performing (optimal) combinations of interventions for each outcome across the PHN and in each LHD (i.e., combinations of interventions minimising the total number of suicides, ED presentations, or patients disengaging), as well as all intervention combinations performing better than every other combination on at least one outcome; these latter combinations, corresponding to non-dominated or Pareto optimal solutions, may be considered as equally optimal alternatives where the goal is to simultaneously minimise suicide mortality, ED presentations, and disengagement from care (see, e.g., Branke et al. 23 ). Analyses in which five interventions were selected from the 12 interventions modelled yielded results similar to those for combinations of four interventions, indicating that our general conclusions are not dependent upon the choice of intervention set size (see "Results" section).

Sensitivity analyses were performed to assess the impact of uncertainty in estimates of the direct effects of each intervention and the duration of increased psychological distress incidence due to coronavirus-related unemployment and social dislocation on the simulation results. We used Latin hypercube sampling to draw 100 sets of values for selected model parameters determining the direct effects of the interventions and the duration of the COVID-19 pandemic effects from a relatively broad distribution of values (± 20% of the default values for the direct intervention effects, ± 50% of the default value for the duration of the pandemic effects). Differences in projected numbers of suicides, ED presentations, and patients disengaging from services between the baseline and intervention scenarios were calculated for each set of parameter values and summarised using simple descriptive statistics.

Ethics approval and consent to participate. This modelling study did not require ethics approval.

Projected numbers of suicides, mental health-related ED presentations, and patients disengaging from services per year under the baseline (business as usual) scenario are presented in Fig. 2 . Numbers of suicides for the HNECC PHN are projected to increase from 174.9 suicides per year in early 2020 (prior to the effects of coronavirus-related lockdowns on unemployment and psychological distress commencing in March 2020) to 186 suicides per year in late 2021, before declining to 174 suicides per year in 2031. Mental health-related ED presentations across the PHN are projected to increase from 16, 210 presentations per year at the start of 2020 to a maximum of 16,552 presentations per year in early 2022 and then decrease to 14,841 presentations per year in 2031. Patient disengagement from services follows a similar pattern, increasing from nearly 55,000 disengagements per year (for the PHN as a whole) at the beginning of 2020 to 56,668 disengagements per year in early 2024, before decreasing to pre-COVID values at the end of the forecast period (1 January 2031).

Under the business-as-usual scenario, 1778 suicides, 155,901 mental health-related ED presentations, and 544,972 disengagements from services are projected for the PHN over the forecast period (i.e., 1 January 2021 to the beginning of 2031; see Table 2 

Post-attempt assertive aftercare

Post-attempt assertive aftercare is an active outreach and enhanced contact program to reduce readmission in those presenting to services after a suicide attempt. It is implemented through existing community-based mental healthcare (CMHC) services and includes individually tailored contact, solution focused counselling, and motivations to adherence to follow-up treatments and continuity of contact GP training Short (1-2 days) training programs aimed at reducing suicidal ideation through referral to specialised psychiatric services. This includes people who may be thinking about suicide for the first time or have survived a previous attempt

Community-based education programs aim to improve recognition of suicide risk and increase help seeking through improved understanding of the causes and risk factors for suicidal behaviour. The effectiveness of this intervention is assumed to increase with increasing community support due to greater opportunity for identification of at-risk individuals by community and organisational gatekeepers

Family education and support

Provision of education and support to families and carers of patients presenting to or engaged with mental health services, with the aim of supporting family or carer involvement in the management of mental disorders Safety planning

Safety planning aims to reduce suicidal behaviour through the provision of a specific plan for staying safe during crisis to suicidal patients presenting to an emergency department. The modelled intervention also includes up to 2 follow-up phone calls to monitor suicide risk and support treatment engagement www.nature.com/scientificreports/ of ED presentations (scenario o) and disengagement from services (scenario q) are substantially lower, ranging from 4.9% to 6.9%. The combinations of interventions that are most effective in preventing suicides in the Central Coast LHD and mental health-related ED presentations across the PHN produce similar reductions in numbers of ED visits in each LHD (11.1-11.6% for scenario b, 11.6-12.3% for scenario o), while the intervention combinations minimising suicide mortality in the Hunter New England LHD and disengagement in both LHDs prevent significantly fewer presentations to emergency departments (7.6-8.5%). Reductions in patient disengagement achieved under the best-performing intervention combination (i.e., scenario q, 11.0-11.7%) are similar to those projected under the intervention combination minimising numbers of ED presentations (10.9-11.5%) but are considerably greater than reductions in patient disengagement projected under the optimal intervention combinations for suicide prevention (6.8-8.8%). Among the 495 possible combinations of four interventions selected from the 12 interventions modelled, 17 intervention combinations may be considered optimal in that they perform better than all other intervention combinations in preventing suicides, mental health-related ED presentations, and/or disengagement from services across the PHN (see Table 2 , Figure S17 ). Reductions in projected numbers of suicides, ED presentations, and patients disengaging from services for each of these non-dominated solutions are presented in Fig. 5 . Combinations of interventions that are more effective in preventing suicides (those towards the left of Fig. 5) generally Figure 2 . Numbers of suicides, emergency department (ED) presentations, and patients disengaging from services per year under the baseline scenario (i.e., business as usual) and the optimal intervention scenario for each outcome (see Table 2 

This study harnessed systems modelling and simulation to explore whether the recent Productivity Commission recommendations to pool resources under a unifying regional governance structure would be sufficient to prevent persistent policy resistance. Findings offer promise that policy resistance can be overcome with implementation of the optimal mix of programs and initiatives and indicate that reductions in suicide deaths in the order of 14.2-16% over 10 years are achievable across the region, however, the scale of this potential impact falls well short of the ambitious Premier's Target to reduce the rate of suicide deaths in NSW by 20% by 2023 24 , as the first step in the journey towards zero suicides. Results also revealed that that while the best performing combination of interventions to minimise suicide deaths differed between the two LHDs, the difference in the number of suicides prevented was negligible, suggesting that optimal impact of interventions could be achieved through independent strategic decision making at regional (PHN) or sub-regional (LHD) levels if agendas are aligned in prioritising suicide prevention. In contrast, competing priorities between the PHN and LHDs (such as minimising mental health-related ED presentations or service disengagement) can undermine optimal impacts of investments to prevent suicide deaths. Understanding such trade-offs and their implications for mental health outcomes and suicide prevention is not possible without the ability to forecast comparative impacts of alternative investment strategies. Therefore, in short, the Productivity Commission's recently recommended pooling of national and state funding for mental health under new Regional Commissioning Authorities is neither necessary nor sufficient to prevent ongoing policy resistance. www.nature.com/scientificreports/ A unifying regional governance structure will not negate the need for advanced decision analytic capability provided by systems modelling and simulation to identify optimal combinations of programs and initiatives for suicide prevention, as well as consensus building processes to unite regional stakeholders behind an agreed agenda. Studies have highlighted the importance of political support from local authorities and acceptance of proposed interventions by the local community for successful implementation of public health programs 25, 26 . Securing the required leadership and sustained support for effective, coordinated implementation of best performing interventions identified by systems modelling requires representatives from across the regional mental health and social systems and broader community to come together to debate, weigh up the trade-offs, and prioritise the key mental health outcomes to be addressed. Regardless of whether proposed reforms are implemented in Australia, the participatory systems modelling approach will be essential for coordinating regional investments in mental health system strengthening and suicide prevention and reducing fragmentation. The participatory systems modelling approach would support the integrated decision analytic, monitoring and evaluation ecosystem needed to achieve the transparency and accountability required for more effective mental health outcomes both regionally and nationally.

Finally, the unintuitive finding of a marked trade-off between minimising suicide deaths versus minimising service disengagement (i.e., both cannot be optimised simultaneously) is explained in part by the additional demand placed on the regional mental health service systems of intensive suicide prevention programs. For example, post suicide attempt assertive aftercare is an active outreach and enhanced contact program designed to intensively support those presenting to services after a suicide attempt in order to prevent re-attempt. It is implemented through existing community-based mental healthcare (CMHC) services. In the context of restrictions in responsive expansion of regional workforces, new programs introduced consume existing service capacity. This in turn leads to increases in service disengagement as wait times for specialist community based mental health services and dissatisfaction with quality of care increases.

Limitations. There are several limitations that require consideration when interpreting the findings of this study. There is potential measurement bias in the range of secondary data used to parameterise the model including the population health surveys, Medicare claims data, and PHN and Local Health District (LHD) datasets. The model acknowledges these potential sources of measurement bias and a number of commonly used strategies were employed to address them, including the triangulation of multiple data sources, parameter estimation via constrained optimisation, and local verification to identify plausible estimates. Table 2 for intervention scenario details). Mean percentage reductions and 95% intervals reported in the rightmost column were derived from the distributions of projected outcomes calculated in the sensitivity analyses (note that the 95% intervals provide a measure of the impact of uncertainty in the assumed intervention and pandemic effects, but should not be interpreted as confidence intervals). Numbers of cases (i.e., suicides, ED presentations, and disengagements from services) prevented were obtained assuming the default parameter values. Mean percentage reductions and 50% and 95% intervals are plotted on the right. www.nature.com/scientificreports/ In addition, there is potentially an under-enumeration of suicide cases used to calibrate the model, due to the misclassification of suicides to ICD codes relating to unintentional injury and events of 'undetermined intent. ' Also, in the absence of a direct measure of suicide attempts, self-harm hospitalisations are used as a proxy in this study. Suicide attempts identified from hospital admissions data likely only capture those cases serious enough to warrant medical intervention, and instances of self-harm where the intent wasn't clear may be not coded as suicide attempts. However, this under-enumeration is consistent across simulations of the baseline case and Table 2 for intervention scenario details). Mean percentage reductions and 95% intervals reported in the rightmost column were derived from the distributions of projected outcomes calculated in the sensitivity analyses (note that the 95% intervals provide a measure of the impact of uncertainty in the assumed intervention and pandemic effects, but should not be interpreted as confidence intervals). Numbers of cases (i.e., suicides, ED presentations, and disengagements from services) prevented were obtained assuming the default parameter values. Mean percentage reductions and 50% and 95% intervals are plotted on the right. Table 2 for intervention scenario details). www.nature.com/scientificreports/ intervention scenarios and as such is unlikely to affect the forecast estimates of impact (i.e., the % reduction in suicidal behaviour) of intervention strategies or the strategic insights derived from the model. Ongoing systematic monitoring and evaluation can determine the extent to which the model forecasts are corresponding with real-world outcomes over time, allowing refinement of model parameters to improve forecasting capabilities. Finally, as the impacts of simulated scenarios are subject to the population, demographic, behavioural, and service dynamics of the modelled region, they may not be generalisable to other regions.

Strengths. The suite of programs, services and initiatives used in this analysis by no means represents an exhaustive list of potentially effective strategies, nor are these optimisation results intended to provide 'the answer. ' Rather, this work demonstrates how systems modelling can provide a quantitative framework for bringing together a body of evidence, data, and local knowledge in a way that answers questions that cannot be achieved through analysis of any single dataset or through real world experimentation. A further strength of the approach is the ability to bring together representatives from different parts of the mental health system, funded by different levels of government, and engage them in a process that helps them better understand the upstream and downstream implications of investments designed to strengthen a particular part of the system. Strategy dialogues supported by a robust, objective systems modelling platform promotes communication and relationship building between system actors that traditionally do not interact. This approach also promotes the aligning of agendas needed for collaborative and coordinated action. Systems models can be iteratively refined and informed by (and will in turn inform) data collected from relevant surveys, administrative data sets, and new research. Following initial model development, key indicators for ongoing monitoring are identified, often engaging different jurisdictions and diverse stakeholders (including lived experience groups) in the process of strengthening their regional decision support asset. This not only improves the predictive capabilities of systems models over time but has the potential to keep system actors invested in sustaining their engagement with the model as a long term, collective, regionally-based decision support asset, and as an objective, constructive platform for supporting ongoing cooperation.

Decades of investments, statutory inquiries, mental health system reforms, and strategic action plans, have failed to reduce suicide rates in Australia. This study has demonstrated that competing priorities between PHNs and LHDs can undermine the optimal impact of investments for suicide prevention and that the Productivity Commission's recently recommended pooling of national and state funding for mental health under new Regional Commissioning Authorities is neither necessary nor sufficient to prevent ongoing policy resistance. Systems modelling provides essential regional decision analysis infrastructure to facilitate optimally coordinated federal and state investments.

The datasets generated and analysed during the current study are available from the corresponding author on reasonable request. www.nature.com/scientificreports/ Publisher's note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http:// creat iveco mmons. org/ licen ses/ by/4. 0/.

Trends of emergency department presentations with a mental health diagnosis by age

Is the prevalence of mental illness increasing in Australia? Evidence from national health surveys and administrative data

A modelling tool for policy analysis to support the design of efficient and effective policy responses for complex public health problems

The Fifth National Mental Health and Suicide Prevention Plan

PERSPECTIVES: accountability for mental health: the Australian experience

Bringing new tools, a regional focus, resource-sensitivity, local engagement and necessary discipline to mental health policy and planning

Systems modelling and simulation to inform strategic decision making for suicide prevention in rural New South Wales (Australia)

Mental health policy-Stumbling in the dark?

Using accountability for mental health to drive reform

Learning from evidence in a complex world

Applying dynamic simulation modeling methods in health care delivery research-the SIMULATE checklist: report of the ISPOR simulation modeling emerging good practices task force

Systems science methods in public health: dynamics, networks, and agents

Australian Government Response to Contributing Lives, Thriving Communities-Review of Mental Health Programmes and Services

Thriving Communities: Report of the National Review of Mental Health Programmes and Services

Productivity Commission

A decision support tool to inform local suicide prevention activity in Greater Western Sydney (Australia)

Public Health Information Development Unit. Social Health Atlas of Australia Data by Primary Health Network (incl. Local Government Areas)

Australian Bureau of Statistics. 2033.0.55.001-Census of Population and Housing: Socio-Economic Indexes for Areas (SEIFA)

Medicare local-local health network partnerships in South Australia: lessons for primary health networks

The new Australian primary health networks: How will they integrate public health and primary care?

Multiobjective Optimization. Interactive and Evolutionary Approaches

Barriers and facilitators for the implementation and evaluation of community-based interventions to promote physical activity and healthy diet: a mixed methods study in Argentina

Barriers and facilitators to the integration of mental health services into primary health care: a systematic review

This work was made possible by generous contributions of time, local knowledge, and content area expertise by the broad range of local stakeholders within the Hunter New England and Central Coast Primary Health Network population catchment, which included representation from the two Local Health Districts (Hunter New England LHD and Central Coast LHD) in the region. These contributions were made through the participatory modelling workshops.

This work was funded primarily by the Hunter New England & Central Coast PHN. Additionally, the research was generously supported by philanthropic funding to the Brain and Mind Centre, University of Sydney. Funders contributed to the scope and design of this study, however, did not influence the collation, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; or the decision to submit the manuscript for publication. He is the Chief Scientific Advisor to, and a 5% equity shareholder in, InnoWell Pty Ltd. InnoWell was formed by the University of Sydney (45% equity) and PwC (Australia; 45% equity) to deliver the $30 M Australian Government-funded Project Synergy (2017-2020; a three-year program for the transformation of mental health services) and to lead transformation of mental health services internationally through the use of innovative technologies.

The online version contains supplementary material available at https:// doi. org/ 10. 1038/ s41598-021-90762-x.Correspondence and requests for materials should be addressed to J.-A.O.Reprints and permissions information is available at www.nature.com/reprints.