key: cord-0791025-rcrby0kv authors: Beck, Andrew F.; Hartley, David M.; Kahn, Robert S.; Taylor, Stuart C.; Bishop, Elizabeth; Rich, Kate; Saeed, Myra S.; Schuler, Christine L.; Seid, Michael; Cronin, Susan C.; Raney, Laura; Zafar, Muhammad A.; Margolis, Peter A. title: Rapid, Bottom-Up Design of a Regional Learning Health System in Response to COVID-19 date: 2021-02-16 journal: Mayo Clin Proc DOI: 10.1016/j.mayocp.2021.02.006 sha: 4df596bda3014efba2e63c8db59b499caf365ce4 doc_id: 791025 cord_uid: rcrby0kv nan Beneath top-down national and state directives and recommendations, communities must respond to COVID-19's many phases. The pandemic has unfolded differently across those communities with outcomes dependent on context, infrastructure, capacity, and how assets are organized, linked, and deployed. Achieving control requires real-time, multi-sector data sharing, learning, and adaptation. Leaders from health care, public health, congregate care, elected offices, neighborhoods, schools, and businesses must work together to create systems that can respond to a pathogen that does not respect geographic, jurisdictional, or disciplinary boundaries. 1 Response capabilities have been compromised by limited cross-sector coordination and decades-long disinvestment in public health. [2] [3] [4] The Pandemic All-Hazards Preparedness Act (PAHPA) of 2006 was passed to overcome these limitations by establishing an "electronic nationwide public health situational awareness capability through an interoperable network of systems to share data and information." 5 This goal has not been achieved, 6 and communities continue to rely on insights pieced together, often manually, from multiple isolated sources. 7 Data are often at too large a scale (national, state) or too incomplete (single sector, jurisdiction) to be useful for decision-making. As SARS-CoV-2 found its way to Greater Cincinnati (OH/USA), it became clear that we, like many communities, lacked processes and infrastructure to optimize pandemic control. We were confronted with difficult, urgent decisions without up-to-date data and coordination capabilities. [8] [9] [10] [11] We sought to catalyze an agile and adaptive regional response using a Learning Health System (LHS) lens. Much as a hurricane can disrupt travel, utilities, and access to needed services, so too has COVID-19 wreaked havoc across regions. One sector cannot respond to a J o u r n a l P r e -p r o o f hurricane; neither can one sector respond to COVID-19. Here, we describe how we used LHS principles to lower boundaries across sectors, promote collaborative sense-making, and grow coordinated infrastructure. Our pre-existing regional emergency preparedness coalition defined Greater Cincinnati as including 14 counties in 3 states, with 22 hospitals and 17 local health departments serving >2 million people. Although response plans existed across jurisdictions and institutions, they were insufficiently linked. Thus, we quickly saw a need to use design and change management strategies, and a network organizational model, 12 to catalyze a LHS "team of teams" to empower stakeholders to act with shared purpose. We applied the following guiding principles: 1. Engage stakeholders to co-design goals, measures of effectiveness, and theory of action. Initial discussions focused on pressing problems of hospital surge capacity and personal protective equipment (PPE) availability. By delineating scope, scale, and boundaries that made sense epidemiologically and pragmatically, decision-makers came to understand crosssector interconnections. The result was goals, measures, and a recognition of critical stakeholders not yet connected to the response (eg, congregate care leaders). Integrate data streams to create a single source for measures. Widely-available data streams provided the foundation for a complete, holistic, and accurate regional picture, beyond its component parts. By bringing together data into a single community-wide report, stakeholders developed a more holistic view of the pandemic. For instance, they were able to J o u r n a l P r e -p r o o f observe the relationship of community incidence to hospital and congregate care facility admission; not one or the other. 3 . Use data to build shared purpose and overcome competition. In normal circumstances, stakeholders compete -hospitals for patients, social service agencies and universities for grant dollars. System-level measures revealed opportunities for learning, catalyzing alignment and collective action. 5. Facilitate rapid learning. What was appropriate on day one was not on day thirty. Structured improvement methods facilitated adaptation to rapidly changing context and identification of answers to emerging questions (eg, how to establish outdoor testing sites in cold weather, where to locate sites to optimize equitable access, how to communicate to diverse populations). Small-scale testing and cross-sector learning generated the know-how needed to identify and scale up solutions. Aims and theory emerged from these principles. In mid-March 2020, a coalition of healthcare, public health, and community leaders came together, convened by the Regional Health Information Organization (RHIO) that serves as the hub for health information exchange and emergency preparedness. A team with expertise in design, change management, improvement, epidemiology, analytics, and community health was recruited from local academic medical centers to help assembled stakeholders create regional situational awareness and J o u r n a l P r e -p r o o f strategy. Initial participants were hospital leaders, but participation evolved and grew over time, ultimately becoming a regional Multi-Agency Coalition (MAC) composed of leaders from stakeholder organizations and sectors. Within ~10 days of Greater Cincinnati's first SARS-CoV-2 case, our situational awareness and strategy team worked with the growing MAC to: 1) develop and agree on a shared aim -to suppress regional SARS-CoV-2 transmission to reduce disease burden while maintaining economic productivity; 2) delineate scope of activities by defining populations, geographies, and partners; and 3) identify drivers of a successfully networked system comprised of effective healthcare delivery, public health-driven prevention, and coordinated cross-sector planning and service delivery ( Figure 1 ). We then defined measures related, drawing on practices from around the world. Officials in Wuhan, China used municipal public health measures like daily case incidence and effective reproductive ratios (R eff ) to inform and evaluate effectiveness of non-pharmaceutical interventions over time. 11 Taiwan demonstrated how integrated "timely, accurate, and transparent" data meaningfully informed responses. 13 By early April, we were producing a shared dashboard daily for MAC members -leaders from area hospitals, public health jurisdictions, and congregate care facilities alongside subject matter experts and support teams like ours ( Figure 2 ). The process of agreeing upon and then using measures built shared commitment, deepening understanding of the interdependent components of the system these leaders were seeking to manage. We related incidence and spread to downstream pandemic effects: healthcare system impact (hospital occupancy, ventilator use, PPE availability, death) and community capability (access to testing, test J o u r n a l P r e -p r o o f turnaround time, participation in contact tracing, time-lags from symptom to isolation). 14 We depicted measures at different levels of aggregation -entire region, county, neighborhood, healthcare system, and hospital -and across vulnerable sub-populations (those residing in congregate care facilities, living in impoverished neighborhoods, and of minority race or ethnicity). We used statistical process control methods to differentiate significant change from random variation. 15 Geospatial approaches identified case clusters and enhanced awareness of background context. 16 Schools brought data to decisions about re-opening and improvement methods to efforts to maximize students reached while on virtual instruction. 20 Regular use of available data also mitigated data shortcomings (eg, inaccurate or incomplete data, inconsistent operational definitions). A local healthcare leader commented that routinely reflecting on and critically evaluating data "allowed [stakeholders] to look outside [their] span of control, toward bigger community issues" reflective of the broader regional system. Despite the presence of the RHIO and preparedness infrastructure, we encountered several important challenges ( Figure 2) . First, regional healthcare institutions are active competitors, historically reluctant to share data. Second, like in many regions, our health information exchanges tend to be siloed, excluding public health, congregate care, and social services data. 21, 22 Third, the sheer number of jurisdictions, organizations, and sectors creates immense alignment, measurement, and improvement challenges. Finally, delays in data entry, manual entry, and unclear data definitions make interpretation difficult. To overcome challenges and connect disconnected sectors, our situational awareness and strategy team used data, analytics, and modeling to identify solutions and meet decision-making needs of stakeholders. We routinely identified data sources and developed prototype measures relevant to immediate needs. Reviewing data relative to regional goals was the first topic on the agenda of every MAC and sub-group meeting (often multiple times weekly). During these meetings, we elicited feedback on measure utility and presentation 23 and responded with J o u r n a l P r e -p r o o f revisions and new analyses as needed (often within 24 hours). As possible, we used existing infrastructure. Continuous measure reviews helped identify and mitigate reporting errors and unearth immediate needs. In parallel, we provided coaching in systems improvement, knowledge sharing, and community connection. We facilitated rapid learning cycles where stakeholder organizations learned from small-scale tests of changes and from one another. We continuously identified best practices from other regions, sharing knowledge back with regional partners. We identified contextual realities within neighborhoods and on the front lines, facilitating the co-design of tailored solutions. Transparent data sharing, learning from variation, sharing best practices, and connecting with community members deepened trust, stimulated action, and enabled participants to see themselves as part of one LHS with common objectives. 24 This approach, built from the bottom-up, facilitated the identification, contextualization, and alignment of responses to new challenges or top-down directives. There is now an opportunity to build better national infrastructure by learning from hundreds of small-scale responses like ours. Future phases of this pandemic, other pandemics, climate events, and economic disasters all could benefit from such infrastructure and learning. Complex challenges demand coordinated, integrated, and adaptive functionalities across relevant sectors. Recognizing the power of LHS approaches like ours has the potential to inform policy and support better systems for emergency preparedness and for population health. Indeed, COVID-19 highlights the urgency to achieve data interoperability and trustworthy integration of data, programs, and ideas. 6 Building a national system by capturing regional innovations (and learning from failures) may seem daunting, but it is a tractable problem. There are <400 metropolitan statistical areas like Greater Cincinnati across the United States. It is possible to J o u r n a l P r e -p r o o f gather and curate the best of what is taking place in such regions, share it broadly, and provide mechanisms to access not just technical experts, but also peers who have solved similar problems. 25 Regions must also have the resources and supports necessary to optimize existing capabilities and then extend them. Policies and incentives should promote cross-jurisdictional and cross-sector alignment. LHS development will require support for technical assistance to learn and apply new methods of system change and collaborative learning. It will also require investments in educating the next generation of LHS improvers, and researching how LHS design, technology, and data and digital governance shape communities' ability to respond at the speed and scale of epidemics. Legend: The left side of this figure illustrates the oft-separate, siloed sectors. To connect these related but disconnected sectors for a region such as Greater Cincinnati (map in the center), there are a series of challenges (middle-top) that can be met through the identified solutions (middle-bottom). For the current pandemic, this resulted in the MAC depicted on the right. The MAC is co-chaired by the Chief Executive Officer (CEO) of a large adult healthcare system and the CEO of the organization serving as both the convener of the regional disaster preparedness coalition and the RHIO. The MAC includes appointed representatives of regional healthcare systems, two public health commissioners representing regional public health jurisdictions, and a leader of the Council on Aging and CEO of a long-term care facility representing congregate care facilities (including skilled nursing facilities, jails, halfway houses, shelters etc.). Support teams include representation of infectious disease specialists, a Chair of Pathology representing laboratory operations, communications (linked to the Chamber of Commerce and business community), and our situational awareness and strategy team. Since the formation of the MAC, additional sectors and their representatives have been added, including those from schools and universities. Together, the MAC and teams that support the MAC focus on aims relating to disease containment, testing and tracing, non-pharmaceutical interventions, communications across sectors and with the public, and supply chain (eg, hospital beds, ventilators, PPE). Such a structure could have lasting ramifications as we seek population health situational awareness and action to outlast COVID-19. Abbreviations: CEO -Chief Executive Officer; LHS -Learning Health System; MAC -Multi-Agency Coalition; RHIO -Regional Health Information Organization. By July 2020: • Reduce mortality to seasonal levels • Achieve and maintain R eff < 1.0 • Maintain workforce >95% J o u r n a l P r e -p r o o f Challenges • Diffuse, poorly integrated leadership structures, processes, and infrastructure • Lack of expectations, incentives, technical support for collaboration • Data aggregated to too large a geography or too specific to single healthcare system or public health jurisdiction • Delays, manual entry, and misaligned data definitions preclude accrual of complete, reliable, and mergeable data • Co-design of system with stakeholders, direct iteration toward pertinent decisions • Infrastructure to enable transparent, efficient production, sharing, and communication of measures and situational awareness data • Leveraged existing data infrastructure (eg, health information exchange, state reporting requirements, national datasets) • Tailored data presentations to meet stakeholder needs Connecting related but disconnected sectors J o u r n a l P r e -p r o o f The Learning Health System in Crisis: Lessons from the Novel Coronavirus Disease Pandemic Evidence-Based Practice for Public Health Emergency Preparedness and Response: Recommendations From a National Academies of Sciences, Engineering, and Medicine Report The Role of Situation Awareness in Naturalistic Decision Making Failing the Test -The Tragic Data Gap Undermining the U.S. Pandemic Response PUBLIC HEALTH INFORMATION TECHNOLOGY: HHS Has Made Little Progress toward Implementing Enhanced Situational Awareness Network Capabilities The Case for A Situational Awareness Network for Emergency Response COVID-19 and the Need for a National Health Information Technology Infrastructure Public Health Measures and the Reproduction Number of SARS-CoV-2 Public Health Interventions for COVID-19: Emerging Evidence and Implications for an Evolving Public Health Crisis Association of Public Health Interventions With the Epidemiology of the COVID-19 Outbreak in Wuhan, China The Architecture of Collaboration Response to COVID-19 in Taiwan: Big Data Analytics, New Technology, and Proactive Testing Impact of delays on effectiveness of contact tracing strategies for COVID-19: a modelling study Statistical process control as a tool for research and healthcare improvement. Qual Saf Health Care Racial Health Disparities and Covid-19 -Caution and Page 12 of 13 © 2021 Mayo Foundation for Medical Education and Research The Fierce Urgency Of Now: Closing Glaring Gaps In US Surveillance Data On COVID-19 Evaluation of the Effectiveness of Surveillance and Containment Measures for the First 100 Patients with COVID-19 in Singapore Applications of health information exchange information to public health practice Health Information Exchange in US Hospitals: The Current Landscape and a Path to Improved Information Sharing Information system concepts for quality measurement Population Health in the Time of COVID-19: Confirmations and Revelations • 4/30: Regional Multi-Agency Coalition (MAC) convened • 5/1: Reopening begins with healthcare systems • 5/21: Indoor dining at restaurants and bars permitted • 5/29-6/10: Protests for racial justice • 6/10: Entertainment venues opened • 7/2 This work, and broader efforts to manage this once-in-a-lifetime pandemic, would not have been possible without the efforts of countless individuals, teams, and organizations across Greater Cincinnati. We explicitly thank those within our healthcare systems, our public health departments, and our community who have been at the front lines during our regional COVID-19 experience.We would also like to thank Mr. Ben Dawson, Mr. Jason Bubenhofer, Mr. Perry Ellington, Mr. Alex Vaillancourt, and Ms. Esther Cleary for their efforts in support of population health situational awareness. We thank Dr. Stephen Davis, Dr. Evaline A. Alessandrini, Dr. Rick Lofgren, Dr. Dustin Calhoun, Mr. Craig Brammer, and Ms. Tiffany Mattingly for their leadership and for their review of this manuscript.