key: cord-0804807-ccr4m5q3 authors: Leyenaar, JoAnna K.; McDaniel, Corrie E.; Arthur, Kimberly C.; Stevens, Cathryn A.; St Ivany, Amanda R. title: Healthcare Quality for Acute Illness during the COVID-19 Pandemic: A Multisite Qualitative Analysis date: 2021-09-24 journal: Pediatr Qual Saf DOI: 10.1097/pq9.0000000000000476 sha: 303f7c439cd4984108299389ddc8db6e057ff2ce doc_id: 804807 cord_uid: ccr4m5q3 The coronavirus disease 2019 (COVID-19) pandemic incited substantial changes to acute care delivery, including the rapid scale-up of telehealth and numerous changes to in-person care. This study explored health system changes associated with the COVID-19 pandemic and their influences on pediatric acute care delivery and quality of care. METHODS: We conducted 38 semistructured interviews May–November 2020 with families and clinicians from 3 US regions, eliciting their perspectives and experiences regarding changes to acute care delivery during the pandemic. Interviews were analyzed using a general inductive approach to identify relationships between clinical care infrastructure, care processes, and healthcare quality. RESULTS: Emerging knowledge of COVID-19 epidemiology and associated restrictions influenced care-seeking behaviors and clinical infrastructure and processes. Infrastructure changes included the closure of some clinics, limited “sick visit” hours and locations, and increased resources for telehealth. Modified care processes included the assignment of clinicians to specific roles, limitations on sibling attendance, increased referrals to other clinics, and iterative development of procedures and protocols. Although intended to increase safety, these changes appear to have decreased access, timeliness, and equity of care. High-quality care was supported by telephone triage processes, in-person visits following initial assessments by telehealth, and identification of diagnoses and populations best-suited to telehealth versus in-person care. CONCLUSIONS: Changes in acute care delivery during the COVID-19 pandemic may have negatively impacted healthcare quality in some domains. Implementation of pediatric-specific guidelines and decision aids describing diagnoses, populations, and procedures best-suited to telehealth may improve the quality of acute care delivery. decreases in the quality of care for health screening and patient follow-up during the pandemic. 10 In the realm of well-child care, COVID-19 health system changes have been associated with decreased immunization rates and delays in preventative care. 11, 12 However, few studies have examined how COVID-19 has impacted healthcare quality for children experiencing acute illnesses. Therefore, we conducted a qualitative study to explore how health system changes associated with the COVID-19 pandemic have influenced pediatric acute care delivery and quality of care. Due to limited knowledge of the implications of health system changes on healthcare quality, we used qualitative methodology to investigate the perspectives of parents and clinicians, adhering to the Standards for Reporting Qualitative Research. 13 This study was conducted in the context of an ongoing multisite clinical trial comparing the effectiveness of direct admission to admission through EDs for children hospitalized with common pediatric illnesses. In this study, 70 referring primary care and urgent care pediatric practices across 3 health systems collaborate to evaluate hospital admission processes and outcomes. For this qualitative analysis, we defined acute care to include primary care, urgent care, ED care, and inpatient hospitalizations for self-limited acute illnesses. Semistructured interviews were conducted from May to November 2020 across 3 health systems in the Northeast, Midwest, and West Coast of the United States. Institutional review board approval was provided by Dartmouth College, with all implementation sites ceding review to this IRB. We used a purposeful sampling approach to attain the perspectives and experiences of clinicians and parents of children hospitalized with acute illnesses. 14 Clinicians were recruited from the above-described 70 primary or urgent care practices and three hospitals. We sought participants with varied clinical roles, including primary care providers (PCPs), urgent care clinicians, inpatient nurses, and pediatric hospitalists. Parents were eligible if they had a child hospitalized with an acute illness such as pneumonia, skin and soft-tissue infections, or dehydration (excluding , if they were English-speaking, and if their child's usual source of care was one of the above-described primary care practices. Parents were purposefully sampled to reflect direct and ED portals of admission and varied reasons for hospitalization. Research team members at each site invited clinicians to participate and approached parents during their child's hospitalization to request their participation. Interviews were conducted by phone, video conference, or in-person, complying with each hospital's COVID-19 research protocol. Each participant received a $50 gift card. We developed semistructured interview guides for parents, outpatient-based clinicians, and inpatient-based clinicians. We modified the guides prospectively based on the results of iterative data analysis and changing COVID-19 trends. Table 1 , Supplemental Digital Content 1, http:// links.lww.com/PQ9/A314, summarizes areas of interview inquiry for the 3 target populations. Interview questions inquired about changes to acute care delivery during the pandemic, resources needed to conduct telehealth, limitations, and opportunities of virtual visits, protocols and procedures related to COVID-19, and perceived implications of these changes on healthcare quality. The interview guide was piloted and modified before initial use. Consent was obtained at the beginning of each interview, including permission to audiorecord. Recordings were transcribed by a professional transcription service and verified for accuracy. Interviews were continued until data saturation was achieved. At that time, the research team agreed that the same codes were being observed repeatedly in the data, and recruitment of both parents and clinicians was ceased. 15 A 5-member research team, comprised 2 clinician-researchers (J.K.L. and C.E.M.), a parent consultant (C.A.S.), a research scientist (K.C.A.), and a qualitative methodologist (A.R.S.) conducted the analysis using a general inductive approach rooted in grounded theory. 16 Interviews with clinicians and parents were analyzed concurrently, and emerging concepts were summarized in a jointly developed codebook and coding framework, adding concepts as needed. The same codebook was used to develop a conceptual model informed by multistakeholder perspectives for both parent and clinician interviews. After identifying initial concepts, we recognized parallels between our findings and the quality of care framework developed by Coyle and Battles 17 , which expands on Donabedian's structure-process-outcome model to incorporate the "antecedents" of medical care (see Table 2 , Supplemental Digital Content 2, http://links. lww.com/PQ9/A315 for definitions and adaptations). We also noted that participants' descriptions of healthcare quality aligned with the Institute of Medicine's quality of care domains. 18 We, therefore, used these models to guide our subsequent analysis. Three full interviews and selected text from five interviews were triple-coded by three members of the research team (A.R.S., C.A.S., and K.C.A.). Disagreements were resolved through in-depth discussions and revisions of the concepts, corresponding codes, and definitions. Following codebook finalization, these 3 research team members coded all transcripts using Dedoose. 19 Through an iterative process of axial coding, 20 emergent themes and domains were summarized in a conceptual model. For validity, we member-checked our findings with a 12-member multistakeholder advisory board of parents and healthcare providers upon completion of analysis. 21 This advisory board was convened to provide diverse perspectives on our direct admission study design and findings; advisory board members were not interview participants. We conducted 38 interviews across 3 healthcare systems. Approximately two-thirds of participants were clinicians, and one-third were parents of children with acute illnesses (Table 1 ). Figure 1 illustrates the conceptual model resulting from our analyses, summarizing the relationships between four major themes that mapped to Coyle's framework 17 : (1) emerging understanding of COVID-19 epidemiology (antecedents of medical care); (2) changes to clinical care infrastructure and resources (structure); (3) modified processes of healthcare delivery (process); and (4) quality of care (outcomes). Emerging understanding of COVID-19 epidemiology, pediatric disease presentation, and associated societal restrictions (eg, stay-at-home orders) were key antecedents to changes in clinical care infrastructure, leading to modifications in processes of care. Clinicians described how emerging knowledge of COVID-19 influenced decision-making about where and how to treat patients. In the words of one urgent care provider, "Initially, the thought was that everything's going to be COVID…So anyone with just an inkling of symptoms, we tended to treat more conservatively…We expected to see this huge influx of patients…but the opposite actually happened. People decided not to come in" (ID123, Site C). Clinicians also reported a desire to keep families and children out of the healthcare system, stating, "If that kid can fly at home, you keep them at home" (ID105, Site A). Clinicians reported seeing considerably fewer children for sick visits, contributing to an overall decrease in patient volumes. Clinicians and parents also described how fear of COVID-19 exposure led parents to avoid in-person care in any setting. One parent reported, "I would say that every interaction with the healthcare system or going anywhere in public is a risk and creates anxiety" (ID211, Site A). Changes to clinical care infrastructure included the designation of separate rooms for patients with and without infectious disease symptoms, closure of some clinic locations within a health system, restructuring of clinic sites to provide either well-child care or "sick visits" to avoid "cross-contaminating patients," and increased equipment and training for telehealth. Associated changes to processes of care included allocation of "sick clinic" hours to a subset of PCPs, changing policies and procedures for in-person visits, and developing and modifying protocols for telehealth. Changes to the in-person visit procedure included checking in for appointments by phone, waiting for appointments in personal vehicles, restrictions on sibling attendance at appointments, and clinicians performing physical examinations in personal vehicles to minimize infectious disease risks. For example, one PCP stated, "A kid with URI [upper respiratory infection] symptoms…who I really need to do an ear exam... We basically have them pull up to the curb in front of our clinic, and then we would proceed to see the patient out there with protective equipment on" (ID113, Site C). Clinicians described more readily diverting patients with infectious disease symptoms to an ED or urgent care clinic, with one clinician stating, "I think a lot of us…are more likely to [send] to the ER during COVID just so that someone can see the child in person and do what we can't do over video" (ID108, Site A). One of the most striking findings was the variation across clinics. For example, one clinician reported sending all pediatric patients with respiratory symptoms to a respiratory clinic without pediatricians, in contrast to another clinician who reported no changes other than the addition of telehealth visits. Of all of the changes in acute care delivery described in this study, the transition to telehealth had the most significant impact on processes of care, with one clinician asserting that telehealth "completely changed the way we practice." Clinicians described associated changes to their clinical roles, with one participant reporting, "We have a sick doc every day of the week, there's a virtual doc" (ID111, Site B). The inability to conduct a thorough physical examination was the most frequently reported challenge associated with telehealth for acute illnesses. Clinicians noted the benefits of triage protocols to inform decisions about seeing a child in-person or via telehealth and of telehealth for initial assessments, informing decisions about whether to bring the child into the clinic or refer to urgent care clinics or EDs as needed. Clinicians and parents described how COVID-19-related changes to clinic infrastructure and processes of acute care delivery influenced quality of care, resulting in tradeoffs between patient safety and other healthcare quality domains, including access, timeliness, effectiveness, equity, and patient-centeredness. These tradeoffs and unintended consequences are summarized with representative quotes in Table 2 . Clinicians and parents also described how care processes enhanced healthcare quality (Table 3) , providing convenience for families while minimizing COVID-19 exposure. Within the realm of patient and provider safety, clinicians described using telehealth and new clinic procedures to minimize patient and family exposure to COVID-19 at the cost of healthcare quality in other realms. This change was articulated by 1 PCP who stated, "Telehealth is good for some things and not for others… I feel like it's sometimes made me feel like I'm practicing not as good medicine" (ID125, Site B). One clinician described a partner who experienced a near-miss because it was impossible to perform a physical exam on an adolescent with tachypnea; the patient was subsequently found to have pleural and pericardial effusions. COVID-19 guidelines also impacted the safety of in-person visits. For example, due to clinic guidelines to avoid aerosolizing procedures, a young child with reactive airway disease with low oxygen saturation was sent home with a nebulizer machine and clinicians, "just kind of crossed our fingers that the mom would be able to give the nebulizer treatment at home" (ID115, Site B). Clinicians and parents described challenges with access to care and timeliness of care for both in-person visits and telehealth. Changes to clinic hours negatively impacted families, with one clinician acknowledging that these changes "restricted access to the office." One parent stated, "...It's frustrating. Any time we think about, 'oh, okay, you're not feeling good'…well, [now] we wait four days… It's made it quite difficult…just not being able to get in on the same day. I definitely took that for granted. I always thought that was going to be an option" (ID207, Site B). The reduction or elimination of walk-in hours and closure of clinics reduced access, with one parent stating, "And then having that super easy walk-in clinic, too, taken away feels hard" (ID207, Site B). The designation of separate physicians for acute care, well-child care, and virtual visits impacted continuity of care. For example, one parent reported, "There was absolutely no way we could see her primary care doctor at all" (ID207, Site B). In contrast, a clinician reported that telehealth resolved "transportation, funds, other household issues" related to access for some families. Parents also described positive reports of little-to-no waits for telehealth encounters. Clinicians raised several questions about their abilities to provide efficient and effective healthcare delivery via telehealth, noting potential overutilization of diagnostic testing or antibiotics, particularly for pharyngitis and otitis media in the absence of a physical examination. However, a provider stated that it was possible to reach a definitive diagnosis via telehealth "probably 75% of the time." Diagnoses identified as well-suited to telehealth included mental health concerns, constipation, feeding issues, and rashes; respiratory complaints, otitis media, and pharyngitis were described as poorly suited to telehealth. Parents raised some additional concerns about effectiveness, reporting that even with in-person visits, off" with increased referrals to urgent care and decreased access to in-person visits with regular pediatrician "Our primary care is [clinic name] and they have like six clinics within our area that we can go to, right? And so I was shocked when she told me that I couldn't get in on the same day...she was having such a hard time finding anything within the same week…So there was absolutely no way we could see her primary care doctor at all, and we had to wait from Tuesday to Saturday to make an appointment…" [ID 207, Site B, parent] "I think a lot of parents have utilized our virtual option [for acute care], and they've really appreciated it for certain things. So they're utilizing that. And I guess the flip side is they don't like the fact that they can't go to their regular pediatrician if we determine… that the patient should be seen in clinic, they don't appreciate the fact that they have to go to urgent care and they can't see their regular pediatrician." [ID 125, Site B, Primary care pediatrician] Equitable Healthcare Delivery: Increase in telehealth services may make it more challenging to engage interpreter services; information dissemination strategies regarding acute care protocols and procedures may not reach all population groups "It's a lot harder to incorporate interpreters, so…families might identify that as a potential barrier that they don't feel comfortable using an interpreter over the phone or that they might not be willing to disclose that they want to use an interpreter, so then you have subquality visits because the family's not using an interpreter when they should be…The dissemination of information in that we're doing telehealth can be disproportionately sent to some patients versus others…" [ID 124, Site C, Hospitalist] Effective Healthcare Delivery: Concern for COVID-19 may result in narrowed differential diagnosis; lack of physical examination by telehealth may influence ability to effectively make diagnoses "I think they were just more concerned of, "Oh, it's COVID. Oh, it's COVID" without actually checking over everything and making sure she had other signs…I just think that they were overlooking some things, because they potentially just wanted it to be COVID- 19 heightened concerns for COVID-19 infection may have led healthcare providers to "overlook some things." In the equity domain, clinicians and parents reported that some parents were unable to benefit from the convenience of telehealth due to limited Wi-Fi availability, internet connectivity challenges, limited phone storage space, challenges accessing interpreter services, and inequitable distribution of information about clinic procedures during the COVID-19 pandemic. As one PCP stated, "Some families who have a hard time with…re-sources…they don't have the computer, or they don't have the internet connection, or they don't have sort of the technical know-how to get things set up" (ID 125, Site B). In the most extreme cases, clinicians reported that families might be unable to use telehealth at all, resulting in an access disparity. Clinicians described challenges associated with using interpreters via telehealth and raised questions about their abilities to effectively counsel families and assess parental understanding when teaching was done via telehealth. In the domain of patient-and family-centered care, participants most frequently described the convenience of telehealth, with one clinician noting that there is "no greater stress than getting a kid into the clinic." In some cases, parents reported discomfort with telehealth stating, "But it still was scary to have to deal with it at home, feeling more alone, not having that kind of touch, face-to-face, in-person time with a provider" (ID211, Site A). Several parents raised concerns about the policies at clinics and hospitals that limited sibling attendance, causing them to delay care and receive less family support while inpatient (representative quotes provided in Table 2 ). Through qualitative analysis of interviews with parents and clinicians across three healthcare systems in the United States, we characterized pediatric acute care delivery changes during the first 9 months of the COVID-19 pandemic and corresponding relationships with healthcare quality. Parents and clinicians described the implications of the rapid scale-up of telehealth, shifts in primary care, and walk-in clinic hours, locations, and clinician roles. Although changes in acute care delivery were intended to improve patient and provider safety, participants described unintended consequences concerning access to usual sources of care, timeliness, and health equity, indicating opportunities for clinical improvements during and beyond the COVID-19 pandemic. Although the technology for telehealth was widely available before the COVID-19 pandemic, barriers related to clinic infrastructure, payment and reimbursement structures, malpractice policies, and technology requirements limited its widespread implementation. [22] [23] [24] [25] That's a big plus for me. I didn't have to wait. We got online right when they were getting online, so. The wait time was--no wait time and I don't have to leave the house. I think that's two big pluses." [ID 209, Site C, parent] "For many disease processes, it's very useful. It's very convenient for families, oftentimes, just because they don't have to take as much time out of their day to do the visit. There's not a commute. There's not a sitting in the waiting room and registering and then sitting in the exam room waiting for the doctor and all those steps. So it takes out a lot of the inefficiencies in the process of seeing your doctor." [ID 113, Site C, Primary care pediatrician] Effective Care Delivery: Telehealth may be most effective when provided through the medical home with a disclosure that it may be followed by an in-person visit. Protocols and decision aids regarding populations and diagnoses best-suited to telehealth enhance effectiveness of care delivery. "So I'm not sure that every telehealth service is equivalent. I think telehealth through your medical home probably is the best option if you're going to use telehealth…" [ID 114, Site A, Primary care pediatrician] "At the beginning of the visit, we make a disclosure. We will try our best to provide the care, confidential care, during this visit, and at any point, if the parent or the provider think that we care not able to provide the care we need, then I might ask you to come to the clinic. I will set up an appointment, or I might ask you to go to the urgent care. And parents understand that..." [ID 116, Site C, Primary care pediatrician] "Our clinic is really good at triaging, by the time they get on my schedule as a telehealth visit most of the ones that really need to be seen in person have already been triaged and told to be seen in person. So I would say probably 80% of the telehealth visits I do we're able to come to a satisfactory conclusion. Before the pandemic, less than 15% of pediatric clinics reported using telehealth. 22, 23 Telehealth's rapid scale-up during the early stages of the pandemic enabled participants to identify several best practices specific to pediatric acute care delivery. Participants also identified concerns about antibiotic stewardship and potentially unnecessary diagnostic testing associated with telehealth for some acute illnesses, aligning with two past studies demonstrating increased rates of antibiotic prescribing via virtual encounters relative to in-person visits. 26, 27 These findings can inform telehealth use during and following the pandemic, building on national guidance from both the American Academy of Pediatrics and Taskforce on Telehealth Policy. [28] [29] [30] Although telehealth was described as a means of increasing healthcare access, several changes to clinic infrastructure and processes of care related to COVID-19 were described as having the opposite effect, particularly limiting access to families' usual sources of care. These changes may have substantial impacts on healthcare quality, given evidence that care within a patient-centered medical home is associated with improved health outcomes, parental satisfaction, and decreased healthcare costs. 31 Minimizing compartmentalization within practices between clinicians who provide telehealth and in-person encounters may help to overcome this challenge. Telehealth has been widely advocated as a potential means of improving access to care and health equity by overcoming barriers, including transportation, childcare, and associated costs. 32, 33 Findings from this study indicate that the rapid scale-up of telehealth has achieved some of this promise, but concerns about equitable healthcare delivery persist. Consistent with pre-COVID-19 literature, families experienced challenges with broadband access, interpreter service availability, and digital literacy. 34, 35 These findings align with three recent studies demonstrating significantly lower telemedicine utilization among racial-ethnic minority populations during the pandemic. 9,36,37 Our conceptual model, considering both structural and procedural factors that impact the quality of care, may be used in future work to inform quality improvement efforts to address inequities. Strengths of this study include its multisite design and participation of parents and clinicians working in primary care, urgent care, and inpatient settings. Limitations include our exclusion of parents who did not speak English, those whose child did not meet the criteria for hospital admission, and those who could not access the healthcare system. Also, PCPs are overrepresented in our sample. At the same time, parents are underrepresented, which may have resulted in a relatively greater emphasis on primary care health system structure and process changes in our conceptual model. The validity and transferability of this work are supported by consistency in results across our 3 implementation sites, but we acknowledge that qualitative research is, by design, hypothesis-generating. Additional research examining the quality of care in larger samples is needed to confirm the relationships we propose in our conceptual model linking acute care delivery structures and processes with quality of care. Pediatric acute care delivery has changed substantially during the COVID-19 pandemic. Although changes were made to improve safety for families and clinicians, they appear to have come at a cost to healthcare access and quality of care. The development and implementation of guidelines and decision aids describing diagnoses and populations best-suited to telehealth and in-person encounters and purposeful use of telehealth for initial assessment and management may improve the quality of acute care delivery. Clinics and hospitals may apply these findings to prioritize improvements in healthcare delivery and correspondingly evaluate health outcomes. US Acute Care Solutions Research Group. Characterizing pediatric emergency department visits during the COVID-19 pandemic Impact of the COVID-19 pandemic on emergency department visits Pediatric hospitalizations during the COVID-19 pandemic Decreased hospital admissions through emergency departments during the COVID-19 pandemic Visitor restriction policy on pediatric wards during novel coronavirus (COVID-19) outbreak: a survey study across North America Benefits and risks of visitor restrictions for hospitalized children during the COVID pandemic Contributing factors to personal protective equipment shortages during the COVID-19 pandemic Telehealth transformation: COVID-19 and the rise of virtual care Pediatric Quality and Safety Practice-level variation in telemedicine use in a pediatric primary care network during the COVID-19 pandemic: retrospective analysis and survey study Primary care in the time of COVID-19: monitoring the effect of the pandemic and the lockdown measures on 34 quality of care indicators calculated for 288 primary care practices covering about 6 million people in Catalonia Effects of the COVID-19 pandemic on routine pediatric vaccine ordering and administration-United States Provision of pediatric immunization services during the COVID-19 pandemic: an assessment of capacity among pediatric immunization providers participating in the vaccines for children program -United States Standards for reporting qualitative research: a synthesis of recommendations Purposeful sampling for qualitative data collection and analysis in mixed method implementation research Saturation in qualitative research: exploring its conceptualization and operationalization Using thematic analysis in psychology Using antecedents of medical care to develop valid quality of care measures Crossing the Quality Chasm: A New Health System for the 21st Century. The National Academies Press Dedoose Version 8.0.35, web application for managing, analyzing, and presenting qualitative and mixed method research data The Coding Manual for Qualitative Researchers Qualitative Inquiry and Research Design: Choosing among Five Traditions The current pediatric telehealth landscape Pediatrician attitudes toward and experiences with telehealth use: results from a National Survey Telemedicine: pediatric applications Overview on the challenges and benefits of using telehealth tools in a pediatric Population Antibiotic prescribing during pediatric direct-to-consumer telemedicine visits Access and quality of care in direct-to-consumer telemedicine Guidance on the necessary use of telehealth during the COVID-19 pandemic Taskforce on telehealth policy (TTP) findings and recommendations. 2020. Available at The use of telemedicine to address access and physician workforce shortages Why is a medical home important? 2021 COVID-19 pandemic health disparities and pediatric health care-The promise of telehealth Strategies for evaluating telehealth Telemedicine and health disparities during COVID-19 Patient interest in and barriers to telemedicine video visits in a multilingual urban safety-net system Changes in health services use among commercially insured US populations during the COVID-19 pandemic Telemedicine expansion during the COVID-19 pandemic and the potential for technology-driven disparities We would like to acknowledge and thank the research assistants and coordinators who recruited participants and conducted interviews at our three implementation sites, including Kristyn Feldman (Children's Hospital of Pittsburgh, Pittsburgh, Pa.), Kathleen Sanders (Providence Regional Medical Center, Everett, Wash.), and Lauren Volz (Nationwide Children's Hospital, Columbus, Ohio). We would also like to acknowledge Jaclyn Engel, Research Assistant, Dartmouth College, for her work in conducting interviews with healthcare providers and for contributing to the initial codebook developed for this project.