key: cord-0904516-ohq7c913 authors: Itamura, Kyohei; Rimell, Franklin L.; Illing, Elisa A.; Higgins, Thomas S.; Ting, Jonathan Y.; Lee, Matthew K.; Wu, Arthur W. title: Assessment of Patient Experiences in Otolaryngology Virtual Visits During the COVID-19 Pandemic date: 2020-06-08 journal: OTO Open DOI: 10.1177/2473974x20933573 sha: 8d54d1627068002368b7960e0b780866f57c6880 doc_id: 904516 cord_uid: ohq7c913 This study evaluates the patient experience during virtual otolaryngology clinic visits implemented during the coronavirus disease 2019 (COVID-19) pandemic. Patient satisfaction surveys were queried from January 1, 2020, to May 1, 2020, for both telehealth and in-person visits. A descriptive analysis of the question responses was performed. There were 195 virtual and 4013 in-person visits with surveys completed in this time period. Ratings related to provider-patient communication were poor for virtual visits. Telehealth has become the new norm for most health care providers in the United States. This study demonstrates some of the initial shortcomings of telehealth in an otolaryngology practice and identifies challenges with interpersonal communication that may need to be addressed as telehealth becomes increasingly prevalent. W ith the coronavirus disease 2019 (COVID- 19) pandemic, otolaryngologists, among other specialties, implemented telehealth strategies to adapt to physical distancing guidelines. [1] [2] [3] [4] [5] [6] [7] [8] [9] Previous studies demonstrated telehealth to be cost-effective and useful. [10] [11] [12] [13] [14] Given the perceived utility of remote care under these circumstances, policy changes have readily promoted its increased use across specialties. 15 Implementing telehealth on a wide scale presents unique challenges to otolaryngologists given routine use of endoscopy and microscopy. 16 However, recent efforts have demonstrated the promising potential of new techniques and tools to evaluate these patients. [16] [17] [18] [19] [20] As telehealth inevitably becomes prevalent from improved technological access and response to the pandemic, there is an emerging knowledge gap of how these rapidly evolving practices are addressing patient needs and concerns. 21 The main objective of this study was to assess the virtual visit experience from the patient's perspective relative to more traditional in-person clinic visits in the same time period. The National Research Corporation is currently used to administer and collect the Clinician and Group Consumer Assessment of Healthcare Providers and Systems (GC CAHPS) survey across outpatient clinics. 22 This has continued during the recent conversion to telehealth, although with slight alterations to suit the different platform. Providers have used Doximity Dialer 23 videoconferencing software for most visits, with Facetime 24 as an alternative. Virtual visit time slots were doubled compared to in-person time slots to allot for technological issues and potential inefficiencies in communication. Cedars-Sinai internal institutional review board exemption was granted for this study since no personal health information was accessed. Patient satisfaction metrics were queried from January 1, 2020, to May 1, 2020, for both telehealth and in-person visits for the 16 otolaryngology providers in our practice. Questions contained in the respective surveys and mean scores are shown in Table 1 and Table 2 . Data from individual surveys were not available, so standard deviation and error were not calculable. Statistical analysis between telehealth and in-person visits was also not calculable, so a descriptive analysis of the results was performed. During the study time period, there were 195 virtual visits and 4013 in-person visits with survey results. Results are displayed in Tables 1 and 2, respectively. Figure 1 shows results from overlapping questions. Despite allotting double time per visit, scores across the survey were surprisingly low in certain categories. Ratings for ease of connection to the provider (65.6), video quality (68.1), wait times (66.7), knowledge of medical history (64.7), and patient understanding of what to do for followup questions (65.2) were poor for virtual visits. Ratings for trust in the provider, provider listening, likelihood to recommend, and overall rating were higher. Physical distancing is critical to curtail the spread of COVID-19. 25 Many providers have transitioned most of their clinic visits to virtual visits, 26 and these efforts have been bolstered by policy changes by reimbursing entities. 27 With so many providers now relying on this method to deliver care, it is critical to determine the efficacy of these services during and after the pandemic. 28 Best practices must be established to optimize quality of care in the remote setting. 29 There is a particular need to evaluate the subjective patient experience during these virtual visits to determine its impact on the patient-physician relationship. 21 Potential harms of relying on virtual visits include diagnostic challenges from the provider's perspective but also suboptimal interpersonal communication. Although previous studies have described positive patient satisfaction for telehealth services, its applicability in otolaryngology is less known. 30 In this study, we report poor ratings on questions relevant to interpersonal communication from patients who underwent virtual visits. Although speculative at best, we postulate that the patient's subjective experience was influenced negatively by this introduction of telecommunication. Despite doubling the length of visits, patients noted difficulties in communication and longer wait times for their visit. The quality of the video was rated quite low by patients and reflects several variables, including the Internet speeds of each individual and the server speed of the platform's server. Audio-video lag is especially frustrating during provider-patient conversation, resulting in an individual talking over the other or missing important details. Patients were not queried about Internet speeds, but this is a consideration that might affect the patient experience. Wait times were also poorly rated for video visits. Virtual check-in to complete various forms may take longer for patients and staff to accomplish. In addition, many of these issues may be a result of providers initially adopting telehealth without formal training or equipment and adapting to these new changes quickly. Over time, it is reasonable to expect patient satisfaction to increase as technical difficulties are optimized. As many otolaryngologists continue telehealth in their practices moving forward, the need remains to determine how these new practice patterns affect the patient experience. Despite the noted advantages that telehealth provides, we observe that there is room for improvement with regards to patient satisfaction in delivering care remotely. Our study is limited to the experiences of the providers and patients at our single institution during this limited time period, and therefore selection bias may skew the results of this initial report. In addition, statistical analysis could not be performed to directly compare virtual and in-person visits. Future work should elucidate whether patient attitudes change over time as telehealth becomes a more familiar medium. Due to the COVID-19 crisis, telehealth has abruptly become the new norm for most health care providers in the United States. This study demonstrates some of the initial shortcomings of telehealth in an otolaryngology practice. Kyohei Itamura, data interpretation, initial manuscript creation, manuscript revision; Franklin L. Rimell, data collection, data interpretation, manuscript revision; Elisa A. Illing, data interpretation, initial manuscript creation, manuscript revision; Thomas S. Higgins, data interpretation, initial manuscript creation, manuscript revision; Jonathan Y. Ting, data interpretation, initial manuscript creation, manuscript revision; Matthew K. Lee, data collection, data interpretation, manuscript revision; Arthur W. Wu, study concept creation, data collection, data interpretation, initial manuscript creation, manuscript revision. Competing interests: Thomas S. Higgins, Sanofi/Regeneron (consultant, speaker), Optinose (investigator/research grant, speaker), Genentec (consultant), Gossamer (investigator/research grant), and Intersect (investigator/research grant); Arthur W. Wu, Sanofi/ Regeneron (medical advisory board, speaker), Optinose (investigator, speaker), and Gossamer (investigator). Funding source: None. Telehealth in oncology during the COVID-19 outbreak: bringing the house call back virtually Mitigation of head and neck cancer service disruption during COVID-19 in Hong Kong through telehealth and multi-institution collaboration The role of telehealth during COVID-19 outbreak: A systematic review based on current evidence Rapid utilization of telehealth in a comprehensive cancer center as a response to COVID-19 Future-proofing cardiac rehabilitation: transitioning services to telehealth during COVID-19 Inpatient teledermatology during the COVID-19 pandemic Telemedicine online visits in urology during the COVID-19 pandemic: potential, risk factors, and patients' perspective Emerging practice patterns in vascular surgery during the COVID-19 pandemic Virtual ophthalmology: telemedicine in a Covid-19 era Use of telehealth during physical rehabilitation for patients with CHF: a systematic review Effectiveness of mobile health interventions on diabetes and obesity treatment and management: systematic review of systematic reviews Effectiveness of telemedicine for pregnant women with gestational diabetes mellitus: an updated meta-analysis of 32 randomized controlled trials with trial sequential analysis Effectiveness and costeffectiveness of telehealth in rural and remote emergency departments: a systematic review protocol Outcomes of telehealth in the management of type 2 diabetes: a systematic review and meta-analysis of RCTs CMS payment policies & regulatory flexibilities during COVID-19 emergency Telemedicine in otolaryngology Where does telemedicine fit into otolaryngology? An assessment of telemedicine eligibility among otolaryngology diagnoses Successful telemedicine programs in otolaryngology COVID-19 and rhinology: a look at the future Reliability and accuracy of remote fiberoptic nasopharyngolaryngoscopy in the pediatric population Telemedicine and e-health solutions for COVID-19: patients' perspective Doximity dialer for iPhone and Android Facetime on the App Store Social distancing during the COVID-19 pandemic: staying home save lives Implementation guide for rapid integration of an outpatient telemedicine program during the COVID-19 pandemic CMS flexibilities to fight COVID-19 Embracing telemedicine into your otolaryngology practice amid the COVID-19 crisis: an invited commentary Optimizing your telemedicine visit during the COVID-19 pandemic: practice guidelines for head and neck cancer patients Telehealth and patient satisfaction: a systematic review and narrative analysis