key: cord-0766555-c788feij
authors: Gilbert, Anthony William; Billany, Joe C T; Adam, Ruth; Martin, Luke; Tobin, Rebecca; Bagdai, Shiv; Galvin, Noreen; Farr, Ian; Allain, Adam; Davies, Lucy; Bateson, John
title: Rapid implementation of virtual clinics due to COVID-19: report and early evaluation of a quality improvement initiative
date: 2020-05-21
journal: BMJ Open Qual
DOI: 10.1136/bmjoq-2020-000985
sha: 75efc54dce91eb7bbde8963f5ce2fea16eb22ea8
doc_id: 766555
cord_uid: c788feij

BACKGROUND: The COVID-19 outbreak has placed the National Health Service under significant strain. Social distancing measures were introduced in the UK in March 2020 and virtual consultations (via telephone or video call) were identified as a potential alternative to face-to-face consultations at this time. LOCAL PROBLEM: The Royal National Orthopaedic Hospital (RNOH) sees on average 11 200 face-to-face consultations a month. On average 7% of these are delivered virtually via telephone. In response to the COVID-19 crisis, the RNOH set a target of reducing face-to-face consultations to 20% of all outpatient attendances. This report outlines a quality improvement initiative to rapidly implement virtual consultations at the RNOH. METHODS: The COVID-19 Action Team, a multidisciplinary group of healthcare professionals, was assembled to support the implementation of virtual clinics. The Institute for Healthcare Improvement approach to quality improvement was followed using the Plan-Do-Study-Act (PDSA) cycle. A process of enablement, process redesign, delivery support and evaluation were carried out, underpinned by Improvement principles. RESULTS: Following the target of 80% virtual consultations being set, 87% of consultations were delivered virtually during the first 6 weeks. Satisfaction scores were high for virtual consultations (90/100 for patients and 78/100 for clinicians); however, outside of the COVID-19 pandemic, video consultations would be preferred less than 50% of the time. Information to support the future redesign of outpatient services was collected. CONCLUSIONS: This report demonstrates that virtual consultations can be rapidly implemented in response to COVID-19 and that they are largely acceptable. Further initiatives are required to support clinically appropriate and acceptable virtual consultations beyond COVID-19. REGISTRATION: This project was submitted to the RNOH’s Project Evaluation Panel and was classified as a service evaluation on 12 March 2020 (ref: SE20.09).

The 2019 novel coronavirus (COVID 19) outbreak was first reported in Wuhan, China and reached the UK on 31 January 2020. On 11 March 2020, the WHO declared the COVID-19 virus a pandemic. 1 mainly affects the upper respiratory tract, and associated clinical symptoms can be mild, severe or critical. 2 The COVID-19 virus spreads primarily through droplets of saliva or discharge from the nose when an infected person coughs or sneezes. Social distancing measures have been established, with the UK public being placed on 'lockdown' from 23 March 2020 3 to avoid transmission of the disease.

Physical attendance at outpatient clinics puts patients at risk of spreading COVID-19. Virtual consultations (VCs) are an important way for patients to access their care without this risk. There has been a surge in the interest for VC in response to COVID-19, 4 5 with the National Health Service (NHS) in the UK releasing new information governance guidance for their use. 6 The Royal National Orthopaedic Hospital (RNOH) is a specialist tertiary centre in Middlesex, UK. On average, 11 200 monthly face-to-face (F2F) consultations are held across two outpatient sites at the RNOH across a range of pathways.

The RNOH was actively developing virtual clinics prior to COVID-19 in line with the NHS Long Term Plan 7 regarding reduction in F2F outpatient appointments. One of the project team had previously investigated the acceptability of VC 8 9 and is actively researching this area. 10 In November 2019, the operational management team agreed to use the VC platform Attend Anywhere with the licence for use granted on 27 February 2020. On 5 March 2020, in response to the growing COVID-19 crisis, a target of reducing F2F clinics to 20% of all outpatient attendances was set. The COVID-19 Action Team was established to support the delivery of this target.

In June 2018, the RNOH committed to applying the Institute for Healthcare Improvement (IHI) approach to quality improvement (QI) to all applicable change processes and established an improvement team to support delivery of this strategy. The IHI method is a formal approach which includes a clear process for thinking through, conducting and analysing the change ideas in a Plan-Do-Study-Act (PDSA) cycle. 11 Normally the improvement team trains and coaches front-line teams to lead and deliver changes, but COVID-19 needed a rapid response, so experienced and skilled members of the improvement team joined the COVID-19 Action Team to support an improvement approach at pace.

The aim of the project was for 80% of all RNOH outpatient appointments to be delivered as VC (using Attend Anywhere or telephone) within 11 days of the target being set (target 80% from 16 March 2020). The secondary aim was to collect data to support the design of a substantive legacy of VC post-COVID-19.

The goal of 80% VC was set and communicated across all clinical staff. Clinical staff were asked to screen clinical lists and identify patients suitable for a VC (either a telephone consultation (TEL) or a video consultation (VID)) rather than F2F for the next 3 weeks. Software upgrades and hardware deployment began immediately and were completed within 24 hours across both sites at the RNOH.

The COVID-19 Action Team was established to rapidly implement VC across the RNOH. The multidisciplinary team consisted of operational management and strategists, a project manager, QI personnel, a clinical research fellow and data management support. The team provided a variety of skills and resources to facilitate implementation. Daily meetings were scheduled to identify processes that needed to be redesigned to facilitate VC. Issues and actions logs were created to identify and overcome obstacles to implementation.

The overall approach to assess the impact of the intervention was straightforward: the percentage of patients undertaking VC (TEL or VID) compared with F2F. A combination of manual data collection of clinic lists and data taken from the RNOH patient management system was used to identify the proportion of patients undergoing VC. A simple, bespoke patient and clinician satisfaction questionnaire was developed to capture patient and clinician experience. This included the summative question 'how satisfied were you with the virtual clinic?' scored out of 100. These data collection methods were supplemented with informal observation and PDSA cycles.

Descriptive statistics were used to analyse quantitative data. A thematic analysis of qualitative data was used to illustrate the underlying reasons behind the quantitative data.

This project was submitted to the RNOH's Project Evaluation Panel and was classified as a service evaluation on 12 March 2020 (ref: SE20.09).

Between 5 and 27 March, a large number of PDSA cycles were undertaken simultaneously across the five main areas shown in table 1 to support rapid implementation of both telephone and video virtual clinics. Coordination of activity and management of interdependencies were managed via the daily implementation group teleconference. PDSAs were considered, and appropriate action to expand, redesign or retest was agreed. Figure 1 and table 2 demonstrate the per cent change of the different consultation types to achieve the target 80% VC, with the majority of VCs conducted using TEL. figure 2 demonstrates the proportion of virtual outpatient activity.

As outlined in table 1, a simple evaluation tool was developed to capture patient and clinician experience of virtual clinics from 16 March 2020. These results are demonstrated in table 3. Feedback was reviewed and discussed during daily COVID-19 Action Team meetings.

Patient satisfaction scores were high (90/100) for both telephone and video consultations. However, patients were more likely to consider using phone consultations again after a phone appointment (94% of patients) than video consultation patients wanting a further video appointment (36% of patients).

Open-ended qualitative data provided an overview of some of the potential reasons for high satisfaction among patients. These included the following: ► The offer of an alternative to F2F during the COVID- 19 pandemic. ► Reduced travel times. ► Reduced waiting times. ► Reduced impact of travel on symptoms. Open-ended qualitative data also provided an overview of some of the potential reasons for high satisfaction amongst patients and clinicians. These included the following: ► VC worked particularly well when the patient was already known to the clinician. ► VID was useful to assess a range of movements or visually assess a patient (figure 3). ► VC ran quicker than traditional F2F clinics. Common reasons for poor satisfaction for both patients and clinicians included the following: ► Variable sound and picture quality. Clinician and patient feedback mechanism in place.

Ongoing data collection and more detailed analysis required to inform future practice and sustainability post-COVID-19.

COF, Clinic Outcome Form; NHS, National Health Service; PDSA, Plan-Do-Study-Act; RNOH, Royal National Orthopaedic Hospital; SOP, standard operating procedure.

Open access Figure 1 Run chart of virtual consultation (VC) and face-toface (F2F) outpatient clinics. ► Low confidence levels with using the technology; both patients and clinicians required support with setting up the hardware and software. ► Equipment issues with outdated software (eg, using Internet Explorer or not having up-to-date phone/ tablet/computer operating system software). ► Patients occasionally were left waiting in the virtual waiting area without having been acknowledged by the hospital. These feedback forms were reviewed on a daily basis and informed the PDSA cycles.

Throughout the QI initiative, the COVID-19 Action Team collected information to support the future roll-out of VC after COVID-19. We now have in place all the technical elements to deliver outpatient appointments in a variety of ways appropriate to patient and clinician preference and convenience, and in the most effective way for the organisation. Prior to restarting a full outpatient service, a formal evaluation of patient and clinician experience will be undertaken. In addition, patient and staff stakeholder sessions will be held to inform any potential redesign of traditional outpatient models of care to incorporate VC.

The COVID-19 Action Team achieved the set goal of 80% VC by week 2. The use of QI methodology, specifically the use of repeated PDSA cycles, was essential to identify and overcome barriers to VC implementation.

The rapid implementation of VC was achieved due to the considerable resources directed to support it. The RNOH Senior Leadership Team clearly communicated VC as an important way to manage patients during the COVID-19 pandemic. The formation of the COVID-19 Action Team provided the initial resources to support patients and clinicians across the RNOH to engage with VC. The multidisciplinary nature of the COVID-19

Open access Action Team, with the ability to draft in extra personnel as required, ensured a wide range of skills and abilities to respond to the dynamic and complex circumstances of implementation. While this QI initiative was delivered in one Trust across two sites, the lessons learnt are relevant in other healthcare settings (table 4) .

The NHS Long Term Plan clearly sets out digital requirements needed to support NHS services. 7 VC features heavily on the RNOH Trust objectives, with VC due to be phased in. The catalyst for VC implementation was the COVID-19 pandemic. This unique situation required urgency to rapidly implement these changes; patients and staff were largely understanding of the necessity for VC and grateful for the swift response to the pandemic.

The RNOH is dedicated to supporting the use of VC, in accordance with the NHS Long Term Plan. 7 The key focus of the COVID-19 Action Team was to implement VC at pace. A secondary objective was to collect data to support the design of a substantive legacy of VC. Further stakeholder engagement initiatives and the use of frameworks 12 or theories of implementation 13 will support this. As we have found in this QI initiative, multidisciplinary working is key.

The majority of patients who underwent VC elected for a phone call (TEL) rather than a video call (VID). TELs have previously been found to be equally clinically effective as usual care, 14 although TELs were associated with lower patient satisfaction. A qualitative interview study with participants from the PhysioDirect telephone and advice service 15 found that the telephone service was broadly acceptable, but it was described as 'impersonal' and many were sceptical about the ability of TELs to achieve the goal of the session. For many the Physio-Direct service provided a 'route in' to care. The satisfaction of phone calls in our project was high (90/100), and approximately 94% indicated they would prefer a F2F call in the future. While TEL has proven to be a useful way to manage patients during the COVID-19 pandemic, further work needs to be done to understand its effectiveness and acceptability at the RNOH in the future.

Previous research 9 at the RNOH investigating patient preferences for types of appointments found that approximately 50% of patients found the use of Skype to be acceptable for a follow-up consultation. These preferences were situational and fluid; patients stated they might choose VID or F2F under differing circumstances. The COVID-19 pandemic is a situation which has forced patients to undergo VC regardless of their preferences. Of those who underwent VC in our project, approximately half indicated they would prefer F2F for their next appointment. This is in keeping with a report 16 that found that, from a survey of 2000 people, 55% would be willing to have a consultation for advice on an ongoing problem. Further research at the RNOH into preferences will likely sustain a legacy of clinically appropriate and acceptable VCs.

Greenhalgh et al 17 found that videoconferencing consultations appeared to work better when the patient and clinician knew each other. It is not obvious from our early evaluation data whether or not this is the case in our project, however, informal feedback from some clinicians indicates that having a prior relationship with the patient may have enhanced the consultation. Technical challenges have previously been shown to be prohibitive, 17 and those encountered in our project occasionally led to abandonment of VID. Clinicians often responded to these issues by abandoning the VID and transferring to TEL, or in cases where it was the sound that was mainly disrupted, they spoke over TEL while capturing images from VID to enable an assessment. Individual agency and reflexive monitoring played an important part in the successful implementation of VC. 18 Significant resources were intensively deployed to deliver this rapid implementation of VC. They included three additional members of staff almost full time to support the roll-out, the cost of hardware, software, Table 4 Lessons learnt regarding rapid implementation of virtual clinics

It is important to have a multidisciplinary team when rapidly implementing VC. The COVID-19 Action Team possessed a range of skills and abilities. The operational management and leadership provided the group with oversight of the workings of the RNOH and the strategic direction in response to COVID-19. Higher level support (from the Chief Operating Officer) facilitated engagement across RNOH. An assigned project manager directed the changes in response to the changing strategy of the Trust. QI personnel provided expertise on the change methodology required to facilitate a rapidly changing service. The use of QI provided a framework to identify and overcome unexpected issues. Insight from a clinical researcher helped identify potentially unexpected clinical issues. Access to data management support was essential to the success of the rapid implementation by providing real-time evaluation data. Flexibility across the group was essential to cross cover roles and responsibilities, particularly during the complex environment of COVID-19 when the system was undergoing rapid changes.

The presence of QI experts and the use of QI methodology facilitate rapid change. The COVID-19 Action Team was strongly outcome-focused and action-focused, and the improvement expert was able to influence the approaches to ensure learning was captured and built on. A skilled improvement advisor added structure and form to the project while facilitating improvement at the pace required. The PDSA approach offered a pragmatic framework to build sustainable change.

It is important to have daily briefings across the team when rapidly implementing VC. Daily virtual briefings with all members of the COVID-19 Action Team ensured optimal communication. Assigning a meeting chair and logging issues and actions ensured focus. Having all members of the multidisciplinary team present allowed for real-time troubleshooting and action planning.

It is important to have effective leadership when rapidly implementing VC. The strategy of the RNOH was clearly communicated to members of the Trust community. Setting a timed and distinct goal provided staff with clear direction. The allocation of resources to facilitate the goal provided the community with the support to enact the goal.

The success of VC is reliant on engaged staff. RNOH staff were flexible, proactive and supportive of the requirement to rapidly implement VC due to COVID-19. This supported a sense of common purpose, which was built on by project leads through continuously listening and reacting to issues raised by colleagues, leading to greater engagement and commitment to the shared goal.

The success of VC is reliant on adequate IT support. The IT team rapidly rolled out a programme of software upgrades and installed hardware for VC across the RNOH within a short space of time. The IT team prioritised COVID-19-related tasks during this period.

The success of VC is reliant on adequate IG support. The IG team were responsive to COVID-19 and provided clear and distinct guidance and troubleshooting for staff who were expected to work differently during this time.

The success of VC is reliant on adequate administrative support. The admin teams responded quickly and effectively to the rapid implementation of VC due to COVID-19. The admin staff were required to call patients to inform them of changes to their care. The teams conducted a huge number of challenging conversations over a short space of time.

It is important to undergo regular evaluation when rapidly implementing VC. After each consultation and at the end of each clinic, the feedback was studied, issues logged and communicated across the COVID-19 Action Team, and actions either taken immediately (eg, technical considerations) or agreed at the daily review meetings. These were conceived and presented as PDSA cycles.

Creating narrative through effective communications. Effective staff and patient communications were central to the success of the project. Staff were supported to share their stories early on, alongside creating easily accessible technical advice and training materials. Examples include clinician blogs, a patient video, training webinars, highlights via existing executive updates, podcast, and use of intranet and internet to access up-to-date tools.

Open access information technology and telephone infrastructure. These costs are rarely reported in the literature 17 and will need to be taken into account when commissioning digitally supported services in the future. Virtual clinics offer potential savings to the NHS which need to be further scoped. Savings for patients included the reduction in time spent travelling and the cost of travelling. VC is not a novel approach to delivering outpatient appointments in healthcare, but this paper discusses an extremely rapid adoption. To our knowledge, this is the first report of an NHS hospital evaluating rapid implementation of VCs due to COVID-19.

The findings must be interpreted in light of their limitations. This was not a research project but a rapid evaluation of VC implementation. The pace of change led to some missing data which were manually collected wherever possible. The pragmatic approach described here does not seek to test or demonstrate statistical significance. Future research studies evaluating the effectiveness and acceptability of VC are required, particularly as services return to a 'new normal' after COVID-19.

Commitment from clinicians and administrators was initially due to the unusual circumstances of COVID-19 and the imperative to stop all non-essential F2F work, but engagement was maintained by continuous multichannel communications throughout the project. The future goal is to maintain a clinically appropriate level of VC post-COVID-19; the improvement-driven approach described in this paper has led to wide engagement, a clear plan of action and objective data to support this aim.

The implementation was within an orthopaedics setting; however, the findings from this report have been reported in a way to be as general as possible to allow for transportability.

This QI initiative demonstrates that rapid implementation of virtual clinics can be achieved in response to the COVID-19 pandemic. The rapid implementation of VCs required a dedicated multidisciplinary team, expertise in operational management, QI, clinical care and data analysis. It required whole systems support from the RNOH Senior Leadership Team, information technology team, information governance team, administrative teams and clinical staff. This is a pragmatic QI initiative that was conducted at pace and must be considered in light of its limitations. To our knowledge this is the first report of rapid implementation of VCs across an NHS Hospital Trust conducted as a consequence of COVID-19. The findings from this report will be of interest to healthcare organisations looking to convert F2F clinics to virtual clinics. A structured and planned approach using QI methodology will be required to facilitate a return to F2F clinics as the COVID-19 situation allows.

Twitter Anthony William Gilbert @awgilbert11 and Joe C T Billany @JoeBillany

WHO. World health organisation Corobovirus disease 2019 (COVID-19) situation Report-51 2020

Coronavirus disease 2019 (COVID-19): what we know

Number of coronovirus (COVID-19) cases and risk in the UK 2020

Covid-19: a remote assessment in primary care

Video consultations for covid-19

Covid-19 information governance advice for health and care professionals 2020

The NHS long term plan. Health Do

What is the patient acceptability of real time 1:1 videoconferencing in an orthopaedics setting? A systematic review

What is the acceptability of real time 1:1 videoconferencing between clinicians and patients for a followup consultation for multi-directional shoulder instability?

Protocol for the connect project: a mixed methods study investigating patient preferences for communication technology use in orthopaedic rehabilitation consultations

The improvement guide: a practical approach to enhancing organizational performance

Beyond adoption: a new framework for theorizing and evaluating nonadoption, abandonment, and challenges to the scale-up, spread, and sustainability of health and care technologies

Implementation, context and complexity

Effectiveness of PhysioDirect telephone assessment and advice services for patients with musculoskeletal problems: pragmatic randomised controlled trial

The acceptability to patients of PhysioDirect telephone assessment and advice services; a qualitative interview study

What will new technology mean for the NHS and its patients? four big technological trends

Real-World implementation of video outpatient consultations at macro, meso, and micro levels: Mixed-method study

Implementing, embedding, and integrating practices: an outline of normalization process theory

RNOH virtual outpatient clinics: a patient guide (Royal national orthopaedic Hospital version

Nhs virtual outpatient clinics: a patient guide (NHS version)

Acknowledgements The authors wish to acknowledge several people from the Royal National Orthopaedic Hospital: the information technology team for their support with the hardware and software, the information governance team for their expertise on data protection and privacy impact, the Research and Innovation Centre for prompt review and registration of the project, and the administration staff for contacting patients and clinicians who participated in the virtual clinics. Finally, the authors are grateful to Kelly Easton, whose contributions at the outset were essential to the delivery of this quality improvement initiative.Contributors AWG, JCTB, RA, LM, RT, SB, AA and LD made substantial contributions to the design of the work. AWG, JCTB, RA, NG, IF and JB were involved in the collection, analysis and interpretation of data. AWG drafted the work with JCTB, RA, LM and JB. All authors critically revised the draft, gave final approval of the version to be published and are accountable for all aspects of the work. AWG is the guarantor of the manuscript. Disclaimer This paper presents independent research funded by the National Institute for Health Research (NIHR). The views expressed are those of the authors and not necessarily those of the NHS, the NIHR or the Department of Health and Social Care.

Competing interests None declared.Patient and public involvement Patients and/or the public were not involved in the design, or conduct, or reporting, or dissemination plans of this research.All patients were given the opportunity to feedback their experience at the end of each consultation. This data was continuously evaluated and used to inform service development.Patient consent for publication Not required.Provenance and peer review Not commissioned; externally peer reviewed.