key: cord-0983841-tdtui4hs
authors: O’Reilly-Shah, Vikas N; Van Cleve, Wil; Long, Dustin R; Moll, Vanessa; Evans, Faye M; Sunshine, Jacob E; Kassebaum, Nicholas J; Harrison, Ewen M; Jabaley, Craig S
title: Impact of COVID-19 response on global surgical volumes: an ongoing observational study
date: 2020-10-01
journal: Bull World Health Organ
DOI: 10.2471/blt.20.264044
sha: 9e3c23eed5cf63a09ce49c45a71c604736890ed8
doc_id: 983841
cord_uid: tdtui4hs

OBJECTIVE: To determine whether location-linked anaesthesiology calculator mobile application (app) data can serve as a qualitative proxy for global surgical case volumes and therefore monitor the impact of the coronavirus disease 2019 (COVID-19) pandemic. METHODS: We collected data provided by users of the mobile app “Anesthesiologist” during 1 October 2018–30 June 2020. We analysed these using RStudio and generated 7-day moving-average app use plots. We calculated country-level reductions in app use as a percentage of baseline. We obtained data on COVID-19 case counts from the European Centre for Disease Prevention and Control. We plotted changing app use and COVID-19 case counts for several countries and regions. FINDINGS: A total of 100 099 app users within 214 countries and territories provided data. We observed that app use was reduced during holidays, weekends and at night, correlating with expected fluctuations in surgical volume. We observed that the onset of the pandemic prompted substantial reductions in app use. We noted strong cross-correlation between COVID-19 case count and reductions in app use in low- and middle-income countries, but not in high-income countries. Of the 112 countries and territories with non-zero app use during baseline and during the pandemic, we calculated a median reduction in app use to 73.6% of baseline. CONCLUSION: App data provide a proxy for surgical case volumes, and can therefore be used as a real-time monitor of the impact of COVID-19 on surgical capacity. We have created a dashboard for ongoing visualization of these data, allowing policy-makers to direct resources to areas of greatest need.

The coronavirus disease 2019 (COVID-19) pandemic has caused substantial disruptions to health-care delivery as a result of constrained resources, supply chain interruptions, the need to protect or cover for affected health-care workers, physical distancing and the realities of meeting a surge in demand. Many health-care systems have responded by cancelling or delaying elective surgical procedures. [1] [2] [3] [4] The downstream impacts of these delays in diagnostic and therapeutic procedural care on public health are unknown. The 2015 Lancet Commission on Global Surgery identified a profound gap in the availability of safe anaesthetic and surgical care in low-and middle-income countries, and estimated that 4.8 billion people lacked access to surgery at baseline before the pandemic. 5, 6 Although high-income countries are better able to absorb disruptions in surgical care, the effect of the COVID-19 pandemic on unmet surgical needs in low-and middle-income countries could be devastating. The course of recovery to baseline conditions following the pandemic may also be prolonged in low-and middle-income countries as a result of the depletion of health-care resources.

Assessing the volume of global surgical care is notoriously difficult. Prior work in this area has relied on estimations based on modelling and labour-intensive retrospective analysis of data from nations where such information is routinely recorded and available. 5, [7] [8] [9] Even where such data are available from public health ministries, however, they are not available in real-time and may be limited to health care delivered by government-funded facilities. 10 We previously developed a free anaesthesia calculator mobile application (app) for the Android platform, called Anesthesiologist. 11 The app ( Fig. 1 ) has been in use globally since 2011, with over 200 000 users in nearly every country of the world. 12 The primary users of this app are physician anaesthesiologists and other anaesthesia providers. 12 The purpose of the app is to provide information fundamental to the practice of anaesthesia, particularly for children, including: physiological parameters by age (e.g. expected weight, blood pressure, heart rate and respiratory rate); airway management information (e.g. endotracheal tube and laryngeal mask airway size); weight-based calculation of appropriate doses for commonly used drugs; and external reference links (e.g. emergency management and peripheral nerve block administration). The app is used by substantially greater numbers of anaesthesia providers in low-and middle-income countries compared with high-income countries. 12 Our aim is to determine whether utilization of the app, aggregated over the large existing international user base, could serve as a real-time qualitative proxy for surgical case Objective To determine whether location-linked anaesthesiology calculator mobile application (app) data can serve as a qualitative proxy for global surgical case volumes and therefore monitor the impact of the coronavirus disease 2019 (COVID- 19) pandemic. Methods We collected data provided by users of the mobile app "Anesthesiologist" during 1 October 2018-30 June 2020. We analysed these using RStudio and generated 7-day moving-average app use plots. We calculated country-level reductions in app use as a percentage of baseline. We obtained data on COVID-19 case counts from the European Centre for Disease Prevention and Control. We plotted changing app use and COVID-19 case counts for several countries and regions. Findings A total of 100 099 app users within 214 countries and territories provided data. We observed that app use was reduced during holidays, weekends and at night, correlating with expected fluctuations in surgical volume. We observed that the onset of the pandemic prompted substantial reductions in app use. We noted strong cross-correlation between COVID-19 case count and reductions in app use in low-and middle-income countries, but not in high-income countries. Of the 112 countries and territories with non-zero app use during baseline and during the pandemic, we calculated a median reduction in app use to 73.6% of baseline. Conclusion App data provide a proxy for surgical case volumes, and can therefore be used as a real-time monitor of the impact of COVID-19 on surgical capacity. We have created a dashboard for ongoing visualization of these data, allowing policy-makers to direct resources to areas of greatest need.

Research COVID-19 impact on surgical case volumes by app data Vikas N O'Reilly-Shah et al.

volume, and therefore be used to monitor the impact of, and recovery from, the COVID-19 pandemic.

Data collection using the app has been described in previous publications. 12, 13 To summarize, the app provides anaesthesia references and drug calculation capabilities, and following development was made available via the Google Play Store. 11, 14 After download and the provision of consent, the app records integrated data regarding service utilization, as well as noncompulsory responses to user surveys via Survalytics. 15 The anonymized information collected includes timestamps from the mobile devices, time zone information, basic demographics, user location (country or dependent territory) from three different sources (global positioning system, internet protocol address 16 of demographic data collected. 17 Data analysed here were collected between 1 October 2018 and 30 June 2020 (final full day of data collection). We also queried the electronic data warehouses of the University of Washington and the Seattle Children's Hospital for aggregate surgical case counts for the period 1 October 2018 to 18 April 2020, a time period capturing the relevant drops in surgical case volumes associated with holidays in the USA. We used publicly available data to classify World Health Organization (WHO) regions. 18 We adopted the publicly available World Bank classification of country income level and region as of July 2020. 19 Finally, we requested data related to global COVID-19 impact (case and death counts) from the European Centre for Disease Prevention and Control. 20

We analysed raw data in R using RStudio v3.6.2 (R Foundation, Vienna, Austria); 21,22 full R code and raw data are available on request. We excluded data containing timestamps before or following the period of interest, including a small number of observations (280) with invalid timestamps. We calculated timeseries data from incoming individual data points (including logged app uses and in-app navigation) from all users. Individual users may have used the app in more than one country or dependent territory, as defined by the International Year, month

App: mobile application, PHEIC: public health emergency of international concern, WHO: World Health Organization. Note: We performed change point detection in time-series data using the cpm package. 23 Research COVID-19 impact on surgical case volumes by app data Vikas N O'Reilly-Shah et al. Year, month App: mobile application, PHEIC: public health emergency of international concern, US: United States of America, WHO: World Health Organization. Note: We performed change point detection in time-series data using the cpm package. 23 Organization for Standardization ISO-3166 α-2 country code associated with the data point; in this case, we assigned the user-level country code in which the majority of uses occurred. We performed change point detection in time-series data using the cpm package. 23 For clarity of presentation, we generated the app use plots using a 7-day moving average to mitigate the routine effect of app use reductions during weekends (available in data repository). 24 For all countries or territories with non-zero user counts during both the baseline period (1 September 2019-1 November 2019) and the period spanning the most recently available data (25) (26) (27) (28) (29) (30) June 2020), we calculated (i) the country-level reduction in app use, which is the mean daily count of recent app use as a percentage of mean daily count of baseline use, and (ii) the median value of these percentage reductions. We generated a map of the estimated global impact of the pandemic on surgery volume using the tmap package for R. 25

The study was reviewed and approved by the Emory University Institutional Review Board (study no. 00082571), and there is a reliance agreement in place with the University of Washington Institutional Review Board. The approval includes a waiver of written informed consent. Participants gave electronic consent anonymously before participating in any data collection. The app is a medical device that falls into the category of enforcement discretion as per the United States Food and Drug Administration. 26

From 1 October 2018 to 30 June 2020, we collected and analysed 4 827 263 data points from 100 099 unique users in 214 countries and territories (Box 1). Approximately half of the users (50.9%; 50 989/100 099) completed or partly completed the survey on their position and the characteristics of their practice; we summarize the provider demographics of these users in Table 1 . The majority of users who responded to the survey were anaesthesia providers: physicians, certified registered nurse anaesthetists or an- aesthesiologist assistants. As identified in a previous publication, anaesthesia officers practising in low-income countries may have identified as being technically trained in anaesthesia or were otherwise self-identified. 12 We noted a large variation with respect to self-reported elements of the practice environment; however, the distribution of participant characteristics was consistent with previous findings. 12 We provide counts of the number of unique users per country or territory that provided data during the study period in Box 1.

We demonstrate in Fig. 2 that there was consistent provision of data by users over the study period. Our countryor region-specific data also indicate large reductions in app use coinciding with major holidays, [27] [28] [29] [30] and hence anticipated reductions in surgical case volumes. In the USA (Fig. 3) , we observed reductions in app use during the period around Thanksgiving Day (i.e. the fourth Thursday of November) and Christmas Day. This finding is consistent with case volume data obtained from the University of Washington Medical Center and Seattle Children's Hospital (data repository), 24 and has been previously described in the literature. In Indonesia, in which the majority of the population self-identify as Muslim (Fig. 3) , we observed large reductions in app use during the month of Ramadan and a smaller decrease around Christmas Day, but not around Thanksgiving Day. We also noted reductions in app use around the time of Hajj as well as Ramadan in aggregated data from 38 Muslim-majority countries (data repository). 24 In Brazil (Fig. 3) , which has a large app user base, we detected a notable decrease in app use during the Carnival celebration in 2019 and 2020 and the Corpus Christi celebration in 2019.

We also observed an expected variation in app use by the day of the week, consistent with known data demonstrating that surgical case volumes are highest during the middle of the week and much lower over weekends (data repository). 24, 28 The expected diurnal variation in app use, peaking between 07:00 and 09:00 local time and with minimal use between midnight and 06:00 local time (data repository), 24 was also evident. 

We illustrate the impacts of COVID-19 on app use in Fig. 4 . Notably, all regions demonstrated steep declines in app use following the WHO declaration of global pandemic status. Some recovery from nadir is apparent, although this recovery in app use varies widely between countries and/or regions. We further used this data to illustrate variability in app use relative to counts of COVID-19 cases. Overall, app use declined as COVID-19 cases increased during the study period (Fig. 4) . We found that in countries of the WHO African Region, the profound decrease in app use plateaued by around the beginning of April 2020, and did not demonstrate any recovery by the end of the study period. In low-income countries, app use briefly plateaued before continuing on a downwards trend. In countries of the WHO European Region, the major reduction in app use in March 2020 was concordant with the WHO pandemic declaration. From the nadir in April 2020, app use rebounded but not to baseline levels. Similar findings were seen in highincome countries: reductions in app use rebounded from a minimum in April 2020. In Germany and Italy, decreases in app use were measured in February 2020, weeks before the WHO pandemic declaration. We observed further reductions in app use after the pandemic declaration, with the subsequent recovery to near baseline in Italy but depressed from baseline in Germany. However, we note that the degree of depression in app use in Germany was not as large as the degree of depression in Italy. In India and the USA decreases in app use followed the WHO declaration and were abrupt. App use in both countries has trended upwards from a minimum, although this recovery was slower in India compared with in the USA.

We generated a map of the global impact of COVID-19 on app use (available in the data repository), 24 which indicated a widespread reduction. Of the 214 countries and territories included in the study (Box 1), users in 112 reported use during both the periods (baseline and recent). We calculated the median reduction in app use of these 112 countries and territories as 73.6% of baseline (inter-quartile range, 57.1-96.0%), with the highest reduction in app use to 18.6% (5.21/28.07) of baseline in Burundi (Table 2 ). Of the 102 countries and territories with no app use during the baseline or recent periods, and therefore not included in the median reduction calculation, 38 were classified as high income, 21 as upper-middle income, 23 as lower-middle income and 13 as low income; 7 did not have a World Bank income-level classification. We observed a mixed relationship between overall reduction in app use and COVID-19 case count at the end of the study period (data repository). 24 In middle-income countries, higher case counts did correlate with lower app use; however, no relationship was observed in high-income countries. We measured the greatest reduction in app use in low-income countries (data repository). 24 When examining the cross-correlation function of COVID-19 case count on a dayto-day basis versus daily app use counts in individual regions and countries, we observed a strong inverse correlation between these two time series at very low lags (data repository). 24

Many people in low-and middle-income countries are already without adequate access to safe anaesthetic and surgical care at baseline. 6 Here, we have shown that the impact of the COVID-19 pandemic on the use of our app, a proxy for surgical case volumes, has exacerbated this burden, especially in low-income countries. Although recovery of app use has been substantial in high-income countries, that recovery has yet to be realized in low-income environments.

The benefits and challenges associated with the collection of health-care data using mobile technology have been discussed in previous publications. 31, 32 The benefits include a decentralized approach to the collection of data from the 95% of the global population living in an area covered by, and subscribed to, a mobile cellular service. 33 A total of 5.5 billion mobile phone subscriptions were recently reported in low-and middle-income countries, representing nearly 92 subscriptions per 100 inhabitants. 34 Challenges include the dissemination of specific applications, the types of data that can be collected, the trade-off between apps that have clinical utility and the data that can be gleaned from the use of these apps, the use of multiple platforms (e.g. Android, iOS), and the analysis and interpretation of stochastic app use data.

A specific strength of our work is the practical use of the app from which data were gathered and analysed. Users download and use the app for the clinical care of patients. The app has never been advertised or its use encouraged via notifications or other mechanisms, meaning that use of the app reflects stochastic clinical care events.

This same stochasticity highlights a limitation of the work, however; data from individual regions or countries with a small user base reduce the confidence we can assign to the association between app use time-series data and surgical case volume. By excluding many more high-and middle-income App: mobile application. a We only included the 112 countries or territories with non-zero app use during both periods in the median reduction calculation. b 1 September to 1 November 2019. c Note that average daily user counts were calculated to several decimal places, hence the apparent rounding errors in percentage reduction calculations.

COVID-19 impact on surgical case volumes by app data Vikas N O'Reilly-Shah et al.

countries than low-income countries with zero app use during the relevant periods in our calculation of median app use reduction, we have probably underestimated the global impact of COVID-19 on surgical case volumes.

Another important limitation is that the app is used primarily for the care of paediatric cases (about 75% of app uses are for patients aged 12 years and younger), and this predominance may drive greater use of the app in lowand middle-income countries where (i) subspecialty training in paediatric anaesthesia is less prevalent compared with in high-income countries; and (ii) as much as 50% of the population in low-and middle-income countries may be younger than 16 years. Notably, these needs in low-and middle-income countries are not trivial: 1.7 billion children lack adequate access to surgical care and an estimated 85% of children will need surgical care by the age of 16 years. 35 Further, given the differential impact of COVID-19 in younger versus older populations, and the proportion of elective versus non-elective surgery in paediatric patients, a greater degree of paediatric surgery may be seen compared with surgery for adults. Conversely, app utilization patterns may be relatively less impacted in high-income countries that have dedicated paediatric hospitals.

Finally, we acknowledge that many factors may drive changes in patterns of app use, and hence the relationship between app use and surgical case volume for a given country or region. For example, users are more likely to consult the app during emergencies, 36 meaning that app use during weekends (when a greater proportion of surgical cases are emergencies) is proportionally greater than would be expected based on actual surgical case volumes. Widespread changes in the distribution and active use of the app (e.g. increased adoption or the loss of users to alternative apps) would require our analysis to be adjusted for changes in the size of the user base. Individual users could also skew the data by downloading and activating the app with no intention of using it; this might cause local distortions but would require a concerted effort to impact the broader trends seen in the data. Higher-income countries may also have benefitted from the resources (e.g. testing kits and personal protective equipment) to continue with elective procedures safely, despite rising COVID-19 case numbers.

In conclusion, we present a realtime qualitative monitor of the impact of COVID-19 on global surgical volumes, particularly in low-and middle-income countries. Combined with other information sources, our app provides governments, global health organizations and philanthropic groups access to data providing markers of recovery -or otherwise -of surgical capacity, as well as the opportunity to direct resources to the areas of greatest need. To ensure the ongoing accessibility of this information, we have developed a near real-time dashboard (http:// globalcases .info). Longer term, our app could be combined with other data to assist with measurement of global surgical capacity as part of the Global Surgery 2030 initiative. ■ Результаты Данные были получены от 100 099 пользователей приложения из 214 стран и территорий. Было отмечено, что использование приложения сокращалось в праздничные дни, выходные дни и ночью, что соотносится с ожидаемыми колебаниями объема хирургических операций. Также было отмечено, что начало пандемии привело к значительному сокращению использования приложения. Авторы наблюдали сильную взаимную корреляцию между количеством случаев COVID-19 и сокращением использования приложения в странах с низким и средним уровнем дохода, но не в странах с высоким уровнем дохода. По данным для 112 стран и территорий с ненулевым использованием приложения во время исходного уровня и во время пандемии медианное сокращение использования приложения составило до 73,6% от исходного уровня. Вывод Данные приложения служат косвенной оценкой количества проводимых хирургических операций и, следовательно, могут использоваться в качестве средства мониторинга воздействия COVID-19 на хирургический потенциал в режиме реального времени. Авторы создали панель индикаторов для непрерывной визуализации этих данных, которая позволяет лицам, формирующим политику, направлять ресурсы в области, где потребности являются наиболее острыми.

Impacto de la respuesta a la COVID-19 en la cantidad de intervenciones quirúrgicas a nivel mundial: un estudio de observación en curso

Objetivo Determinar si los datos de las aplicaciones móviles para calcular la anestesia asociada a la localización pueden servir como un sustituto cualitativo para evaluar la cantidad de intervenciones quirúrgicas a nivel mundial y, por lo tanto, para medir el impacto de la pandemia de la enfermedad del coronavirus 2019 (COVID-19) en esas intervenciones.

Métodos Se recopilaron los datos que suministraron los usuarios de la aplicación móvil «Anestesiólogo» durante el periodo comprendido entre el 1. o de octubre de 2018 y el 30 de junio de 2020. Se analizaron a través de RStudio y se generó un gráfico de uso de la aplicación con un promedio variable de 7 días. Se calcularon las reducciones a nivel de país en el uso de la aplicación como un porcentaje de valor basal. Se obtuvieron datos sobre el recuento de los casos de la COVID-19 del Centro Europeo para la Prevención y el Control de las Enfermedades. Se trazaron gráficos sobre el cambio en el uso de las aplicaciones y el recuento de casos de la COVID-19 en varios países y regiones. Resultados Un total de 100 099 usuarios de la aplicación en 214 países y territorios suministraron datos. Se observó que el uso de la aplicación se redujo durante los días festivos, los fines de semana y por las noches, en correlación con las fluctuaciones previstas de la cantidad de intervenciones quirúrgicas. Se observó que el inicio de la pandemia generó reducciones sustanciales en el uso de la aplicación. Se registró una fuerte correlación cruzada entre el recuento de los casos de la COVID-19 y las reducciones en el uso de la aplicación en los países de ingresos bajos y medios, pero no en los países de ingresos altos. De los 112 países y territorios que no usaron la aplicación durante el momento basal y durante la pandemia, se calculó una reducción mediana en el uso de la aplicación hasta el 73,6 % del valor basal. Conclusión Los datos de la aplicación representan indicadores de la cantidad de intervenciones quirúrgicas y, por lo tanto, se pueden usar para medir en tiempo real el impacto de la COVID-19 en la capacidad quirúrgica. Se ha elaborado un tablero para visualizar estos datos de forma continua, lo que permite a los responsables de formular las políticas asignar recursos a las áreas de mayor necesidad.

en/ health -topics/ Health -systems/ pages/ strengthening -the -health -system -response -to -covid -19/ technical -guidance -and -check -lists/ strengthening -the -health -systems -response -to -covid -19 -technical -guidance -2

en/ health -topics/ Health -systems/ pages/ strengthening -the -health -system -response -to -covid -19/ technical -guidance -and -check -lists/ strengthening -the -health -systems -response -to -covid -19 -technical -guidance

Chicago: American College of Surgeons

London: Royal College of Surgeons

Global access to surgical care: a modelling study

Global Surgery 2030: evidence and solutions for achieving health, welfare, and economic development

An estimation of the global volume of surgery: a modelling strategy based on available data

Size and distribution of the global volume of surgery in 2012. Bull World Health Organ

New global surgical and anaesthesia indicators in the World Development Indicators dataset

Operative volume and surgical case distribution in Uganda's public sector: a stratified randomized evaluation of nationwide surgical capacity

Mountain View; Google; 2020

Assessing the global reach and value of a provider-facing healthcare app using large-scale analytics

Crowdsourcing sugammadex adverse event rates using an in-app survey: feasibility assessment from an observational study

Assessing the global reach and value of a provider-facing healthcare app using large-scale analytics

Survalytics: an open-source cloud-integrated experience sampling, survey, and analytics and metadata collection module for Android operating system apps

COVID-19 impact on surgical case volumes by app data Vikas N

World Wide Web Consortium, Candidate Recommendation CR-geolocation-API-20100907. Bucharest: Artia International SRL

Factors influencing healthcare provider respondent fatigue answering a globally administered in-app survey

Geneva: World Health Organization

World Bank

Download today's data on the geographic distribution of COVID-19 cases worldwide. Solna: European Centre for Disease Prevention and Control

Vienna: R Foundation for Statistical Computing

The jsonlite package: a practical and consistent mapping between JSON data and R objects

Parametric and nonparametric sequential change detection in R: The cpm package

Manuscript -COVID19 Surgery -Supplement -Bull WHO. Supplementary material [data repository

tmap: thematic maps in R

Policy for device software functions and mobile medical applications: guidance for industry and food and drug administration staff

Observations on surgical demand time series: detection and resolution of holiday variance

Metadata from data: identifying holidays from anesthesia data

Assessing the global reach and value of a provider-facing healthcare app using large-scale analytics

Anesthesia workload nationally during regular workdays and weekends

GlobalSurg Collaborative. The efficiency, accuracy and acceptability of smartphonedelivered data collection in a low-resource setting -a prospective study

Addressing the information deficit in global health: lessons from a digital acute care platform in Sri Lanka

World Bank

Global diffusion of eHealth: making universal health coverage achievable: report of the third global survey on eHealth. Geneva: World Health Organization

Estimates of number of children and adolescents without access to surgical care. Bull World Health Organ

Evidence for increased use of the Society of Pediatric Anesthesia Critical Events Checklist in resource-limited environments: a retrospective observational study of app data

We thank Alexandra Torborg, University of KwaZulu-Natal, Nelson R Mandela School of Medicine, South Africa.

Funding: DRL received financial support from the National Institutes of Health/National Institute of General Medical Sciences, USA (grant no. T32 GM086270-11).