key: cord-0994782-o381nved
authors: Hofmann, Bjørn; Andersen, Eivind Richter; Kjelle, Elin
title: What can we learn from the SARS-COV-2 pandemic about the value of specific radiological examinations?
date: 2021-10-26
journal: BMC Health Serv Res
DOI: 10.1186/s12913-021-07190-w
sha: f6b3c8e892afa7100cf30d20c69622f52e8eea2a
doc_id: 994782
cord_uid: o381nved

BACKGROUND: The SARS-COV-2 pandemic provides a natural intervention to assess practical priority setting and internal evaluation of specific health services, such as radiological services. Norway makes an excellent case as it had a very low infection rate and very few cases of COVID-19. Accordingly, the objective of this study is to use the changes in performed outpatient radiological examinations during the first stages of the SARS-COV-2 pandemic to assess the practical evaluation of specific radiological examinations in Norway. METHODS: Data was collected retrospectively from the Norwegian Health Economics Administration (HELFO) in the years 2015–2020. Data included the number of performed outpatient imaging examinations at public hospitals and private imaging centers in Norway and was divided in to three periods based on the level of restrictions on elective health services. Results were analyzed with descriptive statistics. RESULTS: In the first period there was a 45% reduction in outpatient radiology compared to the same time period in 2015–2019 while in period 2 and 3 there was a 25 and 6% reduction respectively. The study identified a list of specific potential low-value radiological examinations. While some of these are covered by the Choosing Wisely campaign, others are not. CONCLUSION: By studying the priority setting practice during the initial phases of the pandemic this study identifies a set of potential low value radiological examinations during the initial phases of the SARS-COV-2 pandemic. These examinations are candidates for closer assessments for health services quality improvement.

During the first period of the SARS-COV-2 pandemic in Norway (March-June 2020), activities at Norwegian hospitals were reduced to a minimum, including postponing outpatient services, elective surgery, and scheduled follow ups. However, the number of persons affected by the pandemic was very small compared to other countries. Figure 1 shows some key figures for the first months of the outbreak in Norway. By June 30 there were 251 covid-19 related deaths in Norway.

While very few health services were directly involved in handling covid-19 patients, all were significantly affected as elective activities were initially reduced to a minimum and then gradually opened again. The event provides a natural intervention to study health services practical priority setting and an unprecedented opportunity to assess practical evaluation of specific health services [1, 2] .

One specific area for investigation is radiological services. Radiological technologies provide tremendous opportunities for diagnostics and subsequent treatment and care. This has significantly expanded the possibilities to help people [3] , but also the potential for unnecessary, inappropriate, futile, or even harmful examinations [4] [5] [6] . Furthermore, critical reflections have emerged on whether there is "too much medicine" [7] [8] [9] [10] [11] [12] and too much radiology [4, [13] [14] [15] [16] .

Internationally a wide range of campaigns, such as Choosing Wisely, Too Much Medicine (BMJ), Smarter Medicine, Prudent Health Care, Slow Medicine, Do Not Do (NICE) [17] , have focused on (in)appropriate and low value care, defined as "an intervention in which evidence suggest it confers not or very little benefit for patients, or risk of harm exceeds probable benefit or, more broadly, the added costs of the intervention do not provide proportional added benefits" [18] . Accordingly, a negative test can have positive value and a positive test can have low value. While there are many consensusbased suggestions for low-value radiological services [5, [19] [20] [21] [22] the extension of low value radiology is still unclear, as examinations identified as "low-value" can be of great value in specific cases [23] . Hence, it can be difficult to define and identify low-value care in radiological practice. This is especially important in perspective of value-based radiology [24] [25] [26] .

However, the pandemic provides a unique opportunity to investigate what happens to health services when forced to prioritize in a strict manner. From an ethical perspective, one should always try to learn as much as possible when crisis occurs.

Thus, the purpose of this study was to assess changes in performed outpatient radiological examinations during the first stages of the SARS-COV-2 pandemic and apply this to study the practical evaluation of radiological examinations. In order to improve health services, we focus on examinations that potentially are of low value.

To address this overall issue the specific research questions are:

-Which examinations were reduced most during the pandemic? -What are the patterns of reduced radiological services during the SARS-COV-2 pandemic in 2020? -How well does the reduction in services correspond to the recommendations of the Choosing Wisely Campaign in Norway and the USA?

The data for this study was all outpatient radiological examinations registered at the Norwegian Health Economics Administration (HELFO) for three specific periods in the years 2015-2020. The periods were defined by the reactions of the Norwegian health authorities and the Government to the SARS-COV-2 pandemic in 2020:

Period 1 is from March 12 till April 11, "the shutdown period", during which only extraordinarily important and severe cases were examined. Several outpatient services were shut down and elective surgery was postponed.

Period 2 from April 12 till May 12, a slight let up in restrictions and important cases were examined in addition to increased outpatient activity in general.

Period 3 is from May 13 till June 12, further let up in restrictions and the radiology departments returned to almost normal outpatient activities.

Results were analyzed with descriptive statistics in Microsoft Excel for Office 365 ProPlus.

Data were grouped and subsumed under main codes (2020) including additional codes from the Norwegian Classification of Radiological Procedures (NCRP) [27] . Codes from 2015 were transposed to 2020 version of codes, as there was a major shift in nomenclature from 2015 to 2016. The average and relative standard deviation was calculated for each code for each period and compared to the subsumed number of examinations for the corresponding month in 2020.

Changes less than 50% for specific examinations in Period 1 were excluded as these examinations were considered to be of high value. Figure 2 illustrates the model applied in this study. In order to avoid artifacts due to small numbers, averages of less than 100 examinations per months were excluded. Reduction in the number of examinations was calculated as the difference in a given period (Period 1-3) in 2020 from the stable average for the same period for the years 2015-2019 in percent.

There were about 256,000 examinations for all three periods between 2015 and 2019 and the relative standard deviation varied between 4 and 12%, as can be seen in Table 1 . The reduction for each period from 2015 to 2019 to 2020 varies from 45.5% in Period 1 to 6.1% in Period 3. Table 2 shows the reduction in number of examinations for the four main radiological modalities from 2019 to 2020 for each of the three periods. While the number of examinations were reduced for all modalities during the first period, the lowest relative reduction was in ultrasound. The use of ultrasound increased during the second period and then decreased again while CT increased in the last period compared to 2019.

For the main examinations in adults identified by the Norwegian version of the Choosing Wisely Campaign [28] , the development of the number of examinations are shown in Fig. 3 .

As the figure illustrates, most of the identified examinations were reduced from one to two third of the normal level but increasing in period 2 and 3. While the use of most examinations followed the pattern in Table 1 and Fig. 2 , i.e., with a stable number of examinations for all three periods (2015-2019), and a substantial reduction in the first period and then a gradual increase in the subsequent periods in 2020, some examinations had a significant reduction in period 1 however increased beyond the previous average in period 3. One example of this is bone density measurement (DEXA), illustrated in Fig. 4 .

Further, some types of examinations were substantially reduced during all three periods as shown in Fig. 5 .

Other examinations had a larger reduction during Period 1, however still regained activity during Period 2 and 3. Examples of this are typical conventional x-ray examinations of the hip, knee, foot and hand, as shown in Fig. 6 , which reveals a small expected seasonal increase for these examinations. Table 3 shows the examinations that had a large reduction (> 20%) in period 2 and durable reduction (> 10%) on average for period 2 and 3. The number of examinations is given to indicate the volume. As the table demonstrates, a series of examination have more than 50% reduction even in period 2 and 3: KUB view, CT Enterography, MRI Pelvis and lower limb, Throat and neck ultrasound, MRI Thoracic spine, MRI sacroiliac joints, Liver, gall bladder, and pancreatic ultrasound, Axillary ultrasound and MRI of the face. CT was the modality with the lowest number of examination codes to have a large reduction in use, while ultrasound and conventional radiography had the largest amount of examination codes with a large reduction in use. Among the defined low value examinations in the Choosing Wisely campaign, imaging of the spine [28] and ultrasound of the throat and neck [5] had the largest reduction.

This study shows a substantial reduction of the number of outpatient examinations during the initial phases of the SARS-COV-2 pandemic in 2020 and concur with other studies [29] [30] [31] [32] [33] [34] . As a natural intervention it can teach us about practical priority setting, i.e., how specific radiological examinations are valued in practice. As such, it can help us identify potential low value radiological services.

Clearly, low value care cannot be read out of the data directly. Careful scrutiny of examination codes and indications is necessary. Moreover, we must assess whether there are unintended consequences associated with the abrupt reduction in imaging, e.g., delayed diagnoses and treatments, and excess mortality. For example, it has been documented that the number of treated injuries was reduced during the first weeks of the pandemic [35] , that the reduction in imaging exacerbated inequities [36] , had economic consequences [37] , and influenced radiology trainees [38] . However, it is too early to assess the implications of the reduction in imaging on people's health. It is also important to notice that health services in general were mostly reduced for milder illnesses [39] . Hence, the study is an important step in identifying lowvalue care and to improve the health services. The approach demonstrates how we can learn from the pandemic and it supplements other ways to identify low value care. The approach is also recognized and applied in many other fields [39] [40] [41] [42] [43] [44] [45] [46] [47] [48] to identify and reduce a range of low-value services.

The reduction in the first period cannot be used to assess the value of radiological services as it certainly included reduction of high value services. However, reduction of examinations during the second and third period, can teach us about priority setting in practice. Accordingly, the following examinations are candidates for being of low value and merit further investigation: Abdominal KUB view, CT Enterography, MRI Pelvis and lower limb, Throat and neck ultrasound, MRI Thoracic spine, MRI sacroiliac joints, Liver, gall bladder and pancreatic ultrasound, Axillary ultrasound and MRI of the face. Of these, Throat and neck ultrasound, MRI of Thoracic spine, sacroiliac joints and face are the ones related to Choosing Wisely recommendations [5] . Our study provides useful insights of the practical priority setting of radiological services. Interestingly, we found that utilization of bone density examinations (DEXA), increased in the third period after the lockdown. This can be the result of a backlog, but also because this service is provided by special departments with few other services and high capacity. However, frequent DEXA screening for osteoporosis in elderly is in the literature considered as low value care [49] . This underscores our point that the identified examinations need further scrutiny.

Only five CT-examinations were reduced more than 20% in period 2 (Table 3) , despite a 57% reduction in the first period. The high utilization of CT during the pandemic may be due to prioritizing cancer pathways and cancer follow up, which was prioritized in the Norwegian health services during the lock down [50] . This could indicate that most CT-examinations are of high value or that it is difficult to reduce the use of CT examinations in Norwegian hospitals. This merits further scrutiny since CT represents high volume and high radiation doses [51] .

One of our aims was to investigate how well the reduction in services corresponds to the recommendations of the Norwegian Choosing Wisely Campaign [28] . Our findings suggest that the practical priority setting only partly corresponded to the campaign. Most examinations were initially reduced from one to two third of the normal level but increased again in period 2 and 3. This could indicate that recommendations from the Norwegian Choosing Wisely Campaign were not followed when opening in period 3. However, the Norwegian version of the campaign include only six specific examinations and indications. Our findings suggest that several radiological examinations have potential to be low value. This corresponds to international literature where more examinations are identified by the extended list of lowvalue radiology [5] . It is also important to notice that the burden of disease may be different during the studied periods as there were less activity during the close-down, e.g., fewer accidents. Moreover, population studies from Norway indicates that there were fewer strokes and infarctions during the start of the pandemic [52, 53] .

The data describe the practical priority setting in radiology, which is interesting in itself. However, to use the data to identify candidates for low value care, we must assume that the practical priority setting roughly follows appropriateness criteria [4, 16] and the stated priority setting principles [54] . This means that the first outpatient examinations to start up and having the highest volume after the close-down would be those of higher value than those who stay low for longer. If not, that would mean that there was no systematic priority setting, e.g., due to high pressure on the services. However, the activity at the radiological departments has been low during lock-down and there are no indications of reduced radiological capacity due to illness among radiologists or radiographers after the lock-down period [55] . While there may be some local reticence of patients to attend imaging facilities for examinations during the first part of the epidemic, no changes in "no-show" rates are Table 3 Average reduction (in %) for period (P) 2 and 3 for examinations with more than 20% reduction for period 2 including the average number of examinations for each period 2015-2019 as well as for 2020 (Continued) [5] reported. Moreover, if patients had been scared from coming, they would most likely not show up for issues of less importance to them. Additionally, radiological services were affected by the reduction in other outpatient services (referring patients to radiology) and in the number of elective surgeries. While this would reduce the number of examinations with explicit prioritization at the radiology department, the reduction may be due to overall priority setting.

In this paper, we provide a methodology to investigate changes to the health services during the pandemic to identify areas for further research. The bar of 50% change and 100 examinations per month is quite high. Many low-value services may be ignored by this approach, such as low-value low-volume interventional procedures. However, as there are fewer interventional procedures for the out-patient group than in the inpatient group, the loss may not be significant. Moreover, there may be many reasons for practice change, and we wanted to study the major changes.

There are also some limitations due to coding practices, which may vary. For example, there are codes for lower extremities and for foot and ankle. Furthermore, one code may be used for several clinical indications and could therefore represent both high and low value examinations. As pointed out, targeted investigation must be conducted to specify and mapping low value examinations. However, the objective of this study has not been to reveal variations or inconsistencies in coding practices, but only to study what is registered at face value and on a principal level.

Another limitation is the choice of study periods. Where to set the limits between periods is not given by nature. It is important to notice that the burden of disease may be different during the studied periods as there were less activity during the lock-down, e.g., fewer accidents, but also fewer strokes and infarctions during the start of the pandemic [52, 53] . Adding additional study periods would provide more information on backlog and lasting effects.

However, the applied periods appear to be well chosen as the first period corresponds well with the close-down, the second with the opening somewhat, and the third with opening more [56] . This is also confirmed by reports by health authorities [51] . Figure 1 also indicates that there were very few covid-19 cases after Period 3. Moreover, the total reduction in Period 2 is 25.4% which corresponds well with other studies [29] [30] [31] [32] [33] [34] and with the literature on overuse in radiological services [5, 57] . It also indicates that our threshold is well selected.

The direct influence of the examinations of patients with SARS-COV-2 is expected to be very low as there were very few cases of SARS-COV-2 in Norway [58] and very few outpatient examinations related to SARS-COV-2 as well as relatively few hospitalized patients with SARS-COV-2 that could influence the number of examinations of outpatients. However, there can be an indirect influence, e.g., cancelled elective outpatient treatments and surgery resulting in reduced pre/postoperative outpatient examinations and controls.

There are many ways to measure reduction. We have used percentage reduction compared to (the average of) the same period previous years, and to use Period 2 and 3 (and not Period 1) to identify potential low-value examinations. However, we noticed that examinations with the highest reduction rate for the various modalities are of relatively low volume examinations. Therefore, further research focusing on high volume examinations and examinations with potential high radiation dose would be welcome.

The results are specific for Norway and for outpatient radiological services. However, the results concur with other studies (on imaging and other services as referred above), and the identified examinations may be relevant for other countries, given the broad international collaboration and alignment. Moreover, this study presents a methodology to analyze the value of health services in other fields as well.

It is too early to verify that the identified examinations are of low value as the long-term effects of the reduction in 2020 are not assessable yet. Nonetheless, this study gives insights in practical priority setting and provides a specific set of potential low-value radiological examinations, and it presents a methodology for identifying them. The next step towards quality improvement is thorough analysis of the specific examinations, the corresponding clinical indications, and the assessment of the long-term effects of reduced services.

In this study, we propose and demonstrate a methodology using the SARS-COV-2 pandemic as a natural intervention to investigate practical priority setting in radiological services in Norway. We found a substantial reduction of the number of outpatient examinations, indicating how specific radiological examinations are valued in practice. As such, it can help us identifying potential low value radiological services. The imaging examinations with the most continuing reduction during the initial phases of the pandemic in 2020 was Abdominal KUB view, CT Enterography, MRI Pelvis and lower limb, Throat and neck ultrasound, MRI Thoracic spine, MRI sacroiliac joints, Liver, gall bladder and pancreatic ultrasound, Axillary ultrasound and MRI of the face. While the study confirmed a reduction in some examinations identified by the Norwegian and USA Choosing Wisely Campaign there was no clear pattern that indicated reduction in identified low-value examinations found in these guidelines. Further research should focus on in-depth analyses of examination codes, clinical indications, and long-term effects to verify specific radiological examinations as low value. Nonetheless, the SARS-COV-2 pandemic provides a natural intervention for identifying potential low value services and for quality improvement.

Abbreviations DEXA: Bone density scan; KUB: Kidney, ureters and bladder; RSD: Relative Standard Deviation; RX: Conventional radiology; SD: Standard Deviation

Covid-19: an opportunity to reduce unnecessary healthcare

Medical overuse in the Iranian healthcare system: a systematic scoping review and practical recommendations for decreasing medical overuse during unexpected COVID-19 pandemic opportunity

The greatest benefit to mankind: a medical history of humanity (the Norton history of science

The ACR appropriateness criteria: translation to practice and research

Reducing inappropriate use of diagnostic imaging through the choosing wisely initiative

Avoiding the unintended consequences of growth in medical care: how might more be worse?

Too much medicine; too little care

Overtreated: why too much medicine is making us sicker and poorer: Bloomsbury

Too much medicine?

Too much medicine?

Winding back the harms of too much medicine

Too much medicine campaign is long overdue

Enough of too much

Medical Utilization and Management

Too much of a good thing is wonderful? A conceptual analysis of excessive examinations and diagnostic futility in diagnostic radiology

The use of ACR appropriateness criteria: a survey of radiology residents and program directors

Choosing wisely for health: a context analysis through a systematic search of the published literature

In search of professional consensus in defining and reducing low-value care

Lowvalue diagnostic imaging use in the pediatric emergency Department in the United States and Canada

Low-value radiographic imaging apparently less employed in Canada vs US emergency departments

Choosing wisely: prevalence and correlates of low-value health care services in the United States

The value of low-value lists

Radiology and value-based health care

ESR concept paper on value-based radiology

Radiology in the era of value-based healthcare: a multi-society expert statement from the ACR, CAR, ESR, IS3R, RANZCR, and RSNA. Insights Imaging

The Norwegian Directorate of eHealth. Prosedyrekodeverkene (Kodeverk for medisinske, kirurgiske og radiologiske prosedyrer, NCMP, NCSP og NCRP). Oslo: The Norwegian Directorate of eHealth

COVID-19 pandemic impact on decreased imaging utilization: a single institutional experience

Recover wisely from COVID-19: responsible resumption of nonurgent radiology services

Population-level impact of coronavirus disease 2019 on breast cancer screening and diagnostic procedures

CT volumes from 2,398 radiology practices in the United States: a realtime Indicator of the effect of COVID-19 on routine care

The impact of the COVID-19 pandemic on diagnostic imaging services in Australia

Recovery of outpatient imaging utilization during the first wave of the COVID-19 pandemic

Impact of the COVID-19 pandemic on the treatment of injuries during lockdown in Norway

Exacerbation of inequities in use of diagnostic radiology during the early stages of reopening after COVID-19

The economic impact of the COVID-19 pandemic on radiology practices

The impact of COVID-19 on radiology trainees

Impact of COVID-19 pandemic on utilisation of healthcare services: a systematic review

Building a better health care system Post-Covid-19: steps for reducing low-value and Wasteful care. NEJM Catalyst Innovations Care Delivery

Running the numbers: capitalize on the moment: leveraging the COVID-19 experience to spur low-value care reduction in North Carolina: a periodic feature to inform North Carolina health care professionals about current topics in health statistics

Crisis into opportunity: can COVID-19 help set a path to improved health care efficiency?

COVID-19: a window of opportunity for positive healthcare reforms

The COVID-19 pandemic can help us understand lowvalue health care

Using Health Care Resources Wisely After the COVID-19 Pandemic: Recommendations to Reduce Low-Value Care

Covid-19: an opportunity to reduce unnecessary healthcare

Benefits of avoiding unnecessary medical care during the COVID-19 pandemic

What the COVID-19 pandemic can teach us about resource stewardship and quality in health care

Frequency of and variation in low-value care in primary care: a retrospective cohort study

Endringer i aktivitet i helsetjenester mars og

Medical radiation exposure of the European population

Cardiovascular hospitalizations, influenza activity, and COVID-19 measures

Effect of COVID-19 pandemic on stroke admission rates in a Norwegian population

Priority setting in health care: trends and models from Scandinavian experiences

SARS-CoV-2 blant ansatte i helse-og omsorgstjenesten

Sykehusinnleggelser med covid-19-en sammenligning av ulike datakilder

The overuse of diagnostic imaging and the choosing wisely initiative

Factors associated with hospitalization, invasive mechanical ventilation treatment and death among all confirmed COVID-19 cases in Norway: prospective cohort study

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations

We are most thankful to the Norwegian Health Economics Administration (HELFO) for providing data for the study.

Authors' contributions BH designed the study. Data were acquired and analyzed by BH and EK. BH made the first draft of the manuscript, which was critically revised in several rounds by EK and EA. All authors have approved of the final manuscript.

No funding bodies had any role in study design, data collection and analysis, decision to publish, or preparation of the manuscript. The research is funded by the Norwegian Research Council (IROS 302503).

The datasets used and/or analysed during the current study available from the corresponding author on reasonable request.

Ethics approval and consent to participate Not applicable.

Not applicable.Competing interests I certify that there is no actual or potential conflict of interest in relation to this manuscript, and there are no financial arrangements or arrangements with respect to the content of this comment with any companies or organizations.Received: 28 April 2021 Accepted: 18 October 2021