key: cord-0802811-ry1diso2
authors: Hammer, Mark M.; Zhao, Anna H.; Hunsaker, Andetta R.; Mendicuti, Alejandra Duran; Sodickson, Aaron D.; Boland, Giles W.; Khorasani, Ramin
title: Radiologist Reporting and Operational Management for Patients with Suspected COVID-19
date: 2020-06-11
journal: J Am Coll Radiol
DOI: 10.1016/j.jacr.2020.06.006
sha: 4a792f3e16a211bfd759d8484e67c2fdcbc7631c
doc_id: 802811
cord_uid: ry1diso2

Abstract Objective Evaluate adoption and outcomes of locally-designed reporting guidelines for patients with possible COVID-19. Methods We developed a departmental guideline for radiologists that specified reporting terminology and required communication for patients with imaging findings suggestive of COVID-19, based on patient test status and imaging indication. In this retrospective study, radiology reports completed 3/1/2020-5/3/2020 that mentioned COVID-19 were reviewed. Reports were divided into patients with known COVID-19, patients with “suspected” COVID-19 (having an order indication of respiratory or infectious signs or symptoms), and “unsuspected patients” (other order indications, e.g., trauma or non-chest pain). Primary outcome was percentage of COVID-19 reports using recommended terminology; secondary outcome was percentages of suspected and unsuspected patients diagnosed with COVID-19. Relationships between categorical variables were assessed with Fisher’s exact test. Results Among 77,400 total reports, 1,083 suggested COVID-19 based on imaging findings; 774 (71%) of COVID-19 reports used recommended terminology. Of 574 patients without known COVID-19 at time of interpretation, 345 (60%) were eventually diagnosed with COVID-19, including 61% (315/516) of suspected and 52% (30/58) of unsuspected patients. Nearly all (46/58) unsuspected patients were identified at CT. Discussion Radiologists rapidly adopted recommended reporting terminology for patients with suspected COVID-19. The majority of patients for whom radiologists raised concern for COVID-19 were subsequently diagnosed with the disease, including the majority of clinically unsuspected patients. Using unambiguous terminology and timely notification about previously unsuspected patients will become increasingly critical to facilitate COVID-19 testing and contact tracing as states begin to lift restrictions.

The COVID-19 pandemic has created new challenges for healthcare with regards to patient triage, isolation, and diagnosis. To manage and control the pandemic, patients with suspected COVID-19 must be isolated and expediently tested(1); positive patients must be cared for with personal protective equipment and, if discharged, instructed to self-quarantine.

Radiology plays an important role in this process in two main respects: first, patients with known or suspected COVID-19 require personnel to use personal protective equipment and employ appropriate cleaning of imaging rooms and scanners; and second, patients with no clinical suspicion for COVID-19 (hereinafter unsuspected patients) may be identified by imaging itself. To address these two scenarios effectively, radiologists need to establish unambiguous reporting terminology and communication algorithms with resulting downstream workflows to handle each scenario (1) (2) (3) . Importantly, these workflows must include protocols for reporting unsuspected patients and tracing personnel and scanners that came into contact with infected patients.

Several reporting guidelines have been proposed to address reporting the radiological findings in patients with suspected COVID-19, including the Radiological Society of North America (RSNA) guidelines and COVID-19 Reporting and Data System (CO-RADS) from the Dutch Radiologic Society (4, 5) . However, these guidelines do not specifically address radiology departmental workflow, such as communications and contact tracing. Here, we describe the implementation of our departmental policies for reporting and operational management of patients with known, suspected, and unsuspected COVID-19. This study aimed to evaluate the initial adoption and outcomes of a locally designed radiologist reporting guideline for patients with possible COVID-19 detected at imaging.

This retrospective study was approved by the Institutional Review Board and carried out according to Health Insurance Portability and Accountability Act guidelines. The study institution is a large academic medical center with a 793-bed quaternary care hospital. A multispecialty Radiology Department is responsible for radiologic studies conducted within the academic medical center, community hospital, outpatient cancer center, and outpatient imaging centers.

Departmental guidelines for reporting and operational workflow for patients with known, clinically suspected, and imaging suspected COVID-19 were developed by a team including radiology leadership, thoracic radiologists, infection control, and hospital leadership ( Figure 1 ). In brief, we asked radiologists to use a previously developed reporting diagnostic Certainty Scale (Table 1) to convey their subjective degree of confidence regarding the diagnosis of COVID-19(6). This diagnostic Certainty Scale was designed to reduce variation in the terminology used by radiologists to convey certainty in radiology reports. The scale, which was already in use in our department, provides an ordinal scale of terminology ranging from "very unlikely" to "most likely," to enable radiologists to convey their degree of certainty about a diagnosis in a clear and unambiguous manner to referring physicians and patients.

Specifically in regards to COVID-19, radiologists are asked to use "consistent with" for a diagnosis of COVID-19 confirmed by reverse transcription polymerase chain reaction (RT-PCR), and "likely represent" or "may represent" for unknown (either unsuspected or not yet RT-PCRconfirmed) diagnoses at the time of interpretation. If a diagnosis of COVID-19 is not probable, radiologists are asked to not use "COVID-19" in their reports.

In addition to the report wording, the guidelines include specific actions for the radiologist and departmental operations team to take, depending upon clinical suspicion of COVID-19. In particular, for clinically unsuspected patients where imaging findings raise the possibility of COVID-19, the guidelines instruct the radiologist to call hospital infection control and alert departmental operations to ensure adequate cleaning and initiate contact tracing.

While the diagnostic Certainty Scale had been in effect in the department for approximately 1 year, the COVID-19 guidelines were discussed in the beginning of March and formally distributed via email to all attending radiologists and trainees in the department on March 13, 2020.

All radiology examination reports signed between March 1, 2020 and May 3, 2020 were identified. All modalities and patient settings (inpatient, outpatient, and Emergency Department) were included. A locally-developed natural language processing algorithm (CEBI-Miner (7)) was used to search reports for the following keywords in the Impression section of the report: COVID, COVID19, COVID-19, coronavirus, SARS-CoV-2, and 2019-nCoV. These reports were then manually reviewed to verify the presence of these keywords. Only exams where the report described imaging findings potentially related to COVID-19 were included (e.g., reports

stating "follow-up may be deferred in the setting of COVID-19 pandemic" or reports that described "no imaging findings to suggest COVID-19" were excluded).

Manual chart review by a medical student identified the results of any RT-PCR testing for COVID-19 (though patients without RT-PCR were not excluded). Radiology order indication was extracted from the report or, if not present in the report, the exam order in the electronic medical record. Study indications were broadly classified as "suspected COVID-19" if the patient had any respiratory or infectious signs or symptoms, including chest pain, or as "unsuspected patients" (receiving imaging for other reasons such as trauma, cancer staging, or non-chest pain). The report terminology used to describe COVID-19 was extracted by manual review.

The primary study outcome was the percentage of COVID-19 reports using the recommended reporting terminology. Secondary outcomes were the percentage of patients diagnosed with COVID-19 by suspected versus unsuspected indication and modality; and percentage of patients diagnosed with COVID-19 by report terminology.

Data were analyzed using Microsoft Excel (Microsoft Corp, Redmond, WA) and JMP Pro v15 (SAS Institute, Cary, NC). Relationships between categorical variables were tested with Fisher's exact test, one-sided. The statistical significance threshold was set at p<0.05.

A total of 77,400 radiology reports were completed during the study period. Among these, 1,083 reports (1.4%) contained imaging findings suggestive of COVID-19 in the Impression section; 509 were known COVID-19 positive at the time of interpretation, 516 were suspected, and 58 were reports for unsuspected patients. COVID-19-suggestive findings were predominantly in chest radiographs, chest CT examinations, and CT angiogram reports ( Table   2 ). Four reports describing "no findings to suggest COVID-19" were excluded.

Reports using terminology from the Certainty Scale accounted for 774 (71%) of all reports. The most commonly used terms are shown in Table 3 . Of 509 reports with a known COVID-19 diagnosis, 296 (58%) used "consistent with" and 91 (18%) used either "may represent" or "likely represent." Of 574 reports without a known COVID-19 diagnosis, 271 (47%) used "may represent" and 90 (16%) used "likely represent." (p=0.11 for difference between suspected and unsuspected). Among unsuspected patients, 24/46 (52%) of those undergoing CT were diagnosed with COVID-19 compared to 6/11 (55%) of those with chest radiographs. One unsuspected patient was identified at PET/CT but was not diagnosed with COVID-19. Of the 58 reports for unsuspected patients, 36 (62%) used recommended report terminology.

The distributions of indication and COVID-19 diagnosis rates in unsuspected patients are given in Table 4 . Of the unsuspected patients, 2 did not receive COVID-19 testing documented in our electronic health record; one patient's findings were thought unlikely to represent COVID-19 by imaging, while the other was thought to be likely. In the latter instance, the ordering physician and the infection control group were contacted.

Of reports using the term "likely represent," 69/90 (77%) patients were eventually diagnosed as COVID-19 positive, and of reports using "may represent," 174/271 (64%) patients were eventually diagnosed with COVID-19 (p=0.02).

We demonstrate the successful implementation and adoption by radiologists of departmental guidelines for use when patients are found with suspected COVID-19 based on imaging findings. These reporting guidelines apply to patients with clinically known, clinically suspected, and clinically unsuspected COVID-19 and provide a framework for both reporting terminology and communication requirements. These enable timely clinical management decisions (testing, contact tracing) and operational recovery (including room and scanner cleaning and contact tracing in the department of radiology). Radiologists broadly adopted the recommended language, with approximately three-quarters of reports using terms from our Certainty Scale. Notably, the majority of both clinically suspected and clinically unsuspected patients where radiologists raised concern for COVID-19 did indeed turn out to be positive (61% and 52%, respectively).

While existing reporting guidelines from the RSNA and CO-RADS are helpful in defining the imaging patterns that are typical, indeterminate, and atypical for COVID-19, they are not specifically tailored to the clinical scenario. Critically, they do not provide a framework for patient management and may be puzzling for referring physicians who are left with uncertainty about the radiologist's diagnostic confidence.

By using a previously developed department-wide diagnostic Certainty Scale(6), our departmental guidance places imaging findings in a confidence spectrum that is transparent to the referring provider. While this confidence scale is not necessarily tied to a likelihood of disease being present, it provides a framework for clinicians and easily allows radiologists to include multiple differential diagnoses with varying degrees of confidence. Indeed, in our study, 77% of reports that stated findings "likely represent" COVID-19 were eventually positive, compared to 64% of reports stating findings "may represent" COVID-19. Of note, these results are in keeping with how we explain the Certainty Scale to our referring providers and patients (https://rad.bwh.harvard.edu/diagnostic-certainty-scale): we describe "likely represents" as having probability of >75% and <90%, and "may represent" with probability boundaries of >25% and <75%. Future studies will be needed to validate and assess the reproducibility of the Certainty Scale for communicating uncertainty in radiology reports.

As noted above, our departmental guidelines also provide radiologists with an established workflow for handling patients with both clinically suspected and unsuspected COVID-19, including guidance about critical notification of the ordering provider as well as notification of infection control and operations staff regarding unsuspected patients. These protocols will likely become even more important in the future as mitigation measures decrease and the epidemic transitions to an endemic phase, with many sporadic unsuspected patients. Indeed, in our study, 58/1,083 or 5.4% of reports containing COVID-19 in the report impression were in patients not suspected to have COVID-19. The majority of these patients, 52%, were eventually diagnosed with the disease. We expect this scenario to become more common in the coming months.

An interesting phenomenon in our study was the relatively low rate of positive CT diagnoses in the suspected category. This is most likely caused by the fact that our hospital guidance is for physicians to use chest radiographs as the initial imaging modality in patients with suspected COVID-19. In general, clinicians will only order a chest CT if COVID-19 is not an initial consideration, an initial COVID-19 nasal swab test is negative, or a patient with COVID-19 develops complications. Thus, the pre-test probability in the CT group is much lower than in the chest radiograph group in our study. Other hospitals and countries that have different imaging policies will likely see different results, potentially with a much higher positive predictive value of CT.

Our study has several limitations, principally that it is a single-center retrospective analysis. However, we have shown the successful rapid implementation of our local operational guidelines for handling suspected COVID-19 imaging findings. Another limitation is that we do not have information about whether infection control was contacted for each unsuspected patient, as recommended in the guidelines. However, we did establish that testing was performed for nearly all of these patients. Finally, we did not evaluate reports in patients with known or suspected COVID-19 in which the term "COVID-19" was not used in the report. Our reporting guidelines specifically instructed radiologists not to use the term COVID-19 unless they actually suspected the diagnosis, and therefore reports that did not use the term COVID-19 are not in the scope of this study.

We demonstrate the successful implementation and adoption by radiologists of departmental guidelines for use when patients are found with suspected COVID-19 based on imaging findings.

•

We developed a departmental reporting and operations guideline for patients with imaging findings suggestive of COVID-19.

Radiologists rapidly adopted the guideline, with 71% (774/1,083) of reports using recommended terminology. Radiologists were asked to use this guideline for patients with imaging findings suggestive of COVID-19, based on patient test status at the time of interpretation and imaging indication. Concerning for 53 (5%)

Note: All terms used in at least 5% of reports are listed individually. 

Operational Strategies to Prevent Coronavirus Disease 2019 (COVID-19) Spread in Radiology: Experience From a Singapore Radiology Department After Severe Acute Respiratory Syndrome

Radiology Department Preparedness for COVID-19: Radiology Scientific Expert Panel

Academic Radiology Departmental Operational Strategy Related to the Coronavirus Disease 2019 (COVID-19) Pandemic

Radiological Society of North America Expert Consensus Statement on Reporting Chest CT Findings Related to COVID-19. Endorsed by the Society of Thoracic Radiology, the American College of Radiology, and RSNA. Radiol Cardiothorac Imaging

CO-RADS -A categorical CT assessment scheme for patients with suspected COVID-19: definition and evaluation

Early Adoption of a Certainty Scale to Improve Diagnostic Certainty Communication

Effect of a Report Template-Enabled Quality Improvement Initiative on Use of Preferred Phrases for Communicating Normal Findings in Structured Abdominal CT and MRI Reports

•We developed a departmental reporting and operations guideline for patients with imaging findings suggestive of COVID-19.• Radiologists rapidly adopted the guideline, with 71% (774/1,083) of reports using recommended terminology.• More than half (52%) of patients unsuspected of having COVID-19 at the time of imaging who had concerning imaging findings documented in the radiology report were diagnosed with COVID-19.