key: cord-282198-ugmv9om1
authors: Pare, Joseph R.; Camelo, Ingrid; Mayo, Kelly C.; Leo, Megan M.; Dugas, Julianne N.; Nelson, Kerrie P.; Baker, William E.; Shareef, Faizah; Mitchell, Patricia M.; Schechter-Perkins, Elissa M.
title: Point-of-care Lung Ultrasound Is More Sensitive than Chest Radiograph for Evaluation of COVID-19
date: 2020-06-19
journal: West J Emerg Med
DOI: 10.5811/westjem.2020.5.47743
sha: 
doc_id: 282198
cord_uid: ugmv9om1

INTRODUCTION: Current recommendations for diagnostic imaging for moderately to severely ill patients with suspected coronavirus disease 2019 (COVID-19) include chest radiograph (CXR). Our primary objective was to determine whether lung ultrasound (LUS) B-lines, when excluding patients with alternative etiologies for B-lines, are more sensitive for the associated diagnosis of COVID-19 than CXR. METHODS: This was a retrospective cohort study of all patients who presented to a single, academic emergency department in the United States between March 20 and April 6, 2020, and received LUS, CXR, and viral testing for COVID-19 as part of their diagnostic evaluation. The primary objective was to estimate the test characteristics of both LUS B-lines and CXR for the associated diagnosis of COVID-19. Our secondary objective was to evaluate the proportion of patients with COVID-19 that have secondary LUS findings of pleural abnormalities and subpleural consolidations. RESULTS: We identified 43 patients who underwent both LUS and CXR and were tested for COVID-19. Of these, 27/43 (63%) tested positive. LUS was more sensitive (88.9%, 95% confidence interval (CI), 71.1–97.0) for the associated diagnosis of COVID-19 than CXR (51.9%, 95% CI, 34.0–69.3; p = 0.013). LUS and CXR specificity were 56.3% (95% CI, 33.2–76.9) and 75.0% (95% CI, 50.0–90.3), respectively (p = 0.453). Secondary LUS findings of patients with COVID-19 demonstrated 21/27 (77.8%) had pleural abnormalities and 10/27 (37%) had subpleural consolidations. CONCLUSION: Among patients who underwent LUS and CXR, LUS was found to have a higher sensitivity than CXR for the evaluation of COVID-19. This data could have important implications as an aid in the diagnostic evaluation of COVID-19, particularly where viral testing is not available or restricted. If generalizable, future directions would include defining how to incorporate LUS into clinical management and its role in screening lower-risk populations.

Novel coronavirus, SARS-CoV-2, is responsible for causing the coronavirus disease 2019 . With an estimated case fatality rate of 1%, COVID-19 has resulted in over 305,000 deaths worldwide to date. 1 COVID-19's mortality POCUS Is More Sensitive than CXR for Evaluation of Pare et al.

What do we already know about this issue? Lung ultrasound (LUS) has been shown to outperform chest radiograph (CXR) in its ability to detect abnormalities with non-coronavirus disease 2019 (COVID-19) pulmonary infections.

What was the research question?

To determine if B-lines detected by LUS are more sensitive for the associated diagnosis of COVID-19 than an abnormal CXR.

What was the major finding of the study? B-lines detected by LUS were more sensitive for the associated diagnosis of COVID-19 than an abnormal CXR.

In locations where viral testing is not available or has significant delays, LUS may provide important information for the evaluation of suspected COVID-19.

is primarily due to lung injury resulting in acute respiratory distress syndrome (ARDS). 2 The definition of ARDS has changed over time; however, using the 2012 Berlin definition it would include acute bilateral lung injury in the absence of fluid overload, causing hypoxemia and respiratory failure. 3 Physicians evaluating patients may wish to order radiographic imaging to screen for findings of COVID-19, evaluate severity of pulmonary involvement, or assess for alternative etiologies of illness. Radiographic results may alter the treating physician's concern for COVID-19 thereby guiding patient counseling, or supporting clinical choices such as hospitalization, the need for closer follow-up, or anticipating complications of the disease. The American College of Radiology (ACR) recommended the use of portable chest radiograph (CXR) when medically necessary for patients with suspected or known COVID-19, which does not include screening purposes. 4 However, it is estimated that portable CXR is only 69% sensitive for findings of COVID-19. 5 When compared to CXR, lung ultrasound (LUS) may offer improved diagnostic accuracy in the evaluation of patients with suspected COVID-19 pneumonia. LUS has a high sensitivity and often out-performs CXR in the diagnosis of other pulmonary infections. 6 LUS findings for COVID-19 have been reported in the literature and include B-lines, pleural abnormalities, and subpleural consolidations. [7] [8] [9] Evaluation of B-lines is already within the scope of practice for emergency physicians (EP), and instruction in interpreting LUS is part of current residency education standards. 10

LUS is a safe, readily available tool that can be employed by EPs to provide real-time clinical assessment for COVID-19. Lab testing utility is hampered by delays in results, accuracy, and availability. CXR may miss pulmonary disease, and the ACR has cautioned against routine screening with chest computed tomography (CT), citing concerns of poor specificity of ground-glass opacities for COVID-19 as well as infection control procedures necessary to decontaminate the CT scanner. 4 Regarding infection control procedures, we expect that portable (or hand-held) ultrasounds would be easier to decontaminate than portable CXR machines or CT suites.

Our primary aim was to determine whether detection of B-lines on LUS, among patients without alternative etiologies for their presence, is more sensitive for the diagnosis of COVID-19 than CXR. Our secondary aim was to evaluate the proportion of patients with COVID-19 that have secondary LUS findings of pleural abnormalities and subpleural consolidations.

This was a retrospective, observational, cohort study of patients undergoing COVID-19 testing (based on real-time reverse transcriptase-polymerase chain reaction [RT-PCR] of nasopharyngeal sampling performed on an assay developed by the Center for Regenerative Medicine at Boston University, operating under an Emergency Use Authorization], who also had both diagnostic LUS and CXR for the evaluation of COVID-19 in the emergency department (ED). This study had institutional review board approval and was conducted based on Standards for Reporting of Diagnostic Accuracy Studies (STARD) guidelines and best practices for retrospective reviews. 11 This investigation was performed at a large urban academic ED in the United States with >140,000 visits per year. The ED is associated with an emergency medicine residency and clinical ultrasound fellowship, and has six dedicated portable ultrasound machines (Philips SPARQ, Wayne, PA; and MINDRAY TE7, Arnold, MD). All ultrasound studies are transferred wirelessly and stored in QPATH (Telexy, Blaine, WA). There was no formal education for LUS specific to COVID-19; however, all physicians have had structured training in LUS. All physicians were provided literature from a small study of 20 patients with COVID-19 that had 12 lung zones evaluated with ultrasound, which found 75% of patients had abnormal LUS findings at the posterior lung bases. 9 When performing point-of-care ultrasound in the clinical setting, all EPs at our institution are required to archive at least one image that is representative of their findings.

POCUS Is More Sensitive than CXR for Evaluation of COVID-19

All ultrasound studies completed in the ED between March 20, 2020-April 6, 2020, were reviewed for LUS imaging. We reviewed the electronic health record (EHR), EPIC (Verona, WI) to determine whether COVID-19 testing was performed. Subjects were included for evaluation if they had a COVID-19 test performed during the index hospitalization or within two weeks of the LUS examination. At the hospital during this time period, COVID-19 testing was performed only on people with symptoms concerning for disease, and no routine screening practices were in place. However, performance of viral testing was at physician discretion, and those without viral testing were excluded from analysis. We also excluded subjects if they did not have a CXR. Lastly, based on EHR review from patient history or physician documentation, patients were excluded if they had reasons for alternative causes of B-lines (congestive heart failure, renal disease leading to volume overload, or underlying lung disease), as it would not be possible to determine the etiology of the abnormal ultrasound results.

All lung ultrasounds were reviewed by two expert EPs, both with clinical ultrasound fellowship training (JRP and KCM), who were blinded to COVID-19 results. When disagreements occurred, a third ultrasound fellowship-trained, blinded independent expert reviewer adjudicated (MML). LUS were scored as positive or negative after review of all images. Subjects were considered to have a positive LUS if any B-lines were detected. The reviewers further graded positive ultrasounds as having 1-2 B-lines or ≥3 B-lines. 12 If B-lines coalesced, the score was graded as ≥3 B-lines if the area of B-lines took up ≥30% of the intercostal space. Although ground-glass opacities can manifest as thinner B-lines <3mm apart, we allowed for percentage grading to account for coalescing in addition to "light beam" artifact, which is a broader, band-shaped artifact described in COVID-19. 13 Because COVID-19 is reported to cause focal and diffuse lung disease, we chose the image with the most B-lines detected at one intercostal space to score each patient.

The images were subsequently evaluated for subpleural consolidations and pleural abnormalities ( Figure 1 and Online Supplemental Videos A-E). We defined subpleural consolidations as an area of hypoechoic focus at the pleural line. These areas may be associated with increased B-lines originating from this area of hypoechoic focus. For pleural abnormalities we defined this as a) loss of pleural line echogenicity; b) irregular contour of the pleural line; or c) areas that appeared >3 millimeters in thickness by visual estimation. 14 Secondary LUS findings were determined by a consensus of all reviewers. Finalized CXR reports were recorded. We classified CXRs as positive if the report included infection in the differential, as defined by words such as opacity, consolidation, or airspace disease. CXRs were classified as negative if no abnormality was noted, an abnormality was noted but attributed to a non-infectious etiology, or was inconclusive for infectious process.

After LUS scoring and data collection, clinical data including demographics, co-morbidities, vital signs, and laboratory values, was collected from the EHR by two investigators (JRP and FS) using a standardized abstraction technique and entered into REDCap.

The primary outcome measure was the sensitivity of LUS compared to CXR for the detection of COVID-19, using the RT-PCR laboratory test as the reference standard. Secondary outcome measures were the proportion of additional secondary LUS findings (pleural abnormalities or subpleural consolidation) detected.

A sample size of 43 patients with an estimated sensitivity of 40% for CXR and 70% for LUS yields 81% power with an alpha of 0.05 assuming 70% disease prevalence. We used an estimated sensitivity of 40% based on results of CXR findings in influenza, as the referenced paper of 69% was not available at the time this study was designed. 5, 15 We compared sensitivities of LUS and CXR using a two-sided McNemar's test. Patient demographics were evaluated with descriptive statistics, Fisher's exact tests, Wilcoxon sum-ranked test, chi-squared tests, and Welch's t-test. Inter-rater reliability for POCUS Is More Sensitive than CXR for Evaluation of COVID-19

Pare et al.

the primary outcome between the two primary reviewers was assessed by Cohen's kappa. 16 

A total of 304 ultrasound studies were completed over the 18-day study period (Figure 2 ). Of these, 81 had LUS performed. Among these, 43 met inclusion criteria, and 27/43 tested positive for COVID-19 by RT-PCR (63%). Four patients admitted with initial negative results were retested, and two were found to be positive. These two subjects were classified in the 27 total patients with COVID-19. Table 1 describes the demographic and clinical information of the included patients.

The sensitivity and specificity of B-lines on LUS associated with COVID-19 were 88.9% (95% CI, 71.1-97.0) and 56.3% (95% CI, 33.2-76.9), respectively. The association between CXR and COVID-19 results had a sensitivity and specificity (Appendix) of 51.9% (95% CI, 34.0-69.3) and 75.0% (95% CI, 50.0-90.3). LUS was more sensitive than CXR for the association of pulmonary findings of COVID-19 (p = 0.013). While there was a trend for CXR to be more specific for the associated diagnosis of COVID-19, this was not found to be statistically significant (p = 0.453). Additional LUS test characteristics are provided in Table 2 . Cohen's kappa for interrater agreement between the two expert LUS reviewers for the primary outcome was strong (κ = 0.83, 95% CI, 0.65-1.00). There were only three cases out of 43 where there was disagreement on the primary outcome between the two reviewers. These involved cases where B-lines were more subtle.

B-lines were more frequently detected in patients with COVID-19 (24/27 patients with COVID-19 and 7/16 patients without, p < 0.001). Of the 27 patients with confirmed COVID-19 infection, 21 had pleural abnormalities (77.8%) and 10 had subpleural consolidations (37%). Of the 16 subjects without COVID-19, three had pleural irregularities (18.8%) and two had subpleural consolidations (12.5%).

There was a mean of 6.2 LUS images recorded per patient, which was not significantly different between COVID-19 results, and a median of 6 LUS images taken per patient. Images were more frequently obtained with a curvilinear probe 37/43, (86%), than the phased array probe, 6/43 (14.0%). Of the LUS studies, 8/43 (18.6%) were completed by residents or physician assistants, 4/43 (9.3%) by an ultrasound fellow, 17/43 (39.5%) by ultrasound faculty, and 14/43 (32.6%) by non-fellowship trained EPs. Of the CXRs performed, 42/43 (97.7%) were performed as portable examinations. The one 2-view CXR was a false negative.

To our knowledge this is the first study to evaluate the test characteristics of LUS for COVID-19. We also are the first to compare the diagnostic performance of LUS to the more conventional use of CXR. Although preliminary, this work provides important results for the application of LUS for detection of COVID-19. This investigation offers compelling evidence that B-lines detected by LUS are more frequently associated with COVID-19 than an abnormal CXR. This finding is in line with the performance of LUS in other pulmonary disease entities. 6, 10 We used RT-PCR as the reference standard for diagnosis of COVID-19. However, it is known that the test characteristics of RT-PCR are dependent on collection technique, timing in disease process, and processing technique. In our population there were two negative RT-PCR tests that were positive on repeat testing. Both patients with initially negative RT-PCR tests had positive LUS findings; thus, it is possible LUS is more sensitive than RT-PCR for COVID-19. Further research would be necessary to substantiate this theory.

Our study reports a sensitivity of 52% for CXR, which is lower than the reported 69% for portable CXR. It is unknown whether the radiologists in that previous study were blinded, and it is also unclear how body mass index or other variables may have resulted in our reported lower sensitivity for CXR. It is unknown how two-view CXRs would perform for the detection of lung involvement from COVID-19, as it might Evidence that LUS is more sensitive for the associated diagnosis of COVID-19 than CXR has potential global implications. These results may be of particular importance to settings with significant delays in viral RT-PCR testing, settings in which RT-PCR testing is restricted or not available, or where CXR or CT are not accessible. Further scientific investigation could determine how LUS at the time of initial evaluation may aid the physician in counseling patients with regard to findings suggestive of COVID-19. Our investigation provides important new data for the role of LUS relative to CXR for patients being evaluated for COVID-19.

Conversely, LUS did have a lower specificity than CXR. As noted, 1-2 B-lines may be non-pathologic; however, only one patient in this study was found to have 1-2 B-lines that did in fact have COVID-19. It is possible that using LUS with only one or two B-lines to direct care for patients suspected of having COVID-19 could lead to unnecessary isolation or further medical testing. Additionally, there are other etiologies for LUS B-lines, and our results will likely be most valuable when interpreted in the clinical context of the medical evaluation.

Physicians should have an estimation of pretest probability when performing and interpreting diagnostic testing, and LUS for COVID-19 is no exception to this rule. In this population with a high prevalence of disease (as judged by RT-PCR results), a positive LUS was a good predictor of disease. Further work is necessary to better delineate how to incorporate these findings into screening for asymptomatic patients, diagnostic algorithms, and clinical management strategies.

Since this was a retrospective study, it is unclear why physicians chose to perform both CXR and LUS. It is also unknown whether the result of either diagnostic test affected the physician's choice to perform the other test. Additionally, the treating physician was not blinded to the patient's history, exam, or CXR. It is possible that knowledge of these data points would change the extent to which the physician performed their LUS. Despite this, there were a similar number of images recorded for patients with and without COVID-19.

Over half of the studies performed were performed by non-fellowship trained EPs. Further work is needed to validate these findings in a population of EPs without fellowship training. Identification of B-lines is a core skill of EPs; therefore, we anticipate the findings would be similar.

Another limitation was the use of RT-PCR for the diagnosis of COVID-19, as it likely misses some cases. Some of the tests classified as false positive may have actually been true positives. RT-PCR was chosen as the reference standard since that is what is currently used at our, and most, institutions nationally, and viral culture is not feasible at this time. Inconclusive CXRs were scored as negative, which might favor the analysis toward LUS. This was done, in accordance with STARD guidelines, because inconclusive CXRs do not provide diagnostic guidance in real time. 11 We used B-lines in this study as a reliable marker for COVID-19. It is possible a comprehensive evaluation including pleural abnormalities and subpleural consolidations would improve the test characteristics of LUS. We chose to only include B-lines for our assessment as B-lines are already familiar to EPs and would be easier to implement. We included any number of B-lines (one or more) as abnormal; however, it has been reported 1-2 B-lines may not be pathologic. We selected this approach to maximize the sensitivity of LUS at the cost of specificity.

This investigation provides evidence that LUS is more sensitive for the associated diagnosis of COVID-19 than CXR when excluding patients with other expected causes of B-lines. This work could have important implications where viral testing is restricted or alternative diagnostic imaging is not available. Further work may find LUS for the evaluation and care of COVID-19 patients to be of clinical benefit and may also have a role to guide testing as screening and contact tracing are expanded.

The many estimates of the COVID-19 case fatality rate

Clinical characteristics of 138 hospitalized patients with 2019 novel coronavirus-infected pneumonia in Wuhan, China

Acute respiratory distress syndrome: the Berlin definition

American College of Radiology. ACR Recommendations for the Use of Chest Radiography and Computed Tomography (CT) for

Available at: https://www. acr.org/Advocacy-and-Economics/ACR-Position-Statements/ Recommendations-for-Chest-Radiography-and-CT-for-Suspected-COVID19-Infection

Frequency and distribution of chest radiographic findings in COVID-19 positive patients

Accuracy of lung ultrasonography versus chest radiography for the diagnosis of adult community-acquired pneumonia: review of the literature and meta-analysis

Can lung US help critical care clinicians in the early diagnosis of novel coronavirus (COVID-19) pneumonia?

Findings of lung ultrasonography of novel corona virus pneumonia during the 2019-2020 epidemic

A preliminary study on the ultrasonic manifestations of peripulmonary lesions of non-critical novel coronavirus pneumonia (COVID-19)

Diagnosing acute heart failure in the emergency department: a systematic review and metaanalysis

Guidelines for Reporting Diagnostic Accuracy Studies: explanation and elaboration

Relevance of lung ultrasound in the diagnosis of acute respiratory failure: the BLUE protocol

What's new in lung ultrasound during the COVID-19 pandemic

Transforming growth factor beta-1 as a predictor of fibrosis in tuberculous pleurisy

Pulmonary imaging of pandemic influenza H1N1 infection: relationship between clinical presentation and disease burden on chest radiography and CT

A coefficient of agreement for nominal scales