key: cord-0773698-ipon95io
authors: Prince-Guerra, Jessica L.; Almendares, Olivia; Nolen, Leisha D.; Gunn, Jayleen K. L.; Dale, Ariella P.; Buono, Sean A.; Deutsch-Feldman, Molly; Suppiah, Suganthi; Hao, LiJuan; Zeng, Yan; Stevens, Valerie A.; Knipe, Kristen; Pompey, Justine; Atherstone, Christine; Bui, David P.; Powell, Tracy; Tamin, Azaibi; Harcourt, Jennifer L.; Shewmaker, Patricia L.; Medrzycki, Magdalena; Wong, Phili; Jain, Shilpi; Tejada-Strop, Alexandra; Rogers, Shannon; Emery, Brian; Wang, Houping; Petway, Marla; Bohannon, Caitlin; Folster, Jennifer M.; MacNeil, Adam; Salerno, Reynolds; Kuhnert-Tallman, Wendi; Tate, Jacqueline E.; Thornburg, Natalie J.; Kirking, Hannah L.; Sheiban, Khalilullah; Kudrna, Julie; Cullen, Theresa; Komatsu, Kenneth K.; Villanueva, Julie M.; Rose, Dale A.; Neatherlin, John C.; Anderson, Mark; Rota, Paul A.; Honein, Margaret A.; Bower, William A.
title: Evaluation of Abbott BinaxNOW Rapid Antigen Test for SARS-CoV-2 Infection at Two Community-Based Testing Sites — Pima County, Arizona, November 3–17, 2020
date: 2021-01-22
journal: MMWR Morb Mortal Wkly Rep
DOI: 10.15585/mmwr.mm7003e3
sha: e936e7a29ca3e6f55612da44f2953307e624dbbf
doc_id: 773698
cord_uid: ipon95io

Rapid antigen tests, such as the Abbott BinaxNOW COVID-19 Ag Card (BinaxNOW), offer results more rapidly (approximately 15-30 minutes) and at a lower cost than do highly sensitive nucleic acid amplification tests (NAATs) (1). Rapid antigen tests have received Food and Drug Administration (FDA) Emergency Use Authorization (EUA) for use in symptomatic persons (2), but data are lacking on test performance in asymptomatic persons to inform expanded screening testing to rapidly identify and isolate infected persons (3). To evaluate the performance of the BinaxNOW rapid antigen test, it was used along with real-time reverse transcription-polymerase chain reaction (RT-PCR) testing to analyze 3,419 paired specimens collected from persons aged ≥10 years at two community testing sites in Pima County, Arizona, during November 3-17, 2020. Viral culture was performed on 274 of 303 residual real-time RT-PCR specimens with positive results by either test (29 were not available for culture). Compared with real-time RT-PCR testing, the BinaxNOW antigen test had a sensitivity of 64.2% for specimens from symptomatic persons and 35.8% for specimens from asymptomatic persons, with near 100% specificity in specimens from both groups. Virus was cultured from 96 of 274 (35.0%) specimens, including 85 (57.8%) of 147 with concordant antigen and real-time RT-PCR positive results, 11 (8.9%) of 124 with false-negative antigen test results, and none of three with false-positive antigen test results. Among specimens positive for viral culture, sensitivity was 92.6% for symptomatic and 78.6% for asymptomatic individuals. When the pretest probability for receiving positive test results for SARS-CoV-2 is elevated (e.g., in symptomatic persons or in persons with a known COVID-19 exposure), a negative antigen test result should be confirmed by NAAT (1). Despite a lower sensitivity to detect infection, rapid antigen tests can be an important tool for screening because of their quick turnaround time, lower costs and resource needs, high specificity, and high positive predictive value (PPV) in settings of high pretest probability. The faster turnaround time of the antigen test can help limit transmission by more rapidly identifying infectious persons for isolation, particularly when used as a component of serial testing strategies.

of high pretest probability. The faster turnaround time of the antigen test can help limit transmission by more rapidly identifying infectious persons for isolation, particularly when used as a component of serial testing strategies.

Paired upper respiratory swabs were collected at the same timepoint from persons aged ≥10 years receiving testing for SARS-CoV-2, the virus that causes coronavirus disease 2019 (COVID-19), at two Pima County Health Department community testing sites during November 3-17 (site A) and November 8-16 (site B). The sites offered SARS-CoV-2 testing to anyone in the community who wanted testing. A questionnaire capturing demographic information and current and past-14-day symptoms was administered to all participants. At both sites, a health care professional first collected a bilateral anterior nasal swab, using a swab provided in the BinaxNOW kit, immediately followed by a bilateral nasopharyngeal (NP) swab for real-time RT-PCR testing. Anterior nasal swabs were immediately tested on-site using the BinaxNOW antigen test according to the manufacturer's instructions (4) . NP swabs were stored in phosphate buffered saline at 39°F (4°C) and analyzed within 24-48 hours by real-time RT-PCR using either the CDC 2019-nCoV Real-Time RT-PCR Diagnostic Panel for detection of SARS-CoV-2 (5) (2,582 swabs) or the Fosun COVID-19 RT-PCR Detection Kit (6) (837 swabs). Viral culture* , † was attempted on 274 of 303 residual real-time RT-PCR specimens if either the real-time RT-PCR or BinaxNOW antigen test result was positive (the remaining 29 were not available for viral culture). Results from real-time RT-PCR and the BinaxNOW antigen test were compared to evaluate sensitivity, specificity, negative predictive value (NPV), and PPV. Statistical analyses were performed using SAS (version 9.4; SAS Institute). Cycle threshold (Ct) values from real-time RT-PCR were compared using a Mann-Whitney U Test; 95% confidence intervals (CIs) not recovered from any of the three available specimens with false-positive BinaxNOW antigen test results. Among the 224 specimens undergoing viral culture that were analyzed with the CDC 2019-nCoV Real-Time RT-PCR Diagnostic Panel for detection of SARS-CoV-2, median Ct values** were significantly higher for specimens with false-negative BinaxNOW antigen test results, indicating lower viral RNA levels than in those with concordant positive results (33.9 versus 22.0 in specimens from symptomatic persons [p<0.001] and 33.9 versus 22.5 in specimens from asymptomatic persons [p<0.001]) ( Figure) . Median Ct values for SARS-CoV-2 culture-positive specimens (22.1) were significantly lower than were those for culture-negative specimens (32.8) (p<0.001), indicating higher levels of viral RNA in culture-positive specimens. Among specimens with positive viral culture, the sensitivity of the BinaxNOW antigen test compared with real-time RT-PCR in specimens from symptomatic participants was 92.6% (95% CI = 83.7%-97.6%) and in those from asymptomatic participants was 78.6% (95% CI = 59.1%-91.7%).

In this evaluation, using real-time RT-PCR as the standard, the sensitivity of the BinaxNOW antigen test was lower among specimens from asymptomatic persons (35.8%) than among specimens from symptomatic persons (64.2%). Specificity (99.8%-100%) was high in specimens from both asymptomatic and symptomatic groups. The prevalence of having SARS-CoV-2 real-time RT-PCR positive test results in this population was moderate (8.7% overall; 4.7% for asymptomatic participants); administering the test in a lower prevalence setting will likely result in a lower PPV. † † Among 11 participants with antigen-negative, real-time RT-PCR-positive specimens with positive viral culture, five were symptomatic and six asymptomatic. Some antigennegative, real-time RT-PCR-positive specimens possibly could represent noninfectious viral particles, but some might also represent infectious virus not detected by the antigen test. In a clinical context, real-time RT-PCR provides the most sensitive assay to detect infection. Viral culture, although more biologically relevant than real-time RT-PCR, is still an artificial system and is subject to limitations. Numerous biological (e.g., individual antibody status and specific sequence of the virus) and environmental (e.g., storage conditions and number of freeze-thaw cycles) variables can affect the sensitivity and Abbreviation: COVID-19 = coronavirus disease 2019. * Includes 113 persons who received testing multiple times and were included more than once in the analysis. † Testing with real-time RT-PCR was performed using the CDC 2019-nCoV Real-Time RT-PCR Diagnostic Panel for detection of SARS-CoV-2 (2,582 participants) or Fosun assay (837 participants). § Only selected categories shown; therefore, row numbers and percentages do not sum to total or 100%. ¶ Participants were asked whether they had each individual sign or symptom from a list based on the Council of State and Territorial Epidemiologists' clinical criteria for COVID-19 interim case definition, which include fever, cough, shortness of breath, fatigue, sore throat, headache, muscle aches, chills, nasal congestion, difficulty breathing, diarrhea, nausea, vomiting, abdominal pain, rigors, loss of taste, and loss of smell (https://cdn.ymaws.com/www.cste.org/resource/resmgr/ps/ positionstatement2020/Interim-20-ID-02_COVID-19.pdf ). ** Based on one or more symptoms.

† † Exposure was defined as close contact (within 6 ft for ≥15 min) in the 14 days before the day of testing with a person with diagnosed COVID-19. § § Received positive real-time RT-PCR or antigen test result.

Results and Performance outcome of viral culture. Despite the limitations of interpreting culture-negative specimens, a positive viral culture is strong evidence for the presence of infectious virus. The performance of the BinaxNOW antigen test compared with real-time RT-PCR was better for those specimens with positive viral culture than for all specimens, with a sensitivity of 92.6% for specimens from symptomatic persons and 78.6% for those from asymptomatic persons. The results of the current evaluation differ from those of an evaluation of the BinaxNOW antigen test in a community screening setting in San Francisco (7), which found a BinaxNOW antigen test overall sensitivity of 89.0% among specimens from all 3,302 participants, regardless of the Ct value of the real-time RT-PCR-positive specimens. The findings in this investigation are subject to at least five limitations. First, anterior nasal swabs were used for BinaxNOW antigen testing, but NP swabs were used for real-time RT-PCR testing, which might have contributed to increased detection for the real-time RT-PCR assay (8) . Second, participants might have inadvertently reported common nonspecific symptoms as COVID-19-compatible symptoms. Third, this investigation evaluated the BinaxNOW antigen test, and results presented here cannot be generalized to other FDA-authorized SARS-CoV-2 antigen tests. Fourth, the BinaxNOW antigen test characteristics might be different depending on whether an individual had previously tested positive. Finally, many factors might limit the ability to culture virus from a specimen, and the inability to detect culturable virus should not be interpreted to mean that a person is not infectious.

Public health departments are implementing various strategies to reduce or prevent SARS-CoV-2 transmission, including expanded screening testing for asymptomatic persons (3). Because estimates suggest that over 50% of transmission occurs from persons who are presymptomatic or asymptomatic (9), expanded screening testing, potentially in serial fashion for reducing transmission in specific venues (e.g., institutions of higher education, schools, and congregate housing settings), is essential to interrupting transmission (3) .

Rapid antigen tests can be an important tool for screening because of their quick turnaround time, lower requirement for resources, high specificity, and high PPV in settings of high pretest probability (e.g., providing testing to symptomatic persons, to persons with a known COVID-19 exposure, or where community transmission is high). Importantly, the faster time from testing to results reporting can speed isolation of infectious persons and will be particularly important in communities with high levels of transmission.

Although the sensitivity of the BinaxNOW antigen test to detect infection was lower compared with real-time RT-PCR, it was relatively high among specimens with positive viral culture, which might reflect better performance for detecting infection in a person with infectious virus present. Community testing strategies focused on preventing transmission using antigen testing should consider serial testing (e.g., in kindergarten through grade 12 schools, institutions of higher education, or congregate housing settings), which might improve test sensitivity in decting infection (10) . When the pretest probability for receiving positive SARS-CoV-2 test results is elevated (e.g. for symptomatic persons or for persons with a known COVID-19 exposure) a negative antigen test result should be confirmed by NAAT. Asymptomatic persons who receive a positive BinaxNOW antigen test result in a setting with a high risk for adverse consequences resulting from false-positive results (e.g. in long-term care facilities) should also receive confirmatory testing by NAAT (1). 

What is already known about this topic?

The BinaxNOW rapid antigen test received Emergency Use Authorization by the Food and Drug Administration for testing specimens from symptomatic persons; performance among asymptomatic persons is not well characterized.

What is added by this report?

Sensitivity of the BinaxNOW antigen test, compared with polymerase chain reaction testing, was lower when used to test specimens from asymptomatic (35.8%) than from symptomatic (64.2%) persons, but specificity was high. Sensitivity was higher for culture-positive specimens (92.6% and 78.6% for those from symptomatic and asymptomatic persons, respectively); however, some antigen test-negative specimens had culturable virus.

What are the implications for public health practice?

The high specificity and rapid BinaxNOW antigen test turnaround time facilitate earlier isolation of infectious persons. Antigen tests can be an important tool in an overall community testing strategy to reduce transmission.

Despite their reduced sensitivity to detect infection compared with real-time RT-PCR, antigen tests might be particularly useful when real-time RT-PCR tests are not readily available or have prolonged turnaround times. Persons who know their positive test result within 15-30 minutes can isolate sooner, and contact tracing can be initiated sooner and be more effective than if a test result is returned days later. Serial antigen testing can improve detection, but consideration should be given to the logistical and personnel resources needed. All persons receiving negative test results (NAAT or antigen) should be counseled that wearing a mask, avoiding close contact with persons outside their household, and washing hands frequently remain critical to preventing the spread of COVID-19. § §

MD: US Department of Health and Human Services, Food and Drug Administration

COVID-19: CDC guidance for expanded screening testing to reduce silent spread of SARS-CoV-2

BinaxNOW COVID-19 Ag card (PN 195-000)-instructions for use

US CDC real-time reverse transcription PCR panel for detection of severe acute respiratory syndrome coronavirus 2

Instruction for use: Fosun COVID-19 RT-PCR detection kit

Field performance and public health response using the BinaxNOW TM Rapid SARS-CoV-2 antigen detection assay during community-based testing

Comparing nasopharyngeal and mid-turbinate nasal swab testing for the identification of SARS-CoV-2

The implications of silent transmission for the control of COVID-19 outbreaks

Assessment of SARS-CoV-2 screening strategies to permit the safe reopening of college campuses in the United States

Kristen Garcia, Wenli Zhou, Morgan Ross, Lyndsay Wagner, Katherine Collins, Shelby Legendre, Christopher Johnson, Paradigm Laboratories, Tucson, Arizona; Spencer Graves, Pima County Health Department, Tuscon, Arizona; Anastasia Litvintseva, Dennis A. Bagarozzi, Jr., David James Petway, Jr., CDC.