key: cord-1021363-gp0br1nd
authors: Akashi, Yusaku; Horie, Michiko; Takeuchi, Yuto; Togashi, Kenichi; Adachi, Yuki; Ueda, Atsuo; Notake, Shigeyuki; Nakamura, Koji; Terada, Norihiko; Kurihara, Yoko; Kiyasu, Yoshihiko; Suzuki, Hiromichi
title: A prospective clinical evaluation of the diagnostic accuracy of the SARS-CoV-2 Rapid Antigen Test using anterior nasal samples()
date: 2022-02-24
journal: J Infect Chemother
DOI: 10.1016/j.jiac.2022.02.016
sha: fea4b309666369638f511374de663108742f6b45
doc_id: 1021363
cord_uid: gp0br1nd

INTRODUCTION: The diagnostic accuracy of antigen testing of anterior nasal (AN) samples for the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) infection has not been evaluated in the Japanese population. This study assessed the diagnostic accuracy of the Roche SARS-CoV-2 rapid antigen test (rapid antigen test) using AN samples. METHODS: Two AN samples and one nasopharyngeal (NP) sample were collected from individuals undergoing screening for SARS-CoV-2 infection. The results of the rapid antigen test and the reverse-transcription polymerase chain reaction (RT-PCR) test using AN samples were compared to those of RT-PCR tests using NP samples. RESULTS: Samples were collected from 800 participants, 95 and 110 of whom tested positive for SARS-CoV-2 on RT-PCR tests of AN and NP samples, respectively. The overall sensitivity/specificity of the AN rapid antigen test and AN RT-PCR were 72.7%/100% and 86.4%/100%, respectively. In symptomatic cases, the sensitivities of the AN rapid antigen test and AN RT-PCR were 84.7% and 94.9%, respectively. In asymptomatic cases, the sensitivities of the AN rapid antigen test and AN RT-PCR were 58.8% and 76.5%, respectively. The sensitivity of the AN rapid antigen test was over 80% in cases with cycle threshold (Ct) values <25; it significantly decreased with an increase in the Ct values (p < 0.001). CONCLUSION: The rapid antigen test with AN samples had a favorable sensitivity, especially in symptomatic cases or in cases with Ct values <25. It gave no false-positive results. Compared with AN-RT PCR, the AN rapid antigen test had a modestly lower sensitivity in asymptomatic cases.

The coronavirus disease 2019 pandemic, caused by the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2), remains a significant health concern despite the development of effective vaccines and treatments [1] [2] [3] . In addition to universal mask wear and vaccination, testing the broad population is a key infection control strategy [2, [4] [5] [6] .

Antigen testing has been used as an alternative to molecular testing due to an easy specimen-handling procedure, wide availability, and short turnaround times [7] . Antigen testing is especially useful in resource-limited settings, and is now applied in infection control at mass-gatherings and in the general population to reduce the risk of transmission [6, 8, 9] . Nasopharyngeal (NP) samples are primarily used for antigen testing in medical facilities; however, sample collection requires trained medical staff and causes discomfort to the patients [10] . Thus, anterior nasal (AN) samples may be preferable, especially for mass screening.

The SARS-CoV-2 rapid antigen test (rapid antigen test; Roche Diagnostics GmbH, Mannheim, Germany) is a lateral flow immunochromatography test that is commercially available worldwide. The rapid antigen test showed pooled sensitivities of 88.1% and 69.2%

for NP samples obtained from symptomatic and asymptomatic individuals, respectively; it also showed a pooled specificity of 99.1% in both [11] . Its diagnostic performance fulfills the World Health Organization criteria and is one of the highest among those of several products tested [11, 12] . Nevertheless, the clinical performance of the rapid antigen test with AN samples has not been well evaluated.

We conducted a prospective study to assess the clinical performance of the rapid antigen test in the Japanese population using AN samples. The results were compared with those of reverse-transcription polymerase chain reaction (RT-PCR) assays.

This study was performed between July 7 and July 29, 2021, at a PCR center in the Tsukuba Medical Center Hospital (TMCH), which is located in the southern part of the Ibaraki Prefecture, Japan. At the PCR center, NP samples were collected from all patients for clinical purposes, and patient data were recorded as previously reported [13, 14] . Two additional AN samples were collected for the rapid antigen test and the RT-PCR test.

The study included individuals who were referred from a local public health center and 51 primary care facilities or were healthcare workers at the TMCH. The participants were those suspected of having contracted a SARS-CoV-2 infection due to their symptoms or a history of close contact. Patients who declined to participate in the study, whose residual samples for RT-PCR were unavailable, and for whom duplicate samples were collected during the same episode were excluded. Participants were considered "symptomatic" if at least one of the following symptoms existed: fever, cough, nasal discharge and/ or congestion, sore throat, loss of taste and/or smell, dyspnea, fatigue, headache, diarrhea, and vomiting.

We obtained verbal informed consent from all participants, and the requirement of a written informed consent was waived due to infection control measures. The study was approved by the ethics committee of the University of Tsukuba (approval number: R03-041).

Trained medical staff collected both AN and NP samples from all participants. We first obtained an AN sample for the rapid antigen test from both nostrils using the swabs included in the test kits, in accordance with the manufacturer's instructions. Another AN sample was then collected in the same manner for RT-PCR testing, using a FLOQSwab (Copan ItaliaSpA, Brescia, Italy). An NP sample was also collected for RT-PCR testing according to the 

The sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV) were calculated from the results of the NP RT-PCR test. The 95% confidence intervals (CIs) were determined using the Clopper and Pearson method. The degree of agreement between two tests was evaluated by calculating the Cohen's kappa coefficient.

Regarding the clinical data of the participants, the Wilcoxon rank sum test and the Fisher's exact test were used for comparing the continuous and categorical variables, respectively.

The Cochran-Armitage test was used to analyze the trend of sensitivity according to the Ct values of the NP RT-PCR.

Two-sided P-values <0.05 were considered statistically significant. All analyses were conducted using R, version 3.3.1 (The R Foundation for Statistical Computing, Vienna, Austria).

Samples were collected from 800 participants, 333 (41.6%) of whom were symptomatic. Table 1 summarizes the prevalence of each symptom and the days from the symptom onset. 

The sensitivity, specificity, PPV, and NPV of the AN rapid antigen test were 72.7%, 100%, 100%, and 95.8%, respectively (Table 2a) . The Cohen's kappa coefficient between the AN rapid antigen test and NP RT-PCR was 0.82.

The sensitivity and specificity of AN RT-PCR were 86.4% (95% CI: 78.5%-92.2%) and 100% (95% CI: 99.5%-100%), respectively (Table 3a) .

Among symptomatic cases, 56 AN and 59 NP samples were positive for SARS-CoV-2 on RT-PCR testing. Using NP RT-PCR test results as the reference, the sensitivities of the AN rapid antigen test and AN RT-PCR in symptomatic cases were found to be 84.7% and 94.9%, respectively (Tables 2b and 3b) .

Among asymptomatic cases, 39 AN and 51 NP samples were positive for SARS-CoV-2 on RT-PCR testing. The sensitivities of the AN rapid antigen test and AN RT-PCR were 58.8% and 76.5%, respectively (Tables 2c and 3c) . 

The Ct values of cases with discrepant results between the AN rapid antigen test and the RT-PCR test using either AN or NP samples are shown in Table 5 

This study demonstrated that using AN samples, the AN rapid antigen test had a favorable diagnostic accuracy for SARS-CoV-2. No false-positive results were obtained in this study.

The sensitivity of the test varied with the presence or absence of symptoms and with the Ct values. In symptomatic patients, the sensitivity was over 84.7%; however, in asymptomatic individuals, the sensitivity decreased to 58.8%.

The overall sensitivity of the AN rapid antigen test was 72.7%; its specificity was 100% with NP RT-PCR test results as the reference. Although the sensitivity was suboptimal, its concordance rate with AN RT-PCR was 98.1% (Supplementary Table 1 ). Besides, its diagnostic performance was comparable to that reported previously [17] . The viral load is generally higher in the nasopharynx than in the nostrils [18] , which may lower the sensitivity of testing with AN samples. The AN RT-PCR did not detect SARS-CoV-2 in 13.6% of the participants with positive NP RT-PCR samples. Most discordant cases between AN and NP RT-PCR were in asymptomatic individuals and the Ct values were >30 on NP RT-PCR, indicating a low viral load.

In symptomatic cases, the AN rapid antigen test demonstrated a sensitivity of 84.7%. The sensitivity seemed favorable even when compared to that of AN RT-PCR. The higher sensitivity may be due to the higher viral load in symptomatic patients and the shorter duration between symptom onset and examinations. Compared with the asymptomatic individuals, the symptomatic patients in our study had a significantly lower Ct values (median; 19.7 vs. 22.7, p = 0.02). The median duration from symptom onset was 2 days, during which viral shedding generally remained high [19] .

Mass screening of asymptomatic individuals with antigen testing has been initiated in some countries [9, 20] . A previous study estimated that such screening suppressed 70% of the SARS-CoV-2 transmission in models [9] . AN samples have primarily been used for this purpose, because they can be self-collected; furthermore, AN sample collection is easy and less invasive than NP sample collection [10, 17] . Our study indicated that although the specificity was high at 100%, the rapid antigen test using AN samples missed a clinically significant proportion of cases of asymptomatic SARS-CoV-2 infection. Nevertheless, antigen testing seems to effectively identify the majority of transmissible cases wherein viral loads are generally high [21] . The rapid antigen test had a sensitivity of approximately 80% in cases with Ct values <25 on NP RT-PCR testing, although the sensitivity decreased to under 60% in cases with Ct values of 25-30 (Table 4) . A similar trend was observed when we limited the study population to asymptomatic individuals (Supplementary Table 2b ). [19, 22] . Furthermore, modeling studies suggest that the specificity and frequency of testing are key for a successful mass screening [23, 24] . Thus, using the rapid antigen test with AN samples could play a useful role in mass screening.

The study has some limitations. First, the interpretation of the results may have varied between the examiners due to the visual nature of the judgment of antigen testing results [25] .

Second, Ct values vary according to the reagents and molecular identification system used, and the choice of positive control, even if same primer targets are used, so the sensitivity of each Ct value range may differ in other settings.

In conclusion, this prospective observational study found that the rapid antigen test with AN samples had a favorable sensitivity in symptomatic patients. However, the sensitivity in asymptomatic individuals was not ideal. Nevertheless, the rapid antigen test with AN samples may be a useful screening tool because of its low invasiveness, high specificity, and the ability to identify individuals with high viral loads. Categorical variables are provided with percentages in parentheses.

RT-PCR tests were performed using the method developed by the National Institute of Infectious Diseases, Japan.

J o u r n a l P r e -p r o o f RT-PCR, reverse-transcription polymerase chain reaction J o u r n a l P r e -p r o o f J o u r n a l P r e -p r o o f 

World Health Organization. Coronavirus Disease (COVID-19) Situation Reports

Progress of the COVID-19 vaccine effort: viruses, vaccines and variants versus efficacy, effectiveness and escape

An evidence review of face masks against COVID-19

Guidance for Healthcare Workers about COVID-19 (SARS-CoV-2) Testing

World Health Organization. Recommendations for national SARS-CoV-2 testing strategies and diagnostic capacities

Centers for Disease Control and Prevention. Interim Guidance for Antigen Testing for SARS

Same-day SARS-CoV-2 antigen test screening in an indoor mass-gathering live music event: a randomised controlled trial

The impact of population-wide rapid antigen testing on SARS-CoV-2 prevalence in Slovakia

Diagnostic performance and characteristics of anterior nasal collection for the SARS-CoV-2 antigen test: a prospective study

Rapid, pointof-care antigen and molecular-based tests for diagnosis of SARS-CoV-2 infection

Antigen-detection in the diagnosis of SARS-CoV-2 infection using rapid immunoassays

The evaluation of a newly developed antigen test (QuickNavi TM -COVID19 Ag) for SARS-CoV-2: A prospective observational study in Japan

Development of Genetic Diagnostic Methods for Detection for Novel Coronavirus 2019(nCoV-2019) in Japan

Head-to-head comparison of SARS-CoV-2 antigen-detecting rapid test with self-collected nasal swab versus professional-collected nasopharyngeal swab

Relative sensitivity of anterior nares and nasopharyngeal swabs for initial detection of SARS-CoV-2 in ambulatory patients: Rapid review and meta-analysis

Duration of Culturable SARS-CoV-2 in Hospitalized Patients with Covid-19

Predicting Infectious Severe Acute Respiratory Syndrome Coronavirus 2 From Diagnostic Samples

Repeated Coronavirus Disease 2019 Molecular Testing: Correlation of Severe Acute Respiratory Syndrome Coronavirus 2 Culture With Molecular Assays and Cycle Thresholds

Test sensitivity is secondary to frequency and turnaround time for COVID-19 screening

Rethinking Covid-19 Test Sensitivity -A Strategy for Containment

COVID-19: Rapid antigen detection for SARS-CoV-2 by lateral flow assay: A national systematic evaluation of sensitivity and specificity for mass-testing