key: cord-0920250-zjtyh9rh
authors: Mandal, Dipendra Kumar; Bhattarai, Bibek Raj; Pokhrel, Sushant; Chhusyabaga, Mandira; Bhandari, Parmananda; Bhatt, Mahendra Prasad; Marhattha, Sujan Babu
title: Diagnostic Performance of SARS-CoV-2 Rapid Antigen Test in relation to RT-PCR C(q) Value
date: 2022-05-10
journal: Adv Virol
DOI: 10.1155/2022/9245248
sha: 0df3e972b251e0908fe863fec075ad66781c84f0
doc_id: 920250
cord_uid: zjtyh9rh

BACKGROUND: Early detection of the SARS-CoV-2 is crucial for both the improvement of turnaround time and limiting the spread of the virus in the community. Thus, this study aims to establish rapid antigen tests as an effective diagnostic tool to improve the testing strategies of COVID-19 diagnosis. METHODS: A laboratory based cross-sectional study was performed on the patients that visited Sukraraj Tropical and Infectious Disease Hospital (STIDH) in Kathmandu, Nepal, from November 2020 to January 2021. A total of 213 nasopharyngeal swabs were collected from both symptomatic and asymptomatic patients for rapid antigen test, followed by RT-PCR assay as reference test for confirmation of COVID-19. A standard questionnaire was administered to collect other information from patients. Data were collected and analyzed using SPSS version 20. RESULTS: Out of 213 individuals, 75 tested positive in Ag-RDT test, while 118 tested positive for SARS-CoV-2 RNA genome via Real time PCR assay. The overall diagnostic performance of Ag-RDT showed 63.6% sensitivity and 97.9% specificity. The diagnostic accuracy of Ag- RDT was 78.9% with κ value 0.590, showing moderate agreement with RT-PCR. Significant difference (p value <0.001) was observed between Ag- RDT(+) and Ag- RDT(−) results when compared to C(q) values obtained from RT- PCR. CONCLUSION: The promising performance of Ag-RDT renders it useful as screening tool alongside RT-PCR to reduce transmission via improving contact tracing, implementation of local mitigation strategies, and refining existing testing protocol for diagnosis of COVID-19.

SARS-CoV-2, a member of the family Coronaviridae, is a large, spherical, enveloped virus with positive sense singlestranded RNA genome ranging 25-32 kb. [1] .

e virus contains about four structural proteins namely spike glycoprotein (S-protein), membrane protein (M-protein), envelope protein (E-protein), and nucleocapsid protein (N-protein). Polyprotein 1a and polyprotein 1ab encoded by ORF1a and ORF1ab comprise nonstructural proteins or NSPs, that is, NSP1-NSP11 and NSP12-NSP16, respectively [2] .

Ever since its discovery in Wuhan, China, in December 2019, it has been causing pandemic till today [3] . e virus originally known as 2019-nCoV, was renamed by International Committee of Taxonomy of Viruses (ICTV) to SARS-CoV-2 [4] . WHO declared a global pandemic on March 11, 2020, due to rapid transmission rate and the infection severity of SARS-CoV-2 [5] . SARS-CoV-2 has an incubation period of 5.2 days, with transmission occurring 1-3 days before symptoms appear [6] . Progression of COVID-19 in advanced and severe cases may lead to severe pneumonia, multiple organ dysfunction, and even death in people with comorbidities [7] . First case presentation of COVID-19 in Nepal was officially reported in a male of age 32 on January 24, 2020 [8] . e newly discovered virus has created problems for its diagnosis, prognosis as well as treatment of this disease.

Various tests for COVID-19 diagnosis include Nucleic Acid Amplification Testing (NAAT) such as RT-PCR, Computed Tomography scan (CT-scan), Protein testing via ELISA, Point of Care Tests (POCT) such as lateral flow assays, use of biosensors, etc. [9] . Currently, the recommended gold standard assay for COVID-19 diagnosis is RT-PCR which involves conversion of SARS-CoV-2 RNA into complementary DNA (cDNA) using reverse transcription followed by specific region amplification of cDNA [10, 11] . C q values obtained from RT-PCR can be an indirect, semiquantitative measurement of viral load and can be considered to be of greater value in determining the infectiousness [12] . As per MIQE guidelines, the terms cut-off point (C p ), take-off point (TOP), and cycle threshold (C t ) all represent the same meaning and are standardized as Quantification cycle (C q ) [13] .

Viral extraction and RT-PCR processing requires aseptic sample collection technique, specialized laboratory setup and highly skilled health professional specialist to analyze and interpret the obtained result [14] . RT-PCR processing takes a long time for test completion which in turn increases the overall turnaround time causing problems in mass screening, contact tracing, and disease surveillance [15, 16] . Rapid pointof-care antigen test (Ag-POCT) is a qualitative test that is based on a principle of lateral flow assay in which SARS-CoV-2 antigen is detected in a patient's sample following color change in the kit. N-antigen is detected by most of the Ag-RDT due to its relative abundance and genomic conservation [17] . It has been approved by WHO in low-and middleincome countries with under-resourced laboratories and may be effective in detecting antigenic virus particles in a short time period, and aid in diagnosis of early infection [18, 19] .

Hence, this study attempts to demonstrate the effective use of rapid antigen test to decrease the turnaround time for effective COVID-19 diagnosis and its use as screening test to reduce transmission at the local level.

is laboratory-based cross-sectional study was performed in Sukraraj Tropical and Infectious Disease Hospital (STIDH), Kathmandu, Nepal, in collaboration with Manmohan Memorial Institute of Health Sciences (MMIHS), Kathmandu, Nepal during the period of 3 months (November 2020 to January 2021).

After obtaining written informed consent, both symptomatic and asymptomatic individuals were selected for the study. Patients of all age groups, referred by physicians of STIDH and contact tracing with symptoms, were regarded as symptomatic cases. Individuals suspected without any symptoms via contact tracing were referred as asymptomatic individuals.

Specimens collected from previously positive patients, during their follow-ups within the study period, were excluded from the study.

For SARS-CoV-2 detection, specimens such as nasopharyngeal swab/throat swab were collected in viral transport medium (VTM) (SANLI medical, China) using aseptic technique. ese swab samples were immersed in 2 ml VTM and sent to molecular lab, STIDH. Further processing was performed aseptically in class II A 2 biosafety cabinet.

Each individual specimen was initially screened for SARS-CoV-2 N-Ag using a rapid antigen test (Espline ® , Japan) based on the principle of lateral flow assay. Briefly, nasopharyngeal swab specimens were immersed into the sample extraction tube containing the extraction buffer. Applicator tip was inserted into the buffer and the tube was left to stand for 5 minutes. en, two drops of this sample solution was applied on the sample zone of the kit. Immediately, the button was pressed in order to start the assay reaction and detect N Ag. Result was interpreted within 30 mins. Visually observed two blue lines of reference (R) and test (T) were interpreted as positive test result or presence of N Ag. For negative COVID-19 antigen result, only the reference (R) line can be visually seen without a blue line in test (T). If no line was observed in both Reference and Test, the test was considered as invalid.

RT-PCR was used to detect SARS-CoV-2 RNA genome. First, nucleic acid from the sample was extracted as per manufacturer's guideline (Zybio Inc., China). en a template was added to the prepared mater-mix (Shenzhen Unimedica Technology, China). e primer set and FAM labeled probe was designed for SARS-CoV-2 ORF1ab gene detection, while VIC labeled probe for detection of SARS-CoV-2 N-gene. Human RNase P gene labeled with CY5 extracted simultaneously with test sample acted as an internal control to validate nucleic acid extraction procedure and reagent integrity. Result was reported as positive when C q ≤ 38 with S-shaped amplification curve was obtained and reported as negative when null C q or C q � 40 was observed. e detection limit was 200 copies/ml.

Data were analyzed using IBM SPSS version 20.0 (IBM Corp., Armonk, NY, USA). Shapiro-Wilk normality test was applied to obtained data for normality distribution. Mann-Whitney U test was used to compare RT-PCR C q values between Ag-positive and Ag-negative test results. Continuous variables were interpreted as median and interquartile range. Categorical variables were reported in numbers, percentages, and 95% confidence Intervals. Cohen's kappa coefficient (κ) was used to assess the agreement between RT-PCR and antigen tests. κ value interpretations were categorized as follows: ≤0 is no agreement, 0.01-0.20 is none to slight, 0.21-0.40 is fair, 0.41-0.60 is moderate, 0.61-0.80 is substantial, and 0.81-1.00 as almost perfect agreement [20] .

Among 213 study population, the median age was 35 years (IQR 27-46.5). Male and female subjects were 67.1% (n � 143/213) and 32.9% (n � 70/213), respectively. Among samples tested for possible SARS-CoV-2 infection by rapid Table 1 .

Among 118 RT-PCR positive cases, 31.3% (n � 37) were female and 68.7% (n � 81) were male with 55.4% period prevalence as presented in Table 2 . Figure 1 shows age distribution of RT-PCR positive cases by gender, demonstrating high SARS-CoV-2 infection among both male and female subjects of age range 20-29 years followed by the age group ranging 30-39 years.

RT-PCR consists of dual target genes. Figure 2 illustrates box plot graphs for C q value distribution of RT-PCR target genes. Middle horizontal line inside the box denotes the median. e median C q value for ORF1ab gene and N gene were 24 Out of 118 RT-PCR positive subjects, the rapid antigen test correctly classified 75 individuals as having the disease. A total of 93 cases were reported by both antigen test and RT-PCR as negative were considered true negatives. Discordant results were obtained between RT-PCR and antigen test, that is, 2 false positives and 43 false negatives (Table 3) . A total of 60.4% (26/43) patients with false negative results had a Cq value of >30. C q values of individual genes were stratified into four groups, that is, <20, 20-< 25, 25-< 30, and 30-< 37. e antigen test results were compared to that of RT-PCR positive results accordingly. Sensitivity in clinical samples with C q < 20 ranged 85.7-88.9%, between 82.1 and 87.2% in C q 20-< 25 and 58.3-71.0% in C q 25-< 30, respectively. Poor performance was observed in C q value > 30, that is, 30-37 with sensitivity as low as 20.0-20.6% (Table 5) . Figure 3 demonstrates the test result of rapid antigen test in relation to RT-PCR C q C q value in Ag-RDT + was 22.69, while in Ag-RDT − case the C q value was much higher at 31.70. e overall differences between the two groups, that is, RT-PCR + /Ag-RDT + and RT-PCR + /Ag-RDT − were significant with p value < 0.001.

RT-PCR C q values of each target gene were studied independently to further demonstrate the performance of antigen test results. For the ORF1ab gene, the cases con- Figure 4 demonstrates the box plot graph of ORF1ab gene and N gene C q value in positive and negative rapid antigen test results. e differences between the two group, that is, RT-PCR + /Ag-RDT + and RT-PCR + /Ag-RDT − were significant for individual genes with p value < 0.001.

Nucleic acid amplification test (NAAT) is used as the gold standard test for diagnosis of COVID-19. RT-PCR is a widely used molecular technique for detection of SARS-CoV-2 viral genome. Despite the increased ability of RT-PCR to accurately diagnose infected individuals, its delay in turnaround time during pandemic caused stress in mass population screening and disease surveillance. Adoption of biosensor to detect COVID-19 has also been widely popular in this scenario. Jing Wang along with his researchers contributed to the development of an optical based sensor to detect SARS-CoV-2 RNA from patients [21] . Antigen test, based on lateral flow assay is another important tool to diagnose the active infection which gives results within minutes, and is easy to interpret. e study conducted in China illustrated higher SARS-CoV-2 infection in males, 63.8% rather than in females, 36.2% which is in correspondence with our study analysis which demonstrated 68.7% and 31.3% male and female infection Advances in Virology rate, respectively [7] . Our study also demonstrated the more infected age group, 20-29 years followed by age group 30-39 years, corresponding with the results obtained from the study conducted by Sharma et al. illustrating males of age group 21-30 years to be more infected [22] . In contrast, one study reported a higher incidence rate among females [23] , whereas Advances in Virology some studies suggest higher infection in the age group 30-39 years followed by 20-29 years of age [24] . e reported sensitivity and specificity of Ag-RDT by the product manufacturer were 80% and 100%, respectively. In our study, the overall sensitivity and specificity of rapid antigen test were found to be lower than the manufacturer, that is, 63.6% (75/118) and 97.9% (93/95), respectively, but showed almost similar results of specificity as recommended by WHO, that is, ≥97%, but less sensitivity, that is, ≤80% [25] . In contrast, Aoki et al. observed lower diagnostic performance of rapid antigen test (sensitivity, 39.7% and specificity, 97.0%) than our findings. e performance of rapid antigen test depends upon site of sample collection, sample handling, viral load, and C q value along with antigen extraction process and antigen kit used [3, 26, 27] .

In our study, discrepancy results were obtained between antigen test and RT-PCR with 2 false positives and 43 false negatives. Although still unclear about the cause of result discrepancy, 60.4% (26/43) of false negative cases in our study had C q ≥ 30 which corresponds to low viral load explaining the false negative results obtained [28] . As per Robert Koch Institute, the individuals with C q > 30 can be considered noncontagious [29] . Since, the detection by Ag-RDT does not need the gene amplification step, unlike PCR which requires amplification of nucleic acid in order to detect the presence of viral RNA genome [30] , this may be the reason for major discrepancy between test results of RT-PCR and rapid antigen tests [31] . e diagnostic accuracy from the findings of our data was found to be 78.9% with a Cohen's weighted kappa value 0.590 displaying moderate agreement between Ag-RDT and RT-PCR, which is similar to the findings obtained by Kohmer et al. during his study [32] . In contrast, a study observed that kappa value 0.859 showed almost a strong agreement between the tests [33] . e reason for this difference is due to the fact that kappa value is highly influenced by data distribution and presence of bias between observers [34, 35] .

C q value of lower range had higher chance of positive rapid antigen test result that was reported by Routsias et al. [36] . From our analysis, the overall C q value median was higher in negative rapid antigen test (31.70) in comparison to C q values in positive antigen test (22.69) which suggests that the probability of Ag-RDT to give true positive cases increase when C q value is < 25, while probability of getting negative result increases when C q value is > 30. Higher C q value in negative rapid antigen test was also observed by Young et al. [37] . Our study data also indicated that the significant true positive rate decreased with subsequent increase in C q value. Comparable findings were obtained in a study conducted in Japan by Takeda et al. [38] . Another study conducted by Kahn et al. also ended up with the same conclusion due to the fact that high C q value is indicative of lower viral load [39] , subsequently lowering the performance of rapid antigen test [40] .

Statistically significant results were obtained between positive and negative rapid antigen test when compared with C q values of individual target genes obtained from RT-PCR. A study conducted by Tregiarri et al. too demonstrated the statistically significant result (p < 0.001) when Ag-RDT data were compared to that of C q values obtained [41] .

Our study also had weaknesses and limitations of its own which would have been proven beneficial for the study. Since the clinical data were not obtained regarding the patient's previous health status or prior infection with other pathogens, cross reactivity could not be excluded. Quantitative estimation of RNA genome and virus culture could not be performed due to shortage of proper resources, although it could have been useful in precisely analyzing the diagnostic performance of rapid antigen test.

e diagnostic performance of the rapid antigen test is in relation to RT-PCR C q value: sensitivity of Ag-RDT is indirectly proportional to C q value. Ag-RDT performance when compared to RT-PCR has decreased sensitivity but comparable specificity. Despite low diagnostic sensitivity, rapid results within minutes, inexpensiveness, and ease of result interpretation makes Ag-RDT valuable in reducing transmission by facilitating rapid isolation, contact tracing in community. e Ag-RDT performance seems to be promising and can be used as a rapid screening tool in patients with high viral load alongside RT-PCR to further improve the testing strategies for diagnosis of COVID-19.

Rapid antigen detection test COVID-19: Coronavirus disease 2019 Cq:

Quantification cycle FN:

False negative FP:

False positive MIQE:

Minimum information for publication of quantitative real-time pcr experiments N gene:

Nucleocapsid gene N-Ag:

Nucleocapsid antigen nCoV:

Novel coronavirus NPV:

Negative predictive value ORF1ab:

Open reading frame 1a/b PPV:

Positive predictive value RT-PCR:

Real-time polymerase chain reaction SARS-CoV-2:

Severe acute respiratory syndrome coronavirus 2 TN:

True negative TP:

True positive WHO: World Health Organization κ value:

Kappa coefficient value.

All the data generated during this study are presented. e primary raw data will be made available to interested researchers upon request to the corresponding author. 

Written informed consent was taken from the patients before participating in the study. Data regarding personal information were coded and kept confidential. 6 Advances in Virology

Family coronaviridae

Role of structural and non-structural proteins and therapeutic targets of SARS-COV-2 for covid-19

Rapid SARS-COV-2 antigen detection assay in comparison with real-time rt-pcr assay for laboratory diagnosis of Covid-19 in ailand

Severe acute respiratory syndrome-related coronavirus: the species and its viruses-a statement of the coronavirus study group

Early epidemiological features of Covid-19 in Nepal and public health response

Temporal dynamics in viral shedding and transmissibility of Covid-19

Men and covid-19: a biopsychosocial approach to understanding sex differences in mortality and recommendations for practice and policy interventions

Understanding Covid-19 in Nepal

Diagnosing Covid-19: the disease and tools for detection

Systematic review with meta-analysis of the accuracy of diagnostic tests for Covid-19

Quantitative RT-PCR: pitfalls and potential

Duration of infectiousness and correlation with RT-PCR cycle threshold values in cases of covid-19, england

e MIQE guidelines: minimum information for publication of quantitative real-time PCR Experiments

Low performance of rapid antigen detection test as frontline testing for COVID-19 diagnosis

Field evaluation of the performance of a SARS-COV-2 antigen rapid diagnostic test in uganda using nasopharyngeal samples

Insight into the practical performance of RT-PCR testing for SARS-COV-2 using serological data: a cohort study

Characterization of SARS-COV-2 nucleocapsid protein reveals multiple functional consequences of the C-terminal domain

Rapid point-of-care antigen and molecular-based tests for diagnosis of SARS-COV-2 infection

Covid-19: 120 million rapid tests pledged to low and middle income countries

Interrater reliability: the kappa statistic

Biosensors in diagnosing covid-19 and recent development

Assessment of COVID-19 pandemic in Nepal: a lockdown scenario analysis

Incidence, clinical features, and outcomes of COVID-19 in Canada: impact of sex and age

COVID-19 case fatality risk by age and gender in a high testing setting in Latin America: chile

Antigen-Detection in the Diagnosis of SARS-COV-2 Infection Using Rapid Immunoassays: Interim Guidance

Evaluation of clinical utility of novel coronavirus antigen detection reagent, espline ® SARS-COV-2

Evaluation of rapid antigen test for detection of SARS-COV-2 virus

False negative rate of Covid-19 PCR testing: a discordant testing analysis

Comparative evaluation of four SARS-COV-2 antigen tests in hospitalized patients

Covid-19 diagnosis -a Review of current methods

Covid-19: how the UK is using lateral flow tests in the pandemic

e comparative clinical performance of four SARS-COV-2 rapid antigen tests and their correlation to infectivity in vitro

Comparison of sars-cov-2 nasal antigen test to nasopharyngeal rt-pcr in mildly symptomatic patients

e kappa statistic in reliability studies: use, interpretation, and sample size requirements

Bias, prevalence and kappa

Diagnostic performance of rapid antigen tests (rats) for SARS-COV-2 and their efficacy in monitoring the infectiousness of Covid-19 patients

Clinical evaluation of bd veritor SARS-COV-2 point-of-care test performance compared to PCR-based testing and versus the sofia 2 SARS antigen point-of-care test

Sars-Cov-2 QRT-PCR CT value distribution in Japan and possible utility of rapid antigen testing kit

Performance of antigen testing for diagnosis of Covid-19: a direct comparison of a lateral flow device to nucleic acid amplification based tests

Performance of SARS-COV-2 rapid antigen test compared with real-time RT-PCR in asymptomatic individuals

Sars-Cov-2 rapid antigen test in comparison to RT-PCR targeting different genes: a real-life evaluation among unselected patients in a regional hospital of Italy

Acknowledgments e authors thank all the patients participating in this study. Special thanks go to all the laboratory staff, management, and officials of Sukraraj Tropical and Infectious Disease Hospital, Teku, Kathmandu, for providing the opportunity to carry out this research work. e authors would also like to thank MMIHS family for providing needed support during the study period as well as for ethical approval of the study.

e authors declare that they have no conflicts of interest.

DM, BRB, and MPB conceived the design of the study, reviewed the literature, and performed the necessary interventions including laboratory investigations. BRB, MC, and PB participated in data collection and laboratory procedures. BRB, SP, and SBM analyzed data. DM, MPB, and SBM supervision and project administration. BRB and SP prepared manuscript. All authors contributed to drafting and critically revising the study and agree to be accountable for all aspects of the work. Dipendra Kumar Mandal and Bibek Raj Bhattarai equally contributed to this study.