key: cord-0986583-7hc2vo6d
authors: Chan, Clarence W; Parker, Kyle; Tesic, Vera; Baldwin, Angel; Tang, Nga Yeung; van Wijk, Xander M R; Yeo, Kiang-Teck J
title: Analytical and Clinical Evaluation of the Automated Elecsys Anti–SARS-CoV-2 Antibody Assay on the Roche cobas e602 Analyzer
date: 2020-08-20
journal: Am J Clin Pathol
DOI: 10.1093/ajcp/aqaa155
sha: d9631d164416c40d277937b3e272813be2dd7198
doc_id: 986583
cord_uid: 7hc2vo6d

OBJECTIVES: To evaluate the analytical and clinical performance of the automated Elecsys anti–severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) antibody (Elecsys Ab) assay on the Roche cobas e602 analyzer. With the ongoing global coronavirus disease 2019 (COVID-19) pandemic, widespread and routine serologic testing of SARS-CoV-2 remains a pressing need. To better understand its epidemiologic spread and to support policies aimed at curtailing further infections, reliable serologic testing is crucial for providing insight into the dynamics of the spread of COVID-19 on a population level. METHODS: The presence of anti–SARS-CoV-2 antibodies in polymerase chain reaction–positive, confirmed COVID-19 patient samples was determined using the Elecsys Ab assay on the Roche cobas e602 analyzer. The precision and cross-reactivity of the Elecsys Ab assay were characterized and its performance was compared against the EuroImmun IgA/IgG antibody (EuroImmun Ab) assay. Calculated sensitivity, specificity, and positive and negative predictive values were assessed. RESULTS: The Elecsys Ab assay demonstrated good precision, had no cross-reactivity with other viral samples, and showed 100% concordance with the EuroImmun Ab assay. Excellent clinical performance with respect to sensitivity, specificity, and positive and negative predictive values was observed. CONCLUSIONS: The Elecsys Ab assay is a precise and highly reliable automated platform for clinical detection of seropositivity in SARS-CoV-2 infection.

conducting widespread testing. As such, there have been significant recent efforts to develop serologic assays for clinical detection of SARS-CoV-2 using patient serum samples. [14] [15] [16] In addition, serologic testing provides imperative epidemiologic data for surveilling populational seroprevalence and a means to assess antiviral activity and clinical efficacy of neutralization by convalescent plasma.

Compared with direct detection methods, serologic assays provide a means and an added advantage to assess the exposure history of an individual, as well as entire populations, to help guide public health policies. 17 Seroconversion for immunoglobulin M (IgM), immunoglobulin G (IgG), and total antibodies against SARS-CoV-2 has been observed to occur several weeks after infection and peaking after 2 to 3 weeks, 3 to 6 weeks, and 2 to 3 weeks, respectively. [18] [19] [20] [21] However, given that there is significant observed variability in both IgM and IgG levels, most serologic assays are designed to detect both IgM and IgG simultaneously. 22 The formation of neutralizing antibodies remains an active area of research. [23] [24] [25] [26] In this study, the qualitative Elecsys Ab assay (Roche Diagnostics) was evaluated analytically and clinically as a practical modality for widespread and routine serologic testing. The immunoassay is an automated assay based on recombinant nucleocapsid protein technology for the detection of SARS-CoV-2 seropositivity. Here we report that the Elecsys Ab assay performs reliably and consistently with both RT-qPCR and the EuroImmun immunoglobulin A (IgA)/IgG antibody (EuroImmun Ab) assay (PerkinElmer) with high precision. Moreover, 95% sensitivity, 100% specificity, and greater than 99% positive and negative predictive values were achieved in our study population and samples.

Leftover heparinized plasma and serum samples from admitted PCR-positive, confirmed COVID-19 patients who had routine metabolic profiles and serologies ordered for clinical care were retrieved from the Clinical Chemistry and Immunology Laboratories for this evaluation. For longer-term storage, samples were frozen at -25°C until ready for use. Samples were collected under a quality assurance protocol that qualifies for institutional review board waiver, as no patient identifiers were used.

The Elecsys Ab is an automated sandwich, doubleantigen electrochemiluminescent immunoassay that employs recombinant protein representing the nucleocapsid antigen of the virus. This Ab assay has recently received emergency use authorization from the US Food and Drug Administration (FDA EUA) for the detection of total antibodies (IgG, IgM, and IgA) in COVID-19infected patients. 27 At our institution, this immunoassay is installed on the Roche cobas e602 module component of the cobas 8000 total automation system. This assay employs a cutoff index (COI) that is mathematically derived from the calibration using two standards-a COI of 1.0 or more is considered reactive (REACT)/positive, while a COI less than 1.0 is reported as nonreactive (NONREACT)/negative. The EuroImmun Ab assay is an enzyme-linked immunosorbent assay (ELISA) that is also authorized by the FDA (via EUA) for the detection of IgA and IgG Ab developed against the SARS-CoV-2 virus and has been previously described. 28

A positive antibody pool, approximately 20 mL, was prepared by combining leftover antibody-positive plasma samples with a COI value of approximately 2.0 to 3.0. Similarly, a negative antibody pool, approximately 20 mL, was prepared by diluting a positive antibody pool with Elecsys universal diluent to yield a COI of approximately 0.4 to 0.5. Aliquots of 0.25 mL were prepared from each pool and frozen at -25°C for longer-term storage. A within-run precision study was performed by assaying each pool 20 times. Between-day precision study was performed by thawing out each respective aliquot to room temperature and running over 38 days. The mean and SD were calculated for each pool, and coefficient of variation (CV) was determined as CV (%) = (SD × 100)/mean.

A total of 66 RT-qPCR-confirmed, archived serum samples from the validation studies for the EuroImmun Ab assay 28 were used for the method comparison study with the Elecsys Ab assay. Analysis of concordance was performed using the Microsoft Excel software.

In total, 25 samples from patients with PCRpositive non-SARS-CoV-2 respiratory infections (via the BioFire FilmArray Respiratory Panel 2), 20 human immunodeficiency virus (HIV)-positive samples, 15 hepatitis B surface antigen (HepBS) Ab-positive samples, and 17 hepatitis C virus (HCV) Ab-positive samples were analyzed on the Elecsys Ab assay to assess the extent of cross-reactivity.

A total of 78 PCR-confirmed (Roche SARS-CoV-2 qualitative PCR assay) positive samples from COVID-19 patients that were collected either 0 to 13 days (40 samples) or 14 or more days (38 samples) after initial PCR positivity and 53 prepandemic samples (41 from a reference range study prior to 2018 and 12 from a banked respiratory viral panel from early 2019) were retrieved for assessment of clinical performance studies. Calculations of sensitivity, specificity, and positive and negative predictive values were performed using the SciStat software (https://www.scistat.com/statisticaltests/diagnostic_test. php), assuming a 5% prevalence. 29

Readouts of the automated Elecsys Ab assay performed on the Roche cobas e602 analyzer are resulted as either positive or negative based on a COI of 1.0 or more or less than 1.0, respectively, thereby rendering the assay a binary, qualitative analysis. To evaluate the within-run precision of the Elecsys Ab assay, both a positive and a negative control sample were run consecutively (n = 20 replicates), yielding mean COI values of 2.47 (CV of 0.8%) and 0.49 (CV of 1.5%), respectively. The betweenday precision analysis was repeated over 38 subsequent days (n = 60 replicates), showing a mean COI of 3.97 (CV of 2.9%) for the positive pool and a mean COI of 0.36 (CV of 2.4%) for the negative pool, respectively ❚Table 1❚.

The performance of the Elecsys Ab assay was compared with that of the Euroimmun Ab assay, a well-established and broadly used test for direct detection of antibodies against SARS-CoV-2, 28 for 66 patient samples ❚Figure 1❚. All 40 samples that were reactive by the Euroimmun Ab (36 were positive for both IgA and IgG, whereas 4 were positive for only IgG) assay yielded COI values of 1.0 or more using the Elecsys Ab assay. Similarly, all 26 samples that were nonreactive by the Euroimmun Ab assay yielded COI values less than 1.0. Of note, there was significantly greater variation in the measured COI values (range, 1.59-155) for the positive Elecsys Ab assay samples than what was observed for the negative samples (COI range, 0.09-0.20). The overall concordance rate between the two assays was 100%.

The specificity of the Elecsys Ab assay for SARS-CoV-2 was examined by testing for cross-reactivity against samples from patients who tested positive for non-SARS-CoV-2 respiratory and other viruses such as HIV, HBV, and HCV. A total of 25 non-SARS-CoV-2 respiratory viral samples, including several common strains of other coronaviruses (HKU1, OC43, NL63, and 229E), were tested using the Elecsys Ab assay, which consistently yielded a COI of less than 1.0 and thus zero cross-reactivity ❚Table 2❚. Similarly, testing of 20 HIV serology-positive, 15 HepBS Ab-positive, and 17 HCV Ab-positive samples on the Elecsys Ab assay also demonstrated zero cross-reactivity, although several samples did yield relatively higher COI values while less than 1.0 ❚Figure 2❚. Therefore, the Elecsys Ab assay demonstrates high specificity for qualitative detection of anti-SARS-CoV-2 antibodies.

As shown in ❚Table 3❚ and ❚Table 4❚, the overall clinical performance of the Elecsys Ab assay was excellent and is consistent with recently reported data 30, 31 and manufacturer specifications. 27, 29 Based on our study data, we determined that the Elecsys Ab assay showed a sensitivity of 77.50% (95% confidence interval [CI], 61.55%-89.16%) for samples collected 0 to 13 days after PCR positivity and a sensitivity of 94.74% (95% CI, 82.25%-99.36%) for samples collected 14 or more days after PCR positivity. The specificity of the assay was 100% (95% CI, 93.28%-100%), based on 53 prepandemic samples. Assuming a 5.0% disease prevalence (consistent with the prevalence the FDA assumes in its review of serology test performance for EUA), the calculated positive predictive value (PPV) is 100% and the negative predictive value (NPV) is 98.83% (95% CI, 97.94%-99.34%) with an overall accuracy of 98.88% (95% CI, 94.07%-99.97%) for samples collected 0 to 13 days and 99.72% (95% CI, 98.94%-99.93%) with an overall accuracy of 99.74% (95% CI, 95.51%-100%) for samples collected 14 or more days after PCR positivity, respectively (Tables 3 and 4 ). For comparison, ❚Table 5❚ shows the calculated PPV, NPV, and accuracy at 3%, 5%, and 10% prevalence, respectively. Overall, the test showed high clinical performance at these various assumed prevalence percentages.

Reliable and robust diagnostic platforms remain a pressing need in the ongoing COVID-19 pandemic caused by SARS-CoV-2. 32 our understanding and tracking of both the natural immune response against SARS-CoV-2 and the epidemiologic spread of the virus on populational levels. As with all clinical assays, thorough validation of any novel diagnostic test by the clinical laboratory is critical prior to widespread or routine implementation of the test. In late February 2020, after the onset of the ongoing COVID-19 pandemic, the FDA permitted immunoassay manufacturers to offer SARS-CoV-2 Ab kits prior to receiving EUA to mitigate the testing capability deficits in the United States at the time. 33 However, this decision by the FDA ultimately led to the availability and utilization of several substandard Ab kits for COVID-19 surveillance, resulting in a higher incidence of false-positive Ab results and therefore a sense of unreliability. The FDA has since revised its policy 34, 35 to require manufacturers to seek EUA prior to marketing and distributing serologic tests and, as part of its efforts to tighten the quality of available Ab kits, stipulated that these serologic test characteristics ought to be sufficiently high and made publicly available. To date, 33 serologic tests (vs 19 in mid-June 2020), including the Elecsys Ab assay, have received EUA. 29 Current RT-qPCR tests for active infection employ direct detection of viral genetic material, whereas serologic testing reveals a subject's immune response toward the presence of an antigen. As such, serologic testing is not the preferred method for diagnosing COVID-19, and their routine use must also account for immunosuppressive states and antibody-level variations related to disease course and severity. 36 On the other hand, serologic tests remain an invaluable diagnostic modality in that they provide still much-needed insight into the adaptive immune response against SARS-CoV-2, the exposure history of an individual, transmission patterns, and potential donors of convalescent plasma. Furthermore, as we combat the ongoing COVID-19 pandemic, the true prevalence of Ab positivity against SARS-CoV-2 remains unknown in the US population.

In this study, we analytically and clinically evaluated the qualitative, automated Elecsys Ab assay and report that it performs reliably, precisely, and consistently with both RT-qPCR and the EuroImmun Ab assay, with calculated 95% sensitivity, 100% specificity, and positive and negative predictive values approaching 100% for samples obtained 14 or more days after PCR positivity, consistent with manufacturer specifications. 27 early after infection or compromised immunity (eg, in patients on immunosuppressive regimen or newborns with an immature immune system).

Our studies demonstrate that the Elecsys Ab assay is a robust serologic diagnostic platform and is consistent with initial estimates of its performance measures. 29 Importantly, our work provides independent external validation data in a major teaching hospital laboratory setting in the United States and therefore expands on recent studies addressing the clinical performance of the Elecsys Ab assay. 30, 31 Furthermore, whereas these other studies 30, 31 focused primarily on the relationship between the number of days after symptom onset vs the sensitivity of the Elecsys Ab assay, we provide additional data that specifically address the precision and cross-reactivity of the immunoassay when performed on the Roche cobas e602 analyzer.

Corresponding author: Kiang-Teck J. Yeo, PhD; jyeo@bsd. uchicago.edu.

Clinical features of patients infected with 2019 novel coronavirus in Wuhan

China Novel Coronavirus Investigating and Research Team. A novel coronavirus from patients with pneumonia in China

Genomic characterization of the 2019 novel human-pathogenic coronavirus isolated from a patient with atypical pneumonia after visiting Wuhan

Epidemiological and clinical characteristics of 99 cases of 2019 novel coronavirus pneumonia in Wuhan, China: a descriptive study

Geographical tracking and mapping of coronavirus disease COVID-19/severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) epidemic and associated events around the world: how 21st century GIS technologies are supporting the global fight against outbreaks and epidemics

Impact assessment of nonpharmaceutical interventions against coronavirus disease 2019 and influenza in Hong Kong: an observational study

Individual quarantine versus active monitoring of contacts for the mitigation of COVID-19: a modelling study

Washington State 2019-nCoV Case Investigation Team. First case of 2019 novel coronavirus in the United States

Diagnosing COVID-19: the disease and tools for detection

Overcoming the bottleneck to widespread testing: a rapid review of nucleic acid testing approaches for COVID-19 detection

Detection of 2019 novel coronavirus (2019-nCoV) by real-time RT-PCR

Persistence and clearance of viral RNA in 2019 novel coronavirus disease rehabilitation patients

SARS-CoV-2-positive sputum and feces after conversion of pharyngeal samples in patients with COVID-19

Diagnostic value and dynamic variance of serum antibody in coronavirus disease 2019

Antibody detection and dynamic characteristics in patients with COVID-19

A serological assay to detect SARS-CoV-2 seroconversion in humans

Evaluation of a COVID-19 IgM and IgG rapid test; an efficient tool for assessment of past exposure to SARS-CoV-2

Antibody responses to SARS-CoV-2 in patients of novel coronavirus disease

Antibody responses to SARS-CoV-2 in patients with COVID-19

Serology characteristics of SARS-CoV-2 infection since exposure and post symptom onset

Virological assessment of hospitalized patients with COVID-2019

Temporal profiles of viral load in posterior oropharyngeal saliva samples and serum antibody responses during infection by SARS-CoV-2: an observational cohort study

Potent neutralizing antibodies against SARS-CoV-2 identified by high-throughput single-cell sequencing of convalescent patients' B cells

Neutralizing antibodies against SARS-CoV-2 and other human coronaviruses

A human monoclonal antibody blocking SARS-CoV-2 infection

Effectiveness of convalescent plasma therapy in severe COVID-19 patients

Elecsys® Anti-SARS-CoV-2 Method Sheet

Evaluation of the EUROIMMUN anti-SARS-CoV-2 ELISA assay for detection of IgA and IgG antibodies

emergency-situations-medical-devices/eua-authorizedserology-test-performance

Clinical performance of the Elecsys electrochemiluminescent immunoassay for the detection of SARS-CoV-2 total antibodies

Clinical performance of the Roche SARS-CoV-2 serologic assay

US Food and Drug Administration. Coronavirus (COVID-19) update: FDA issues new policy to help expedite availability of diagnostics

Coronavirus (COVID-19) update: FDA provides more regulatory relief during outbreak, continues to help expedite availability of diagnostics

Policy for coronavirus disease-2019 tests during the public health emergency (revised)

Kinetics of SARS-CoV-2 specific IgM and IgG responses in COVID-19 patients