key: cord-0731212-pudfjgvx authors: Stieber, Francis; Howard, Jenny; Rao, Sonia N.; Kawamura, L. Masae; Manissero, Davide; Love, Joanna; Yang, Mei; Uchiyama, Robin; Parsons, Sean; Miller, Chris; Douwes, Harmony; McDonald, Aaron; Fairburn, Luke; Boyle, Jeffrey title: First performance report of QIAreach™ Anti-SARS-CoV-2 Total Test, an innovative nanoparticle fluorescence digital detection platform date: 2020-10-30 journal: J Clin Virol DOI: 10.1016/j.jcv.2020.104681 sha: cd259689d07ff979a425dd644f797a1d02d58bb7 doc_id: 731212 cord_uid: pudfjgvx In 2019, severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) caused a global pandemic. Disease diagnosis, appropriate clinical management and infection control are all important factors in controlling the spread of SARS-CoV-2. The QIAreach™ Anti-SARS-CoV-2 Total Test (Anti-CoV2) is a rapid, qualitative serological test, using proprietary nanoparticle fluorescence technology to detect total antibody (IgA, IgM, and IgG) against SARS-CoV-2. Here we report the results of the US Food and Drug Administration (FDA) clinical agreement study. Thirty positive plasma or serum samples were taken from consenting individuals with polymerase chain reaction (PCR)-confirmed SARS-CoV-2 infection ≥14 days from symptom onset. Seventy-five samples from before the believed circulation of SARS-CoV-2 (November 1, 2019) were used to assess specificity. Positive percent agreement (PPA) and negative percent agreement (NPA) were calculated along with the corresponding exact two-sided 95 % confidence intervals (CI) using an FDA Emergency Use Authorized PCR test as the reference method. Anti-CoV2 was shown to have 100 % sensitivity (PPA; 95 % CI 88.4–100 %) and 100 % specificity (NPA; 95 % CI 95.2–100 %). Against 157 pre-pandemic samples, no cross-reactivity was observed with seasonal coronaviruses or other respiratory pathogens tested. Additionally, no interference was observed when samples were spiked with: conjugated bilirubin 0.4 mg/ml; unconjugated bilirubin 0.4 mg/ml; hemoglobin 5 mg/ml; prednisolone 0.12 mg/ml; triglycerides 15 mg/ml. In conclusion, Anti-CoV2 provides accurate qualitative detection of total antibodies against SARS-CoV-2. Severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) is a novel beta-coronavirus that has caused a global outbreak of respiratory disease, Coronavirus Disease 2019 (COVID- 19) , with significant morbidity, mortality, and excess healthcare costs [1, 2] . An important aspect of controlling and slowing the spread of this pandemic is the availability of reliable and accurate methods for testing both symptomatic and asymptomatic individuals [3] [4] [5] . Rapid detection of cases and contacts, along with appropriate clinical management and infection control efforts, are critical to public health and disease control [4, 5] . Despite researchers working around the clock, much is yet to be discovered regarding SARS-CoV-2 transmission dynamics, ability to confer antibody production and immunity, and even prevalence of the disease within our communities. In patients infected with SARS-CoV-2, rapid, successive seroconversion of specific immunoglobulin A (IgA), immunoglobulin M (IgM) and immunoglobulin (IgG) typically occur within 14 days post onset of symptoms (DPO), with IgA responses appearing earlier, larger and more sustained than IgM [6] [7] [8] [9] [10] [11] . Strength of antibody responses likely correlates with disease severity [12] [13] [14] [15] . In a study of 259 symptomatic North American patients infected with SARS-CoV-2, ELISA-based detection of IgG, IgA, or IgM antibody responses to the receptor binding domain of the SARS-CoV-2 spike protein were all accurate in identifying infected individuals 14-28 DPO, with 100 % specificity and a sensitivity of 97 %, 91 %, and 81 %, respectively [8] . In the same study, IgG responses persisted through 75 DPO [8] . Currently, antibody testing is not recommended as the sole basis for diagnosis of acute SARS-CoV-2 infection, and as such no antibody tests are authorized by the US Food and Drug Administration (FDA) for this purpose [16] . However, antibody tests may be used in conjunction with molecular tests as a diagnostic aid, particularly in patients with delayed presentation and where viral genomic load is below the limit of detection for PCR assays, and to facilitate contact tracing, surveillance and sero-epidemiologic studies [16] [17] [18] . They are important for detecting past infection, including those without symptoms, as well as identifying convalescent plasma donors, and for verifying successful vaccinations once one is developed [16] [17] [18] [19] . Lateral flow assays (LFAs) are portable, easy to use and provide a quick readout, making them ideal point-of-care (POC) serological tests [20] . However, current LFAs are run individually, sensitivity and specificity varies between assays, and there is subjectivity by individual readers when calling faint bands [20] . Worryingly, clinical performance and sensitivity issues for some COVID-19 LFAs have been noted, and a FDA "removed" test list has been created [21] . In a meta-analysis of 40 studies, pooled sensitivity for LFAs was substantially lower than ELISA platforms measuring IgG or IgM; 66.0 % (95 % confidence interval [CI] 49.3-79.3 %) and 84.3 % (95 % CI 75.6-90.9 %), respectively [22] . Additionally, detection of IgM is less specific than IgG for many LFAs, in line with previous evidence highlighting disproportionate false-positive results with IgM tests [23] [24] [25] . Despite potential performance concerns, the need for rapid COVID-19 testing has led the FDA to grant Emergency Use Authorization (EUA) to a number of COVID-19 serological tests [25] . The QIAreach™ Anti-SARS-CoV-2 Total Test (Anti-CoV2) is a digital lateral flow serological test using patented nanoparticle fluorescence technology that qualitatively detects total antibodies to SARS-CoV-2 in human serum and plasma. Anti-CoV2 combines the benefits of traditional LFAs with added objective digital, rather than subjective, visual readouts. Unlike current LFAs, its unique digital detection cartridge (eStick, Fig. 1 ) and 8-port eHub design allows for low to higher volume testing of up to 32 tests per hub per hour to support real-time bio-surveillance and contact tracing in both epidemic and endemic settings. The aim of this study was to validate Anti-CoV2 to ensure it meets the clinical performance, user needs, and supports the FDA EUA and other regulatory body submissions. For the sensitivity analysis, plasma or serum samples from consenting subjects with PCR-confirmed SARS-CoV-2 infection were retrospectively obtained. Samples were collected ≥14 days from symptom onset. For the specificity analysis, plasma or serum samples collected prior to the outbreak of the COVID-19 pandemic (prior to November 1, 2019) were used. Samples were excluded if sample volume was <150 μL, samples or containers were physically damaged, or if samples were improperly collected or stored per instructions for use. Sample sizes were based on FDA EUA recommendations [24] ; a total of 30 PCR-confirmed positive samples and 75 negative samples were tested in this study. The samples were blinded and randomized to the Anti-CoV2 operators prior to testing. Cross-reactivity was evaluated by testing SARS-CoV-2 seronegative specimens from subjects with antibodies to other coronaviruses, other viral and bacterial infections and autoantibodies that could potentially cause false positive results. For the cross-reactivity analysis, negative SARS-CoV-2 plasma or serum samples collected prior to the outbreak of the COVID-19 pandemic (prior to November 1, 2019) were used. All specimens were collected and processed based on standard procedures used by manufacturers and vendors; plasma specimens for this study were collected using either heparin or EDTA tubes, while serum specimens for this study were collected using serum tubes. Specimens were stored frozen (at or below − 20 • C) after collection, and shipped on dry ice then stored at ≤− 20 • C upon arrival. The effect of potentially interfering substances on Anti-CoV2 performance was evaluated by spiking endogenous and exogenous interfering substances into SARS-CoV-2 negative plasma and low titer SARS-CoV-2 antibody positive plasma at the highest Clinical and Laboratory Standards Institute recommended concentrations. Notably, hemoglobin levels above 5 mg/ml (significantly reddish brown colored samples) can potentially interfere with the Anti-CoV2 optical measurement system. Anti-CoV2 eStick firmware features built-in controls to determine unacceptably high levels of hemolysate and will return an invalid result in the form of an error code if interference is present. Casing (blue) contains LFA strip with optoelectronic technology and a microprocessor that converts a fluorescent signal into a qualitative readout for the detection of SARS-CoV-2 specific antibodies in patient test samples Anti-CoV2 was performed according to the manufacturer's instructions. Anti-CoV2 Diluent Buffer is first added to the Anti-CoV2 Processing Tube and reconstitutes a SARS-CoV-2 viral S1 proteinnanoparticle conjugate. Patient serum or plasma is then added to the Processing Tube and mixed with the resuspended conjugate. The sample is then transferred from the Processing Tube to a single-use eStick sample port. Antibody responses are measured via nanoparticle fluorescence. The eStick contains optoelectronic technology and a microprocessor that converts a fluorescent signal into a qualitative readout for the detection of SARS-CoV-2 specific antibodies in patient test samples (Fig. 2) . Upon test completion, positive or negative test results from the eStick firmware are reported on the OLED display from each connection port of the eHub. When using the manufacturer's software to backup or transfer test results, test data is automatically transferred to an attached computer using the eHub connection port. The comparator methods for sensitivity analysis were FDA EUAauthorized PCR tests for the diagnosis of SARS-CoV-2 infection. Serology results from each individual were compared with results from one of three tests: cobas® SARS-CoV-2 Test (Roche, Switzerland), Abbott RealTime SARS-CoV-2 on the m2000 RealTime system (Abbott, United States), or Xpert® Xpress SARS-CoV-2 (Cepheid, United States). The positive percent agreement (PPA; sensitivity) and negative percent agreement (NPA; specificity) were calculated along with the corresponding exact two-sided 95 % CI. Calculation of positive predictive value (PPV) was based on the assumption that the prevalence of SARS-CoV-2 infection was 5 % at the time of sample collection. Calculation of negative predictive value (NPV) was based on the assumption that the prevalence of SARS-CoV-2 infection is 5 %. Interference criteria was based on 90 % overall qualitative agreement of negative and positive samples to an expected result. All 30 specimens tested for sensitivity were from a cohort of SARS− CoV-2 RT-PCR positive patients who experienced symptoms consistent with COVID-19, with days between symptom onset and sample collection ranging from 14 to 58 days. All samples met the eligibility criteria. The breakdown of the sample collection is given in Table 1 . In 30 PCR-confirmed SARS-CoV-2 samples taken ≥14 DPO, antibodies to SARS-CoV-2 were detected in all samples using Anti-CoV2 resulting in 100 % sensitivity (PPA; 95 % CI 88.4-100 %) ( Table 2 ). In 75 SARS-CoV-2 negative samples taken prior to the COVID-19 pandemic, no antibodies to SARS-CoV-2 were detected in all samples using Anti-CoV2 resulting in 100 % specificity (NPA; 95 % CI 95.2-100 %) ( Table 2 ). The presumed PPV and NPV with Anti-CoV2 are 100 % (95 % CI 49.2-100 %) and 100 % (95 % CI 99.4-100 %), respectively. Anti-CoV2 was evaluated for potential cross-reactivity with antibodies to common pathogens including seasonal coronaviruses and other respiratory viruses and bacteria, and anti-nuclear antibodies (ANA). A total of 157 individual specimens collected from SARS-CoV-2 negative individuals prior to the COVID-19 pandemic were tested. No cross-reactivity was observed (Table 3) . Ten replicates of each sample were tested for interference. Interference was not observed when samples were spiked with endogenous and exogenous interfering substances at the following levels: conjugated bilirubin 0.4 mg/ml; unconjugated bilirubin 0.4 mg/ml; hemoglobin 5 mg/ml; prednisolone 0.12 mg/ml; triglycerides 15 mg/ml. In this study, we assessed the diagnostic performance of Anti-CoV2 for the detection of antibodies against SARS-CoV-2, based on the FDA EUA serological testing guidelines. FDA acceptance criteria for EUA submission are: minimum clinical sensitivity of ≥90 % for SARS-CoV-2 positive specimens and a minimum clinical specificity of ≥95 % for SARS-CoV-2 negative specimens [26] . Using 30 PCR-confirmed SAR-S-CoV-2 samples and 75 negative SARS-CoV-2 samples, Anti-CoV2 was shown to have 100 % sensitivity (PPA) and 100 % specificity (NPA). There was no evidence of interference from potentially interfering substances at the concentrations listed above, and no cross-reactivity was observed against samples containing antibodies to common pathogens including seasonal coronaviruses and other respiratory viruses such as influenza A and B. The high specificity of Anti-CoV2 arises due to the multiple binding steps that have to occur for the antibodies to be detected. First, the antibody must bind to the conjugated antigen in the Processing Tube, and then the antibody-conjugated antigen complex must bind to the antigen on the solid phase within the eStick. Both the capture and detection antigen is the Spike protein S1 subunit; however, no comprehensive assessment was conducted to determine specific viral epitopes within S1. The chance of detecting non-specific binding of antibody is low due to this antigen-antibody-antigen complex requirement (Fig. 2) . No antibody tests are authorized by the FDA to be the sole diagnostic test for COVID-19 [16] . However, serological testing does have applications in sero-epidemiological studies, real-time bio-surveillance, contact tracing, detecting prior infection, identifying convalescent plasma donors, and for verifying successful vaccinations once one is developed [16] [17] [18] . Since the start of the COVID-19 outbreak, many manufacturers have developed serological tests with variable results, and initially with limited oversight from regulators [27] . Indeed, some tests are reported to have inadequate sensitivity and specificity [21, 22] . This variability has led to uncertainty in the reliability of serological testing within the medical community, which emphasizes the need for quality tests that are properly validated [28] . In an assessment of ten LFAs (not including Anti-CoV-2), sensitivity for the detection of IgG or IgM at >20 DPO ranged from 81.8 %-100 %, with specificity 84.3 %-100 % [23] . In a separate study of six POC LFAs, sensitivity at >21 DPO ranged from 0 % to 100 %, with specificity 96 %-100 % [29] , and another assessment of five POC LFAs in a low prevalence setting reported sensitivities ranging from 51.8 %-67.9 %, with specificity 95.6 %-100.0 % [30] . Furthermore, in a meta-analysis of 40 studies, pooled sensitivity for LFAs was substantially lower than ELISA platforms measuring IgG or IgM; 66.0 % (95 % CI 49.3-79.3 %) and 84.3 % (95 % CI 75.6-90.9 %), respectively [20] . In a study evaluating LFAs using finger-prick self-testing, sensitivity ranged from 21 % to 92 % versus PCR-confirmed cases, and sensitivity was observed to be significantly inferior to ELISA in 8 out of 11 LFAs assessed [31] . The high sensitivity and specificity of Anti-CoV2 compares favorably with other LFAs. The high sensitivity of Anti-CoV2 is due in part to its detection of total antibody, which will have a higher concentration in sera than each class, or class combinations, meaning Anti-CoV2 is potentially less prone to false negative results compared with other LFAs that only detect one or two classes of antibody. Multiple studies have shown evidence of seroconversion to only one class of antibody, meaning tests designed to detect the presence of one class of Ig may result in false-negatives [6, 8, 9, 23] . Seroconversion to total Ig has also been shown to occur more quickly than seroconversion to IgG or IgM [6, 9] , and in a separate study, IgA was persistently higher throughout the observation period compared with IgM [11] . Another study demonstrated that IgA testing provided better diagnostic accuracy early in disease [10] . LFAs that detect IgM and/or IgG are therefore, inherently less sensitive than LFAs that detect total antibody. In this regard, The Infectious Diseases Society of America only recommends the use of IgG or total Ig for clinical and epidemiological purposes due to the lack of evidence in support of IgM only, IgA only or IgG and IgM combination tests [32] . Anti-CoV2 is simple to perform, providing rapid, precise results with minimal training and equipment. Additionally, the system overcomes the limitations in common LFA visual tests that are key to scaling testing to meet the demands inherent in a global pandemic. Simultaneous testing of multiple samples allows for increased testing volume, electronic test interpretation eliminates the subjectivity inherent in common LFA visual tests and the restrictive in-person time window required to read results, thereby reducing the number of skilled workers needed to scale up testing. The portability and ability to use the system at POC, or in near patient settings, are also of potential interest for many low-and middle-income countries, where access to molecular testing for Table 1 Sample collection details for PCR-confirmed SARS-CoV-2 positive samples. Days between blood draw and first date of symptom onset ≤7 8-14 15-21 22-28 29-35 36-42 43-49 50-56 57-60 Number of samples 0 1 7 5 5 7 3 0 2 Table 2 Positive and negative percent agreement for Anti-CoV2. ANA, anti-nuclear antibody; HBc, hepatitis B core antibody; HBs, hepatitis B surface antibody; HCoV, human coronavirus. * Cross reactivity is evaluated separately for each pathogen category. Several specimens contained antibodies to multiple pathogens, resulting in some specimens listed more than once, but in separate pathogen categories. diagnosing SARS-CoV-2 infection is insufficient. In these areas, rapid POC testing without the need for laboratories could provide an alternative triage option [3] . Anti-CoV2 could provide a reliable indication of a previous infection with SARS-CoV-2 for use in bio-surveillance, contact tracing, identification of convalescent plasma donors, sero-epidemiologic studies, and verification of vaccine efficacy. There are some limitations to this study. Although the sample size in this study was in line with the FDA EUA serological testing guidelines, further evaluation on a larger sample set, including samples from individuals categorized by symptom severity and/or hospitalization would be of interest. In a comparative analysis of five widely used serological assays (not including Anti-CoV2), sensitivity was 100 % for all assays in hospitalized patients, but much lower for non-hospitalized patients; 69 %-91.6 % [33] . Additionally, in our study, only samples taken between 14 and 60 DPO were used in the sensitivity analysis; therefore, it is unclear what the clinical performance of this assay will be on samples taken either side of this time frame. Additionally, Anti-CoV2 needs to be evaluated in sero-epidemiological studies, as well as against other tests including LFAs and ELISA-based platforms. In conclusion, QIAreach™ Anti-SARS-CoV-2 Total Test provides highly accurate detection of total antibodies against SARS-CoV-2. All named authors meet the International Committee of Medical Journal Editors (ICMJE) criteria for authorship for this article, take responsibility for the integrity of the work as a whole, and have given their approval for this version to be published. All authors contributed to data analysis, data interpretation and writing of this report. This study has been funded by QIAGEN QSI. Characteristics of and important lessons from the coronavirus disease 2019 (COVID-19) Outbreak in China: summary of a report of 72 314 cases from the Chinese center for disease control and prevention The outbreak of the novel severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2): a review of the current global status Serology testing in the COVID-19 pandemic response COVID 19: EU Recommendations for Testing Strategies European Centre for Disease Prevention and Control, An Overview of the Rapid Test Situation for COVID-19 Diagnosis in the EU/EEA, 1, ECDC, Stockholm Antibody responses to SARS-CoV-2 in patients of novel coronavirus disease 2019 Distinct features of SARS-CoV-2-specific IgA response in COVID-19 patients Dynamics and significance of the antibody response to SARS-CoV-2 infection Serology characteristics of SARS-CoV-2 infection since exposure and post symptom onset Serum IgA, IgM, and IgG responses in COVID-19 IgA-Ab response to spike glycoprotein of SARS-CoV-2 in patients with COVID-19: a longitudinal study Differences in antibody kinetics and functionality between severe and mild SARS-CoV-2 infections Antibody responses to SARS-CoV-2 in COVID-19 patients: the perspective application of serological tests in clinical practice Kinetics of viral load and antibody response in relation to COVID-19 severity Viral kinetics and antibody responses in patients with COVID-19, medRxiv Important Information on the Use of Serological (Antibody) Tests for COVID-19 -Letter to Health Care Providers, FDA: Division of Industry and Consumer Education Infectious Diseases Society of America, IDSA COVID-19 Antibody Testing Primer. IDSA, 2020. May 4Available at Developing antibody tests for SARS-CoV-2 Overview of Testing for SARS-CoV-2 (COVID-19) Lateral flow assays Certain COVID-19 Serology/Antibody Tests Should Not Be Used -Letter to Clinical Laboratory Staff and Health Care Providers, FDA: Division of Industry and Consumer Education Diagnostic accuracy of serological tests for covid-19: systematic review and metaanalysis Hospital-wide SARS-CoV-2 antibody screening in 3056 Immunoglobulin M for acute infection: true or false? Clin Available at Available at Double-edged spike-are SARS-CoV-2 serologic tests safe right now? Evaluation of six commercial mid to high volume antibody and six point of care lateral flow assays for detection of SARS-CoV-2 antibodies Evaluation of serological tests for SARS-CoV-2: implications for serology testing in a low-prevalence setting Clinical and laboratory evaluation of SARS-CoV-2 lateral flow assays for use in a national COVID-19 seroprevalence survey Infectious Diseases Society of America Guidelines on the Diagnosis of COVID-19: Serologic Testing, Available at Comparison of different serological assays for SARS-CoV-2 in real life The authors would like to acknowledge Sarah Johnston, MBiolSci, of Ashfield Healthcare Communications, part of UDG Healthcare plc, for medical writing support that was funded by QIAGEN Manchester Ltd.