key: cord-0847316-pbzqncfh authors: Tagwerker, C.; Baig, I.; Brunson, E.; Mundo, K.; Dutra-Smith, D.; Carias-Marines, M. J.; de Zoysa, R. S.; Smith, D. J. title: Clinical performance of two EUA-approved anti-COVID-19 IgG/IgM rapid lateral flow immunoassays using whole blood finger-sticks date: 2021-06-05 journal: nan DOI: 10.1101/2021.06.04.21258189 sha: 298766df62dd0b91fb8031fafd47fab593bdda5a doc_id: 847316 cord_uid: pbzqncfh Serological, or antibody, tests detect immunoglobulins produced by the hosts plasma B cells following exposure to foreign antigens. Venipuncture blood draws to collect human venous whole blood, plasma from anticoagulated blood (Li+ heparin, K2EDTA and sodium citrate), or serum are commonly utilized and require refrigerated temperatures during transport to the testing facility. Subsequent laboratory testing by enzyme-linked immunosorbent assays (ELISA) or chemiluminescence immunoassays (CLIA) can take an additional 2-5 hours. In the context of the COVID-19 pandemic, rapid diagnostic tests (RDT) to be used in point-of-care (POC) and remote settings have become essential during mandatory quarantine and isolation periods. RDTs allowed for more cost-effective testing using less collection materials with an immediate (5-10 minutes) test result. However, the majority of emerging RDTs receiving Emergency Use Authorization (EUA) approval by the Food and Drug Administration (FDA) for qualitative detection and differentiation of IgM and IgG antibodies to SARS-CoV-2 were only approved for use in human venous whole blood, plasma or serum. In this study we summarize performance characteristics of one RDT (COVID-19 IgG/IgM lateral flow immunoassay rapid cassette) to another by simultaneous application of whole blood finger-stick specimens (n = 32). The study was performed over 5 different days, with daily quality controls consisting of serum previously verified to be positive or negative by COVID-19 IgG/IgM ELISA testing. An outbreak of respiratory disease caused by a novel coronavirus SARS-CoV-2 (COVID-19) first detected in Wuhan City, Hubei Province, China, has demonstrated the capability to spread rapidly, leading to significant impacts on healthcare systems and causing societal disruption was designated as a pandemic by the World Health Organization (WHO) [1] . To respond effectively to the COVID-19 outbreak, rapid detection of cases and contacts, appropriate clinical management and infection control are critical. On February 4, 2020, the Secretary of Health and Human Services (HHS) confirmed a public health emergency (PHE) and that circumstances exist justifying the authorization of emergency use of in vitro diagnostics for detection of SARS-CoV-2 [2] , [3] . Rapid detection of COVID-19 cases requires wide availability of diagnostic testing to control the emergence of this rapidly spreading, severe illness. The SARS-CoV-2 genome encodes approximately 25 proteins that are required for infection and replication, including four major structural proteins spike (S), envelope (E), membrane (M), and nucleocapsid (N) protein [4] , [5] . ELISA or CLIA assays are the most frequently used format for serological testing with an average turnaround time of 2 to 5 hours. A rapid diagnostic test (RDT) is a simple test based on lateral flow immunoassay (LFIA) technology and can potentially be administered as a point-of-care (POC) test or self-test. RDT test strips can provide reliable qualitative detection and differentiation of IgM, IgG and/or IgA antibodies against SARS-CoV-2 from a drop of blood. It is important to note that donor antibodies (IgG, IgM, or IgA) are produced against a specific SARS-CoV-2. In case of an RDT such as lateral flow immunoassays (LFIA), when a specimen followed by assay buffer is added to the sample well, and IgM/IgG/IgA antibodies are present, these antibodies bind to colloidal gold conjugated to recombinant COVID-19 antigens (e.g. SARS-CoV-2 spike or nucleocapsid antigen) immobilized on a nitrocellulose strip. The antibody/COVID-19 conjugate complex migrates through a nitrocellulose membrane by capillary action to a line of the corresponding immobilized antibody (anti-human IgM, anti-human IgG or anti-human IgA) where it is trapped forming a colored band which confirms a reactive test result. Absence of a colored band in the test region indicates a non-reactive test result [6] . During the COVID-19 pandemic, the majority of emerging RDTs receiving Emergency Use Authorization (EUA) approval by the Food and Drug Administration (FDA) for qualitative detection and differentiation of IgM and IgG antibodies to SARS-CoV-2 were only approved for use in human venous whole blood, plasma or serum by laboratories certified under the Clinical Laboratory Improvement Amendments of 1988 (CLIA). As of May 29, 2020, the FDA provided EUA to a COVID-19 IgG/IgM rapid test cassette serology test manufactured by Healgen® for use in human venous whole blood, plasma from anticoagulated blood (Li+ heparin, K2EDTA and sodium citrate), or serum [7]- [9] . As of June 19, 2020, the FDA provided EUA to a similar product, the LYHER® Novel Coronavirus (2019-nCoV) IgM/IgG Antibody Combo Test Kit (Colloidal Gold) for use in human serum and plasma (Li+ heparin, K2EDTA or sodium-citrate) [10] . All rights reserved. No reuse allowed without permission. (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. The copyright holder for this preprint this version posted June 5, 2021. ; In this study we summarize performance characteristics of the Healgen® COVID-19 IgG/IgM lateral flow immunoassay rapid cassette to the LYHER® Novel Coronavirus (2019-nCoV) IgM/IgG Antibody Combo Test Kit, both LFIAs specifically targeting antibodies binding the SARS-CoV-2 spike S1 antigen. In order to determine performance of a different specimen source, simultaneous application of whole blood finger-stick specimens (n = 32) was performed over 5 different days, with daily quality controls consisting of serum previously verified to be positive or negative by COVID-19 IgG/IgM ELISA testing. This study was approved by the Alcala Pharmaceutical Inc. Institutional Review Board (IORG0010127) in consideration of the Code of Ethics of the World Medical Association (Declaration of Helsinki). Specimen collections were performed at the phlebotomy collection site at Alcala Testing and Analysis Services, 3703 Camino del Rio South, San Diego, CA, 92108 by certified phlebotomists. Whole blood specimen rapid cassette testing was conducted from 08/14/2020 to 08/26/2020 at Alcala Testing and Analysis Services. All subjects were recruited by phone or e-mail at the San Diego Comprehensive Pain Management Clinic, 3703 Camino del Rio South, San Diego, CA, 92108. Healthcare workers from the clinic or volunteers in any setting (symptomatic or asymptomatic) could enroll without a prior COVID-19 test. All specimens derived from human subjects were de-identified of their health information as defined by Health Insurance Portability and Accountability Act (HIPAA) guidelines. Thirty-two volunteers took part in a whole blood finger-stick collection with simultaneous application of the specimen to the Healgen® or LYHER® COVID-19 IgG and IgM antibody rapid cassette. Whole blood finger-sticks for Healgen® and LYHER® lateral flow rapid cassette testing were collected with kits containing 21G (2.2. mm depth) high flow safety lancets (One-Care®, Irvine, CA), alcohol prep pad, gauze and band-aids. Use of digital timers ensured rapid cassette image interpretation at the recommended 10-minute mark. Deidentified, positive and negative control serum for IgG/IgM COVID-19 antibodies was made available for daily quality control (QC) testing of both rapid cassettes. QC serum was verified by the EDI™ Novel Coronavirus COVID-19 IgG/IgM ELISA diagnostic kit as described previously in Baig et al. [11] . Healgen® and LYHER® lateral flow rapid cassette kits for COVID-19 IgG and IgM antibody detection were used for testing individuals by whole blood finger-stick at the Alcala Labs collection site. 3 donors who tested for positive for IgG and/or IgM COVID-19 antibodies also provided nasopharyngeal swabs for confirmation COVID-19 by RT-PCR (Nucleic acid amplification technique or NAAT). RT-PCR analysis was performed by Luminex MAGPIX NxTAG® CoV Extended Panel as previously described [11] . Sample buffer was equilibrated at room temperature (15-30°C) prior to testing. Rapid cassettes and the 5 μL mini plastic dropper were removed from the sealed foil pouch and placed on a clean and level surface. After cleansing the finger stick collection site with the alcohol prep pad, whole blood was drawn using the 21G lancet and whole blood specimen (or serum quality control material) applied into the sample well (S) of the rapid cassette with the mini plastic dropper. Two drops (approximately 80 μL) of sample buffer were added to buffer well (B) while avoiding air bubbles (Fig 1a) . An additional drop of the sample buffer was added within 2 minutes if the red color did not move across the test window. The result was read in ten minutes. Result interpretation after fifteen minutes was avoided. If the internal control in the control line region (C) changed from blue to red and no line appeared in the test line regions M or G results were interpreted as negative (Fig 1b) . IgM positive was determined if the colored line in the control line region (C) changed from blue to red, and a colored (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. The copyright holder for this preprint this version posted June 5, 2021. ; line appeared in region M, indicating the presence of IgM anti-SARS-CoV-2 antibodies. The test was considered IgG positive, if the colored line in the control line region (C) changed from blue to red, and a colored line appeared in test line region G. This result indicates the presence of IgG anti-SARS-CoV-2 antibodies. For both IgG and IgM to be considered positive two colored lines were visible in test line regions M and G in combination with the control line region (C) changing from blue to red. The test results indicate the presence of both IgM and IgG anti-SARS-CoV-2 antibodies (Fig 1c) . An invalid result was not observed, in this case the control line may be partially red or completely fail to change to red. Insufficient specimen volume, incorrectly stored or expired rapid cassette lots are the most likely reasons for control line failure. Sample buffer was equilibrated at room temperature (15-30°C) prior to testing. Rapid cassettes (no mini plastic dropper provided) were removed from the sealed foil pouch and placed on a clean and level surface. Upon cleansing the finger stick collection site with the alcohol prep pad, whole blood was drawn using the 21G lancet, whole blood specimen (or serum quality control material) was applied to the sample well (S) of the rapid cassette using a 200 μL transfer pipette. Two drops (approximately 80 μL) of sample buffer was added to the (S) well while avoiding air bubbles. The LYHER® lateral flow rapid cassette features no separate buffer well (Fig 2a) . The result was read in ten minutes. Result interpretation after fifteen minutes was avoided. All rights reserved. No reuse allowed without permission. (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. If the internal control line on the nitrocellulose membrane (control line region (C)) changed from white to red and no line appeared in the test line regions M or G results were interpreted as negative (Fig 2b) . (Fig 2c) . An invalid result was not observed, in this case the control line may be partially red or completely fail to change to red. Insufficient specimen volume, incorrectly stored or expired rapid cassette lots are the most likely reasons for control line failure. An internal control band is included in both the Healgen® and LYHER® lateral flow immunoassays. A red line appears in the control region (C) if sufficient specimen volume was applied, and the colorimetric lateral flow immunoassay is performing as expected. It is recommended by the FDA that positive and negative controls be tested as a good laboratory practice to confirm the test procedure and to verify proper test performance for both EUAapproved products described here. In this study pretested IgG or IgG, IgM positive serum control material and pretested IgG, IgM negative serum control material was pipetted onto 2 separate (c) (b) All rights reserved. No reuse allowed without permission. (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. The copyright holder for this preprint this version posted June 5, 2021. cassettes for every Healgen® and LYHER® lateral flow rapid cassette batch tested within 24 hours. The Healgen® COVID-19 IgG/IgM Rapid Test Cassette was originally evaluated in China by testing a total of 191 plasma (K2EDTA) clinical samples and a study by the Frederick National Laboratory for Cancer Research (FNLCR) using frozen serum and plasma specimens, with 30 positives confirmed by RT-PCR and 80 negative specimens derived from collections before 2020 (n = 110). Alcala Labs performed a similar study on 75 clinical specimens comparing whole blood finger-stick collections to a simultaneous venipuncture draw serum collection measured by IgG/IgM ELISA [11] ( Table 1) . All 3 studies showed that a whole blood finger-stick collection versus venipuncture serum draws performs equally well in regard to combined sensitivity (100%) and 1% higher in combined specificity. Overall, the combined positive predictive value (PPV) at a presumed prevalence of 5% increased by 10% and the combined negative predictive value (PPV) at a presumed prevalence of 5% was maintained at 100% ( Table 1) : Table 2) . All rights reserved. No reuse allowed without permission. (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. The copyright holder for this preprint this version posted June 5, 2021. ; The Healgen® COVID-19 IgG/IgM Rapid Test Cassette was also originally evaluated using by the Frederick National Laboratory for Cancer Research (n = 110 serum or plasma specimens) with positives confirmed by RT-PCR, a direct comparison between the 2 studies at the FNLCR in Table 4 shows equal performance between the 2 rapid cassettes for serum or plasma specimens in regard to combined sensitivity, and 1% higher combined specificity for the LYHER® LFIA product. (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. Based on this data the LYHER® rapid cassette shows a combined sensitivity of 86.7% and combined specificity of 100% in whole blood finger-stick specimens versus the Healgen® rapid cassette. The negative predictive value (NPV) at 5% prevalence was determined at 99.3% and the positive predictive value (PPV) at 100%. This study confirmed that utilizing the LYHER® COVID-19 IgG/IgM rapid cassette by applying whole blood finger-stick derived specimens instead of serum or plasma from a venipuncture draw shows a combined sensitivity of 86.7% and combined specificity of 100% versus the Healgen® COVID-19 IgG/IgM rapid cassette. Clearly, performance of both COVID-19 IgG/IgM rapid diagnostic tests using LFIA technology is highly sensitive and specific in venipuncture serum or plasma (both at 99.4-100% sensitivity and 97.5-98.8% specificity). As has been shown in the Baig et al. study (n = 75) [11] , Healgen® LFIA technology is 100% sensitive in whole blood fingerstick versus serum. LYHER® LFIA technology is 13.3% less sensitive in whole blood finger-stick but maintains 100% specificity. This study may skew sensitivity to a lower percentage due to a relatively smaller sample size of positive whole blood specimens (n = 8) and overall low sample size (n = 32). However, the negative predictive value (NPV) at 5% prevalence was determined at 99.3% and the positive predictive value (PPV) at 100% showing both rapid diagnostic tests can be reliably applied in remote settings on whole blood finger-stick specimens. All rights reserved. No reuse allowed without permission. (which was not certified by peer review) is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. The copyright holder for this preprint this version posted June 5, 2021. ; https://doi.org/10.1101/2021.06.04.21258189 doi: medRxiv preprint World Health Organization declares global emergency: A review of the 2019 novel coronavirus (COVID-19) Policy for Coronavirus Disease-2019 Tests During the Public Health Emergency (Revised) -Immediately in Effect Guidance for Clinical Laboratories, Commercial Manufacturers, and Food and Drug Administration Staff | Enhanced Reader Federal Register :: Determination of Public Health Emergency Structural Proteins in Severe Acute Respiratory Syndrome Coronavirus-2 Coronavirus biology and replication: implications for SARS-CoV-2 COVID-19 serological tests: how well do they actually perform? COVID-19 IgG/IgM EUA Serology Test Evaluation Report for 'COVID-19 IgG/IgM Rapid Test Cassette' from Healgen Letter of Authorization -COVID-19 IgG/IgM Rapid Test Cassette Food & Drug Administration Direct comparison of venipuncture serum draws versus whole blood finger-stick specimens by anti-COVID-19 IgG/IgM rapid lateral flow immunoassay and ELISA Antibody IgG/IgM RAPID CASSETTE Package-Insert -LYHER Serology Test Evaluation Report for 2019-nCoV IgG / IgM Detection Kit (Colloidal Gold) The authors would like to thank the San Diego Comprehensive Pain Management Clinic (SDCPMC) and associated staff for donor collections performed during this study. The authors received no specific funding for this work. The authors declare no competing interests.