key: cord-0729177-9zs7g5jx authors: Goodhue Meyer, Erin; Simmons, Graham; Grebe, Eduard; Gannett, Michael; Franz, Sergej; Darst, Orsolya; Di Germanio, Clara; Stone, Mars; Contestable, Paul; Prichard, Alicia; Reik, Rita; Vassallo, Ralph; Young, Pampee; Busch, Michael P.; Williamson, Phillip; Dumont, Larry J. title: Selecting COVID‐19 convalescent plasma for neutralizing antibody potency using a high‐capacity SARS‐CoV‐2 antibody assay date: 2021-02-18 journal: Transfusion DOI: 10.1111/trf.16321 sha: cad75e63a280404ea908e4c344440dd757d4268f doc_id: 729177 cord_uid: 9zs7g5jx BACKGROUND: Efficacy of COVID‐19 convalescent plasma (CCP) is hypothesized to be associated with the concentration of neutralizing antibodies (nAb) to SARS‐CoV‐2. High capacity serologic assays detecting binding antibodies (bAb) have been developed; nAb assays are not adaptable to high‐throughput testing. We sought to determine the effectiveness of using surrogate bAb signal‐to‐cutoff ratios (S/Co) in predicting nAb titers using a pseudovirus reporter viral particle neutralization (RVPN) assay. METHODS: CCP donor serum collected by three US blood collectors was tested with a bAb assay (Ortho Clinical Diagnostics VITROS Anti‐SARS‐CoV‐2 Total, CoV2T) and a nAb RVPN assay. Prediction effectiveness of various CoV2T S/Co criteria was evaluated for RVPN nAb NT(50) titers using receiver operating characteristics. RESULTS: Seven hundred and fifty‐three CCPs were tested with median CoV2T S/Co and NT(50) of 71.2 of 527.5. Proportions of donors with NT(50) over target nAb titers were 86% ≥1:80, 76% ≥1:160, and 62% ≥1:320. Increasing CoV2T S/Co criterion reduced the sensitivity to predict NT(50) titers, while specificity to identify those below increased. As target NT50 titers increase, the CoV2T assay becomes less accurate as a predictor with a decline in positive predictive value and rise in negative predictive value. CONCLUSION: Selection of a clinically effective nAb titer will impact availability of CCP. Product release with CoV2T assay S/Co criterion must balance the risk of releasing products below target nAb titers with the cost of false negatives. A two‐step testing scheme may be optimal, with nAb testing on CoV2T samples with S/Cos below criterion. A novel coronavirus, SARS-CoV-2, first identified as the causative agent of a late 2019 outbreak of atypical pneumonia in Wuhan, China, was declared a pandemic by the World Health Organization in March 2020. It is not only the high transmissibility of SARS-CoV-2 that made it a significant public health concern, but also the heterogeneity and seriousness of clinical manifestations in the form of COVID-19 disease. There had been over 20 million confirmed cases worldwide and more than 5 million in the United States by August 25th. The death toll worldwide had reached in excess of 814,000, with the United States accounting for over 20% of those deaths (177,773). 1 Over the past 6 months, the medical and scientific communities have worked to characterize the pathologic course and determine the best treatment options for COVID-19. Currently, viral-specific therapies and vaccines are under development. The most specific therapeutic option currently available is an old standby: convalescent plasma (CP). On March 24, 2020, the Food and Drug Administration released a pathway for investigational new drug (IND) use of COVID-19 convalescent plasma (CCP) for the treatment of patients suffering from severe, life-threatening COVID-19. 2 Clinical use of CCP has expanded rapidly through the Mayo Clinic's Expanded Access Program (EAP), single-patient emergency INDs, and single or multi-center institutional INDs. 2 Several observational studies have demonstrated clinical benefit from 1-2 unit transfusions of CCP. [3] [4] [5] An early report for the Mayo Clinic EAP showed reduced mortality in patients who received CCP early (within 3 days of diagnosis) and a mortality benefit with higher IgG antibody levels in the transfused plasma. 6 The safety of CCP transfusions was similar to standard plasma transfusions. 7 A randomized controlled trial conducted in Wuhan, however, did not report improved outcomes with CCP treatment for patients with severe COVID-19, although the study was terminated early due to a decrease in the COVID-19 case load. 8 The transfusion community mobilized efforts to recruit and collect CCP from recovered patients in the context of rapidly evolving FDA guidance and testing technologies. In previous outbreaks, the clinical benefit of CP was related to the dose of neutralizing antibodies in the plasma. 9,10 Neutralizing antibodies directly block viral attachment to the host cell and subsequent fusion. 11, 12 A small 2018 study on the use of CP in a Middle East Respiratory Syndrome outbreak demonstrated that the neutralizing titer of the convalescent plasma should exceed 1:80 to be clinically effective. 10 The CCP used in Duan et al.'s retrospective review of 10 patients with severe COVID-19 and Shen et al.'s of five patients had high titers (ie. >1:640). 3, 4 Despite some encouraging preliminary data, the clinical utility of CCP in COVID-19 has not been established, and the optimal dose and types of anti-SARS-CoV-2 antibodies in CCP remain uncertain. Current FDA guidance through the CCP Emergency Use Agreement (EUA) guidelines recommends high titer CCP with an S/Co of >12 with the Ortho VITROS Anti-SARS-CoV-2 IgG only assay (Ortho Clinical Diagnostics, Raritan, New Jersey) which correlates to a neutralizing nAb titer of >1:250. 13 FDA has recognized that qualification of CCP products on the basis of nAb titer is challenging, given that conventional neutralizing antibody titer assays are cell-based, not amendable to high throughput testing, and not standardized. To that end on April 20, 2020, Creative Testing Solutions (CTS) implemented the VITROS Anti-SARS-CoV-2 Total Ig assay (CoV2T, Ortho Clinical Diagnostics, Raritan, New Jersey), which had received FDA emergency use authorization (EUA) on April 3, 2020. The assay detects binding antibodies (bAb) to the S1 subunit of the SARS-CoV-2 spike glycoprotein. Three large blood collection organizations began using the CoV2T semiquantitative test to ascertain donor seroreactivity to qualify CCP products, although the correlation of CoV2T signal-to-cutoff ratio (S/Co) with SARS-CoV-2 nAb titers was unknown. In this study, we endeavored to determine the effectiveness of CoV2T S/CO in predicting titers of nAbs to the immunodominant S protein, measured using SARS-CoV-2 Reporter Viral Particle Neutralization (RVPN) assay (Vitalant Research Institute [VRI], San Francisco, CA). We evaluated the reliability of a range of CoV2T S/CO criteria for predicting nAb titer, in an effort to derive optimal testing algorithms for CCP qualification. We tested serum samples from 753 CCP donations collected by the American Red Cross (ARC), OneBlood, and Vitalant during April and May 2020 with both the Ortho VITROS ® CoV2T serologic assay and the VRI RVPN assay. CCP donor collection began in early April 2020. ARC study donors were collected from 4/8/20-5/19/20, OneBlood from 3/30/2020-5/12/2020, and Vitalant from 4/12/2020-5/13/220. FDA-mandated CCP donor qualification evolved throughout the study period due to testing availability and evolution of the pandemic in the United States. Evidence of COVID-19 was required in the form of a documented positive SARS-CoV-2 molecular or serologic test, and either complete resolution of symptoms at least 28 days prior to donation or complete resolution 14 days prior to donation with negative molecular test result. All CCP donors were also required to meet traditional allogeneic blood donor criteria per the Code of Federal Regulations (21 CFR 630.10 and 630.15). 14 At time of plasma collection, donors consented to use of deidentified donor information and test results for research purposes. ARC collected apheresis plasma units on Alyx and Amicus devices (Fresenius Kabi USA LLC, Lake Zurich, IL). At OneBlood, whole blood plasma collection was performed using the Haemonetics Leukotrap blood collection system (Haemonetics, Braintree, Mass.). Apheresis plasma collection was performed at both OneBlood and Vitalant using Alyx devices and Trima (Terumo BCT, Lakewood, CO) apheresis systems following manufacturers' recommendations. On April 27, 2020, ARC began CCP donor qualification with the CoV2T assay. Units from donors with a signal to cutoff (S/Co) ratio ≥ 1.0 (reactive per package insert) were labeled as CCP units. Retrospective testing was accomplished for the donors collected from 4/8/2020 to 4/26/2020 from frozen serum drawn at time of collection. Vitalant began CoV2T testing on 5/6/2020 but startup reporting delays precluded its use as a release criterion until after 5/13/2020 with retrospective testing on previously frozen samples completed thereafter. Vitalant also used an S/Co ≥1.0 as a CCP unit release criterion. Vitalant has allowed repeat CCP donations every 7 days. Either refrigerated serum from the routine donation testing tubes, or frozen serums from randomly selected CCP donations were sent to the CTS in St. Petersburg, Florida. Serum aliquots were prepared at CTS for CoV2T testing by individual donation. Regardless of VITROS Anti-SARS-CoV-2 Total Ab reactivity status, the serums aliquots were refrozen after testing and then shipped on dry ice to Vitalant Research Institute (VRI; San Francisco, CA) for assessment of the sample's SARS-CoV-2 neutralization activity. VITROS Anti-SARS-CoV-2 Total testing was performed following the manufacturer's package insert instructions. 15 The VITROS CoV2T test is an antigen sandwich immunoassay designed to qualitatively detect antibody to the S1 subunit of the SARS-CoV-2 spike glycoprotein, including IgA, IgM, and IgG. The assay involves a twostage reaction, in which SARS-CoV-2 antibodies present in the sample initially bind with SARS-CoV-2 antigen coated on the test well. Any unbound sample is removed by washing. Subsequently, a horseradish peroxidase (HRP)-labeled recombinant SARS-CoV-2 antigen is added. The HRP-labeled conjugate binds specifically to anti-SARS-CoV-2 already captured on the test well. Unbound conjugate is removed by a subsequent wash step. The bound HRP conjugate is then measured by a luminescent reaction. A reagent containing luminogenic substrates and an electron transfer agent are added to the test wells. The HRP in the bound conjugate catalyzes the oxidation of the luminol derivative, producing light. The electron transfer agent (a substituted acetanilide) increases the level of light produced and prolongs its emission. The light signals are read by the VITROS system. The amount of HRP conjugate bound is indicative of the amount of anti-SARS-CoV-2 antibody present. Results of the test are reported as either Reactive (S/Co ≥ 1.0) or Nonreactive (S/Co < 1.0), although the S/Co can also be obtained from the system. Study samples were tested with the SARS-CoV-2 Reporter Viral Particle Neutralization (RVPN) assay at VRI. 16 Upon receipt, serum samples were plated in a 96-well plate and heat-inactivated (HI) for 30 min at 56°C. Reporter viral particles (RVPs) represent a safe and rapid way of quantitatively measuring neutralization, by using SARS-CoV-2 Spike glycoprotein pseudotyped onto a rhabdovirus reporter virus. Neutralization was performed using vesicular stomatitis virus (VSV)-based pseudovirions (PV, D614) as previously described. 16 Briefly, HEK293T cells were transfected with human ACE2 and TMPRSS2 by TransIT-2020. Twenty-four hours later, cells were plated into black 96-well tissue culture treated plates. Four-fold dilutions of heat inactivated serum were performed and VSV-firefly luciferase pseudovirus harboring SARS-CoV-2 S (adjusted to result in 10,000-20,000 RLU in target cells), was mixed with the respective serum dilution, no serum controls and a positive and negative serum control. The mixture was incubated for 1 h at 37°C and then used to infect the transfected cells in black plates. After 24 h at 37°C, supernatant was removed, cells lysed, and luciferase activity was measured as per manufacturer's instructions (Promega, Madison, WI). Fifty percent neutralization titers (NT 50 ) were estimated by calculating percent of no serum control and plotting nonlinear regression curves constructed in GraphPad Prism version 8.4 (GraphPad Software, San Diego, CA). Donors are considered to lack neutralizing antibodies if their titer was <40. CoV2T sensitivity and specificity for selection of CCP at four RVPN NT 50 target nAb titers (1:80, 1:160, 1:320, and 1:640) were determined by dichotomizing the RVPN titer outcomes at the S/Co criterion of interest and preparing receiver operating characteristic (ROC) analyses using a computer program (NCSS 10 Statistical Software, 2015; NCSS, LLC, Kaysville, Utah, USA). Based on the prevalence of CCP above the RVPN threshold titers, positive and negative predictive values (PPV and NPV, respectively) were calculated. Two-stage CCP release strategies were examined at several CoV2T acceptance values by determining the proportion of CCP within an S/Co range sent for reflex RVPN that would exceed the selected nAb target (SAS 9.4, SAS Institute, Cary, NC). A nonparametric Spearman rank correlation coefficient was performed between CoV2T and RVPN (SAS 9.4, SAS Institute, Cary, NC). Seven hundred and fifty-three CCP donors were tested from three blood centers across the United States (Table 1) . Median donor age was 47 years (range 15-84 years) and roughly equally distributed between males and females (48.8% female). ABO blood type frequencies were relatively consistent with previously published prevalences in the US population: group O 39.5%, group A 40.3%, group B 13.4%, and group AB 6.8%. 17 The CCP donors were well represented across the United States hailing from 39 of the 48 continental states (Figure 1 ). Florida accounted for the entire CCP donor population from one blood center with the other two covering 38 states. Colorado and California had the second two highest study donor populations (16.9% and 8.9%, respectively). Several states (i.e. Rhode Island, Wyoming, Alabama, New Mexico) had only one donor representing 0.1% of the overall study population. The ARC samples had a slightly lower percent reactive on the VITROS CoV2T, and a lower median nAb titer in the RVPN. This may have been a consequence of the difference in collection catchments, and would be expected to change as the pandemic peak progresses around the country. This is not relevant for evaluation of the CoV2T predictive performance. The 753 CCP donors had a median CoV2T S/Co of 71.2 (IQR 19.9-156) and a median NT 50 of 528 (IQR 182-1627) ( Table 1) . Ninety-four percentage were reactive for CoV2T and had a neutralizing titer ≥40 with 6% "sero-silent" with nonreactive S/Co and absence of a neutralizing titer. Figure 2 shows the distribution of study population based on CoV2T S/Co results against RVPN titers. The distribution is not normal and suggests a direct linear relationship between CoV2T and RVPN consistent with other studies. 18 A Spearman rank correlation coefficient showed low correlation between CoV2T and RVPN (r = 0.34217, p < .0001). Truncated RVPN results beyond the assay response range are evident in Figure 2 at 1:40 and 1:10,000. Table 2 summarizes proportions of reactive CCP donations at S/Co thresholds of 1, 10, 20, 30, and 60 that yields RVPN NT 50 titers meeting proposed CCP minimum potency levels. As the S/Co threshold approaches 60, the proportion of selected donors meeting candidate NT 50 titers increaseswith 98% of donors with S/Co ≥60 had NT 50 ≥ 1:80 and 79% ≥1:320. However, at an S/CO criterion of 60, 45% of donors do not meet the S/Co criterion ( Table 2 ), many of whom have high neutralization titers. The CoV2T ROCs are shown in Figure 3 for NT 50 thresholds of 1:80, 1:160, 1:320, and 1:640. As the threshold nAb titer criterion increases, the performance of the CoV2T assay for selecting CCP above the threshold CoV2T S/Co cutoffs are superimposed on the ROC illustrating how increasing the S/Co criterion results in a tradeoff effect of decreasing sensitivity (probability of a true positive selection) while decreasing the risk of a false positive selection. This is also shown in Table 3 with various combinations of CoV2T cutoff S/Co and desired CCP NT 50 . Based on the prevalence of NT 50 greater than threshold values, the PPV and NPV for the CoV2T assay illustrate the tradeoff associated with increasing the NT 50 requirement. We examined the effect of a two-stage selection process for CCP donations (Figure 4) : Stage 1 is a CCP rejection with S/Co < 1.0 and immediate acceptance for S/Co > acceptance criterion; Stage 2 is reflexed secondary screening for 1.0 < S/Co < acceptance criterion illustrated here as an RVPN assay. The anticipated outcome of several such threshold and acceptance criteria is shown in Table 4 . For example, with an S/Co acceptance criterion of 30, 6.5% are immediately rejected with S/Co < 1.0, 67.5% are immediately accepted as CCP, and 26% are reflexed to secondary screening. With an NT50 target of 1:160, 89.8% with S/Co > 30 are anticipated to be at or above the target and 60.6% of the reflexed tested units would be releasable with RVPN NT50 > 1:160. This results in 91.7% of the final released inventory expected to exceed the NT50 target (Table S1 ). Approximately, 11% (78 of 704) of all tested units would not be released as CCP. COVID-19 has presented new and daunting challenges for our society worldwide. The last 6 months have seen incredible strides in public health and prevention as well as understanding of disease pathogenesis and formulation of effective treatment protocols. Viral-specific therapy is still in development setting the stage for temporary use of an historical treatment: convalescent plasma. Initial studies using CCP have suggested efficacy particularly when used earlier in the disease course, though the most efficacious nAb titer and dose have not yet been determined. 6, 19 Although bAbs may protect through multiple effector pathways, the effectiveness of passive immunotherapy is believed to be broadly proportional to the potency of the intervention as determined with nAb titers. As applied to CCP on the large-scale experience in the US, it is not possible to provide timely screening of CCP products due to technological limitations. Therefore, it is imperative to apply high throughput bAb assays as indicators of nAb levels. We have demonstrated that the CoV2T test system, while not a perfect predictor of nAb titers, is capable of identifying donors with no Ab response. The test system also presents an S/Co readout with a large dynamic range. This output range can be exploited to provide reasonable PPV as a screening tool. For example, an S/Co criterion of 30 applied to a previously qualified CCP donor population is expected to result in 90% of CCP with NT 50 ≥1:160. We further illustrated that reflex testing of CCPP in the intermediate zone of S/Co 1-30 could provide additional units at or above the desired NT 50 . Such an approach will permit high throughput screening for timely provision of CCP. The selection of targeted nAb titers for clinical use will significantly affect the yield and availability of CCP transfusion. Due to inherent limitations of large volume testing for neutralization titers, we present a potential reflex testing algorithm using initial high-throughput CoV2T testing. The S/Co thresholds selected for routine product release will need to balance the risk of releasing F I G U R E 3 ROC curves for varied nAb titer thresholds. As the nAb titer increases, the ability of the S/Co to predict the nAb titer decreases. ▲:S/Co= 60 ♦:S/Co= 30 •:S/Co= 20 ■:S/Co= 10 X:S/Co= 1 [Color figure can be viewed at wileyonlinelibrary.com] products without the minimum target nAb titer. Organizations may consider this testing scheme or develop others to effectively select for CCP. Salazar et al showed pair-wise Pearson correlations of 0.67 and 0.62 between IgG ELISA assays for antibodies to the Spike glycoprotein ectodomain (ECD) and receptor binding domain (RBD), respectively, with neutralization titers. 20 Another approach that could be considered is pooling of CCP units from different donors. This would narrow the distribution of nAb titers in the CPP and take advantage of regression to the mean. In other words, the lower titer units would be balanced by the higher titer units and result in higher proportions of pooled CCP above any desired nAb titer. Regardless, any algorithm would need to effectively evaluate testing performance characteristics including sensitivity and specificity as well as PPV and NPV while correlating with clinical outcomes. Organizations will also need to consider the cost/benefit ratio of adding additional tests to algorithms. Our study did have several limitations. The SARS-CoV-2 RVPN detects the presence of neutralizing antibody directed against the virus, but there is still a potential that cross-reactivity with other coronavirus species may occur. In addition, though represented in 39 different states, the study population was not entirely representative of the potential CCP donor pool within the United States which as of August 25, 2020 exceeds 124,036. 1, 17 Despite being the largest published report of CCP donors to date, our population was still relatively small and collected in the early days of the pandemic. Our cross-sectional analysis showed 94% seropositivity to both the CoV2T and the RVPN with 6% sero-silent consistent with a recent serosurvey of recovered COVID-19 patients. 21 However, our testing only examined humoral response to the immune dominate S-protein. Additional studies are necessary to examine humoral response to additional viral antigens and correlate with days from COVID-19 symptom onset and severity of illness. Ab reactivity on the CoV2T testing system appears to be quite stable over at least 90 days (unpublished); however, other assay platforms targeting IgG-only suggest waning for the IgG response, and possibly, nAb as well. 22 John's Hopkins University and Medical Center Investigational COVID-19 Convalescent Plasma: Guide for Industry, the Food and Drug Administration Treatment of 5 critically ill patients with COVID-19 with convalescent plasma Effectiveness of convalescent plasma therapy in severe COVID-19 patients Treatment of COVID-19 patients with convalescent plasma Effect of convalescent plasma on mortality among hospitalized patients with COVID-19: Initial threemonth experience. medRxiv Early safety indicators of COVID-19 convalescent plasma in 5000 patients Effect of convalescent plasma therapy on time to clinical improvement in patients with severe and life-threatening COVID-19: A randomized clinical trial Convalescent plasma treatment reduced mortality in patients with severe pandemic influenza A (H1N1) 2009 virus infection Challenges of convalescent plasma infusion therapy in Middle East respiratory coronavirus infection: A single centre experience Deconstructing the antiviral neutralizing-antibody response: Implications for vaccine development and immunity Antibodies to SARS-CoV-2 and their potential for therapeutic passive immunization Recommendations for Investigational COVID-19 Convalescent Plasma, the Food and Drug Administration Code of Federal Regulations. Title 21, CFR Parts 600 to 799 VITROS Immunodiagnostic Products Anti-SARS-CoV-2 Total Reagent Pack and VITROS Immunodiagnostic Products Anti-SARS-CoV-2 Total Calibrator Instructions for Use. Version 3.0. Ortho Clinical Diagnostics SARS-CoV-2 seroprevalence and neutralizing activity in donor and patient blood from San Francisco Bay Area. medRxiv Serological analysis of New York City COVID-19 convalescent plasma donors. medRxiv Convalescent plasma or hyperimmune immunoglobulin for people with COVID-19: A living systematic review Convalescent plasma anti-SARS-CoV-2 spike protein ectodomain and receptor binding domain IgG correlate with virus neutralization IgG antibodies to SARS-CoV-2 in a large cohort of previously infected persons SARS-CoV-2 infection induces robust, neutralizing antibody responses that are 1 stable for at least three months. medRxiv Longitudinal evaluation and decline of antibody responses in SARS-CoV-2 infection. medRxiv Persistence and decay of human antibody The authors have no conflict of interest related to the content in this manuscript.