key: cord-1009624-i90oz77y authors: Egger, Alexander E.; Irsara, Christian; Holzer, Barbara; Winkler, Christoph; Bellmann-Weiler, Rosa; Weiss, Günter; Hartmann, Boris; Prokop, Wolfgang; Hoermann, Gregor; Griesmacher, Andrea; Anliker, Markus title: Borderline and weakly positive antibody levels against the S-protein of SARS-CoV-2 exhibit limited agreement with virus neutralization titres date: 2021-12-08 journal: Journal of Clinical Virology Plus DOI: 10.1016/j.jcvp.2021.100058 sha: 4b496020c4e0cbe687c8181e267adbd22eb0a6a8 doc_id: 1009624 cord_uid: i90oz77y The presence of neutralizing antibodies against SARS-CoV-2 in a large number of people is – besides cellular immunity – important to overcome the SARS-CoV-2 pandemic. While determination of neutralizing antibodies via virus neutralization tests are laborious, assays to determine the antibody levels serologically are fully automated and widely available. Correlations between these methodologies were recently given by the manufacturers, however performance in samples close to the cut off value have not yet been fully validated. Thus, we analysed 22 borderline and low positive (<100 BAU/ml) samples and 9 high positive (≥ 100 BAU/ml) from infected and/or vaccinated individuals and compared the SARS-CoV-2 IgG II Quant assay (Abbott), LIAISON SARS-CoV-2 TrimericS IgG (Diasorin), Elecsys Anti-SARS-CoV-2 S (Roche), and SARS-CoV-2 IgG (Siemens) with results obtained from a virus neutralization test. Based on the cut off values given by Abbott, Diasorin, Roche, and Siemens, the positive serologic results were concordant with the virus neutralization test in 100%, 76%, 88%, and 71%, respectively, while in turn, negative ones were in agreement in 29%, 79%, 93%, and 86%, respectively. In conclusion, weakly positive, serologic results are challenging to correctly predict the presence of neutralizing antibodies. Our study suggests, that different cut off values (for positivity vs. presence of neutralizing antibodies) could improve the test's performance, but determination thereof requires more samples to be analysed. Based on the cut off values given by Abbott, Diasorin, Roche, and Siemens, the positive serologic results were concordant with the virus neutralization test in 100%, 76%, 88%, and 71%, respectively, while in turn, negative ones were in agreement in 29%, 79%, 93%, and 86%, respectively. In conclusion, weakly positive, serologic results are challenging to correctly predict the presence of neutralizing antibodies. Our study suggests, that different cut off values (for positivity vs. presence of neutralizing antibodies) could improve the test's performance, but determination thereof requires more samples to be analysed. A key-step to overcome the corona pandemic is a high percentage of people having recovered from an infection or have been vaccinated in order to get a sufficient cellular and/or humoral immune response. Gold-standard to assess the extent of humoral response are virus neutralisation tests using viable viruses to quantify the presence of neutralizing antibodies. As they require specialized laboratory equipment and biosafety measures (level 3), they cannot be performed at large scale for population wide studies. Modifications thereof, such as pseudovirus neutralization tests or surrogate virus neutralisation tests can be conducted with a reduced workload under lower safety levels but are still more time consuming than fully automated high throughput SARS-CoV-2 serologic assays to quantify antibodies against SARS-CoV-2. However, the latter not necessarily measure neutralizing antibodies, thus manufacturers have recently evaluated the correlation of their quantitative antibody assays with virus neutralization titres (VNT), and have subsequently provided this information and cut-offs as surrogate for virus neutralization tests. Furthermore, external clinical correlation studies were performed and published [1] [2] [3] [4] [5] [6] [7] . The correlation studies were usually performed across a broad range of (mainly high) antibody levels against SARS-CoV-2. Interpretation of borderline reactive and weakly positive antibody results remains challenging in clinical practice. As of yet the correlation between antibody test results and neutralization titres stated by the manufacturers apply only for convalescent patients after COVID-19 infection but do not necessarily apply to subjects after vaccination. For both groups of subjects the exact cut-off of the different antibody tests which grossly guarantees a positive VNT has to be established urgently and harmonized among laboratories. Therefore, as part of our clinical routine assay validation, we briefly investigated the agreement between antibody levels especially in the borderline range and a VNT, including samples of vaccinees. We first applied our routinely used assay, the SARS-CoV-2 IgG II Quant assay (Abbott) to identify negative, borderline, and (high) positive samples (Table 1 ) in respect to the manufacturer's cut off value for positivity (7.1 BAU/ml), above which a 100% positive agreement with positive neutralization titres is predicted by Abbott. In addition, we also analysed in parallel these samples with the following quantitative assays: LIAISON SARS-CoV-2 TrimericS IgG (Diasorin), Elecsys Anti-SARS-CoV-2 S (Roche), and SARS-CoV-2 IgG (Siemens) using the cut off values of 33.8 BAU/ml, 15 BAU/ml, and 21.6 BAU/ml, respectively. A virus neutralization test with authentic, live SARS-CoV-2 virus was conducted as described [8] and TCID50 virus neutralisation titres equal or higher than 4 were considered as positive. Details on sample characteristics are given in Table 1 . when using the manufacturer's cut off. In turn, Roche gave the highest NPA (93%) while still possessing a high PPA (88%) in our setting. This is also reflected in the TPA, where Roche performed best (90%) followed by Diasorin (77%), Siemens (77%) and Abbott (68%). Briefly, we compared the performance for the low positive samples only (i.e. exclusion of the 9 samples above 100 BAU/ml). In this case (Table S1 ) the TPA is less affected in the case of Roche (86%) compared to Diasorin (68%), Siemens (68%) and Abbott (55%). In a last step, we identified for each assay the sample with the lowest antibody concentration above which all samples resulted in a positive VNT in our setting (in comparison to the manufacturers' cut off): Abbott ≥48 BAU/ml (7.1 BAU/ml), Diasorin ≥82 BAU/ml (33.8 BAU/ml), Roche ≥26 BAU/ml (15 BAU/ml), Siemens ≥39 BAU/ml (21.6 BAU/ml). Due to the small number of samples, these values should not be considered as suggestions for improved cut off values, but raise concern thatfor all assaysweakly/low positive results can be challenging to interpret in regard to their clinical meaning although in general a good qualitative agreement has been reported for various antibody tests with VNT in larger populations of COVID-19 patients or vaccinees [2, 7] . False positive serologic results are more critical than false negative ones as they pretend the presence of neutralizing antibodies. To resolve this, establishment of different cut off values, one to detect antibodies and (a higher) to correlate with neutralizing antibodies, is suggested as already given only by Roche (15 BAU/ml compared to 0.8 BAU/ml as cut-off for reactivity). In addition, the Roche assay detects all classes of high affinity antibodies. Sterlin et. al. showed that IgA dominates the neutralizing response especially in the early stage (< 28 d after symptom onset) [9] . These may be the reasons why Roche exhibited the best qualitative agreement in our setting while the other manufacturers suggest the same cut-off value for both questions and only detect IgG antibodies. Nevertheless, discrepant results persisted to a different extend for all assays. In our point of view, this is due to the lack of standardized procedures to validate the correlation to neutralization antibodies, including 1) limited information on sample selection and range of antibody concentra-tion in the manufacturers' cohorts, 2) use of different methodologies (virus neutralization test in the case of Abbott, Diasorin and Siemens vs. an in vitro surrogate ELISA for neutralizing antibodies in the case of Roche) and 3) different targets and antibody populations evaluated by the various serologic assays: total, high affinity antibodies (including IgG) against S1-RBD in the case of Roche, IgG against the entire trimeric S-protein (Diasorin), IgG against the S1-RBD domain only (Abbott, Siemens). Virus neutralization tests on the other hand are able to detect all antibody isotypes with neutralizing activity targeting the S1-RBD but also other neutralizing epitopes on the spike protein: Non-RBD spike antibodies, such as the Nterminal directed ones were found to be protective in convalescent plasma donors [10] and thus these antibodies should contribute to the results obtained with the Diasorin assay (entire Spike protein) and VNTs. In conclusion, SARS-CoV-2 antibody tests are valuable to indicate previous infection as well as a serological response to previous infection or vaccination against COVID-19. However, especially weakly positive antibody levels should be interpreted with caution regarding the presence of neutralizing antibody levels based on the manufacturer's cut off values. Doing so, false positive results may be predicted and therefore, re-evaluation of these cut off based on a larger number of borderline samples is recommended. In addition, all these correlations are only in vitro-based and neither a clinically protective (lowest) antibody level nor a protective virus neutralization titre is yet established. All procedures were in accordance with the ethical standards of the Institutional and/or National Research Committee and with the 1964 Helsinki declaration and its later amendments. We only used retrospective data, which were part of the routine diagnostics (determination of antibodies against SARS-COV-2, e.g.), and analysed remnant samples (no additional blood draw) for comparative assay validation purposes during the ongoing COVID-19 pandemic. This investigation had no effect on the treatment of the patients studied. High positive (>100 BAU/ml) 9 Total 31 Abbreviations: IQR, interquartile range. * Sample selection based on the Abbott test. Antibody levels in a range from 6-16 BAU/ml around the off value of the manufacturer (7.1 BAU/ml) were considered borderline in our setting. Clinical validation of the Siemens quantitative SARS-CoV-2 spike IgG assay (sCOVG) reveals improved sensitivity and a good correlation with virus neutralization titers Analytical and clinical performances of a SARS-CoV-2 S-RBD IgG assay: comparison with neutralization titers Correlation of SARS-CoV-2 Neutralizing Antibodies to an Automated Chemiluminescent Serological Immunoassay SARS-CoV-2 Serologic Assay Needs for the Next Phase of the US COVID-19 Pandemic Response Comparison of Four SARS-CoV-2 Neutralization Assays. Vaccines (Basel) Association between SARS-CoV-2 Neutralizing Antibodies and Commercial Serological Assays Serological Assays for Assessing Postvaccination SARS-CoV-2 Antibody Response A comprehensive antigen production and characterisation study for easy-to-implement, specific and quantitative SARS-CoV-2 serotests IgA dominates the early neutralizing antibody response to SARS-CoV-2 Prevalent, protective, and convergent IgG recognition of SARS-CoV-2 non-RBD spike epitopes Alexander Egger: conceptualization, Investigation (serologic assays), validation, formal analysis, visualization, writing -original draft Christoph Winkler: conceptualization, investigation (serologic assays) Christian Irsara: Investigation (serologic assays), formal analysis, writing -review and editing Investigation (virus neutralization test), writing -review and editing Gregor Hoermann: conceptualization, validation, writing -original draft, supervision Markus Anliker: conceptualization, writing -review and editing, resources, supervision The authors acknowledge Robert Kiechl (Abbott), Harald Schwarz (Diasorin), Erik Alk (Roche), and Gernot Osterer (Siemens) for technical support. AE, CW, CI, WP performed or analysed serological tests. BHo and BHa performed virus neutralization tests. RB-W, and GW obtained clinical data. AE and CI performed statistical analysis. AE, CI, AG, GH and MA designed the study and wrote the paper. All authors revised and approved the final manuscript. No potential conflict of interest relevant to this article were reported. None declared. No potential conflict of interest relevant to this article.