key: cord-0718734-nu3xp2oj
authors: Münsterkötter, Lennart; Hollstein, Moritz Maximilian; Hahn, Andreas; Kröger, Andrea; Schnelle, Moritz; Erpenbeck, Luise; Groß, Uwe; Frickmann, Hagen; Zautner, Andreas Erich
title: Comparison of the Anti-SARS-CoV-2 Surrogate Neutralization Assays by TECOmedical and DiaPROPH-Med with Samples from Vaccinated and Infected Individuals
date: 2022-02-03
journal: Viruses
DOI: 10.3390/v14020315
sha: f0854abbacfccefb278ab976bdee8e0d8d990e4a
doc_id: 718734
cord_uid: nu3xp2oj

Anti-SARS-CoV-2-specific serological responses are a topic of ongoing evaluation studies. In the study presented here, the anti-SARS-CoV-2 surrogate neutralization assays by TECOmedical and DiaPROPH -Med were assessed in a head-to-head comparison with serum samples of individuals after vaccination as well as after previous infection with SARS-CoV-2. In case of discordant results, a cell culture-based neutralization assay was applied as a reference standard. The TECOmedical assay showed sensitivity and specificity of 100% and 61.3%, respectively, the DiaPROPH-Med assay 95.0% and 48.4%, respectively. As a side finding of the study, differences in the likelihood of expressing neutralizing antibodies could be shown for different exposition types. So, 60 of 81 (74.07%) of the samples with only one vaccination showed an expression of neutralizing antibodies in contrast to 85.71% (60 of 70 samples) of the samples with two vaccinations and 100% (40 of 40) of the samples from previously infected individuals. In conclusion, the both assays showed results similar to previous assessments. While the measured diagnostic accuracy of both assays requires further technical improvement of this diagnostic approach, as the calculated specificity values of 61.3% and 48.4%, respectively, appear acceptable for diagnostic use only in populations with a high percentage of positive subjects, but not at expectedly low positivity rates.

Although protective immunity is considered a key element in order to overcome the COVID-19 pandemic, vaccine-induced immune-protection is not associated with sterile immunity and is prone to be undermined by virus variants [1] . Serological screening assays were rapidly developed along with the global spread of SARS-CoV-2 [2, 3] . However, it soon became obvious that the reliability of such diagnostic strategies depends on various factors including uneven geographic distributions of cross-reacting antibodies [4] .

Further, it was clear that the functionality of adaptive immunological components is more important than just sole quantity [5] . In line with this, it became evident that a diagnostic focus should be on the neutralizing the potency of detected anti-SARS-CoV-2-antibodies [6, 7] . Correlations between the severity of clinical courses of COVID-19 disease and neutralizing antibody titers could be shown [8] [9] [10] [11] .

To circumvent the need for laborious and time-consuming tissue culture infecting dose-(TCID-) assays for the assessment of the neutralizing potency of anti-SARS-CoV-2-antibodies, alternative diagnostic strategies were implemented and tested. Those attempts comprised correlations of total and neutralizing anti-SARS-CoV-2-antibodies [12] [13] [14] [15] . In addition, however, specific antigenic target structures were identified in order to develop surrogate neutralization assays for testing for antibodies specific to those critical epitopes [16, 17] .

In the meantime, numerous cellular and acellular surrogate neutralization assays have been introduced and evaluated . Such evaluations of both neutralizing and overall anti-SARS-CoV-2-antibodies comprised both natural infections and post-vaccination states [46] [47] [48] [49] [50] . Next to neutralizing potency, antibody avidity was included in the long-term assessments as well [51] .

In the study presented here, two surrogate neutralization assays, i.e., the TECO SARS-CoV-2 Neutralization Antibody Assay (TECOmedical AG, Sissach, Switzerland), for which previous assessments had suggested imperfect sensitivity and specificity in the 90% range [24, 25] , and the DIA-SARS-CoV-2-nAb (DiaPROPH Med, Kiev, Ukraine) surrogate neutralization assay, were compared in a head-to-head assessment with serum samples from vaccinated and infected individuals. The choice of the assays was based on the fact that first evaluation results for the TECOmedical assay were already available [24, 25] allowing at least a rough estimation of the credibility of the results of the present study, while no peer-reviewed published data on the DiaPROPH assay were available so far. By applying this approach, this communication intends to contribute to the puzzle of diagnostic accuracy assessment of commercially available serological SARS-CoV-2 assays. Quantitative measurement of overall-anti-SARS-CoV-2 antibodies and avidity testing were comparatively added and contradicting results in the surrogate neutralization assays were finally decided by a cell culture-based neutralization assay.

For the assessment, 81 serum samples were obtained after the first vaccination against SARS-CoV-2, 70 serum samples after the second vaccination against SARS-CoV-2 and 40 samples from individuals with a history of natural infections with the SARS-CoV-2 virus. For the vaccinees, who were participants in the COV-ADAPT study [52] , anti-SARS-CoV-2-NCP-ELISA (IgG) (Euroimmun, Lübeck, Germany) excluded anti-nucleocapsid-IgGs (NCP) to rule out infection with SARS-CoV-2 before vaccination. Negative results were a prerequisite for being included in the assessment. Vaccinations had been performed with various combinations of Vaxzevria (AstraZeneca, Cambridge, UK) or Comirnaty (Biontech, Mainz, Germany). Infections that occurred during a period when the Wuhan wild type variant was prevalent had been ensured by real-time PCR. Based on the various combinations of possible expositions, three different exposition types, i.e., natural infection, exposure to one vaccination and exposure to two vaccinations, were defined.

All sera were comparatively assessed for neutralizing anti-SARS-CoV-2 antibodies using the surrogate neutralization assays TECO SARS-CoV-2 Neutralization Antibody Assay (TECOmedical AG, Sissach, Switzerland) and DIA-SARS-CoV-2-nAb (DiaPROPH Med, Kiev, Ukraine; distributed by AlphaScience GmbH, Riedstadt, Germany) as described by the manufacturer using the DSX Automated ELISA System (Thermo Labsystems, Chantilly, VA, USA). Both assays are competitive ELISAs. In detail, during the TECO SARS-CoV-2 Neutralization Assay (later also referred to as the "TECOmedical surrogate neutralization assay"), anti-SARS-CoV-2-IgG present in tested sera are bound to a conjugate during preincubation ( Figure 1 ). The conjugate consists of a HRP-(horseradish peroxidase-) labelled receptor binding domain of the viruses' spike protein. Formed complexes block the conjugate's interaction with ACE2-receptors on the solid phase. Added tetramethylbenzide (TMB) substrate then reacts with the remaining conjugate that successfully interacted with the mentioned receptors. When read at 450/620 nm, the sample's OD is inversely correlated with the concentration of present neutralizing antibodies. In contrast to that, the DIA-SARS-CoV-2-nAb (later also referred to as "DiaPROPH-Med surrogate neutralization assay) makes use of an HRP-labelled recombinant human spike protein as a conjugate, which directly competes with neutralizing antibodies in the test wells ( Figure 2 ). The latter prevents the conjugate's interaction with recombinant human ACE2-receptors. TMB substrate is again used to detect HRP-labelled spike protein that successfully interacted with the solid phase. When read at 450/620 nm, the sample's OD is inversely correlated with the concentration of the present neutralizing antibodies.

In addition, all samples were subjected to an avidity assessment of anti-SARS-CoV-2 antibodies using the DIA-SARS-CoV-2-S-IgG-av avidity assay (DiaPROPH Med, Kiev, Ukraine; distributed by AlphaScience GmbH, Riedstadt, Germany; later also referred to as "DiaPROPH-Med antibody avidity assay").

To determine a sample's avidity, serum is placed in two wells simultaneously, hereafter referred to as the reference well and test well, respectively. In both wells, anti-SARS-CoV-2-IgG present in the sample are bound to immobilized recombinant SARS-CoV-2 spike protein on the solid phase. The test wells are then treated with a dissociation solution, which destroys low avidity antibody-antigen complexes formed in the first step. Remaining complexes in both wells are then detected by an HRP-labelled monoclonal anti-human IgG. TMB is added as the substrate for the enzymatic reaction. When read at 450/620 nm, the reference well's OD is directly correlated with the concentration of present anti-SARS-CoV-2-IgG. The test well's OD relative to the reference well's OD is used to calculate the RAI (Relative Avidity Index). If the reference wells indicate quantitative IgG above a cut-off, results can be interpreted as low avidity (RAI < 40%) and high avidity (>40%). A schematic visualization is provided in Figure 3 . Measurement of the total IgG-antibodies directed against the receptor binding domain of the SARS-CoV-2 spike protein (anti-spike-RBD-IgG) were assessed applying the SARS-CoV-2-IgG-II-Quant assay on the Architect i2000SR analyzer (Abbott, North Chicago, IL, USA, later also referred to as "total S-antigen-specific anti-SARS-CoV-2-IgG assay").

Serum samples that showed discrepant results in the surrogate neutralization assays were additionally tested with a tissue culture infecting dose (TCID)-based neutralization assay. Serum samples were serially diluted and incubated with 250 pfu/mL SARS-CoV-2 virus for 1h at room temperature. Antibody-virus mixtures were added to 96-well plates containing monolayers of Vero E6 cells (ATCC CRL-1586). Cells were cultured at 37 • C until cytopathic effect was observed. Neutralization titers were expressed as TCID. Titers ≤ 1:4 were considered negative.

Both surrogate neutralization assays were tested against a composite reference standard consisting of their combined results. In detail, samples with concordantly positive results in both surrogate neutralization assays were considered as "truly" positive for neutralization antibodies, samples with concordantly negative results as "truly" negative. In case of discordant results of the composite reference standard, the TCID-(tissue culture infecting dose-)based neutralization assay was applied for confirmatory testing. Its results were considered as definite. Based on those assumptions, diagnostic accuracy values were calculated for both surrogate neutralization assays. To ensure hardest possible assessment conditions, "indetermined" results were counted as "negative" for the sensitivity assessment and as "positive" for the specificity assessment.

In addition, it was assessed whether different exposition types either to SARS-CoV-2 or to vaccination were associated with an increased or a decreased likelihood of expressing neutralizing antibodies. Further, the association of exposition types and antibody avidity values was assessed. Finally, correlation between titer levels of total S-antigen-specific anti-SARS-CoV-2 S-antibody titers on the one hand and antibody avidity values on the other hand with the levels of neutralizing antibodies as measured with both surrogate neutralization assays was assessed applying Spearman's correlation coefficient.

Considering the low number of included samples, assessments were restricted to descriptive statistics and simple statistic approaches like Fisher's exact test, Kruskal-Wallis rank sum testing and Wilcoxon rank sum testing.

Based on the abovementioned assumptions on "true positivity" and "true negativity" for the surrogate neutralization assays, calculated sensitivity of the TECOmedical assay and the DiaPROPH-Med assay were 100% and 95.0%, respectively, while specificity was 61.3% and 48.4%, respectively. Details are provided in Table 1 . In addition, the results of the Abbott total S-antigen-specific anti-SARS-CoV-2 IgG were given. For anti-spike IgG, a protective cut-off of 50 BAU/mL has been established by the World Health Organization (WHO). Cohen's kappa (95% CI) between the gold standard used in this study, based on concordance of surrogate neutralization assays and TCID assay results against the protective BAU/mL is 0.440 (0.274-0.605). The sensitivity and specificity of the Abbott total S-antigen-specific anti-SARS-CoV-2 IgG protective BAU/mL with respect to the standard used here are 88.8 and 58.1, respectively. 

Three types of exposition, i.e., one received vaccination, two received vaccinations, and natural SARS-CoV-2 infection were comparatively evaluated regarding an increased or a decreased likelihood of expressing neutralizing antibodies as well as with the levels of antibody avidity as measured with the DiaPROPH-Med avidity assay.

There was an association between exposition type and the overall likelihood of expressing neutralizing antibodies. While only 60 of 81 (74.07%) of the samples with only one vaccination showed an expression of neutralizing antibodies, this was the case for 85.71% (60 of 70 samples) of the samples from individuals with two vaccinations and 100% (40 of 40) of the samples from previously infected individuals. This association was statistically significant (Fisher's exact test, p value < 0.001).

There was also a difference between the levels of antibody avidity as measured with the DiaPROPH-Med avidity assay for the samples from individuals with one and two vaccinations as well as from already infected individuals. Also, differences were seen for the association of exposition type and neutralizing antibodies as measured by the surrogate neutralization assays with best neutralizing effects after two vaccines. The details on the avidity levels and surrogate neutralization levels by exposition type are indicated in Table 2 . Finally, correlation between anti-spike-RBD-IgG titers on the one hand and antibody avidity values on the other hand with the levels of neutralizing antibodies as measured with both surrogate neutralization assays was assessed using Spearman's correlation coefficient. The measured coefficients ranged from 0.19 to 0.88. All pairwise correlations were positive, indicating that higher titers in one assay were associated with higher titers in the other assay. The p-values of all calculated correlation coefficients were less than 0.05. Details are provided in Table 3 . 

The evaluation was conducted to comparably assess the diagnostic accuracy of two surrogate neutralization assays for the estimation of the neutralizing potential of anti-SARS-CoV-2 antibodies. The assessment confirmed good sensitivity of the TECOmedical assay, while its specificity scored worse than in previous assessments [24, 25] . The DiaPROPH-Med surrogate neutralization test performed slightly worse in direct comparison in terms of its sensitivity and specificity, but has a more balanced price-performance ratio. Accordingly, respective diagnostic results should be interpreted with care. Of note, indetermined results as indicated by the DiaPROPH-Med surrogate neutralization assay were interpreted in the strictest possible way to ensure a thorough assessment. So, "indetermined" was interpreted like "negative" for the sensitivity assessment and like "positive" for the specificity assessment. However, the sensitivity of both surrogate neutralization assays is markedly higher than considering protective BAU/mL of quantitative total S-antigen-specific anti-SARS-CoV-2 IgG testing.

As a side finding, it could be shown with both assays that the abundance of neutralizing antibodies was increased in individuals after two vaccines as well as in individuals with natural infection compared to individuals with just one vaccine. This finding is not surprising, as vaccination trials have shown increased neutralizing potential after repeated vaccination [53] . For maturation-related avidity testing, the findings pointed in similar direction. Finally, correlation analysis of anti-spike-RBD-IgG-antibodies, neutralizing antibodies, and antibody avidity did not lead to conclusive associations allowing reliable predictions, although positive correlation was shown for the most parameters.

The evaluation has a number of limitations. First, only a moderate number of samples could be included in the assessment. Second, cell culture-based neutralization assays could only be run in case of contradicting results due to organizational reasons and funding restrictions.

The assessment confirmed acceptable diagnostic sensitivity for both surrogate neutralization assays. In contrast, further technical improvement of both assays seems advisable to increase their specificity and so, their results should be interpreted with care. Nevertheless, surrogate neutralization assays appear superior compared with the assessment of protective BAU/mL based on quantitative total S-antigen-specific anti-SARS-CoV-2 IgG detection. 

The study was approved by the ethics committee of the University Medical Center Göttingen (21 May 2020 and 21 May 2021). Informed consent was obtained from all participants and study design and study implementation were performed in accordance with the guidelines of Good Clinical Practice (ICH 1996) and the Declaration of Helsinki. The study was registered with the German Clinical Trials Register (DRKS) under (DRKS00026029).

Informed consent was obtained from all participants and study design and study implementation were performed in accordance with the guidelines of Good Clinical Practice (ICH 1996) and the Declaration of Helsinki.

Data Availability Statement: All relevant data are shown within the manuscript. Raw data can be provided at reasonable request.

Community transmission and viral load kinetics of the SARS-CoV-2 delta (B.1.617.2) variant in vaccinated and unvaccinated individuals in the UK: A prospective, longitudinal, cohort study

Review of current advances in serologic testing for COVID-19

SARS-CoV-2 serologic assay needs for the next phase of the US COVID-19 pandemic response. Open Forum Infect. Dis. 2020, 8, ofaa555

Limited specificity of commercially available SARS-CoV-2 IgG ELISAs in serum samples of African origin

Function is more reliable than quantity to follow up the humoral response to the receptor binding domain of SARS-CoV-2 spike protein after natural infection or COVID-19 vaccination

Quantifying absolute neutralization titers against SARS-CoV-2 by a standardized virus neutralization assay allows for cross-cohort comparisons of COVID-19 sera

Understanding neutralising antibodies against SARS-CoV-2 and their implications in clinical practice

SARS-CoV-2 neutralizing antibodies in patients with varying severity of acute COVID-19 illness

SARS-CoV-2 neutralizing antibody levels are correlated with severity of COVID-19 pneumonia

Low serum neutralizing anti-SARS-CoV-2 S antibody levels in mildly affected COVID-19 convalescent patients revealed by two different detection methods

Clinical predictors of SARS-CoV-2 neutralizing antibody titers in COVID-19 convalescents: Implications for convalescent plasma donor recruitment

Comparative analyses of SARS-CoV-2 binding (IgG, IgM, IgA) and neutralizing antibodies from human serum samples

Evaluation of the correlation between the access SARS-CoV-2 IgM and IgG II antibody tests with the SARS-CoV-2 surrogate virus neutralization test

Performance of three SARS-CoV-2 immunoassays, three rapid lateral flow tests, and a novel bead-based affinity surrogate test for the detection of SARS-CoV-2 antibodies in human serum

Head-to-head evaluation of seven different seroassays including direct viral neutralisation in a representative cohort for SARS-CoV-2

Convalescent plasma anti-SARS-CoV-2 spike protein ectodomain and receptor-binding domain IgG correlate with virus neutralization

Neutralizing antibody and soluble ace2 inhibition of a replication-competent VSV-SARS-CoV-2 and a clinical isolate of SARS-CoV-2

A simple protein-based surrogate neutralization assay for SARS-CoV-2

A Multiplex microsphere IgG assay for SARS-CoV-2 using ACE2-mediated inhibition as a surrogate for neutralization

Performance of a surrogate SARS-CoV-2-neutralizing antibody assay in natural infection and vaccination samples

Evaluation of a multi-species SARS-CoV-2 surrogate virus neutralization test

A combined strategy to detect plasma samples reliably with high anti-SARS-CoV-2 neutralizing antibody titers in routine laboratories

Comparison of two assays to detect IgG antibodies to the receptor binding domain of SARS-CoV-2 as a surrogate marker for assessing neutralizing antibodies in COVID-19 patients

Utility of different surrogate enzyme-linked immunosorbent assays (sELISAs) for detection of SARS-CoV-2 neutralizing antibodies

Two novel SARS-CoV-2 surrogate virus neutralization assays are suitable for assessing successful immunization with mRNA-1273

Validation and clinical evaluation of a SARS-CoV-2 surrogate virus neutralisation test (sVNT)

Comparison of two commercial surrogate ELISAs to detect a neutralising antibody response to SARS-CoV-2

Validation of a commercially available indirect assay for SARS-CoV-2 neutralising antibodies using a pseudotyped virus assay

Evaluation of a Surrogate enzyme-linked immunosorbent assay-based severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) cPass neutralization antibody detection assay and correlation with immunoglobulin G commercial serology assays

Establishment of a well-characterized SARS-CoV-2 lentiviral pseudovirus neutralization assay using 293T cells with stable expression of ACE2 and TMPRSS2

Evaluation of a commercial culture-free neutralization antibody detection kit for severe acute respiratory syndromerelated Coronavirus-2 and comparison with an antireceptor-binding domain enzyme-linked immunosorbent assay

Evaluation of a SARS-CoV-2 surrogate virus neutralization test for detection of antibody in human, canine, cat, and hamster sera

A surrogate virus neutralization test to quantify antibody-mediated inhibition of SARS-CoV-2 in finger stick dried blood spot samples

Measuring SARS-CoV-2 neutralizing antibody activity using pseudotyped and chimeric viruses

A surrogate cell-based SARS-CoV-2 spike blocking assay

Evaluation of cell-based and surrogate SARS-CoV-2 neutralization assays

Semi-quantitative, high throughput analysis of SARS-CoV-2 neutralizing antibodies: Measuring the level and duration of immune response antibodies post infection/vaccination

Correlation of sample-to-cut-off ratio of anti-SARS-CoV-2 IgG antibody chemiluminescent assay with neutralization activity: A prospective multi-centric study in India

Evaluation of a commercially-available surrogate virus neutralization test for severe acute respiratory syndrome coronavirus-2 (SARS-CoV-2)

Evaluating humoral immunity against SARS-CoV-2: Validation of a plaque-reduction neutralization test and a multilaboratory comparison of conventional and surrogate neutralization assays

IMMUNO-COV v2.0: Development and validation of a high-throughput clinical assay for measuring SARS-CoV-2-Neutralizing antibody titers

Comparison of potency assays to assess SARS-CoV-2 neutralizing antibody capacity in COVID-19 convalescent plasma

NeutrobodyPlex-monitoring SARS-CoV-2 neutralizing immune responses using nanobodies

SARS-CoV-2 assays to detect functional antibody responses that block ACE2 recognition in vaccinated animals and infected patients

St Jude Investigative Team; et al. An Assessment of Serological Assays for SARS-CoV-2 as Surrogates for Authentic Virus Neutralization

Comparing results of five SARS-CoV-2 antibody assays before and after the first dose of ChAdOx1 nCoV-19 vaccine among health care workers

Comparison of the results of five SARS-CoV-2 antibody assays before and after the first and second ChAdOx1 nCoV-19 vaccinations among health care workers: A prospective multicenter study

Durability of antibody response to vaccination and surrogate neutralization of emerging variants based on SARS-CoV-2 exposure history

Evaluation of SARS-CoV-2 neutralization assays for antibody monitoring in natural infection and vaccine trials

Chemiluminescence immunoassay based serological immunoassays for detection of SARS-CoV-2 neutralizing antibodies in COVID-19 convalescent patients and vaccinated population

Marked increase in avidity of SARS-CoV-2 antibodies 7-8 months after infection is not diminished in old age

Interdependencies of Cellular and Humoral Immune Responses in Heterologous and Homologous SARS-CoV-2 Vaccination

Safety and immunogenicity of two RNA-based COVID-19 vaccine candidates

We thank Kristin Cebulski for excellent technical assistance in performing the cell culture-based neutralization assays.

The authors declare no conflict of interest.