key: cord-0890116-c4d9x2qy
authors: de la Guardia, Carolina; Rangel, Giselle; Villarreal, Alcibiades; Goodridge, Amador; Fernández, Patricia L.; Lleonart, Ricardo
title: Development of in-house, indirect ELISAs for the detection of SARS-CoV-2 spike protein-associated serology in COVID-19 patients in Panama
date: 2021-09-14
journal: PLoS One
DOI: 10.1371/journal.pone.0257351
sha: aa781a0e86af70109dc7777c97d4161940cc537f
doc_id: 890116
cord_uid: c4d9x2qy

COVID-19 is the name of the acute respiratory disease caused by the new coronavirus SARS-CoV-2, a close relative of those that caused the severe outbreaks of SARS and MERS several years ago. Since first appearance on December of 2019, the COVID-19 pandemic has cause extremely high levels of mortality, morbidity, global economic breakdown, and the consequent human suffering. The main diagnostic test for the confirmation of symptomatic individuals is the detection of viral RNA by reverse transcriptase–quantitative real time PCR (RT-PCR). Additionally, serology techniques, such as ELISA are useful to measure the antibodies produced in humans after contact with the virus, as well as the direct presence of viral antigens. In this study we aim to assemble and evaluate four ELISA assays to measure the presence of IgG or IgM specific for the viral Spike protein in COVID-19 patients, using either the full recombinant SARS-CoV-2 Spike protein or the fragment corresponding to the receptor binding domain. As a control, we analyzed a group of pre-pandemic serum samples obtained before 2017. Strong reactivity was observed against both antigens. A few pre-pandemic samples displayed high OD values, suggesting the possibility of some cross reactivity. All four assays show very good repeatability, both intra- and inter-assay. Receiver operating characteristic analysis allowed the definition of cutoffs and evaluation of performance for each ELISA by estimation of the area under the curve. This performance parameter was high for all tests (AUC range: 0.98–0.99). Multiple comparisons between tests revealed no significant difference between each other (P values: 0.24–0.95). Our results show that both antigens are effective to detect both specific IgG and IgM antibodies, with high sensitivity (range 0.92–0.99), specificity (range 0.93–0.97) and congruence with the RT-PCR test (Cohen´s Kappa range 0.87–0.93). These assays will allow health authorities to have a new tool to estimate seroprevalence, in order to manage and improve the severe sanitary situation caused by this virus.

a1111111111 a1111111111 a1111111111 a1111111111 a1111111111

The new coronavirus disease 2019 (COVID-19) is a highly infectious disease caused by the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) that has become a worldwide pandemic with huge human and economic costs [1] . Most patients with COVID-19 develop a mild to severe respiratory illness, while others develop minimally-or asymptomatic infection [2] . Several investigations have shown that asymptomatic patients can also spread the disease [3] . Since COVID-19 was declared a global pandemic, the world has suffered more that 130 million confirmed cases and 2.8 million deaths [4] . The Americas have also been strongly affected, with more than 58 million confirmed cases and 1.4 million deceased patients (as of April 11, 2021) [5, 6] . The last available situation report for Panama, dated April 6, 2021, shows 356,373 confirmed cases and 6,131 deceased [7] .

Virus specific reverse transcriptase-polymerase chain reaction (RT-PCR) has become the assay of choice to rapidly detect viral RNA sequences in acute infection of either symptomatic subjects or their contacts [8] . For symptomatic individuals, the gold standard for testing is still the RT-PCR on nasopharyngeal swab samples [9, 10] . However, RT-PCR is not devoid of important limitations, such as false-negative results [11] [12] [13] [14] [15] , variability in accuracy for different types of specimens [10] , hazardous sample collection procedure [16] and sensitivity issues [11, 16] .

Besides RT-PCR, the use of serological techniques has become an important tool for the management of the COVID-19 pandemic. In symptomatic individuals, serology testing may also help understand important aspects of the disease, such as the duration of virus-specific antibodies [17] . For asymptomatic individuals, serology testing contributes to answer epidemiological questions, including virus exposure in general population or in high-risk groups, to plan public health interventions, and to monitor vaccine applications and performance [17] . In fact, we recently evaluated the performance of a rapid lateral flow immunoassay to detect IgM/IgG antibodies against SARS-CoV-2 [18] . However, this type of rapid tests may present some limitations, such as not allowing quantitation of antibody titers or suboptimal sensitivity [19] . In contrast, better results may be obtained by tests based on the enzyme-linked immunosorbent assay (ELISA), which are easy and convenient to implement [20] .

The humoral response of humans to the SARS-CoV-2 is apparently dominated by the production of antibodies specific for several structural proteins of the virion, mainly the Spike (S) and the Nucleocapsid (N) proteins [21] . Here we report the use of recombinant S protein, either as a full-length antigen, or just the fragment corresponding to the receptor binding domain (RBD) to assemble in-house, indirect enzyme-linked immunosorbent assays (ELISAs) for the detection of SARS-CoV-2-specific IgG and IgM antibodies. We also report the performance of the tests using a group of local COVID-19 patients and pre-pandemic serum samples collected before 2017. Our results confirm the usefulness of these antigens for the ELISA, opening the possibility for conducting new local studies for better knowledge and management of the disease in the country.

The study population represents a sub cohort of a cross-sectional study conducted between April and December 2020 [18] . Clinical serum samples were obtained from 102 hospitalized patients confirmed to be positive for SARS-CoV-2 viral infection by reverse transcriptase polymerase chain reaction (RT-PCR, done by a national reference lab) on nasopharyngeal swab testing. All participants develop mild to moderate clinical symptoms and were treated in public hospitals located in Panama and Colon cities. As negative control samples, 45 pre-pandemic serum samples were used from de-identified, bio-banked sera stored at INDICASAT-AIP. These samples correspond to research projects on tuberculosis serosurveillance, including 15 patients with active pulmonary tuberculosis, 15 patients with latent TB infections and 15 healthy individuals from blood bank. Venous blood samples were collected using Serum separator tubes (SST™ II advance, BD Vacutainer, VWR, No. BDAM368879). Immediately after collection, tubes were inverted six times, left at room temperature for 30 min, then centrifuged at room temperature for 10 min at 1300 x g. Serum samples were aliquoted and frozen at -80˚C until testing. Prior to analysis, all serum samples were heat-inactivated at 56˚C for one hour [22, 23] .

Clinical serum samples from COVID-19 patients were collected as part of a cross-sectional study registered with the Panama Ministry of Health (No.1462) and was approved by the National Research Bioethics Committee (CNBI; No. EC-CNBI-2020-03-43). Pre-pandemic serum samples were taken in Colon province, with ethical clearance No. 1131/CNBI/ICGES/ 11 and No. 125/CBI/ICGES/14. All study participants were enrolled after written informed consent was given.

Recombinant antigens used for ELISA were donated by Dr Florian Krammer, and consisted of 1) recombinant RBD fragment, corresponding to amino acids 319-541 plus a His tail, and 2) the full spike protein, modified as described for stabilization and multimerization (aa 1-1213) [24] . Before use, recombinant protein batches were verified for concentration and integrity by SDS-PAGE (S1 Fig).

The ELISA assays were implemented to detect SARS-CoV-2-specific IgG and IgM antibodies specific to S or RBD antigens. Protocol was adapted from Stadlbauer et al. (2020) [22] . Briefly, 96-well high binding microtiter plates (Corning Costar no. 3361) were coated with 50 μL of RBD or S recombinant protein (both at 2 μg/mL) in 1X Phosphate Buffered Saline (PBS), overnight at 4˚C. The next day, wells were washed three times with 250 μL of PBST (PBS containing 0.1% Tween 20) and blocked for 2 h at room temperature (RT) with 200 μL of 1.5% nonfat dry milk (NFM) in PBST. Plates were washed as before and serum samples added in 100 μL, prediluted 1:50 in PBST with 0.5% NFM, and incubated 2 h at RT. After similar washing, secondary conjugated antibody was added at 1:3,000 dilution in PBST with 0.5% NFM and incubated for 1 h at RT. Specific IgG and IgM antibodies were detected with anti-human HRP conjugates: goat anti-human IgG (H+L), Thermo Fisher No. H10307, or goat antihuman IgM (Heavy chain), Thermo Fisher No. A18835, respectively. Plates were then washed and 100 μL of substrate TMB (3, 3', 5, 5'-Tetramethylbenzidine Liquid substrate, Super Sensitive, Sigma) added and incubated for 5 min. Reaction was stopped with 50 μL of 1M HCl and immediately read at 450 nm (SynergyHT, BioTek).

All statistical analyses were carried out using Prism v9.1.0 (GraphPad, USA) and easyROC online calculator (http://www.biosoft.hacettepe.edu.tr/easyROC/). Results of data analysis are presented as estimated statistics and their 95% confidence intervals (CI), or coefficients of variation (%CV). Normality of the optical density data was tested using Kolmogorov-Smirnov procedure. Correlation between OD data and evolution time (time elapsed between the positive RT-PCR result and serum sampling) was assessed using nonparametric Spearman's rankorder correlation test. Receiver-operating characteristic (ROC) analysis was performed on ELISA OD data to calculate area under the curve (AUC) and optimal cut-off, based on procedures implemented in online calculator easyROC [25, 26] . Pairwise comparisons between the AUCs of described ELISA tests were done using the multiple comparison procedure implemented in easyROC. The performance of the tests was assessed by calculating sensitivity, specificity, and positive-and negative predictive values using contingency table analysis procedure as implemented in GraphPad Prism. Confidence intervals for each estimate was calculated following Wilson/Brown method as implemented in the same software. Based on cutoff calculated in the ROC analysis for each test, samples were classified as positive or negative, and agreement between RT-PCR test and ELISAs was assessed using Cohen's kappa statistic, calculated as described by Fleiss et al. 2003 [27] , using an online calculator (GraphPad QuickCalcs, USA). For all statistical analyses, P values < 0.05 were considered statistically significant.

Repeatability assessment was done by randomly selecting two positive serum samples, including one strongly positive (OD~2) and one weakly reactive (OD~0.6), and one negative. With these samples, ELISAs were repeated, in quadruplicates, over at least five different days. Then, coefficients of variation were calculated both intra-and inter-assay using OD data.

We implemented and evaluated in-house, indirect ELISAs to detect SARS-CoV-2 specific IgG or IgM antibodies in serum samples, using two recombinant viral proteins, the receptor binding domain of spike (RBD), or the full-length trimeric spike as previously reported [24] . For this study, we used serum samples from two groups, 102 COVID-19 patients and 45 pre-pandemic serums obtained from patients enrolled in previous studies (Table 1) . COVID-19 patients were enrolled from May 4 to December 27, 2020 at two hospital wards including: Complejo Hospitalario Dr. Arnulfo Arias Madrid in Panama City and Hospital Manuel Amador Guerrero, Colon City. All these patients had moderate symptoms and a positive RT-PCR test (median time of RT-PCR to serology, 14 days). Main clinical signs at admission were fever (76%), dysnea (72%) and cough (68%). Additionally, 73% reported to had at least one chronic disease, including hypertension (47%), type II diabetes (36%), and renal failure (11%). Prepandemic samples were obtained from subjects participating in tuberculosis (TB) research and surveillance programs at the Colon province, Panama.

Some COVID-19 samples were negative for all ELISA tests assayed, irrespective of their time of sampling after the RT-PCR positive result. These samples also tested negative previously in a rapid immunochromatography serology test measuring IgG and IgM [18] , therefore were considered non-responsive and not considered for the rest of the study. When using 1:50 dilution of samples, strong reactivity was observed in most COVID-19 samples, while vast majority of pre-pandemic ones remain negatives (Fig 1) . Some overlapping of OD values between COVID-19 and pre-pandemic samples was observed for all assays. IgG-detecting tests showed a more concentration of OD values in a strongly positive or negative zone, while OD values produced by IgMs were less defined regardless of the antigen used. A few samples (5) in the pre-pandemic group showed higher than expected values in some of the assays, particularly in the RBD-IgG ELISA (Fig 1) , suggesting potential crossreactivity with pre-existing antibodies.

To evaluate ELISA performance, we used receiver-operating characteristic (ROC) analysis using OD data (Table 2 ) and the area under the curve (AUC) graphs were constructed to graphically depict performance of the systems (Fig 2) . The area under the curve was high for all ELISA systems, with highest value for the RBD-IgG ELISA (range 0.98-0.99) suggesting an excellent performance in all cases. By performing all possible pairwise multiple comparisons of AUC for all ELISA tests, we could not observe significant differences, with P values ranging from 0.24 (RBD-IgG vs Spike-IgM) to 0.95 (RBD-IgM vs Spike-IgM), suggesting a high performance yet very similar for all tests. Using Youden approach for selecting cutoffs based on both sensitivity and specificity, the best values were estimated in a range of 0.48 to 0.93 units of absorbance (Table 2 ). Using these calculated cut-off values, samples were classified as positive and negative for subsequent analyses.

All four assays showed good estimated values for sensitivity, specificity, positive and negative predictive values, and Kappa statistics. Sensitivity values were higher for the RBD-IgG (Table 2) , as per the interpretation scale of Landis and Koch (1977) [28] .

We attempted to evaluate if there was a relationship between the time of evolution (time after the positive RT-PCR result) and optical density data for each ELISA. Normality of the OD data sets was tested using Kolmogorov-Smirnov test, resulting in rejection of normality. Therefore, correlation between OD and time variables was assessed using nonparametric Spearman's rank-order correlation test. Optical densities did not show significant correlation with evolution time for any of the described ELISAs (RBD-IgG: P = 0.19; RBD-IgM: P = 0.80; Spike-IgG: P = 0.13; Spike-IgM: P = 0.43; S2 Fig) . The same was observed by looking at the positivity rate for time period ranges (Table 3) .

To assess the repeatability of the assays we also measure the coefficient of variation (%CV) both intra-and inter-assays, by selecting several negative, weak positive and strong positive sera and measure the dispersion of the resulting ODs at several replicates within a plate and among several plates in different days ( Table 4 ). The values of CV ranged from 4% to 9%, well below the maximum tolerated of 15% for ELISA tests, indicating good performance in terms of repeatability.

In this study, we have evaluated four in-house ELISAs for the detection of antibodies against SARS-CoV-2 proteins. RBD-and full S-based ELISAs were used to detect IgM and IgG antibodies in serum samples of RT-PCR confirmed COVID-19 patients and pre-pandemic 19 group remain negative, a fact already observed by some authors that suggests a lack of-or a weak seroconversion [29] [30] [31] .

In terms of the temporal behavior of the seroconversion, we did not observe a clear pattern of increase positivity in time. In fact, most of our COVID-19 group samples show very early seroconversion, while some remain negative irrespective of their time since RT-PCR confirmation. This unusual trend is consistent with other reports indicating a much earlier seroconversion in COVID-19 patients [32] [33] [34] and a non-typical temporal pattern of responses for IgG and IgM [35] .

Interestingly, some of the samples of the pre-pandemic group showed high levels of reactivity, particularly in the RBD-IgG ELISA, suggesting possible crossreactivity with pre-existing antibodies. Several authors have shown antibody crossreactivity in the immune response to several coronaviruses in human samples [29, [36] [37] [38] .

Apart from highly pathogenic SARS-CoV, MERS-CoV and SARS-CoV-2, infections by other human coronaviruses are seldom reported, particularly in Panama and other countries of the region [39] . These viruses, however, are also able to cause severe disease in children, elderly patients and immunocompromised individuals [40] . Although heavily underreported, these coronaviruses have been circulating in several countries of the region, with estimated prevalence of about 5-7% of all influenza-like infections in Latin American countries including Brazil, Costa Rica and Colombia [41] . Although we could not assess the contact status of our pre-pandemic samples with other human coronaviruses, it is conceivable that some of them may have been exposed to these endemic coronaviruses and potentially developed crossreactive antibodies.

Our study presents however some limitations. The number of samples analyzed is still low. Additionally, to assess the relationship between positivity and evolution time we used the available date of RT-PCR confirmation, and this may not be a good surrogate of infection time. When available, studies should try to use the date of symptoms onset for better estimation of seroconversion time. It is also important to note that our COVID-19 cohort only include mild to moderate patients, and this fact may have influenced the strength of the immune response observed in our study. It has been shown that severity correlates with a more intense immune response and production of specific antibodies [42] [43] [44] [45] [46] . A more complete picture of the serology would have been obtained with patients from all the spectrum of the disease. Next steps should include testing of RT-PCR positive, asymptomatic subjects to characterize whether the tests are able to detect lower antibody levels likely expected in such situation.

Nevertheless, our results confirm previous reports indicating the usefulness of these antigens for assays to measure seroconversion after SARS-CoV-2 infections [24, [47] [48] [49] . The ELISA tests are simple to perform and very robust once optimized. Besides, since only a very small amount of sample is required, they are very convenient. Our results are consistent with those shown by others, suggesting that these serology assays have a very good potential for studies measuring virus exposure in large groups, as well as seroconversion and seroprevalence studies in Panama. Additionally, since current vaccines being applied in Panama are based on Spike protein as immunogen, these assays may be a useful asset to study their effect and monitor the general immunological status of the population on the way to the much-needed herd immunity. 

WHO. Novel Coronavirus Situation Report -10

World Health Organization

The prevalence of symptoms in 24,410 adults infected by the novel coronavirus (SARS-CoV-2; COVID-19): A systematic review and meta-analysis of 148 studies from 9 countries

Clinical Course and Molecular Viral Shedding among Asymptomatic and Symptomatic Patients with SARS-CoV-2 Infection in a Community Treatment Center in the Republic of Korea

WHO declares COVID-19 a pandemic

World Health Organization

Detection of 2019 novel coronavirus (2019-nCoV) by real-time RT-PCR. Eurosurveillance [Internet

Laboratory diagnosis of emerging human coronavirus infections-the state of the art

Emerging Microbes and Infections

Detection of SARS-CoV-2 in Different Types of Clinical Specimens

A case of imported COVID-19 diagnosed by PCR-positive lower respiratory specimen but with PCR-negative throat swabs

Positive rate of RT-PCR detection of SARS-CoV-2 infection in 4880 cases from one hospital in

Frequency of serological nonresponders and false-negative RT-PCR results in SARS-CoV-2 testing: A population-based study

Variation in False-Negative Rate of Reverse Transcriptase Polymerase Chain Reaction-Based SARS-CoV-2 Tests by Time Since Exposure

Diagnosis of the Coronavirus disease (COVID-19): rRT-PCR or CT?

Recent advances and perspectives of nucleic acid detection for coronavirus

Algorithms for testing COVID-19 focused on use of RT-PCR and high-affinity serological testing: A consensus statement from a panel of Latin American experts

Performance of a Point of Care Test for Detecting IgM and IgG Antibodies Against SARS-CoV-2 and Seroprevalence in Blood Donors and Health Care Workers in Panama

Diagnostic accuracy of serological tests for covid-19: Systematic review and meta-analysis

The ELISA, enzyme-linked immunosorbent assay

Clinical Chemistry

Antibody responses against SARS-CoV-2 in COVID-19 patients

SARS-CoV-2 Seroconversion in Humans: A Detailed Protocol for a Serological Assay, Antigen Production, and Test Setup

Repeated cross-sectional sero-monitoring of SARS-CoV-2 in New York City

A serological assay to detect SARS-CoV-2 seroconversion in humans

OptimalCutpoints: An R package for selecting optimal cutpoints in diagnostic tests

An Interactive Web-tool for ROC Curve Analysis Using R Language Environment

Statistical methods for rates and proportions

The Measurement of Observer Agreement for Categorical Data

Serological cross-reactivity using a SARS-CoV-2 ELISA test in acute Zika virus infection, Colombia

Preexisting and de novo humoral immunity to SARS-CoV-2 in humans

Multi-center nationwide comparison of seven serology assays reveals a SARS-CoV-2 non-responding seronegative subpopulation

Viral Kinetics and Antibody Responses in Patients with COVID-19. medRxiv

Serological immunochromatographic approach in diagnosis with SARS-CoV-2 infected COVID-19 patients

Rapid Generation of Neutralizing Antibody Responses in COVID-19 Patients

Antibody responses to SARS-CoV-2 in patients with COVID-19

S protein-reactive IGG and memory B cell production after human SARS-CoV-2 infection includes broad reactivity to the S2 subunit

Pediatric Severe Acute Respiratory Syndrome Coronavirus 2 (SARS-CoV-2): Clinical Presentation, Infectivity, and Immune Responses

Epitope-resolved profiling of the SARS-CoV-2 antibody response identifies cross-reactivity with endemic human coronaviruses

Coronavirus infections reported by ProMED

Origin and evolution of pathogenic coronaviruses

Respiratory viruses and influenza-like illness: Epidemiology and outcomes in children aged 6 months to 10 years in a multi-country population sample

High neutralizing antibody titer in intensive care unit patients with COVID-19. Emerg Microbes Infect

SARS-CoV-2-IgG response is different in COVID-19 outpatients and asymptomatic contact persons

Magnitude and Kinetics of Anti-Severe Acute Respiratory Syndrome Coronavirus 2 Antibody Responses and Their Relationship to Disease Severity

SARS-CoV-2 Antibody Responses Are Correlated to Disease Severity in COVID-19 Convalescent Individuals

SARS-CoV-2 specific antibody and neutralization assays reveal the wide range of the humoral immune response to virus

Severe Acute Respiratory Syndrome Coronavirus 2-Specific Antibody Responses in Coronavirus Disease Patients. Emerg Infect Dis

Serological assays for severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2)

A highly specific and sensitive serological assay detects SARS-CoV-2 antibody levels in COVID-19 patients that correlate with neutralization

We are very thankful to Dr. Florian Krammer (Department of Microbiology, Icahn School of Medicine at Mount Sinai, New York, NY, USA) for donation of the SARS-CoV-2 recombinant proteins used in this study. We thank all enrolled patients for their willingness to participate in the study. We are very grateful to Dr. Eduardo Ortega and Dr. Jagannatha Rao for continued support and useful advice during this study. We also thank MSc. Dilcia Sambrano, Dr. Carlos Restrepo, Dr. Diana Oviedo, BSc. Ambar Pérez-Lao, Dr. Odemaris Luque, Dr. Ana de Chavez, Dr. Julio Jurado, Dr. Nicolas Hurtado, Dr. Azael Gonzalez and BSc. Laiss Mudarra at Caja de Seguro Social and Ministerio de Salud in Colon City for their support during recruitment and sampling. We also thank support of Sistema Nacional de Investigación (SNI, SENACYT, Panama) for the authors A.V., A.G., P.L., and R.L.