key: cord-0997724-fknwxxkc
authors: Ko, J.-H.; Müller, M. A.; Seok, H.; Park, G. E.; Lee, J. Y.; Cho, S. Y.; Ha, Y. E.; Baek, J. Y.; Kim, S. H.; Kang, J.-M.; Kim, Y.-J.; Jo, I. J.; Chung, C. R.; Hahn, M.-J.; Drosten, C.; Kang, C.-I.; Chung, D. R.; Song, J.-H.; Kang, E.-S.; Peck, K. R.
title: Suggested new breakpoints of anti-MERS-CoV antibody ELISA titers: performance analysis of serologic tests
date: 2017-07-11
journal: Eur J Clin Microbiol Infect Dis
DOI: 10.1007/s10096-017-3043-3
sha: 687431d0054067f8265d04e56d7556be7c715a63
doc_id: 997724
cord_uid: fknwxxkc

To provide optimal cut-off values of anti-Middle East respiratory syndrome coronavirus (MERS-CoV) serologic tests, we evaluated performance of ELISA IgG, ELISA IgA, IFA IgM, and IFA IgG using 138 serum samples of 49 MERS-CoV-infected patients and 219 serum samples of 219 rRT-PCR-negative MERS-CoV-exposed healthcare personnel and patients. The performance analysis was conducted for two different purposes: (1) prediction of neutralization activity in MERS-CoV-infected patients, and (2) epidemiologic surveillance of MERS-CoV infections among MERS-CoV-exposed individuals. To evaluate performance according to serum collection time, we used ‘days post onset of illness (dpoi)’ and ‘days post exposure (dpex)’ assessing neutralization activity and infection diagnosis, respectively. Performance of serologic tests improved with delayed sampling time, being maximized after a seroconversion period. In predicting neutralization activity, ELISA IgG tests showed optimal performance using sera collected after 21 dpoi at cut-off values of OD ratio 0.4 (sensitivity 100% and specificity 100%), and ELISA IgA showed optimal performance using sera collected after 14 dpoi at cut-off value of OD ratio 0.2 (sensitivity 85.2% and specificity 100%). In diagnosis of MERS-CoV infection, ELISA IgG exhibited optimal performance using sera collected after 28 dpex, at a cut-off value of OD ratio 0.2 (sensitivity 97.3% and specificity 92.9%). These new breakpoints are markedly lower than previously suggested values (ELISA IgG OD ratio 1.1, sensitivity 34.8% and specificity 100% in the present data set), and the performance data help serologic tests to be practically used in the field of MERS management. ELECTRONIC SUPPLEMENTARY MATERIAL: The online version of this article (doi:10.1007/s10096-017-3043-3) contains supplementary material, which is available to authorized users.

Middle East respiratory syndrome coronavirus (MERS-CoV) is a novel beta coronavirus that may cause lethal respiratory disease [1] . Anti-MERS-CoV serologic tests including enzyme-linked immunosorbent assay (ELISA) and immunofluorescence assay (IFA) are available as commercial kits, and have been used for various purposes including epidemiologic investigations, evaluation of antibody kinetics, and assessing feasibility of convalescent plasma infusion therapy [2] [3] [4] [5] [6] . The manufacturer's instructions provided relatively high cut-off values for positivity to warrant specificity, which were derived from limited positive samples (ELISA IgG, Euroimmun, Lübeck, Germany; 4 MERS patient samples and 500 negative controls) [7] . In previously conducted serologic studies, cutoff values were differently applied depending on the purpose of serologic tests: several epidemiologic studies applied low cut-off values to increase sensitivity of the test [3, 6] , while others followed the manufacturer's instructions [2, 4] . Also, as not all confirmed MERS-CoV-infected patients mounted robust neutralization activity [2] , the performance of serologic tests should be separately analyzed depending on the purposes of the tests: predicting neutralization activity in MERS-CoVinfected patients and diagnosing MERS-CoV infection in epidemiologic surveillance. To provide optimal cut-off values depending on the purposes of the tests, we evaluated performance of various anti-MERS-CoV serologic tests using 138 serum samples of 49 MERS-CoV-infected patients and 219 serum samples of 219 rRT-PCR-negative MERS-CoV-exposed healthcare personnel (HCP) and patients.

The performance analysis included sensitivity, specificity, positive predictive value, and negative predictive value, and was conducted under two different purposes of serologic tests:

(1) prediction of neutralization activity in MERS-CoVinfected patients, and (2) epidemiologic surveillance of MERS-CoV infections among MERS-CoV-exposed individuals. Plaque reduction neutralization test (PRNT) and sputum real-time reverse transcriptase polymerase chain reaction (rRT-PCR) for MERS-CoV were used as gold standards for assessing neutralization activity and diagnosing MERS-CoV infection, respectively.

MERS-CoV exposure dates and symptom onsets of collected serum samples were clearly identified owing to thorough contact investigation and monitoring of exposed individuals [8] . To provide a common point of reference, we used 'days post onset of illness (dpoi)' assessing neutralization activity since symptom onset could be clearly identified among MERS-CoV-infected patients. Meanwhile, as epidemiologic surveillances are usually conducted on the basis of exposure events, we applied 'days post exposure (dpex)' assessing diagnostic performance of serologic tests in epidemiologic surveillance.

To compare performances of serologic tests depending on serum collection time, each test was evaluated at three different timepoints: (1) regardless of serum collection time, (2) after 14 dpoi (or 21 dpex), and (3) after 21 dpoi (or 28 dpex).

During the 2015 Korean MERS outbreak, we obtained 138 serum samples from 49 MERS-CoV infected patients. Study population included 42 patients who were managed at a 1950bed tertiary care university hospital [8, 9] , and seven patients who donated sera for plasma infusion therapy or serologic testing. MERS-CoV infections were confirmed on the basis of rRT-PCR assays targeting upstream of the E gene (upE) and the open-reading frame gene 1a (ORF1a) [10, 11] . Epidemiologic investigation data and electronic medical records were reviewed to obtain exact exposure date and symptom onset. One or two serum samples were collected per week of illness during hospitalization. Follow-up serum samples were obtained up to 6 months from symptom onset at an outpatient clinic. Sera of 219 rRT-PCR-negative MERS-CoV-exposed HCP and patients were used as negative control samples [3] . Collected samples were stored at −70°C for about three months before testing. The Institutional Review Board of Samsung Medical Center approved the present study.

Anti-MERS-CoV ELISA IgG and IgA (Euroimmun, Lübeck, Germany) were based on soluble MERS-CoV spike protein S1 domain expressed in HEK-293 T cells [ 6 , 12-14 ] . Sera were tested according to the manufacturer 's instructions with 1:100 dilutions. Secondary detection was done with peroxidase-labeled anti-human IgG and IgA. ELISA IgG was initially tested in all of the collected serum samples, and other serologic tests including ELISA IgA, IFA, and PRNT were selectively performed depending on ELISA IgG (using optical density (OD) ratio cut-off value of 0.2) and sputum rRT-PCR results (Table 1 ). Since IFA IgG was limitedly tested among an rRT-PCR-negative population, diagnostic performance for epidemiologic surveillance of IFA IgG could not be evaluated.

Anti-MERS-CoV IFA IgG and IgM (Euroimmun) were performed with slides carrying Vero cells infected with full MERS-CoV [12, 14, 15] . Sera were tested according to the manufacturer's instructions with 1:10 and 1:100 dilutions for IFA IgM and IgG, respectively.

For comparison of the performance of IFA IgG with that of ELISA IgG, 71 sera were selected for titration from 1:50 to 1:1000 dilutions, including sera collected between 14 and 27 dpoi (presumed window period of seroconversion) [4, 5] , and sera of patients who were serially sampled at least four times (Table 1) .

PRNT MERS-CoV PRNT was performed as previously described [12, 14] . Pre-dilution before setting up the log2-dilution series was 1:10, defining 1:20 as the lowest possible significant titer for categorizing a sample as positive [12] .

Cut-off values with optimal sensitivity and specificity were analyzed per 0.1 OD ratio or each IFA intensity. Areas under the curve (AUCs) were calculated using the receiver operating characteristic (ROC) curve. R-3.3.1 for Windows (RStudio, Boston, MA, USA) was used for all statistical analyses. ELISA IgG was initially tested in all collected samples, and other serologic tests were selectively performed depending on rRT-PCR and ELISA IgG results. A 0.2 OD ratio cut-off value was applied for ELISA, which was approximately three-fold compared with the median (0.06) value of 41 healthy individuals * Five sera that were collected late were not tested. † To compare performance in predicting neutralizing activity with ELISA IgG, anti-MERS-CoV IFA IgG was tested with titration from 1:50 to 1:1000 dilutions in selected sera of MERS-CoV-infected patients: 18 sera from 18 patients collected between 14 and 27 dpoi (presumed window period of seroconversion) and 53 sera from 12 patients whose sera were serially collected at least four times. ‡ To substantiate ELISA results, IFA IgG was tested in these samples at a 1:100 dilution, which was not included in performance analysis.

Middle East respiratory syndrome coronavirus, ELISA enzyme-linked immunosorbent assay, IFA immunofluorescence assay, PRNT plaque reduction neutralization test, rRT-PCR real-time reverse transcriptase polymerase chain reaction, HCP healthcare personnel, OD optical density, dpoi days post onset of illness

The performance of serologic tests improved with delayed sampling time, being maximized when sera collected after 21 dpoi were used (Fig. 1a) . In predicting neutralization activity, ELISA IgG and IFA IgM tests showed optimal performance using sera collected after 21 dpoi, at cut-off values of OD ratio 0.4 and weekly-positive IFA intensity, respectively ( Table 4 ).

In diagnosing MERS-CoV infection, ELISA IgG, ELISA IgA, and IFA IgM tests showed optimal performance using sera collected after 28 dpex, at cut-off value of OD ratio 0.2, OD ratio 0.2, and weakly-positive IFA intensity, respectively (Table 3) . Most values of rRT-PCRnegative MERS-CoV-exposed individuals were under these cut-off values, discriminating MERS-CoV-infected and non-infected individuals (Fig. 2) . Overall, ELISA IgG showed better performance than ELISA IgA or IFA IgM for diagnosing MERS-CoV infection (AUC 0.982, 0.914, and 0.875, respectively, when sera collected after 28 dpex were used). Performance of serologic tests improved with delayed sampling time, being maximized when sera collected after 28 dpex were used ( Fig. 1b and Supplementary Tables 5 to 7 ). In addition, the specificity of ELISA IgG, ELISA IgA, and IFA IgM tests was 100% regardless of serum collection time, at cut-off value of OD ratio 0.5, OD ratio 0.3, and IFA intensity 1+, respectively. MERS-CoV-exposed population. When sera collected after 28 dpex were used, sensitivity and specificity increased to 97.3 and 98.2, respectively. An ELISA OD ratio of 0.262 was the best cut-off value based on the ROC curve, and 0.2 was the optimal value on the basis of a 0.1 OD ratio. ROC receiver operating characteristic, MERS-CoV Middle East respiratory syndrome coronavirus, ELISA enzyme-linked immunosorbent assay, OD optical density, dpoi days post onset of illness, dpex days post exposure

Neutralization testing is a gold standard method for detecting antiviral antibodies, especially exhibiting virus-killing function. However, neutralization tests against MERS-CoV cannot be readily performed worldwide as it requires biosafety level 3 facilities, skilled experts, and carries a potential risk of infection [5] . To reduce such risks and workloads, previous anti-MERS-CoV serologic studies applied step-wise approaches using ELISA and IFA, which are relatively easy and safe to test [6, 12] . To make anti-MERS-CoV serologic tests more practical, we assessed performance of ELISA and IFA tests for two clinical purposes and suggested optimal cutoff values. Data are expressed as a percentage of each predictive value according to various cut-off values. Cut-off values with optimal sensitivity and specificity analyzed per 0.1 OD ratio (ELISA) or IFA intensity are presented as gray-scale. AUCs were calculated from the ROC curve. The population of this analysis is 49 MERS-CoV-infected patients confirmed by rRT-PCR (Table 1 ). The neutralization activity of sera was confirmed by PRNT and a 1:20 dilution was defined as the lowest significant titer.

Middle East respiratory syndrome coronavirus, ELISA enzyme-linked immunosorbent assay, AUC area under the curve, PPV positive predictive value, NPV negative predictive value, dpoi days post onset of illness, IFA immunofluorescence assay, w+ weak positive, OD optical density, ROC receiver operating characteristic, rRT-PCR real-time reverse transcriptase polymerase chain reaction, PRNT plaque reduction neutralization test

As previous cut-off values for positivity were provided for diagnosis of MERS-CoV infection [7] , we firstly suggest cut-off values for predicting neutralization activity. In the present analysis, both ELISA IgG and IgA excellently predicted neutralization activity (using sera collected after 21 dpoi, AUC 1.000 and 0.996, respectively). Of note, ELISA IgG showed 100% sensitivity and 100% specificity at this time point, with OD ratio cut-off value of 0.4.

Predicting neutralization activity is extremely important in selecting donors and recipients of convalescent plasma infusion therapy, which is a potential treatment for MERS-CoV infection [2] . In the present analysis, even after 21 dpoi, 19.5% (8/41, Supplementary Table 1) of collected sera did not have neutralization activity, which emphasizes importance of antibody testing before collecting convalescent plasma. In addition, measurement Data are expressed as a percentage of each predictive value according to various cut-off values. Cut-off values with optimal sensitivity and specificity analyzed per 0.1 OD ratio (ELISA) or IFA intensity are presented as gray-scale. AUCs were calculated from the ROC curve. The population this analysis is 268 MERS-CoV-exposed individuals ( Table 1) . Diagnosis of MERS-CoV infection was confirmed by positive rRT-PCR assay of respiratory specimens.

Middle East respiratory syndrome coronavirus, ELISA enzyme-linked immunosorbent assay, AUC area under the curve, PPV positive predictive value, NPV negative predictive value, dpex days post exposure, IFA immunofluorescence assay, w+ weak positive, OD optical density, ROC receiver operating characteristic, rRT-PCR real-time reverse transcriptase polymerase chain reaction of neutralization activity is also important in selecting recipients and evaluating effect of convalescent plasma infusion. Using ELSIA tests with performance data from the present analysis, evaluation of neutralization activity can be performed in the field of MERS patient management without delay. Diagnosing MERS-CoV infections using anti-MERS-CoV serologic tests has been practically used for postexposure epidemiologic studies or sero-prevalence investigations in endemic regions [3, 6, 12, 16] . To increase sensitivity of ELISA as a screening test, several epidemiologic studies applied low cut-off values of OD ratio, usually a three-fold value of negative controls (ELISA IgG OD ratios 0.2 to 0.3, depending on study sites) [3, 6] . In the present analysis, we demonstrated that an ELISA IgG cut-off value of OD ratio 0.2 actually showed optimal performance with high specificity of 92 to 94%. This is visually well demonstrated in Fig. 2 ; an ELISA IgG cut-off value of OD ratio 0.2 optimally discriminated negative controls and symptomatic infections (groups 1 to 3), while ELISA IgA and IFA IgM show inferior performance differentiating negative controls and mild patients (group 1). Asymptomatic patients (group 0) did not show any serologic responses, which make serologic diagnosis inapplicable. The manufacturer's instructions provided a significantly higher break point for MERS diagnosis to warrant specificity (for ELISA IgG, borderline OD ratio cut-off of 0.8-1.1 and positive ≥1.1) [7] . However, we demonstrated that ELISA IgG exhibits 100% specificity from the cut-off value of OD ratio 0.5 (Supplementary  Table 5 ), while previous cut-off value of OD ratio 1.1 showed extremely low sensitivity of 34.8%. Therefore, we suggest ELISA IgG OD ratio 0.2 as a new break point for MERS-CoV diagnosis for general application, while OD ratio 0.5 can be applied for maximal specificity. In addition, we recommend taking at least a 28-day interval from MERS-exposure to serum sampling for postexposure serologic investigations, to warrant seroconversion. In our unpublished data, seroconversion occurred around the third week of illness or the fourth week after exposure (18 dpoi in median, ranged 14-24; 22 dpex in median, ranged 18-30; Ko et al., data under review).

Although ELISA IgG showed slightly higher AUC than IFA IgG (Supplementary Table 4) , the number of IFA tested samples was not sufficient, which limited comparison of performance between the two different methods. However, performance of ELISA IgG was at least not inferior to that of IFA IgG, which implies that additional confirmation by IFA after ELISA screening is not mandatory. In addition, considering the crossreactivity of the serologic tests to other coronaviruses [12] , the performance for MERS diagnosis could be affected by the local epidemiology of human coronavirus infections.

In conclusion, in a performance analysis using 138 serum samples form 49 MERS-CoV-infected patients, ELISA IgG showed optimal performance in predicting neutralization activity and diagnosing MERS-CoV infection at cut-off values of OD ratio 0.4 and 0.2, respectively. With this performance analysis, anti-MERS-CoV serologic tests can be practically used in the field of MERS management. statistical advice and figure development, as well as Mingu Kang for IFA testing.

Funding This work was supported by a Samsung Biomedical Research Institute (SBRI) grant [#SMX1161321]. CD reports funding by EU grants Antigone (GA no. 278976) and Prepare (GA no. 602525).

There are no potential conflicts of interest relevant to this article to report.

Middle East respiratory syndrome

Feasibility of using convalescent plasma immunotherapy for MERS-CoV infection, Saudi Arabia

Serologic evaluation of MERS screening strategy for healthcare personnel during a hospital-associated outbreak

Kinetics of serologic responses to MERS coronavirus infection in humans

Viral shedding and antibody response in 37 patients with Middle East respiratory syndrome coronavirus infection

Presence of Middle East respiratory syndrome coronavirus antibodies in Saudi Arabia: a nationwide, cross-sectional, serological study

Control of an outbreak of Middle East respiratory syndrome in a tertiary Hospital in Korea

Predictive factors for pneumonia development and progression to respiratory failure in MERS-CoV infected patients

Case definition and management of patients with MERS coronavirus in Saudi Arabia

Detection of a novel human coronavirus by real-time reverse-transcription polymerase chain reaction

Transmission of MERScoronavirus in household contacts

Dipeptidyl peptidase 4 is a functional receptor for the emerging human coronavirus-EMC

Infectious Middle East respiratory syndrome coronavirus excretion and serotype variability based on live virus isolates from patients in Saudi Arabia

Assays for laboratory confirmation of novel human coronavirus (hCoV-EMC) infections

Surveillance of the Middle East respiratory syndrome (MERS) coronavirus (CoV) infection in healthcare workers after contact with confirmed MERS patients: incidence and risk factors of MERS-CoV seropositivity

Acknowledgements We would like to express our sincerest condolences to the patients and families who suffered from the MERS outbreak. We also greatly appreciate the HCP and staff members at Samsung Medical Center and all other hospitals who worked together to overcome the MERS outbreak. Finally, we would like to thank Jinseob Kim for Informed consent As a retrospective study, the Institutional Review Board waived informed consent in the present study.