key: cord-0717479-19stv7zl
authors: Li, Xiaoming; Liu, Chao; Mao, Zhi; Xiao, Minglu; Wang, Li; Qi, Shuang; Zhou, Feihu
title: Predictive values of neutrophil-to-lymphocyte ratio on disease severity and mortality in COVID-19 patients: a systematic review and meta-analysis
date: 2020-11-16
journal: Crit Care
DOI: 10.1186/s13054-020-03374-8
sha: 5cd8ed11776111f89a7ba35677db49ff70ee2c05
doc_id: 717479
cord_uid: 19stv7zl

BACKGROUND: Coronavirus disease 2019 (COVID-19), a highly infectious disease, has been rapidly spreading all over the world and remains a great threat to global public health. Patients diagnosed with severe or critical cases have a poor prognosis. Hence, it is crucial for us to identify potentially severe or critical cases early and give timely treatments for targeted patients. In the clinical practice of treating patients with COVID-19, we have observed that the neutrophil-to-lymphocyte ratio (NLR) of severe patients is higher than that in mild patients. We performed this systematic review and meta-analysis to evaluate the predictive values of NLR on disease severity and mortality in patients with COVID-19. METHODS: We searched PubMed, EMBASE, China National Knowledge Infrastructure (CNKI) and Wanfang databases to identify eligible studies (up to August 11, 2020). Two authors independently screened studies and extracted data. The methodological quality of the included studies was assessed by Quality Assessment of Diagnostic Accuracy Studies 2 (QUADAS-2). RESULTS: Thirteen studies involving 1579 patients reported the predictive value of NLR on disease severity. The pooled sensitivity (SEN), specificity (SPE) and area under curve (AUC) were 0.78 (95% CI 0.70–0.84), 0.78 (95% CI 0.73–0.83) and 0.85 (95% CI 0.81–0.88), respectively. Ten studies involving 2967 patients reported the predictive value of NLR on mortality. The pooled SEN, SPE and AUC were 0.83 (95% CI 0.75–0.89), 0.83 (95% CI 0.74–0.89) and 0.90 (95% CI 0.87–0.92), respectively. CONCLUSIONS: NLR has good predictive values on disease severity and mortality in patients with COVID-19 infection. Evaluating NLR can help clinicians identify potentially severe cases early, conduct early triage and initiate effective management in time, which may reduce the overall mortality of COVID-19. TRIAL REGISTRY: This meta-analysis was prospectively registered on PROSPERO database (Registration number: CRD42020203612).

to global public health [1] . The clinical symptoms of patients with COVID-19 vary widely. A significant proportion of patients with COVID- 19 have mild symptoms, such as fever, muscle ache, cough, shortness of breath and fatigue, and about half of patients do not show any obvious symptoms [2, 3] . However, some severe cases with severe pneumonia can develop into acute respiratory distress syndrome (ARDS), pulmonary oedema or multiple organ dysfunction syndrome (MODS), hence leading to a high mortality [4] [5] [6] . Although many patients have mild symptoms, they may suddenly progress to ARDS, septic shock or even MODS [7] . Patients diagnosed with severe or critical illness have a poor prognosis. Hence, it is crucial for us to identify potentially severe or critical cases early and give timely treatments for targeted patients. Therefore, we can prevent the progression of COVID-19, save medical resources and reduce mortality.

Similar to patients with Middle East respiratory syndrome (MERS) and severe acute respiratory syndrome (SARS), dysregulated inflammation leading to cytokine storms is associated with worsening clinical outcomes in patients with COVID-19 [8] [9] [10] . Emerging evidences suggested that peripheral blood neutrophilto-lymphocyte ratio (NLR) can be used as a marker of systemic inflammation. Furthermore, NLR has shown good predictive values on progression and clinical outcomes in various disease, such as solid tumours, chronic obstructive pulmonary disease (COPD), cardiovascular disease and pancreatitis [11] [12] [13] [14] . Recently, several studies have reported that NLR may differentiate between mild/moderate and severe/critical groups and probability of death in patients with COVID-19 infection. In addition, a series of studies have suggested NLR is a reliable predictor of COVID-19 progression and elevated NLR is associated with high mortality [15] [16] [17] [18] [19] [20] .

NLR is a readily available biomarker that can be calculated from components of the differential white cell count (dividing neutrophil by lymphocyte count). We performed this systematic review and meta-analysis to evaluate the predictive values of NLR on disease severity and mortality in patients with COVID-19 and to provide a reliable marker for early identification of potentially severe or critically ill cases.

We followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA statement) guidelines to perform this meta-analysis [21] . It was prospectively registered on PROSPERO database (Registration number: CRD42020203612).

We reviewed PubMed, EMBASE, China National Knowledge Infrastructure (CNKI) and Wanfang databases through August 11, 2020. The search terms were as follows: ("Neutrophil to lymphocyte ratio" or "neutrophil lymphocyte ratio" or "neutrophil-to-lymphocyte ratio" or "neutrophil/lymphocyte ratio" or "NLR") and ("Coronavirus disease 2019" or "2019 Novel Coronavirus" or "SARS-CoV-2" or "2019-nCoV" or "COVID-19"). The detail of search strategy of PubMed is shown in Additional file 1. No language restrictions were imposed. To find additional citations, the reference lists of the included studies and recent review articles were screened when necessary.

Two authors (X.L and C.L) independently screened all identified citations to find studies for the final analysis. Any disagreement was resolved through discussion. In case of persistent disagreement, we consulted the third reviewer (F.Z) for arbitration. Studies were selected if they met the following criteria: (1) The predictive value of NLR on disease severity or mortality in patients with COVID-19 was evaluated; (2) a 2 × 2 table of results could be constructed [sufficient information to calculate true positive (TP), false positive (FP), false negative (FN) and true negative (TN)]. The exclusion criteria were as follows: (1) case report, review, editorial, conference abstract, comment, letter, animal study; (2) unable to extract a 2 × 2 table of results.

Two authors (X.L and C.L) independently extracted relevant information from individual studies, including first author, publication year, country, publication language, number of patients (male/female), mean age, cut-off value, area under curve (AUC), TP, TN, FP, FN, sensitivity (SEN) and specificity (SPE). The extracted information was checked by a third author (Z.M). We used the Quality Assessment of Diagnostic Accuracy Studies 2 (QUADAS-2) criteria to evaluate each of the included studies in 4 domains: patient selection; index test; reference standard; and flow and test timing [22] .

The statistical analyses were conducted by STATA (version 14.0) using MIDAS module [23] . A bivariate random-effects regression model was performed to calculate SEN, SPE, positive likelihood ratio, negative likelihood ratio, diagnostic odds ratio (DOR) and corresponding 95% credible interval (CI). A summary receiver operating characteristic (SROC) curve was drawn to assess the overall diagnostic accuracy. The higher the AUC value, the better the diagnostic power [24] . We used Deek funnel plot to detect publication bias. If the P value is less than 0.1, publication bias may exist. I 2 index was calculated to assess heterogeneity between studies, and I 2 values above 50% were regarded as the indicative of substantial heterogeneity [25] . We conducted Fagan nomograph to explore the relationship between the pre-test probability, likelihood ratio and the post-test probability. To investigate potential sources of heterogeneity among included studies, sensitivity and subgroup analyses were conducted. In sensitivity analyses, we only included studies published in English. We did subgroup analyses based on cut-off value.

As a result of the literature search, a total of 298 studies were identified, including 97 from PubMed, 91 from EMBASE, 62 from CNKI and 48 from Wanfang debase. Figure 1 shows the study selection process. In total, 111 duplicate publications were excluded. According to the inclusion and exclusion criteria, we excluded 145 studies by evaluating the titles and abstracts. The remaining 42 studies were further scrutinized by reading the full text. Finally, only 19 studies were included in this metaanalysis, of which 9 reported the predictive value on disease severity [26] [27] [28] [29] [30] [31] [32] [33] [34] , 6 reported the predictive value on mortality [35] [36] [37] [38] [39] [40] , and 4 reported the predictive value on both disease severity and mortality [41] [42] [43] [44] .

The characteristics of the included studies and the predictive value of NLR on disease severity or mortality in each study are presented in Table 1 . Most studies were conducted in China. Twelve studies were published in English, six in Chinese and one in Spanish. Except one prospective study [27] , all others were retrospective studies. The number of participants across studies ranged from 45 to 1004. Notably, the SEN, SPE, AUC and cutoff value of NLR predicting mortality and disease severity ranged greatly among the included studies. Except two studies [41, 42] , all other studies defined severe 

The methodological quality of the included studies is presented in Additional file 2. One study only included patients classified as moderate [36] , one included only severe patients [35] , and another included only elderly patients [40] . Therefore, these three studies were considered to have a high risk of patient selection bias.

One study included 32 moderate cases, and another 31 severe cases were included as a control group [32] .

One study included 48 moderate cases, and another 37 severe cases were included as a control group [34] . One study included 50 moderate cases, and another 43 severe cases were included as a control group [43] . One study included 42 dead patients, and another 42 discharged patients were included as a control group [37] . These four studies were also assessed to show high risk of patient selection bias, because they did not avoid a case-control design. One study did not provide sufficient information about patients enrolled and leaded to a high risk of patient selection in our opinion [33] . Most studies were considered to have unclear risk of bias regarding index tests, because they did not report the blindness between index and reference tests. Deek funnel plot is shown in Additional file 3, and publication bias may exist among studies reporting the predictive value of NLR on disease severity (P = 0.04).

Thirteen studies involving 1579 patients reported the predictive value of NLR on disease severity. The pooled SEN and SPE were 0.78 (95% CI 0.70-0.84, I 2 = 71.83) and 0.78 (95% CI 0.73-0.83, I 2 = 77.80), respectively (Fig. 2a) . The positive likelihood ratio was 3.6 (95% CI 2.9-4.4), and the negative likelihood ratio was 0.28 (95% CI 0.21-0.38). The DOR was 13 (95% CI 9-18). The SROC curve is shown in Fig. 3a . The AUC of NLR for predicting disease severity was 0.85 (95% CI 0.81-0.88), indicating high diagnostic value. We can learn from Fagan nomogram (Fig. 4a ) that if the pre-test probability was set to 50%, the post-test probability of NLR for the detection of severe cases was 78% when the NLR was above the cut-off value. On the contrary, when the NLR was below the cut-off value, the post-test probability was 26%.

Ten studies involving 2967 patients reported the predictive value of NLR on mortality. The pooled SEN and SPE were 0.83 (95% CI 0.75-0.89, I 2 = 66.13) and 0.83 (95% CI 0.74-0.89, I 2 = 90.34), respectively (Fig. 2b) . The positive likelihood ratio was 4.8 (95% CI 3.3-7.0), and the negative likelihood ratio was 0.21 (95% CI 0.15-0.30). The DOR was 23 (95% CI . The SROC with pooled diagnostic accuracy was 0.90 (95% CI 0.87-0.92), presented in Fig. 3b . The Fagan nomogram showed that the post-test probability of NLR for the detection of mortality was 83% when the NLR was above the cut-off value and the post-test probability was 17% when the NLR was below the cut-off value (Fig. 4b) .

We conducted the subgroup analyses based on the cutoff value. In terms of predicting disease severity, the cut-off value in six studies was higher than 4.5 and was termed the "high cut-off value" subgroup. Seven others used a lower cut-off value, which were included in the "low cut-off value" subgroup. The AUC was 0.86 (95% CI 0.83-0.89) and 0.82 (95% CI 0.78-0.85), respectively. Similarly, ten studies reporting the predictive value of NLR on mortality were divided into "high cut-off value" (cut-off ≥ 6.5) and "low cut-off value" (< 6.5) subgroups, and the AUC was 0.92 (95% CI 0.89-0.94) and 0.84 (95% CI 0.80-0.87), respectively. In the sensitivity analyses, we only included studies published in English. The pooled AUC for predicting disease severity and mortality was 0.83 (95% CI 0.80-0.86) and 0.90 (95% CI 0.87-0.92), respectively. Detailed results about subgroup analyses and sensitivity analyses are presented in Table 2 .

Although in the clinical practice of treating patients with COVID-19, we have observed that the NLR of severe patients is higher than that in mild patients, there is no systematic review and meta-analysis to evaluate the predictive values of NLR on disease severity and mortality in patients with COVID-19. Studies have reported various thresholds to NLR. Clinicians are therefore unclear regarding the thresholds of NLR that should be applied in order to categorize severity of disease and predict prognosis. Our study suggested that NLR can not only be a good biomarker predicting disease severity in patients with COVID-19 (AUC = 0.85, SEN = 0.78 and SPE = 0.78), but also have value in predicting mortality (AUC = 0.90, SEN = 0.83 and SPE = 0.83). COVID-19 spread rapidly and is an ongoing global pandemic. Medical workers from different countries make efforts to explore the best diagnostic method and the most effective treatment for COVID-19. More and more studies have focused on COVID-19 and published in different languages. To find enough studies that reported the predictive values of NLR on disease severity and mortality in patients with COVID-19, we did not impose any language restrictions. In our final analyses, twelve studies were published in English, six in Chinese and one in Spanish. To our knowledge, English is the most widely used language in the world. Studies published in English may have a wider readership and receive peer review from different countries, while studies published in other languages may be available only to native speakers. Therefore, we performed sensitivity analyses by omitting studies not published in English. The results of the sensitivity analyses were in accordance with the main analyses, indicating that the publish language was not a confounding factor.

To our knowledge, the treatments for mild cases and severe cases are greatly different. For mild cases, there is no need to intervene too much. Some patients can even recover without any treatments. However, for severe cases, even we take many kinds of measures, such as mechanical ventilation, extracorporeal membrane oxygenation (ECMO) and continuous renal replacement therapy (CRRT), the mortality is still high [45, 46] . Therefore, if the potentially severe cases were identified early and effective treatments were taken to prevent the progression of those patients, more patients' lives may be saved.

The current criteria for classifying mild cases and severe cases are mainly based on RR, oxygen saturation and PaO2/FiO2. These indicators are important but lack specificity for COVID-19. In laboratory examination of patients with COVID-19, the absolute value of peripheral white blood cells is usually normal or low, and lymphopenia is common [47] . However, in severe or non-survival patients with COVID-19, the lymphocytes count decreases progressively, while the neutrophils count gradually increases. This may be due to excessive inflammation and immune suppression caused by SARS-CoV-2 infection. On the one hand, neutrophils are generally regarded as pro-inflammatory cells with a range of antimicrobial activities, which can be triggered by virusrelated inflammatory factors, such as interleukin-6 and interleukin-8 [9] . On the other hand, systematic inflammation triggered by SARS-CoV-2 significantly depresses cellular immunity, leading to a decrease in CD3 + T cells, CD4 + T cells and CD8 + T cells. In addition, SARS-CoV-2-infected T cells may also cause cytopathic effects on T cells [10, [48] [49] [50] . Therefore, NLR, a cost-effective marker, can be easily calculated from peripheral blood routine tests and may be associated with the progression and prognosis of COVID-19. To date, four meta-analyses have reported that patients with severe COVID-19 infection had a higher NLR than those with non-severe COVID-19 infection [51] [52] [53] [54] . However, none of them evaluated the predictive values of NLR on disease severity and mortality.

There are several limitations in this meta-analysis. First, all but one of the studies were retrospective, meaning the data were prone to confounding factors. Second, the progression and prognosis of disease were influenced by many factors, such as age, sex and comorbidities, while we did not evaluate other factors. Finally, there was considerable heterogeneity among the included studies. Although we conducted sensitivity and subgroup analyses, the heterogeneity was not significantly decreased. That may be caused by different cut-off values, different conditions of patients or different comorbidities among the included studies. Additional high-quality studies are 

NLR has good predictive values on disease severity and mortality in patients with COVID-19 infection. Fig. 4 Fagan nomogram of NLR for predicting disease severity and mortality in patients with COVID-19. The pre-test probability was set to 50%. a. The post-test probability of NLR for the detection of severe cases was 78% when the NLR was above the cut-off value. The post-test probability was 22% when the NLR was below the cut-off value. b. The post-test probability of NLR for the detection of mortality was 83% when the NLR was above the cut-off value. The post-test probability was 17% when the NLR was below the cut-off value 

Rodriguez-Morales AJ Coronavirus disease 2019-COVID-19

Severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2): a review

Clinical characteristics of COVID-19 in 104 people with SARS-CoV-2 infection on the Diamond Princess cruise ship: a retrospective analysis

Mesenchymal stem cell therapy for acute respiratory distress syndrome: from basic to clinics

Risk factors associated with acute respiratory distress syndrome and death in patients with coronavirus disease 2019 pneumonia in Wuhan

Clinical features, ventilatory management, and outcome of ARDS caused by COVID-19 are similar to other causes of ARDS

Epidemiological and clinical characteristics of 99 cases of 2019 novel coronavirus pneumonia in Wuhan, China: a descriptive study

COVID-19 as an acute inflammatory disease

Cytokine storms: understanding COVID-19

Immune response to SARS-CoV-2 and mechanisms of immunopathological changes in COVID-19

Prognostic role of neutrophil-to-lymphocyte ratio in solid tumors: a systematic review and meta-analysis

Association of neutrophilto-lymphocyte ratio with mortality and cardiovascular disease in the Jackson heart study and modification by the duffy antigen variant

Neutrophil to lymphocyte ratio and clinical outcomes in COPD: recent evidence and future perspectives

Diagnostic value of neutrophillymphocyte ratio for predicting the severity of acute pancreatitis: a metaanalysis

High neutrophil-to-lymphocyte ratio associated with progression to critical illness in older patients with COVID-19: a multicenter retrospective study

Clinical, radiological and laboratory characteristics and risk factors for severity and mortality of 289 hospitalized COVID-19 patients

The clinical implication of dynamic neutrophil to lymphocyte ratio and D-dimer in COVID-19: A retrospective study in Suzhou China

Haematological characteristics and risk factors in the classification and prognosis evaluation of COVID-19: a retrospective cohort study

Cinemre H (2020) Can the neutrophil/lymphocyte ratio (NLR) have a role in the diagnosis of coronavirus 2019 disease (COVID-19)?

Neutrophil-to-lymphocyte ratio as a predictive biomarker for moderate-severe ARDS in severe COVID-19 patients

Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement

Group Q-: QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies

MIDAS: Stata module for meta-analytical integration of diagnostic test accuracy studies

Summary receiver operating characteristic curve analysis techniques in the evaluation of diagnostic tests

Measuring inconsistency in meta-analyses

Value of neutrophil-to-lymphocyte ratio in the classification diagnosis of coronavirus disease 2019

Neutrophil-to-lymphocyte ratio predicts critical illness patients with 2019 coronavirus disease in the early stage

Combined use of the neutrophil-to-lymphocyte ratio and CRP to predict 7-day disease severity in 84 hospitalized patients with COVID-19 pneumonia: a retrospective cohort study

The value of clinical parameters in predicting the severity of COVID-19

Abnormalities of peripheral blood system in patients with COVID-19 in Wenzhou, China

Preliminary study to identify severe from moderate cases of COVID-19 using combined hematology parameters

An increased neutrophil/lymphocyte ratio is an early warning signal of severe COVID-19. Nan Fang Yi Ke Da Xue Xue Bao

The diagnostic and predictive role of NLR, d-NLR and PLR in COVID-19 patients

Study on early laboratory warning of severe COVID-19

The characteristics and outcomes of 681 severe cases with COVID-19 in China

Predictors of progression from moderate to severe coronavirus disease 2019: a retrospective cohort

Predictive value of multiple inflammatory indexes on the prognosis of patients with corona virus disease 2019

Neutrophil-to-lymphocyte ratio and outcomes in Louisiana Covid-19 patients

Neutrophil to lymphocyte ratio as prognostic and predictive factor in patients with coronavirus disease 2019: a retrospective cross-sectional study

Clinical characteristics and risk factors of mortality in elderly patients with novel coronavirus pneumonia

Clinical profiles, characteristics, and outcomes of the first 100 admitted COVID-19 patients in Pakistan: a single-center retrospective study in a tertiary care Hospital of Karachi

Neutrophil to lymphocyte ratio as a prognostic marker in COVID-19

Biochemical analysis between common type and critical type of COVID-19 and clinical value of neutrophil/lymphocyte ratio. Zhejiang Da Xue Xue Bao Yi Xue Ban

Predictive values of blood urea nitrogen/creatinine ratio and other routine blood parameters on disease severity and survival of COVID-19 patients

Extracorporeal membrane oxygenation for severe acute respiratory distress syndrome associated with COVID-19: a retrospective cohort study

Clinical characteristics and outcomes of critically ill patients with novel coronavirus infectious disease (COVID-19) in China: a retrospective multicenter study

A review of coronavirus disease-2019 (COVID-19)

RETRACTED ARTICLE: SARS-CoV-2 infects T lymphocytes through its spike protein-mediated membrane fusion

The immunopathology of sepsis and potential therapeutic targets

Viral and host factors related to the clinical outcome of COVID-19

Use of neutrophil-to-lymphocyte and platelet-to-lymphocyte ratios in COVID-19

Can we predict the severity of coronavirus disease 2019 with a routine blood test?

Laboratory features of severe vs. non-severe COVID-19 patients in Asian populations: a systematic review and meta-analysis

Neutrophil-to-lymphocyte ratio and lymphocyte-to-C-reactive protein ratio in patients with severe coronavirus disease 2019 (COVID-19): A meta-analysis

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations

We thank all researchers and clinicians involved in the individual trials.

Evaluating NLR can help clinicians identify potentially severe cases early, conduct early triage and initiate effective management in time, which may reduce the overall mortality of COVID-19.

Supplementary information accompanies this paper at https ://doi. org/10.1186/s1305 4-020-03374 -8.Additional file 1. Search strategy terms and results of PubMed.Additional file 2. Summary of the methodological quality of the studies according to the QUADAS-2 (Quality Assessment of Diagnostic Accuracy Studies-2) criteria.

Deek funnel plot asymmetry test for publication bias, with P < 0.1 indicating publication bias. Authors' contributions XML and CL contributed equally to this work. XML and CL conceived the study, participated in the design, collected the data, performed statistical analyses and drafted the manuscript. ZM and LW collected the data and performed statistical analyses. MLX and SQ collected the data and revised the manuscript critically for important intellectual content. FHZ performed statistical analyses and helped to revise the manuscript critically for important intellectual content. All authors read and approved the final manuscript.

This work was funded by WU Jieping Medical Foundation (No.