key: cord-1040043-ss84mf5z
authors: Zhang, Yue; Wu, Lin; Yang, Jibin; Zhou, Congyang; Liu, Ying
title: A Nomogram-Based Prediction for Severe Pneumonia in Patients with Coronavirus Disease 2019 (COVID-19)
date: 2020-10-12
journal: Infect Drug Resist
DOI: 10.2147/idr.s261725
sha: 38cae74c313a15e9c5a36c9a5dff3a07545f895a
doc_id: 1040043
cord_uid: ss84mf5z

BACKGROUND: The outbreak of a novel coronavirus disease 2019 (COVID-19) is currently ongoing worldwide. A proportion of COVID-19 patients progress rapidly to acute respiratory failure. OBJECTIVE: We aimed to build a model to predict the risk of developing severe pneumonia in patients with COVID-19 in the early stage. METHODS: Data from patients who were confirmed to have COVID-19 and were admitted within 7 days from the onset of respiratory symptoms were retrospectively collected. The patients were classified into severe and non-severe groups according to the presence or absence of severe pneumonia during 1–2 weeks of follow-up. The clinical characteristics and laboratory indicators were screened by cross-validation based on LASSO regression to build a prediction model presented by a nomogram. The discrimination and stability, as well as the prediction performance of the model, were analysed. RESULTS: The neutrophil–lymphocyte ratio, monocyte counts, eosinophil percentage, serum lactate dehydrogenase level and history of diabetes mellitus were collected for the model. Bootstrap resampling showed the apparent C-statistics, and the brier scores were 0.929 and 0.098. The optimism of the C-statistics and brier score was 0.0172 and −0.019, respectively. The adjusted C-statistics and brier score were 0.9108 and 0.1169, respectively. The optimal cut-off value of the total nomogram score was determined to be 119 according to the maximal Youden index. The sensitivity, specificity, positive predictive value, and negative predictive value for differentiating the presence and absence of severe pneumonia were 83%, 89%, 74%, and 94%, respectively. CONCLUSION: In our study, the neutrophil–lymphocyte ratio, monocyte counts, eosinophil percentage, serum lactate dehydrogenase level and history of diabetes mellitus showed great discrimination and stability for the prediction of the presence of severe pneumonia and were selected for the model.

An epidemic caused by coronavirus disease 2019 (COVID-19) has occurred unexpectedly around the world. [1] [2] [3] [4] The clinical spectrum of COVID-19 varies from asymptomatic or pauci-symptomatic forms to clinical conditions characterized by acute respiratory failure that necessitates mechanical ventilation and support in an intensive care unit (ICU) to multi-organ and systemic manifestations in terms of sepsis, septic shock, and multiple organ dysfunction syndromes. 5, 6 Previous studies showed that nearly 20% of patients with COVID-19 developed a severe or critical clinical course with higher morbidity and mortality rates, more than 25% of patients required ICU admission, nearly 20% of patients developed acute respiratory distress syndrome, and 10% of patients required invasive mechanical ventilation or extracorporeal membrane oxygenation for refractory hypoxemia. [6] [7] [8] Different treatments and managements between non-severe and severe COVID-19 patients are thus required. The proper management and distribution of medical resources critical factors that rely on the accurate estimation at an early stage for COVID-19 patients at high risk of developing severe pneumonia. Early recognition can not only facilitate patients' classified management but benefit those at high risk of receiving close supervision and timely special intervention. Previous studies 9,10 have attempted to screen haematological biomarkers as predictors for the severity of COVID-19, but further clinical validation is lacking. Nomograms, currently available prediction tools, show good discrimination characteristics in predicting outcomes and are simple and convenient for clinical use. 11, 12 Therefore, the purpose of this study was to build a model to predict the risk of developing severe pneumonia at an early stage in patients with COVID-19 and to present the model by nomogram.

The data of patients who were admitted between January 28, 2020, and March 20, 2020 at the First Affiliated Hospital of Nanchang University and were confirmed to have COVID-19 were retrospectively collected. The study was approved by the Institutional Ethics Committee of the First Affiliated Hospital of Nanchang University. Participant consent for approval was waived due to the retrospective study design. We confirmed that all patient data accessed complied with relevant data protection and privacy regulations. The inclusion criteria were as follows: (1) patients were admitted within 7 days from the onset of respiratory symptoms or in the absence of any symptoms following contact with confirmed COVID-19 patients; (2) more than two positive polymerase chain reaction (PCR) tests of severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2); and (3) more than 18 years old. None of the patients had developed severe pneumonia at the time of admission.

The clinical information of the patients was collected. Routine tests such as complete blood count, blood chemistries and lactate dehydrogenase were performed when upon admission and were included as predictive factors in the study. The test time from the onset of symptoms was collected. All variables including basic information and laboratory indictors in this study are reported in Table 1 . The outcome of the prediction model was the presence of severe pneumonia after admission. The patients were classified into severe and non-severe groups according to the presence or absence of severe pneumonia during 1-2 weeks of follow-up. Severe pneumonia in this study included severe and critical pneumonia. The diagnostic criteria of the severe type or critical pneumonia were (1) respiratory distress (respiratory rate, ≥30 cycles per minute), (2) oxygen saturation 93% or below or arterial partial pressure of oxygen (PaO2)/oxygen concentration FiO2 less than or equal to 300 mm Hg in the resting state, (3) respiratory failure requiring mechanical ventilation, (4) shock, and (5) other forms of organ failure requiring monitoring and treatment at the intensive care unit. 13 Severe pneumonia was determined if one of the diagnostic criteria was met.

Cross-validation based on the Least Absolute Shrinkage and Selection Operator (LASSO) method was conducted to select significant features from all variables mentioned in Table 1 . The process was mainly performed in the glmnet package of R, version 3.6.0 (http://www.r-project.org/).

A nomogram was constructed using selected features. A nomogram is based on proportionally converting each regression coefficient in a multivariate logistic regression point scale. The points are added across independent variables to derive total points, which are converted to predicted probabilities. 14 In this study, the predictive power was measured by the concordance index (C-index), namely, C-statistics. To prove the stability of the model, bootstrapping validation with 100 resamples was conducted to overcome the overfitting problem. 15 The calibration curve provided a comparison between the expected and observed conversion probabilities. The entire process submit your manuscript | www.dovepress.com

Infection and Drug Resistance 2020:13 was performed in the rms package of R, version 3.6.0 (http://www.r-project.org/).

Internal validation was used to evaluate the stability of the prediction model by the principle of random changes in sample composition as implemented by the bootstrap resampling technique, in which the regression models were fitted in 100 bootstrap replicates drawn with replacement from the total sample. Then, the model was refitted in each bootstrap replicate and tested on the original sample to estimate optimism in model performance. The process was performed in the stats and pROC package of R, version 3.6.0 (http://www. r-project.org/). 

For clinical use of the model, the total scores of each patient were calculated based on the nomogram. Receiver operating characteristic curve analysis was used to calculate the optimal cut-off values that were determined by maximizing the Youden index (sensitivity + specificity − 1). The accuracy of the optimal cut-off value was then assessed by the sensitivity, specificity, predictive values, and likelihood ratios. The process was performed in the pROC and epiR package of R, version 3.6.0 (http://www.r-project.org/).

Continuous variables with normal distributions are expressed as the mean (SD) and compared using an unpaired, 2-tailed t-test. Continuous variables without normal distributions are expressed as medians (quartiles) and compared using the Mann-Whitney test. Categorical variables were compared using the χ2 test or Fisher's exact test.

In all analyses, P < 0.05 was considered to indicate statistical significance. All analyses were performed using SPSS, version 21 and R, version 3.6.0.

One hundred and twelve patients who were identified as a confirmed COVID-19 were included in this study from January 28 to March 20, 2020. The 112 patients were divided into two groups according to the presence or absence of severe pneumonia after admission. The patients with (n = 82) or without (n = 30) severe pneumonia were described in Table 1 . All laboratory results were obtained according to the tests, which were performed on the same day as admission. Age, male percentage, time of admission from onset, percentage of diabetes mellitus history, cough percentage, haemocyte tests including white blood cell counts, neutrophil counts, percentage of neutrophils, neutrophil-lymphocyte ratio, monocyte counts and basophil percentage, as well as serum lactate dehydrogenase and serum creatine levels, were significantly higher in the severe pneumonia group compared to the non-severe group (p < 0.05) ( Table 1 ). The lymphocyte counts, lymphocyte percentage, eosinophil counts and eosinophil percentage in the severe group were significantly lower than the nonsevere group (p < 0.05) ( Table 1 ).

Feature selection was conducted by cross-validationbased LASSO regression in all patients. When the lambda value was collected as 1 standard error, eight variables (age, sex, lymphocyte counts, neutrophillymphocyte ratio, monocyte counts, eosinophil percentage, serum lactate dehydrogenase level and history of diabetes mellitus) were selected (Figure 1 ). After estimating the regression coefficient in the refitting model, five variables, including the neutrophil-lymphocyte ratio, monocyte counts, eosinophil percentage, serum lactate dehydrogenase level and history of diabetes mellitus, were finally collected. 

A nomogram that combined the five significant predictors was constructed. Figure 2A shows the predictive nomogram, which obtained a C-statistic of 0.929 (95% CI, 0.875-0.984). The calibration plots of the nomogram are shown in Figure 2B using bootstrapping with 100 resamples. The closer the calibration curve is to the diagonal, the better the predictive power of the nomogram. Figure 2C shows a large area under the receiver operating characteristic (AUROC) curve, which was equal to the C-statistics.

As shown in Table 2 , bootstrap resampling showed negligible model optimism. The apparent C-statistics and apparent brier score was 0.929 and 0.098, respectively. The optimism of the C-statistics and brier score was 0.0172 and −0.019, respectively. The adjusted 

The performance of the model was good in predicting the presence of severe pneumonia. The predictive accuracy was an AUC of 0.929. The optimal cut-off value of the total nomogram score was determined to be 119. The sensitivity, specificity, positive predictive value, and negative predictive value when used in differentiating the presence from absence of severe pneumonia was 83%, 89%, 74%, and 94%, respectively (Table 3 ).

In our study, we found that many characteristics and laboratory indicators at the early stage showed a significant difference between COVID-19 patients in severe versus non-severe groups (Table 1) . After statistical layers of screening, five significant features, including the neutrophil-lymphocyte ratio, monocyte counts, eosinophil percentage, serum lactate dehydrogenase level and history of diabetes mellitus, were finally selected for the model and showed great discrimination and stability for the prediction of the presence of severe pneumonia ( Figure 2 and Table 2 ). For clinical use of the model, we summarized the prediction performance and found that the sensitivity, specificity, positive predictive value and negative predictive value was 83%, 89%, 74%, and 94%, respectively, in estimating the risk of severe pneumonia by using the total score and 119 as the cut-off value ( Table 3 ). The included indicators are all routine examinations performed upon patient admission. Thus, the model has a high value of practical application in the clinic. Based on the prediction, the nomogram might serve as a tool to predict patients at high risk of severe pneumonia. The model will not only help physicians perform reasonable classified management for COVID-19 patients but also facilitate randomized clinical trials to evaluate the efficacy of early inhaled oxygen or intensive care unit management on improving the prognosis of patients at high risk.

Recent research showed that COVID-19 patients deteriorated over the course of 7-14 days after the onset of initial symptoms. 16 This finding is consistent with our observation, which indicates that the prediction should be carried out within 7 days after the onset of symptoms. Of the five features, the neutrophil-lymphocyte ratio and serum lactate dehydrogenase levels have been reported to be significantly correlated with severe COVID-19 pneumonia. 16, 17 Additionally, comorbid conditions are also important in the development of COVID-19 pneumonia. Most COVID-19 patients with severe pneumonia or those that died have underlying diseases, including diabetes, hypertension, and cardiovascular disease, and the overall case-fatality rate of these patients is higher than the non-severe patients. 6 Diabetes, including undiagnosed diabetes, is more prevalent compared to other comorbidities, and makes patients more vulnerable to any infection. Previous studies reported that diabetes mellitus was one of the major factors associated with severe pneumonia following influenza infection. 18 These studies support our clinical findings that diabetes is an important risk factor for predicting severe pneumonia at an early stage.

At present, few studies have been conducted to predict the development of severe pneumonia in COVID-19 patients. Of the currently available systems for assessing pneumonia severity, the pneumonia severity index (PSI) and CURB-65 score are widely validated and used; however, these scales do not play an early predictive role in the development of severe pneumonia and have low specificity for the severity of COVID-19, as well as poor performance in predicting the presence of severe COVID-19 pneumonia. 16 A study combining the neutrophillymphocyte ratio and age to predict severe pneumonia in COVID-19 patients also showed good predictive performance. 16 The current study demonstrated superior predictive performance by adding other significant indicators to the neutrophil-lymphocyte ratio. This study has several limitations. The data were obtained from a single institution, and the model only underwent internal validation. A prospective research study is required to validate the feasibility and effectiveness of the nomogram.

In this study, the neutrophil-lymphocyte ratio, monocyte counts, eosinophil percentage, serum lactate dehydrogenase level and history of diabetes mellitus were selected for inclusion in the model that showed great discrimination and stability for the prediction of the presence of severe pneumonia. The model may help physicians identify COVID-19 patients at risk of developing severe pneumonia in the early stage and provide timely treatment and optimal management for medical resources.

Coronavirus disease 2019 outbreak

Report on the epidemiological features of Coronavirus Disease 2019 (COVID-19) outbreak in the Republic of Korea from

The outbreak of Coronavirus Disease 2019 (COVID-19)-An emerging global health threat

Coronavirus disease 2019 outbreak: preparedness and readiness of countries in the Eastern Mediterranean Region

World Health Organization declares global emergency: a review of the 2019 novel coronavirus (COVID-19)

Clinical features of patients infected with 2019 novel coronavirus in Wuhan

Characteristics of and important lessons from the Coronavirus Disease 2019 (COVID-19) outbreak in China: summary of a report of 72,314 cases from the Chinese Center for Disease Control and Prevention

Severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) and coronavirus disease-2019 (COVID-19): the epidemic and the challenges

Diagnostic utility of clinical laboratory data determinations for patients with the severe COVID-19

Clinical and biochemical indexes from 2019-nCoV infected patients linked to viral loads and lung injury

Can nomograms be superior to other prediction tools

Nomogram for preoperative estimation of microvascular invasion risk in hepatitis B virus-related hepatocellular carcinoma within the Milan criteria

New coronavirus pneumonial diagnosis and treatment program

Towards better clinical prediction models: seven steps for development and an ABCD for validation

Multivariable prognostic models: issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors

Neutrophil-to-lymphocyte ratio predicts severe illness patients with 2019 Novel Coronavirus in the early stage

Epidemiological and clinical characteristics of 99 cases of 2019 novel coronavirus pneumonia in Wuhan, China: a descriptive study

Influenza A-associated severe pneumonia in hospitalized patients: risk factors and NAI treatments

Infection and Drug Resistance 2020:13 submit your manuscript | www

We thank all the staff who participated in the data collection. 

The authors report no conflicts of interest in this work.

Infection and Drug Resistance is an international, peer-reviewed openaccess journal that focuses on the optimal treatment of infection (bacterial, fungal and viral) and the development and institution of preventive strategies to minimize the development and spread of resistance. The journal is specifically concerned with the epidemiology of antibiotic resistance and the mechanisms of resistance development and diffusion in both hospitals and the community. The manuscript management system is completely online and includes a very quick and fair peerreview system, which is all easy to use. Visit http://www.dovepress.com/ testimonials.php to read real quotes from published authors.Submit your manuscript here: https://www.dovepress.com/infection-and-drug-resistance-journal submit your manuscript | www.dovepress.com

Infection and Drug Resistance 2020:13