key: cord-0732024-3lp0tqyd authors: Pan, Deng; Cheng, Dandan; Cao, Yiwei; Hu, Chuan; Zou, Fenglin; Yu, Wencheng; Xu, Tao title: A Predicting Nomogram for Mortality in Patients With COVID-19 date: 2020-08-11 journal: Front Public Health DOI: 10.3389/fpubh.2020.00461 sha: 66e688e59967740db53a8a1671337c323dd86a66 doc_id: 732024 cord_uid: 3lp0tqyd Background: The global COVID-19 epidemic remains severe, with the cumulative global death toll reaching more than 207,170 as of May 2, 2020 (1). Purpose: Our research objective is to establish a reliable nomogram to predict mortality in COVID-19 patients. The nomogram can help us distinguish between patients who are at high risk of death and need close attention. Patients and Methods: For the single-center retrospective study, we collected 21 cases of patients who died in the critical illness area of the Optical Valley Branch of Tongji Hospital, Huazhong University of Science and Technology, from February 9 to March 10. Additionally, we selected 99 patients discharged during this period for analysis. The nomogram was constructed to predict the mortality for COVID-19 patients using the primary group of 120 patients and was validated using an independent cohort of 84 patients. We used multivariable logistic regression analysis to construct the prediction model. The nomogram was evaluated for calibration, differentiation, and clinical usefulness. Results: The predictors included in the nomogram were c-reactive protein, PaO(2)/FiO(2), and cTnI. The areas under the curves of the nomogram were 0.988 (95% CI: 0.972–1.000) and 0.956 (95% CI, 0.874–1.000) in the primary and validation groups, respectively. Decision curve analysis suggests that the nomogram may have clinical usefulness. Conclusion: This study provides a nomogram containing c-reactive protein, PaO(2)/FiO(2), and cTnI that can be conveniently used to predict individual mortality in COVID-19 patients. Next, we will collect as many cases as possible from multiple centers to build a more reliable nomogram to predict mortality for COVID-19 patients. Since the outbreak of COVID-19 in Wuhan, Hubei province, in December 2019, it has had a major impact on people's lives, health, and property safety. It has rapidly expanded to 34 provincial divisions of China (2) (3) (4) . As of April 28, 2020, the total number of confirmed cases in Wuhan has reached 68,128, accounting for 80.75% of the total number of confirmed cases in China, and 4,512 people have died in Wuhan, accounting for 97.18% of the total number of deaths in China (5) . SARS-CoV-2 is a binuclear virus that has a wide clinical spectrum of infection (6) (7) (8) . In the past 2 months, only a few studies have analyzed prognostic factors for death, with repeated emphasis on factors such as age, lymphocytosis, leukocytosis, and elevated ALT (7) . Thus, some of these potential prognostic factors need further validation, and a scoring system that accurately predicts the possible mortality risk is needed. Nomograms are used for multiple indicators to diagnose or predict disease onset or progression, making prognostic model results easier to read. Therefore, nomograms have been gradually applied in medical research and clinical practice (9, 10) . Here, we randomly selected some patients with definite clinical outcome (death or discharge) who had been admitted to the critical care unit of the Optical Valley Branch of Tongji Hospital, Huazhong University of Science and Technology, as of March 10, 2020 (11) . The aim of our study was to establish a nomogram that incorporated demographics, clinical characteristics, and laboratory results to predict individual mortality in COVID-19 patients. We selected COVID-19 patients admitted to the critical illness area of the Optical Valley Branch of Tongji Hospital, Huazhong University of Science and Technology, from February 9, 2020, to March 10, 2020. Patients were enrolled in this cohort if they: (1) were more than 18 years old; (2) were diagnosed with COVID-19 by multiplex real-time RT-PCR; (3) had complete clinical records of medical history and laboratory results. Patients were excluded if they: (1) were suspected with COVID-19; (2) had incomplete clinical records of medical history and laboratory results. We collected demographics, comorbidities, routine laboratory tests, immunological indicators, radiological images, and inpatient treatments (12) . For each patient, the baseline characters were screened: gender, age, leukocytes, plateletlymphocyte ratio (PLR), neutrophil-lymphocyte ratio (NLR), Charlson Comorbidity Index (CCI), CURB-65 score, PaO 2 /FiO 2 , interleukin-1β (IL-1β), interleukin-2R (IL-2R), interleukin-6 (IL-6), interleukin-8 (IL-8), interleukin-10 (IL-10), tumor necrosis factor-α (TNF-α), cardiac troponin I (cTnI), brain natriuretic peptide (BNP), calcitonin, c-reactive protein (CRP), lactate dehydrogenase (LDH), d-dimer, fibrinogen, history of hypertension, heart failure, coronary heart disease (CHD), diabetes, cough, expectoration, diarrhea, shortness of breath, body temperature above 38 • C, and X-ray or CT findings. We used the chi-square test for univariate analysis. Multivariable regression models were developed by incorporating meaningful factors in univariate analyses. Univariate and multivariate regression analysis was used to analyze the risk factors in the primary cohort (13) . Then we construct a nomogram on the basis of the multivariate logistic regression model. Patients' demographic and clinical characteristics were analyzed using descriptive methods, with standard summary statistics including the median, interquartile range (IQR), and proportions. Categorical variables were processed by Chisquare or Fisher's exact tests, as appropriate. We tested the accuracy of the nomograms by discrimination and calibration both in the primary and the validation cohort. We used the receiver operating characteristic curve (ROC) to assess the discriminative ability of the nomogram and then assessed the area under the curve (AUC) (14, 15) . Calibration curves were used to compare the association between actual outcomes and predicted probabilities (16) . Decision curve analysis (DCA) was performed by calculating the net benefits for a range of threshold probabilities to evaluate the clinical utility of the nomogram (17, 18) . Statistical analysis was performed using SPSS 23 (IBM, Chicago, IL, USA) and R version 3.4.4. All statistical tests were two-tailed, and a P < 0.05 was considered to be statistically significant. Between February 9, 2020, and March 10, 2020, from more than 600 patients in the critical illness area of the Optical Valley Branch of Tongji Hospital, 120 cases were selected for inclusion in the study by means of a random number We used univariate and multivariate analyses to identify the prognostic factors (20, 21) . Multivariate logistic regression analysis determined that CRP, PaO 2 /FiO 2 , and cTnI were independent predictors ( Table 2) . The model with three independent predictors is established and represented by a nomogram (Figure 1) . We predicted the probability of death in patients with COVID-19 by calculating the sum of points in the nomogram corresponding to patient characteristics. Regarding the clinical application of this nomogram, we assumed that, if a patient's CRP was 20 mg/L, the PaO 2 /FiO 2 was 350, and the cTnI was increased, then the corresponding score of this patient was 3+33+26, a total of 62 points, so the corresponding risk of death of this patient was between 0.001 and 0.01, and this patient was relatively safe. The AUC for the prediction nomogram was 0.988, 95% CI, 0.972-1.000 (23) . The AUC for CRP was 0.910. The AUC for PaO 2 /FiO 2 was 0.942. The AUC for cTnI was 0.737. The nomogram decision curve analysis is shown in Figure 2 . The calibration curve of the nomogram for the probability of mortality demonstrated good agreement between prediction and observation in the primary cohort (Figure 2 ) (24) . The decision curve showed that if the threshold probability of a patient or doctor is >0%, using the nomogram to predict the mortality for COVID-19 patients adds more benefit. Within this range, net benefit was comparable, with several overlaps, on the basis of the nomogram (25) . Validation was performed by using another 84 COVID-19 patients. In the validation cohort, the independent risk factors included in the nomogram were examined. The AUC of the nomogram was 0.956 (95% CI: 0.874-1.000). Figure 3 shows that the calibration plot for the probability of mortality demonstrated good agreement between the prediction by nomogram and actual observation. Since 2003, coronavirus has caused a number of major public health events (26, 27) . Generally, it was not until the outbreak of severe acute respiratory syndrome (SARS) in Guangdong, China, in 2002 and 2003 that the coronavirus was found to be highly pathogenic to humans. Another highly pathogenic coronavirus is the Middle East respiratory syndrome (MERS) coronavirus, which emerged in 2012 in Middle Eastern countries (28) (29) (30) (31) . COVID-19 is another highly pathogenic coronavirus that has been added to human history. Although COVID-19 has a mortality rate of <3% compared to SARS (9.6%) and MERS (34%), its effects remain extremely sudden and devastating (32, 33) . Previous studies have shown that coronaviruses can cause respiratory and intestinal infections (34) . According to recent reports, the most common symptoms of COVID-19 patients are fever, cough, myalgia, and fatigue, while the less common are expectoration, hemoptysis, and diarrhea (35) (36) (37) (38) (39) . Most patients have mild symptoms and good prognosis. Mild patients may have only a low fever and mild weakness, with no obvious signs of pneumonia (40) . In the late stage of infection, a variety of complications occur in critically ill patients, including ARDS, septic shock, refractory metabolic acidosis, acute myocardial injury, disseminated intravascular coagulation, and even death (5, 6) . Therefore, early diagnosis and early assessment of the patient's prognosis are crucial for controlling the outbreak. Corticosteroids were used extensively during the outbreaks of severe SARS and MERS and are being applied in COVID-19 patients. Corticosteroids suppress inflammation in the lungs but also inhibit immune responses and pathogen clearance at the same time (41) . The clinical benefit of corticosteroids in COVID-19 needs further clinical trials to confirm (42, 43) . In previous studies, several prognostic models have been developed. For example, the NLR was the most effective prognostic factor affecting prognosis for severe COVID-19 patients (44) . In our study, this nomogram based on three variables, CRP, PaO 2 /FiO 2 , and cTnI, can provide a more accurate assessment and prediction of mortality at admission for COVID-19 patients. If patients with high mortality rates are properly and promptly identified, they should be more likely to benefit from nutritional support in nursing care and close attention in clinical care, which will ultimately have a positive impact on their recovery (45, 46) . The variables in the nomogram we constructed were easily accessible from routine clinical work. As a result, clinicians can use this simple, intuitive predictive tool to draw a few lines in a few seconds to make a quick assessment of a patient's prognosis with no computational difficulty. Additionally, our model can help clinical workers rationally allocate medical resources to reduce the fatality rate of COVID-19 when medical resources are scarce. There are still some limitations to our study. First, the study was at a single center with a small sample, and the next step is to include as many cases as possible from multiple centers to build a more reliable predicting nomogram for mortality in COVID-19 patients. Second, we excluded patients whose case data were incomplete, which could have resulted in selection bias. To sum up, to better identify the prognosis of COVID-19 patients, identify severe patients as early as possible, improve the cure rate, and reduce the fatality rate, we constructed a nomogram based on 120 patients to predict mortality. The proposed nomogram considered three independent risk factors, namely, CRP, PaO 2 /FiO 2 , and cTnI. We have confirmed that this nomogram has excellent discrimination and clinical availability. The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation. The studies involving human participants were reviewed and approved by Medical ethics committee of affiliated hospital of Qingdao university. The ethics committee waived the requirement of written informed consent for participation. Written informed consent was obtained from the individual(s) for the publication of any potentially identifiable images or data included in this article. DP: data analysis and visualization. DP, DC, YC, and CH: writing original draft. FZ, TX, and WY: review and editing. All authors contributed to the article and approved the submitted version. National Health Commission of the People's Republic of China Outbreak of pneumonia of unknown etiology in Wuhan, China: The mystery and the miracle The continuing 2019-nCoV epidemic threat of novel coronaviruses to global health -the latest 2019 novel coronavirus outbreak in Wuhan, China Clinical features of 69 cases with coronavirus disease The Official Website of Hubei Provincial Health Committee Clinical characteristics of 138 hospitalized patients with (2019). novel coronavirus-infected pneumonia in Wuhan Epidemiological and clinical characteristics of 99 cases of 2019 novel coronavirus pneumonia in Wuhan, China: a descriptive study Rapid point-of-care testing for SARS-CoV-2 in a community screening setting shows low sensitivity Nomogram for preoperative estimation of microvascular invasion risk in Hepatitis B virus-related hepatocellular carcinoma within the Milan criteria Nomogram predicting cancer-specific mortality in patients with esophageal adenocarcinoma: a competing risk analysis Clinical course and risk factors for mortality of adult inpatients' with COVID-19 in Wuhan, China: a retrospective cohort study Clinical features predicting mortality risk in patients with viral pneumonia: the MuLBSTA score A radiomics nomogram for the preoperative prediction of lymph node metastasis in bladder cancer Validation of discrete time-to-event prediction models in the presence of competing risks Prognostic models with competing risks: methods and application to coronary risk prediction Development and validation of a nomogram for predicting survival in male patients with breast cancer Decision curve analysis: a novel method for evaluating prediction models Development and validation of nomograms to accurately predict risk of recurrence for patients with laryngeal squamous cell carcinoma: Cohort study ESPEN guideline clinical nutrition in neurology Development and validation of a nomogram for predicting survival in patients with gastrointestinal stromal tumours A novel scoring system for prediction of disease severity in COVID-19 Impact of blood analysis and immune function on the prognosis of patients with COVID-19. Cold Spring Harbor Lab Survival prediction in high-grade osteosarcoma using radiomics of diagnostic computed tomography Conversion is a risk factor for postoperative anastomotic leak in rectal cancer patients -a retrospective cohort study Extensions to decision curve analysis, a novel method for evaluating diagnostic tests, prediction models and molecular markers The architecture of SARS-CoV-2 transcriptome Recent progress in understanding 2019. novel coronavirus associated with human respiratory disease: detection, mechanism and treatment Identification of a novel coronavirus in patients with severe acute respiratory syndrome A novel coronavirus associated with severe acute respiratory syndrome Isolation of a novel coronavirus from a man with pneumonia in Saudi Arabia Epidemiology and cause of severe acute respiratory syndrome (sars) in guangdong, people's republic of china Does SARS-CoV-2 has a longer incubation period than SARS and MERS? Abl kinase inhibitors are potent inhibitors of sars-cov and mers-cov fusion Identification of diverse bat alphacoronaviruses and betacoronaviruses in China provides new insights into the evolution and origin of coronavirus-related diseases Clinical characteristics of novel coronavirus cases in tertiary hospitals in hubei province A novel coronavirus from patients with pneumonia in china A precision medicine approach to managing 2019 novel coronavirus pneumonia Clinical characteristics and therapeutic procedure for four cases with 2019 novel coronavirus pneumonia receiving combined Chinese and Western medicine treatment Overview of the 2019. novel coronavirus (2019-nCoV): the pathogen of severe specific contagious pneumonia (SSCP) Clinical and computed tomographic imaging features of novel coronavirus pneumonia caused by SARS-CoV-2 Clinical evidence does not support corticosteroid treatment for 2019-nCoV lung injury Treatment of severe acute respiratory syndrome with glucosteroids: the Guangzhou experience Neutrophil-to-lymphocyte ratio predicts critical illness patients with 2019 coronavirus disease in the early stage Risk of malnutrition is an independent predictor of mortality, length of hospital stay, and hospitalization costs in stroke patients Risk of malnutrition is an independent predictor of mortality, length of hospital stay, and hospitalization costs in stroke patients Thanks to the medical workers who have contributed to the epidemic and those in all industries involved in the prevention and control of the epidemic. Finally, we pay tribute to our patients.