key: cord-0863242-aa834wiz authors: Salaffi, Fausto; Carotti, Marina; Di Carlo, Marco; Ceccarelli, Luca; Galli, Massimo; Sarzi-Puttini, Piercarlo; Giovagnoni, Andrea title: Predicting Severe/Critical Outcomes in Patients With SARS-CoV2 Pneumonia: Development of the prediCtion seveRe/crItical ouTcome in COVID-19 (CRITIC) Model date: 2021-09-08 journal: Front Med (Lausanne) DOI: 10.3389/fmed.2021.695195 sha: 3fa0dc545e20d476b0a222c519e7398f4b68ca9e doc_id: 863242 cord_uid: aa834wiz Objective: To create a prediction model of the risk of severe/critical disease in patients with Coronavirus disease (COVID-19). Methods: Clinical, laboratory, and lung computed tomography (CT) severity score were collected from patients admitted for COVID-19 pneumonia and considered as independent variables for the risk of severe/critical disease in a logistic regression analysis. The discriminative properties of the variables were analyzed through the area under the receiver operating characteristic curve analysis and included in a prediction model based on Fagan's nomogram to calculate the post-test probability of severe/critical disease. All analyses were conducted using Medcalc (version 19.0, MedCalc Software, Ostend, Belgium). Results: One hundred seventy-one patients with COVID-19 pneumonia, including 37 severe/critical cases (21.6%) and 134 mild/moderate cases were evaluated. Among all the analyzed variables, Charlson Comorbidity Index (CCI) was that with the highest relative importance (p = 0.0001), followed by CT severity score (p = 0.0002), and age (p = 0.0009). The optimal cut-off points for the predictive variables resulted: 3 for CCI [sensitivity 83.8%, specificity 69.6%, positive likelihood ratio (+LR) 2.76], 69.9 for age (sensitivity 94.6%, specificity 68.1, +LR 2.97), and 53 for CT severity score (sensitivity 64.9%, specificity 84.4%, +LR 4.17). Conclusion: The nomogram including CCI, age, and CT severity score, may be used to stratify patients with COVID-19 pneumonia. Coronavirus disease (COVID-19) is a highly life-threatening infectious disease. The pandemic of the novel severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) pandemic, which is still ongoing, has resulted in huge costs in terms of human lives, economic and social damage (1, 2) . COVID-19 pneumonia can result in acute respiratory distress syndrome (ARDS) and multiple organ failure (3, 4) . The severe/critical patients have a poor prognosis and a high mortality rate as compared to the mild/typical patients (5, 6) . In patients admitted to hospitals have been identified certain factors related to increased severity (7, 8) . The use of imaging in the diagnosis and identification of risk factors for the development of COVID-19 pneumonia is important. Lung CT is the first-line imaging modality in cases where there is a deep suspicion (9) . CT can accurately evaluate the type and extent of lung lesions (10) . Recent studies showed that lung CT may enable the detection of the disease with higher sensitivity in comparison to reverse-transcription polymerase chain reaction (RT-PCR). A recent meta-analysis performed to determine the diagnostic accuracy of the initial lung CT scan compared to RT-PCR in COVID-19 patients, demonstrated that the sensitivity of CT, compared to RT-PCR, was 87% and that the specificity was 46%, with a positive predictive value of 69% and a negative predictive value of 89% (11) . Although lung CT findings such as consolidation, linear opacities, crazy-paving pattern, bronchial wall thickening, and extrapulmonary lesions are features of severe/critical COVID-19 pneumonia (10) , there is still limited information about the prognostic implication of CT findings in patients with COVID-19. Identifying admission CT predictors of adverse outcome in patients without underlying medical issues would help to identify the most vulnerable patients in this age range and, as a result, change their therapy. Several recent studies reported imaging CT findings of patients with adverse outcomes (12) (13) (14) (15) . However, data on the outcomes of consecutive patients, factors influencing hospital admission vs. outpatient management, and risk factors for COVID-19 adverse effects is still lacking in Italy. The significance of recognizing patients that are at risk of developing severe COVID-19 is mandatory for optimizing intra-hospital resources. Patients with serious illnesses often need a wide range of medical services. As a result, through patient prioritization, early identification of patients at high risk of developing severe COVID-19 will encourage appropriate supportive treatment and reduce mortality rates, as well as unnecessary or insufficient healthcare usage (16, 17) . As a method for rapid clinical management of hospitalized patients, the aim of this study is to build an individualized research model to identify the risk of severe/critical disease in patients with COVID-19 pneumonia. The present study is an extension of the data collected in a previous study aimed at realizing a prognostic lung CT score for worse outcomes in COVID-19 pneumonia (18) . In that study, between February 20th, 2020 and April 15th, 2020, data concerning a cohort of patients diagnosed as having COVID-19 pneumonia were retrospectively collected from four hospitals in the Italian regions of Marche, Lombardy and Emilia-Romagna. The inclusion criteria were: an epidemiological history plausible of SARS-CoV2 infection, the identification of SARS-CoV-2 nucleic acid in throat swabs or the lower respiratory tract by real-time reverse transcription polymerase chain reaction, and at least one thin-section lung CT. One the basis of the clinical stages of COVID-19 proposed by WHO (19) , patients were assigned to 1 of 2 categories: those with mild/moderate disease and those with severe/critical disease. Mild symptomatic patients meeting the case definition for COVID-19 without evidence of viral pneumonia or hypoxia. Moderate patients meeting clinical signs of pneumonia (fever, cough, dyspnea, and fast breathing) but no signs of severe pneumonia, including pulse oximeter oxygen saturation ≥90% on room air. Severe disease was defined a respiratory rate of ≥30 beats per minute, or ≤93% resting oxygen saturation, or arterial oxygen partial pressure (PaO 2 )/fraction of inspired oxygen (FiO 2 ) ≤300 mmHg (1 mm Hg = 0.133 kPa), or a ≥50% progression of lung CT findings of pneumonia (fever, cough, dyspnea, fast breathing) within 24-48 h (20) . Critical disease was defined as admission to an ICU for mechanical ventilation or oxygenation impairment (mild ARDS: 200 mmHg 38 • C. Dry cough was also a common symptom at onset (108/171, 63.15%), followed by fatigue (102/171, 59.64%), myalgia (86/171, 50.29%), anosmia (67/171, 39.18%), and dyspnea (70/171, 40.9%). The mean (SD) Borg score was 2.61 (1.57). Comorbidities were detected in 89 (52%) patients, of whom 49.4% (44/89) had only one comorbidity. The mean (SD) CCI was 3.37 (2.21) . Of note, severe/critical group had a higher frequency of comorbidities, especially more than one comorbidity (all p < 0.001), compared with mild/typical group). Compared with mild/typical group, patients in severe/critical group were older (p < 0.001) and more frequently males (p < 0.05). Ninety-four of these 171 (54.9%) patients were admitted to hospital of whom 57 (60.6%) were discharged alive without hospital care. Among the 37 patients admitted to hospital, with critical illness, 25 (67.6%) required mechanical ventilation, nine (24.3%) required intensive care without mechanical ventilation, and three patients (8.1%) died. The most common pattern seen on lung CT was multiple lobe involvement (90.9%) with more extensive GGO (81.9%) than consolidation (71.3%). The patients with severe/critical disease had a higher prevalence of consolidation (p = 0.031), interlobular septal thickening (p = 0.005), a crazy-paving pattern (p = 0.023), reticular opacities (p = 0.009), and air bronchogram (p = 0.001). The mean (SD) lung CT-severity score was 76.65 (6.93) in the group with severe/critical disease and 61.69 (13.21) in the group with mild/typical disease (p = 0.001). Table 1 summarizes the differences between mild/moderate group and severe/critical group. In logistic regression model, only the variables found to be significant in the univariate analysis were considered in predicting a severe/critical disease. Among all the analyzed variables, CCI was found to have the highest relative importance with a Wald value of 15.99 (p < 0.0001), followed by CT severity score (Wald 13.41; p = 0.0002) and age (Wald 10.94; p = 0.0009) ( Table 2) . The predictive performance of a single variable was estimated by the area under the AUC-ROC curve analysis. Age showed an AUC of 0.838 (p = 0.0001) ( Figure 1A) and an optimal cut-off point of 69.9 (sensitivity 94.6%, specificity 68.1%, +LR 2.97) (Supplementary Table 1) . The CCI demonstrated excellent discriminative ability, with an AUC of 0.854 (p = 0.0001) ( Figure 1B) and an optimal cut-off point of 3 (sensitivity 83.8%, specificity 69.6%, +LR 2.76) (Supplementary Table 2 ). The CT severity score revealed an AUC of 0.824 (p = 0.0001) ( Figure 1C ) and an optimal cut-off point of 53 (sensitivity 64.9%, specificity 84.4%, +LR 4.17) (Supplementary Table 3) . The three predictive variables (age, CCI, CT severity score) can be applied to the Fagan nomogram to calculate the post-test probability of severe/critical disease risk (Figure 2) . Calculation of the post-test probability is based on the pre-test probability (21.6% in the case series studied) and the product of the +LRs of the three predictor variables in the individual patient. This type of calculation is suitable to be performed through smartphone apps. With the results of this study, a quick and userfriendly smartphone app based on these findings was created to calculate the post-test probability of severe/critical disease in COVID-19 pneumonia patients (CRITIC-App © , Fausto Salaffi, 2021, all rights reserved; the app is accessible for iOS/Android mobile platforms to interested researchers at website http://www. faustosalaffi.it/app/covid/). In this study it has been proposed a prediction model, calculated at hospital admission, to establish the subsequent presence of disease deterioration and the occurrence of severe/critical disease (serious clinical outcomes, such as ICU admission or death) in patients with COVID-19 pneumonia. Consistent with previous studies, our study found that age, comorbidities and CT severity score are important and independent predictors of severe/critical or fatality risk of COVID-19 patients. Age is a pivotal variable in predicting unfavorable outcomes in COVID-19 patients (27, 28) . A study of 191 COVID-19 patients showed that older age was associated with a higher risk of in-hospital death, with an odds ratio (OR) of 1.10 for every year added (7) . Similarly, Wu and coworkers discovered that older age was related to a higher risk of developing ARDS and dying as a result of it, which is possibly due to elderly patients' lower immune function (27) . Older people were considered to be physically frail and more likely to have comorbidities, which placed them at a higher risk of negative consequences, including death (29) . Data from the present study support that older age is a predictor for adverse outcomes. In particular, the cut-off point of ∼70 years seems to correlate with an augmented risk. Among the possible causes of an increased risk in the elderly population is also considered the treatment with angiotensinconverting enzyme (ACE) inhibitors or angiotensin II type-I receptor blockers (ARBs), drugs that would seem to increase the expression of the ACE-2 receptor, the gateway for the entry of the virus into the cells (30) . Coexisting comorbidities are similarly associated with an increased risk of COVID-19 severity. Huang and colleagues found that a known history of type 2 diabetes increased the likelihood of developing severe illness in COVID-19 patients by six times (31, 32) . Another study found that 64.3% of patients had at least one comorbidity, with hypertension (30%) and diabetes (12.1%) being the most common, and that older men with comorbidities were more likely to be affected by COVID-19 (33) . Several reports of COVID-19 related comorbidities, on the other hand, proposed that comorbidity should be considered further (32, 34, 35) . A more comprehensive evaluation of the impact of various comorbidities on COVID-19 patients is needed and valuable in guiding proper inter-disciplinary management, especially for elderly patients. Patients with severe cardiovascular injury and underlying cardiac insufficiency, for example, are more likely to experience adverse events, according to recent reports (16, 36) . For clinical prognosis, summary comorbidity scales such as the CCI are widely used (37, 38) . The CCI was created to predict the probability of death within 1 year of being admitted to the hospital. The scores are based on a variety of comorbidities, each of which is assigned a weighted integer from one to six dependent on the severity of the condition (39) . CCI is a well-validated and easy-to-use indicator for assessing patient's prognosis and survival. Age, gender, and the existence of comorbidities such as diabetes, cardiovascular, cerebrovascular, and respiratory disorders are frequently used to predict the severity and mortality of COVID-19 during the present pandemic (40) (41) (42) (43) . In a nationwide study of Danish COVID-19 patients it has been investigated if CCI score was associated with the risk of severe outcome and death (44) . It has been found that the odds of severe COVID-19 were significantly increased in CCI score 1-2 (OR 1.7), CCI score 3-4 (OR 2.36), and CCI score >4 (OR 2.67) compared to CCI score 0. In the present study it has been revealed that the CCI score of ≥3 was associated with an ∼4-fold time increase in the risk of adverse outcomes. A systematic review and meta-analysis of CCI score and a composite of poor outcomes demonstrated that, compared to a CCI score of 0, a CCI score of 1-2 and CCI score of ≥3 was prognostically associated with mortality and associated with a composite of poor outcomes. Per point increase of CCI score also increased mortality risk by 16%. Moreover, a higher mean CCI score is also significantly associated with mortality and disease severity. The CCI score, which adds together ages and summarizes comorbidity measures, predicts death in COVID-19 patients by an exponential increase in the odds ratio at each point in the score (45) . Lung CT scanning has a higher sensitivity than chest radiography, allowing abnormalities in the lungs to be identified sooner. CT identifies the processes underlying severe/critical conditions and improve clinical diagnosis and treatment by studying their clinical and imaging features. Consistently with several recent reports (46) (47) (48) , it has been showed that predominant pattern observed was bilateral and peripheral GGO and consolidation (49) (50) (51) . Despite the fact that pleural and/or pericardial effusion were more frequent in critically ill COVID-19 patients, a multivariable study found no connection between them and death or negative outcomes (10) . Qualitative indicators by themselves could differentiate extreme/serious cases from mild/typical cases, but they were unsuccessful in separating severe cases from critical cases. The use of a combination of qualitative and quantitative metrics to identify cases at various clinical stages (52) could assist in the rapid detection and management of critical cases, potentially lowering mortality (19) . Previous studies used a semi-quantitative lung CT severity score to measure COVID-19 lung involvement, with the score being assigned based on the severity of all abnormal lung areas involved, similar to the CT severity score system applied to the present study (6, 10, 49, 53, 54) . The ideal cut-off point for the CT score employed for study in the prediction of severe/critical disease is 53 (range of the score 0-96). Conversely, some variables potentially expected to be suggestive of worse outcomes did not prove to be so. For example, cigarette smoking or CRP levels have not been shown to be associated with worse prognosis. High levels of CRP and erythrocyte sedimentation rate (ESR) have been previously reported in COVID-19 patients. Previous works have documented that CRP might play a role in predicting a higher severity of COVID-19 in the early stages, before the development of CT findings (55) . A recent systematic review and meta-analysis confirmed that elevated CRP levels are predictors of a worse prognosis in COVID-19 patients (56) . Interestingly, a role on CRP values would also be determined by oral cavity health, these two variables being inversely correlated (57) . The main novelty of the present study consists in having applied a comprehensive model of the main variables conditioning outcomes in patients with COVID-19 pneumonia. The integration between the variables was possible through the Fagan nomogram that, calculated on the app, allows a rather rapid estimation of unfavorable prognosis at the patient's bedside. Some works has already proposed the application of algorithms in COVID-19. A retrospective study that assessed the risk of hospitalization in 4,536 COVID-19 patients documented how the variables influencing this risk are multiple, both clinical and demographic (29) . This study has several limitations. First, due to the retrospective nature of the study, there is a chance of knowledge bias. As a result, some information was lacking, and some information, such as the timing of symptom initiation and exposure history, was focused on patients' memories, which may be skewed by recall bias. At the same time, the presence of heterogeneity in some clinical data, such as ICU admission, was FIGURE 2 | Example of application of the nomogram in the calculation of the CRITIC post-test probability. In the nomogram left axis represents the pre-test probability (21.6% in this case study), middle axis represents positive likelihood ratio, and the right axis shows post-test probability. To calculate the actual risk (post-test probability, %) of severe/critical disease in a given patient with COVID-19 pneumonia, the positive likelihood ratio of each item in that patient have to be multiplied. The resulting positive likelihood ratio product represents the point intercepted on the middle axis. unavoidable. Second, there were variations in care, and it was not taken into consideration how treatment influenced prognosis. Third, the data from the two groups were not matched, and the severe/critical group's sample size was limited. Fourth, our patients came from a single geographic area and were treated in a single health system; although our patient population is diverse, factors correlated with poor outcomes may vary elsewhere. Fifth, in this study, well-experienced thoracic radiologists scored the CT images in agreement, and CT scoring is time consuming and can be difficult to apply routinely. In conclusion, the findings of the present study suggested that the main risk factors predicting a severe/critical outcome in COVID-19 pneumonia patients are older age, comorbidities, and lung CT severity. The prediction model proposed could be used as a quantitative risk predictor method at the time of admission, however it needs further validation in larger cohort studies due to small sample size. The raw data supporting the conclusions of this article will be made available by the authors, upon reasonable request to the corresponding author. The studies involving human participants were reviewed and approved by Review board of Luigi Sacco University Hospital. Written informed consent for participation was not required for this study in accordance with the national legislation and the institutional requirements. FS, PS-P, and MG conceived and designed the study and the protocol. MC, LC, and AG performed the lung CT examinations and their relative interpretation and were involved in revising the paper for important intellectual content. FS and MD carried out data interpretation and analysis. FS, MD, and MC wrote the paper. MC, LC, PS-P, MG, and AG were involved in drafting the article or revising it critically for important intellectual content. All authors have read and approved the final manuscript. COVID-19 (coronavirus disease 2019): A new coronavirus disease Ramadan fasting during the COVID-19 pandemic; observance of health, nutrition and exercise criteria for improving the immune system A novel coronavirus from patients with pneumonia in China Clinical features of patients infected with 2019 novel coronavirus in Wuhan A novel coronavirus outbreak of global health concern Chest CT findings in coronavirus disease-19 (COVID-19): relationship to duration of infection Clinical course and risk factors for mortality of adult inpatients with COVID-19 in Wuhan, China: a retrospective cohort study Comorbidity and its impact on 1590 patients with COVID-19 in China: a nationwide analysis Relation between chest CT findings and clinical conditions of coronavirus disease (COVID-19) pneumonia: a multicenter study The clinical and chest CT features associated with severe and critical COVID-19 pneumonia A meta-analysis of accuracy and sensitivity of chest CT and RT-PCR in COVID-19 diagnosis Predictive value of CT in the short-term mortality of Coronavirus Disease 2019 (COVID-19) pneumonia in non-elderly patients: a case-control study Prognostic value of initial chest CT findings for clinical outcomes in patients with COVID-19 Predictive value of initial CT scan for various adverse outcomes in patients with COVID-19 pneumonia The association of CT-measured cardiac indices with lung involvement and clinical outcome in patients with COVID-19 Predictors of mortality for patients with COVID-19 pneumonia caused by SARS-CoV-2: a prospective cohort study Development and validation of a clinical risk score to predict the occurrence of critical illness in hospitalized patients with COVID-19 The role of a chest computed tomography severity score in coronavirus disease 2019 pneumonia Clinical Management of Severe Acute Respiratory Infection When Novel Coronavirus (nCoV) Infection Is Suspected: Interim Guidance World Health Organization. IMAI District Clinician Manual. Hospital Care for Adolescents and Adults Acute respiratory distress syndrome: the Berlin Definition Prevalence of COVID infections in a population of rheumatic patients from Lombardy and Marche treated with biological drugs or small molecules: a multicentre retrospective study Psychophysical bases of perceived exertion A. new method of classifying prognostic comorbidity in longitudinal studies: development and validation The impact of common co-morbidities (as measured using the Charlson index) on hip fracture risk in elderly men: a population-based cohort study Introduction to evidencebased imaging Risk factors associated with acute respiratory distress syndrome and death in patients with coronavirus disease 2019 pneumonia in Wuhan The prognostic value of comorbidity for the severity of COVID-19: a systematic review and meta-analysis study Development and validation of a model for individualized prediction of hospitalization risk in 4,536 patients with COVID-19 COVID-19 and older adults: what we know Clinical findings of patients with coronavirus disease Characteristics of and important lessons from the coronavirus disease 2019 (COVID-19) outbreak in China: summary of a report of 72 314 cases from the Chinese Center for Disease Control and Prevention Clinical characteristics of 140 patients infected with SARS-CoV-2 in Wuhan Risk factors for severity and mortality in adult COVID-19 inpatients in Wuhan Epidemiological and clinical characteristics of 99 cases of 2019 novel coronavirus pneumonia in Wuhan, China: a descriptive study COVID-19 and the cardiovascular system Comorbidities associated with mortality in 31,461 adults with COVID-19 in the United States: a federated electronic medical record analysis Epidemiology, outcomes, and the use of intensive care unit resources of critically ill patients diagnosed with COVID-19 in São Paulo, Brazil: a cohort study Why summary comorbidity measures such as the Charlson comorbidity index and Elixhauser score work Impact of cerebrovascular and cardiovascular diseases on mortality and severity of COVID-19-systematic review, metaanalysis, and meta-regression Effect of heart failure on the outcome of COVID-19-a meta-analysis and systematic review Body mass index and outcome in patients with COVID-19: a dose-response metaanalysis Hypertension is associated with increased mortality and severity of disease in COVID-19 pneumonia: a systematic review, meta-analysis and meta-regression Charlson comorbidity index score and risk of severe outcome and death in Danish COVID-19 patients Charlson comorbidity index and a composite of poor outcomes in COVID-19 patients: a systematic review and meta-analysis Evolution of CT manifestations in a patient recovered 2019 novel coronavirus (2019-nCoV) pneumonia in Wuhan Manifestations of two cases of 2019 novel coronavirus (2019-nCoV) pneumonia Association of radiologic findings with mortality of patients infected with 2019 novel coronavirus in Wuhan Time course of lung changes at chest CT during recovery from coronavirus disease 2019 (COVID-19) Clinical and high-resolution CT features of the COVID-19 infection: comparison of the initial and follow-up changes Radiological findings from 81 patients with COVID-19 pneumonia in Wuhan, China: a descriptive study Computer-aided tomographic analysis of interstitial lung disease (ILD) in patients with systemic sclerosis (SSc). Correlation with pulmonary physiologic tests and patient-centred measures of perceived dyspnea and functional disability Epidemiological and clinical characteristics analysis of COVID-19 in the surrounding areas of Wuhan, Hubei Province in 2020 Chest CT findings in patients with coronavirus disease 2019 and its relationship with clinical features C-reactive protein correlates with computed tomographic findings and predicts severe COVID-19 early Clinical characteristics, laboratory abnormalities and CT findings of COVID-19 patients and risk factors of severe disease: a systematic review and meta-analysis The impact of oral health status on COVID-19 severity, recovery period and C-reactive protein values The authors would like to express their appreciation for all of the emergency services, nurses, doctors, and other hospital staff for their efforts to combat the COVID-19 outbreak. We would like to thank APPYCOM (www.appycom.it) for developing the Mobile Web-app and providing technical assistance during the study. The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fmed. The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.