key: cord-1044874-jlvvbr3j
authors: Qu, Rong; Hu, Linhui; Ling, Yun; Hou, Yating; Fang, Heng; Zhang, Huidan; Liang, Silin; He, Zhimei; Fang, Miaoxian; Li, Jiaxin; Li, Xu; Chen, Chunbo
title: C-reactive protein concentration as a risk predictor of mortality in intensive care unit: a multicenter, prospective, observational study
date: 2020-11-23
journal: BMC Anesthesiol
DOI: 10.1186/s12871-020-01207-3
sha: 0d93563f515f1138f4d96546cddb1b880e39912f
doc_id: 1044874
cord_uid: jlvvbr3j

BACKGROUND: It is not clear whether there are valuable inflammatory markers for prognosis judgment in the intensive care unit (ICU). We therefore conducted a multicenter, prospective, observational study to evaluate the prognostic role of inflammatory markers. METHODS: The clinical and laboratory data of patients at admission, including C-reactive protein (CRP), were collected in four general ICUs from September 1, 2018, to August 1, 2019. Multivariate logistic regression was used to identify factors independently associated with nonsurvival. The area under the receiver operating characteristic curve (AUC-ROC), net reclassification improvement (NRI), and integrated discrimination improvement (IDI) were used to evaluate the effect size of different factors in predicting mortality during ICU stay. 3 -knots were used to assess whether alternative cut points for these biomarkers were more appropriate. RESULTS: A total of 813 patients were recruited, among whom 121 patients (14.88%) died during the ICU stay. The AUC-ROC values of PCT and CRP for discriminating ICU mortality were 0.696 (95% confidence interval [CI], 0.650–0.743) and 0.684 (95% CI, 0.633–0.735), respectively. In the multivariable analysis, only APACHE II score (odds ratio, 1.166; 95% CI, 1.129–1.203; P = 0.000) and CRP concentration > 62.8 mg/L (odds ratio, 2.145; 95% CI, 1.343–3.427; P = 0.001), were significantly associated with an increased risk of ICU mortality. Moreover, the combination of APACHE II score and CRP > 62.8 mg/L significantly improved risk reclassification over the APACHE II score alone, with NRI (0.556) and IDI (0.013). Restricted cubic spline analysis confirmed that CRP concentration > 62.8 mg/L was the optimal cut-off value for differentiating between surviving and nonsurviving patients. CONCLUSION: CRP markedly improved risk reclassification for prognosis prediction.

Patients admitted to the ICU suffer from critical illness or injury and are at a high risk of dying. ICU mortality rates differ widely depending on the underlying disease process, with death rates as low as 1 in 20 for patients admitted following elective surgery and as high as 1 in 4 for patients with respiratory diseases [1] . The risk of death can be approximated by evaluating the severity of a patient's illness as determined by important pathophysiological, clinical, and demographic determinants. In clinical practice, estimates of mortality risk can be useful in resource allocation, in determining appropriate levels of care, and even in discussions with patients and their families about expected outcomes.

The use of clinical risk scores, such as the Acute Physiology and Chronic Health Evaluation II (APACHE II) score or the Sequential Organ Failure Assessment (SOFA) score [2, 3] , despite their considerable prognostic accuracy for ICU mortality, is partly also limited by practicality issues. For instance, certain disease states or conditions may generate very high severity scores, even though they do not generally result in high mortality. These are usually conditions associated with a high degree of physiological derangement but which are either self-limiting or can be managed to return towards normal relatively quickly. Classically, this arises with diabetic ketoacidosis but might also occur in patients admitted to ICU after surgery while still under the effects of general anesthesia [4] . Due to this uncertainty and drawback, physicians are often interested in the use of newly or clinically available predictive biomarkers that are objectively, rapidly, cost-effectively measurable, respond to clinical recovery, and add relevant, reliable, and real-time information [5] .

As one of the major contributors for the all-cause mortality, systematic inflammatory response (SIR) is the common pathophysiological reaction in the critically ill patients [6, 7] . Markers of the SIR syndrome (SIRS), including CRP and PCT, as well as white blood cell count (WBC) have been shown to be prognostic of survival in patients in a variety of cancers [8] [9] [10] [11] [12] [13] . However, the relationships between early CRP, PCT and WBC count at ICU admission and the mortality of severe patients have not been fully validated. We therefore conducted a multicenter, prospective, observational study to examine the possible independent relationships between the blood concentrations of the abovementioned inflammatory markers at ICU admission and ICU mortality in critically ill adults. The ability of the independent inflammatory markers for mortality prediction was further assessed.

The study was conducted from September 1, 2018, to August 1, 2019, in four general ICUs of tertiary care hospitals in the Guangdong Province, China, which were multidisciplinary ICUs admitting patients from all medical areas with a specialty in surgery, including cardiothoracic surgery. When admitted into the ICU, patients were assessed for inclusion in the study. The inclusion criteria were: 1) length of ICU stay more than 24 h; 2) age over 15 years old; 3) informed consent signed. The exclusion criteria included any of the following: length of stay (LOS) in the ICU < 24 h; patients with thyroid tumors (e.g., thyroid adenoma or thyroid carcinoma); and inability to provide informed consent or unavailability of a proxy for informed consent. The primary endpoint was all-cause ICU mortality. The protocol was approved by the Institutional Ethics Committee of each participating center and was performed according to the ethical standards of the Declaration of Helsinki. Written informed consent was obtained from each patient or their legal surrogates. The study was registered at http://www.chictr.org.cn/showproj.aspx?proj=29522 (ChiCTR1800017806).

All of the biomarkers were measured in a central laboratory, and all of the samples were labeled using study identification numbers without personal identifiers or clinical conditions. PCT was measured by Elecsys BRAHMS PCT (Roche Diagnostics GmbH, Germany; normal range, ≤0.05 μg/L). CRP was measured by an immunoenzyme analyzer (Hitachi 917, Tokyo, Japan; normal range, ≤5 mg/L). WBC counts were measured using an XE4000i automatic hemocyte analyzer. Blood samples for the purpose of study were collected only within 1 h after ICU admission, and clinicians decided the time and frequency of testing according to the actual clinical situation during the ICU stay.

In addition to PCT and CRP concentrations and WBC count, we also collected the demographic and clinical characteristics of each patient, including sex, age, treatment, preexisting chronic conditions, sepsis, Charlson score, source of admission, SOFA score, APACHE II score, and LOS in the ICU. ICU mortality data were collected by reviewing medical records in the in-hospital patient data management system. Sepsis was diagnosed according to the Surviving Sepsis Guidelines [4] .

Continuous variables are expressed as the median (IQR) and were compared with the Mann-Whitney U test; categorical variables are expressed as numbers (%) and were compared by the χ 2 test or Fisher's exact test between the survival and nonsurvival groups. All analyses were 2tailed and conducted by SPSS for Windows (version 26.0; IBM, Chicago, IL, USA) and R Statistical Software (version 5.3.0). A P value < 0.05 was considered statistically significant.

Discrimination was evaluated using the area under the curve (AUROC) derived from the conventional receiver operating characteristic (ROC) curve. AUROC of > 0.5, > 0.6, > 0.70 or > 0.80 were considered poor, fair, satisfactory or good, respectively [12] . AUROCs, as a measure of classification accuracy, were further compared with or without CRP added to the APAC HE II score using the nonparametric approach of DeLong and Clarke-Pearson [14] . Univariate and multivariate logistic regression analyses were used to detect factors independently associated with nonsurvival. The optimal cut-off values for individual biomarkers were determined using Youden's index. To evaluate the utility of the biomarkers for risk classification, we determined the category-free net reclassification improvement (NRI) and the integrated discrimination improvement (IDI), as previously described [15, 16] .

In consideration of the possibility that dichotomized cutoffs may not accurately capture the usefulness of PCT and CRP, sensitivity analysis was used to assess whether alternative cut points for these biomarkers were more appropriate. We used a restricted cubic spline function with 3 knots for PCT and CRP to allow nonlinearity as continuous predictors in a multivariable model [12, 17, 18] .

Of the 1526 consecutive patients who were screened for inclusion in the study, 713 (46.7%) were excluded, and 813 patients were enrolled in the analyses (Fig. 1 ). The baseline characteristics and outcomes of the patients are summarized in Table 1 15 ] mg/L, P = 0.000). APACHE II score, SOFA score, age, source of admission, treatments, sepsis, preexisting clinical conditions including hypertension, COPD, coronary disease, diabetes mellitus and chronic heart failure also differed significantly between the two groups. The median days of LOS in the ICU were 6 and 3 in the survival and nonsurvival groups, respectively (Table 1) .

In the univariate analyses, elevations in PCT concentrations (odds ratio [OR]: 1.010 [1.003; 1.018], P = 0.004) and CRP concentrations (OR: 1.008 [1.006; 1.011], P = 0.000) were associated with an increased risk of ICU mortality. Additionally, APACHE II score, age, sepsis, hypertension, diabetes mellitus, COPD, coronary disease, mechanical ventilation, RRT, use of norepinephrine and chronic heart failure also had this association, whereas WBC was not determined to be a risk factor (Table 2) . (Table 2) , and this association did not seem to be significantly different between the sepsis and nonsepsis groups (Fig. 2) . Moreover, adding the variable of CRP > 62.8 mg/L to the APACHE II score did not significantly increase the AUROC (Fig. 3) .

Although CRP > 62.8 mg/L as a dichotomized variable did not significantly provide incremental value to the AUC of the APACHE II score, it markedly improved risk reclassification over the APACHE II score alone, displaying a category-free NRI of 0.556 (P < 0.0001) and an IDI of 0.013 (P = 0.0245) ( Table 3 ). Our analysis suggested that the addition of CRP to the APACHE II score considerably improved the prediction accuracy of ICU mortality, mainly due to increasing the correct predicted probabilities for without events.

In the sensitivity analysis using a restricted cubic spline function for PCT, there was no obvious nonlinearity between PCT and the risk of ICU mortality (Fig. 4A) . However, CRP concentration > 62.8 mg/L was confirmed to be the optimal cut-off value in differentiating between patients with survival and those without survival (Fig. 4B) . The sensitivity and specificity of using CRP > 62.8 mg/L as a cut-off point to predict ICU mortality were 0.521 (95% CI, 0.43-0.72) and 0.767 (95% CI, 0.55-0.87), respectively. The positive and negative predictive values were 0.281 (95% CI, 0.214-0.516) and 0.902 (95% CI, 0.85-0.98), respectively.

In our study of critically ill patients, at ICU admission, the serum concentrations of PCT and CRP and WBC count were significantly lower in survivors than in nonsurvivors, which is similar to the findings of previous studies [12, 19] . As a continuous predictor, none of the inflammatory markers at ICU admission, including PCT concentrations, had sufficient discriminative ability for predicting ICU mortality. However, as a dichotomized variable, CRP > 62.8 mg/L at ICU admission was associated with an increased odds of ICU mortality regardless of whether the patient was septic or not. This association remained significant even after adjusting for the APACHE II score, WBC count, and PCT concentration. The findings have clinical implications that some clinically available inflammatory markers may be useful for helping clinicians assess the prognosis of patients in the ICU, which is worth further confirmation.

In clinical practice, PCT concentration is a wellestablished marker in septic patients [20] [21] [22] [23] . However, this real-world study with a sizable sample did not provide evidence for the usefulness of PCT as a predictor of ICU mortality, and this negative association was not due to any nonlinear relationship between PCT and mortality. Although the PCT concentrations of nonsurvivors were significantly higher than those of survivors, the difference was not significant after adjusting for the APACHE II score, WBC count, and CRP concentration, and its AUC-ROC curve was not satisfactory. This result is not surprising since patients with different pathogens might have differently increased PCT values [24] . PCT elevation also occurs in nonsepsis states, such as postoperative conditions, cardiogenic shock or resuscitated cardiac arrest. In addition, PCT levels may be low in patients with viral infections, localized infections or early infections [25] . This negative finding may be due to the complicated reasons for ICU admission. On the other hand, even though the PCT concentration is increased in the serum of patients with bacterial infection, the half-life of PCT is short, and the maximum daily decrease under effective anti-infective therapy is 50% [26] . Therefore, with infection control, the PCT concentration decreases gradually, and the risk of death decreases accordingly. Otherwise, with the progression of infection, the PCT concentration continues to increase, and the risk of death also increases. This may be another reason why the discriminatory performance of PCT was poor in our population. This finding reminds us that more attention should be paid to the trend of PCT serum levels and not only one PCT value [20, 23, 27] . Of course, the time frame between two consecutive samples needs further investigation. CRP has been used for many years [28] [29] [30] . However, as it is difficult to differentiate sepsis from other nonsepsis causes of SIR, its specificity has been challenged [31, 32] . In the study, the CRP concentrations of nonsurvivors were significantly higher than those of survivors. However, its AUC-ROC curve was not satisfactory. As a dichotomized variable, CRP > 62.8 mg/L at ICU admission was associated with an increased odds of ICU mortality regardless of whether the patient was septic or not. This may be related to the lack of specificity of CRP in both sepsis and nonsepsis patients [31] . The findings suggested that even inflammation without infection may still be associated with ICU mortality. The negative predictive value of CRP showed that patients with a low CRP (< 62.8 mg/L) at ICU admission had a low risk of ICU mortality. Therefore, in clinical practice, CRP may be useful for helping clinicians assess the prognosis of ICU patients.

In our study, APACHE II scores other than WBC count were independently associated with the outcome of nonsurvival. As the APACHE II score is a physiologically based system containing 12 physiological parameters, it is a useful prediction tool for hospital consequences, including mortality in critically ill patients [33] . Moreover, the APACHE II scoring system includes WBC count, and thus, pathophysiological changes after systemic insult could be illustrated comprehensively and systematically by the APACHE II scoring system. Therefore, this scoring system is thought to be superior to WBC count for the prediction of adverse outcomes [34] . Furthermore, we determined that the variable of CRP > 62.8 mg/L did not increase the prediction performance of the APACHE II score using the AUC-ROC comparison by the DeLong method. However, the AUC has recently been criticized for its insensitivity in model comparisons in which the baseline model has performed well [35] . Thus, 2 other measures have been proposed to capture the improvement in discrimination for nested models: integrated discrimination improvement and continuous net reclassification improvement. In the present study, we found that the dichotomized variable of CRP markedly improved risk reclassification over the APACHE II score, displaying a category-free NRI of 0.556 and an IDI of 0.013. On the basis of these results, we concluded that the APACHE II score plus CRP is more promising in terms of improving predictive value than the APACHE II score alone.

There are advantages in this study. To the best of our knowledge, this is the largest study exploring the prognostic value of PCT at ICU admission for patients with and without sepsis. Moreover, it is a multicenter prospective study that allows the retrieval of real-world data with potentially better data quality than retrospective designs, and our results may be generalizable to other centers that have different cases. However, there are some limitations in the study. First, many studies [36, 37] revealed that distinct groups of pathogens and different foci of infection determined different PCT serum concentration. In this study, the specific information about infections were not analyzed. It was due to the incomplete data regarding the pathogens and foci of infection. In addition to pathogens, there are many other contributing factors like the source of ICU admission, which showed difference in the constitution of the two groups. Second, CRP at ICU admission was associated with ICU mortality, and this association did not seem to be different between septic patients and nonseptic patients, but the sensitivity and specificity were not perfect. Third, many confounders may still exist and potentially determine bias. For example, some preexisting clinical conditions (i.e., hypertension, diabetes mellitus, coronary disease, diabetes mellitus) presented high proportions in the non-survival than in the survival group. Thus, further studies, such as those combining multiple biomarkers, are essential for improving the prediction performance.

PCT concentration and WBC count at ICU admission were inadequate in their predictive ability of ICU mortality. As a dichotomized variable, CRP > 62.8 mg/L at ICU admission was associated with an increased odds of ICU mortality regardless of whether the patient was septic or not. The negative predictive value of CRP showed that patients with a low CRP (< 62.8 mg/L) at ICU admission had a low risk of ICU mortality. Further studies, such as those combining multiple biomarkers, are essential for improving the prediction performance.

For inflammatory biomarkers at ICU admission, the concentration of CRP, and not PCT or WBC, can be an independent risk factor for ICU mortality, and CRP can improve risk reclassification for prognosis prediction.

The online version contains supplementary material available at https://doi. org/10.1186/s12871-020-01207-3. 

Variation in ICU risk-adjusted mortality: impact of methods of assessment and potential confounders

Prognostic accuracy of the SOFA score, SIRS criteria, and qSOFA score for in-hospital mortality among adults with suspected infection admitted to the intensive care unit

The third international consensus definitions for Sepsis and septic shock

Surviving Sepsis campaign: international guidelines for management of severe sepsis and septic shock

Identification of complex metabolic states in critically injured patients using bioinformatic cluster analysis

The epidemiology of the systemic inflammatory response

Neutrophilto-lymphocyte ratio relation to Sepsis severity scores and inflammatory biomarkers in patients with community-acquired pneumonia: a case series

The systemic inflammation-based Glasgow prognostic score: a decade of experience in patients with cancer

C-reactive protein concentration as a predictor of in-hospital mortality after ICU discharge: a prospective cohort study

C-reactive protein as a predictor of mortality in critically ill patients: a meta-analysis and systematic review

Procalcitonin value is an early prognostic factor related to mortality in admission to pediatric intensive care unit

Procalcitonin concentrations as a predictor of unexpected readmission and mortality after intensive care unit discharge: a retrospective cohort study

WBC count and the risk of cancer mortality in a national sample of U.S. adults: results from the second National Health and nutrition examination survey mortality study

Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach

Statistical evaluation of prognostic versus diagnostic models: beyond the ROC curve

Evaluating the added predictive ability of a new marker: from area under the ROC curve to reclassification and beyond

Estimating long-term survival of critically ill patients: the PREDICT model

Cubic splines to model relationships between continuous variables and outcomes: a guide for clinicians

Adding C-reactive protein and procalcitonin to the model of end-stage liver disease score improves mortality prediction in patients with complications of cirrhosis

Procalcitonin-guided antibiotic therapy: an expert consensus

Comparison of diagnostic accuracy in sepsis between presepsin, procalcitonin, and C-reactive protein: a systematic review and meta-analysis. Ann Intensive Care

Assessment of apoptosis inhibitor of macrophage/CD5L as a biomarker to predict mortality in the critically ill with Sepsis

Serial Procalcitonin predicts mortality in severe Sepsis patients: results from the multicenter Procalcitonin MOnitoring SEpsis (MOSES) study

Procalcitonin levels in gram-positive, gram-negative, and fungal bloodstream infections

Serum procalcitonin measurement as diagnostic and prognostic marker in febrile adult patients presenting to the emergency department

Procalcitonin for diagnosis of infection and guide to antibiotic decisions: past, present and future

Evaluating the value of dynamic procalcitonin and presepsin measurements for patients with severe sepsis

The time course of blood C-reactive protein concentrations in relation to the response to initial antimicrobial therapy in patients with sepsis

Sepsis biomarkers: a review

Is Interleukin-6 a better predictor of successful antibiotic therapy than procalcitonin and C-reactive protein? A single center study in critically ill adults

The C-reactive protein

Electroencephalographic abnormalities in Sepsis patients in correlation to the calculated prognostic scores: a case series

Urine neutrophil gelatinase-associated lipocalin moderately predicts acute kidney injury in critically ill adults

Predicting mortality in intensive care unit patients with stroke

Interpreting incremental value of markers added to risk prediction models

Procalcitonin levels in candidemia versus bacteremia: a systematic review

Bloos F, for the Msg: influence of pathogen and focus of infection on procalcitonin values in sepsis patients with bacteremia or candidemia

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations

The authors would like to thank all the doctors, nurses, technicians, and patients for their dedication to the study.

Authors' contributions CBC designed the study, analyzed the data, and wrote the manuscript. RQ, LHH contributed to the study concept. XL, CBC contributed to study coordination. RQ contributed to data collection. RQ and LHH did the statistical analysis. All authors contributed to data interpretation and approved the manuscript.

Chunbo Chen is currently receiving a grant (#201803010058) from the Guangzhou Livelihood Science and Technology Project; Chunbo Chen is currently receiving a grant (No.DFJH2020028) under the major program of Summit Project, Guangdong Province High-level Hospital Construction Project of Guangdong Provincial People's Hospital, Guangdong Academy of Medical Sciences; Linhui Hu is currently receiving a grant (#2020YJ01) from Emergent Science and Technology Project for Prevention and Treatment of Novel Coronavirus Pneumonia of Maoming City and High-level Hospital Construction Research Project of Maoming People's Hospital (#zx2020017). The funding sources played no role in the design of the study and collection, analysis or interpretation of data, and played no role in the drafting, revision, or submission of the manuscript.

The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.Ethics approval and consent to participate All procedures performed in the trial were in accordance with the ethical standards of the ethics committee of all the participating centers (Ethics Committee of Huizhou Municipal Central Hospital; NO. LLBA201804A) and with the 1964 Helsinki Declaration and its later amendments or comparable ethical standards. Informed consent was written from all individual participants included in the study.

Not applicable.

The authors declare that they have no competing interests.