key: cord-0030702-itchh2fa authors: Yasrebi-de Kom, Izak A R; Dongelmans, Dave A; Abu-Hanna, Ameen; Schut, Martijn C; de Keizer, Nicolette F; Kellum, John A; Jager, Kitty J; Klopotowska, Joanna E title: Incorrect application of the KDIGO acute kidney injury staging criteria date: 2021-12-10 journal: Clin Kidney J DOI: 10.1093/ckj/sfab256 sha: d387b23b45c0318e30cc1145c8a43ee4ca89606f doc_id: 30702 cord_uid: itchh2fa BACKGROUND: Recent research demonstrated substantial heterogeneity in the Kidney Disease: Improving Global Outcomes (KDIGO) acute kidney injury (AKI) diagnosis and staging criteria implementations in clinical research. Here we report an additional issue in the implementation of the criteria: the incorrect description and application of a stage 3 serum creatinine (SCr) criterion. Instead of an increase in SCr to or beyond 4.0 mg/dL, studies apparently interpreted this criterion as an increase in SCr by 4.0 mg/dL. METHODS: Using a sample of 8124 consecutive intensive care unit (ICU) admissions, we illustrate the implications of such incorrect application. The AKI stage distributions associated with the correct and incorrect stage 3 SCr criterion implementations were compared, both with and without the stage 3 renal replacement therapy (RRT) criterion. In addition, we compared chronic kidney disease presence, ICU mortality rates and hospital mortality rates associated with each of the AKI stages and the misclassified cases. RESULTS: Where incorrect implementation of the SCr stage 3 criterion showed a stage 3 AKI rate of 29%, correct implementation revealed a rate of 34%, mainly due to shifts from stage 1 to stage 3. Without the stage 3 RRT criterion, the stage 3 AKI rates were 9% and 19% after incorrect and correct implementation, respectively. The ICU and hospital mortality rates in cases misclassified as stage 1 or 2 were similar to those in cases correctly classified as stage 1 instead of stage 3. CONCLUSIONS: While incorrect implementation of the SCr stage 3 criterion has significant consequences for AKI severity epidemiology, consequences for clinical decision making may be less severe. We urge researchers and clinicians to verify their implementation of the AKI staging criteria. Acute kidney injury (AKI) is a frequent problem in hospitalized patients, especially in those admitted to an intensive care unit (ICU). AKI diagnosis and staging are relevant as AKI induces longer hospital stays and higher mortality [1] . The apparent incidence of AKI varies across ICUs and subpopulations due to differences in AKI definitions used, patient comorbidities and clinical practices [2, 3] . In 2012, Kidney Disease: Improving Global Outcomes (KDIGO) published a clinical practice guideline for AKI diagnosis and classification using serum creatinine (SCr), urine output (UO) and the initiation of renal replacement therapy (RRT) [4] . The KDIGO AKI definition and subsequent severity staging criteria are shown in Table 1 . Recent literature suggests that implementations of this guideline vary across studies [5] . Examples include differences in methods to calculate the SCr baseline [5] and the inclusion or exclusion of the RRT staging criterion [6, 7] . In addition, studies often refrain from using UO data, as it is frequently hampered by missing values [3, 5] . This variation has led to different and incomparable AKI rates and research results [5] . We recently identified eight publications with an additional issue: an apparently erroneous interpretation and application of a stage 3 SCr criterion (Table 2) [7] [8] [9] [10] [11] [12] [13] [14] . Patients with AKI should be assigned stage 3 if their SCr increases to ≥4.0 mg/dL (353.6 μmol/L). However, instead of an increase in SCr to ≥4.0 mg/dL, the authors of these studies apparently interpreted this criterion as an increase in SCr of 4.0 mg/dL. As a result, patients may have been assigned an incorrect AKI stage. This suggests that the KDIGO AKI guideline criteria are not only described and applied inconsistently, but sometimes also incorrectly. Here we demonstrate the consequences of applying the incorrect SCr stage 3 criterion on the AKI stage 3 rate in ICU admissions. In addition, we provide an implementation of the KDIGO AKI guideline SCr criteria in R code to facilitate the correct usage of the AKI and AKI staging criteria. We retrospectively received data from electronic hospital records of consecutive admissions to one of the ICUs in the Amsterdam University Medical Centres in the Netherlands between [9] 2012 Table 2 '≥4.0 mg/dL (353.6 μmol/L) increase' Yes Horne and Selby [10] 2015 Table 2 'Increase 354 μmol/L' Yes Machado et al. [11] 2014 Methods Correctly described in Table 1 , but incorrectly described in the methods section 'Stages of AKI based on KDIGO classification': 'Increase in SCr ≥4.0 mg/dL' Siew and Davenport [12] 2014 Table 1 'Increase in SCr ≥4.0 mg/dL (354 μmol/L)' Yes Stack et al. [7] 2020 Materials and methods 'Increase ≥354 μmol/L' No Li et al. [13] 2020 Methods 'Absolute increase in SCr levels of ≥354 μmol/L' Yes Tai et al. [14] 2021 Supplementary data, Table S1 'Increase in serum creatinine ≥353.6 μmol/L' Yes [15] . The linked data included encoded admission identification numbers, admission and discharge timestamps, patient demographics, admission type specifications, Acute Physiology and Chronic Health Evaluation IV (APACHE IV) admission diagnoses and scores [16] , SCr measurements with timestamps, chronic dialysis at admission (yes/no), chronic kidney disease (CKD) at admission (yes/no), RRT initiation during admission (yes/no), ICU survival (yes/no) and hospital survival (yes/no). We excluded admissions with chronic dialysis at admission. The SCr baseline was defined as the first SCr value within the first 24 h of ICU admission. We compared the AKI stage distribution after applying the correct and incorrect SCr criteria, both with and without the stage 3 RRT criterion. In addition, we compared the presence of CKD and the ICU and hospital mortality rates associated with each stage and in the misclassified cases. Lastly, we compared the AKI stage distributions after AKI staging with and without the 4.0 mg/dL SCr stage 3 threshold criterion while applying the stage 3 RRT criterion. All data analyses were performed in R version 3.6.1 (R Foundation for Statistical Computing, Vienna, Austria). This study was exempted from formal approval by the Medical Ethics Committee of the Amsterdam University Medical Centres (waiver W19_433 # 19.499), as it did not fall within the scope of the Dutch Medical Research Involving Human Subjects Act (WMO). The Dutch legal framework for research with care data (i.e. non-WMO) allows working with encoded routinely collected data without informed consent under specific conditions, e.g. when datasets consist of a very large number of patients. We received encoded data for 8124 ICU admissions. The median patient age was 64 years, and the majority of patients were men (63.6%). The median SCr baseline was 0.9 mg/dL, 5.5% of the admissions had CKD at admission and the minority of the admissions were planned (33.1%; Table 3 ). In 1225 admissions {15%, [95% confidence interval (CI) 14-16]}, we identified AKI based solely on the KDIGO AKI SCr criteria (Table 4a) . After AKI staging using both the SCr criteria and the RRT stage 3 criterion, stage 3 AKI occurred in 421 cases [34% (95% CI 32-37)] when SCr criteria were applied correctly versus 357 cases [29% (95% CI 27-32)] when SCr criteria were applied incorrectly, mainly due to a shift to cases misclassified as AKI stage 1 (Tables 3 and 4a). AKI staging without the stage 3 RRT criterion showed a more pronounced impact of the incorrect SCr stage 3 criterion: stage 3 AKI occurred in 237 cases [19% (95% CI 17-22)] versus 113 cases [9% (95% CI 8-11)] after correct and incorrect application, respectively (Table 4b) . The ICU and hospital mortality rates in cases misclassified as stage 1 or 2 were most similar to those in correctly classified AKI stage 1 cases, irrespective of the use of the RRT stage 3 criterion. Furthermore, 55% (95% CI 42-67) of the misclassified cases using the RRT stage 3 criterion and 43% (95% CI 34-51) without use of this criterion concerned cases with CKD at admission (Tables 4a and 4b) . A comparison of characteristics of the CKD and non-CKD patients is provided in the Supplementary data, Table S3 . Lastly, omitting the 4.0 mg/dL SCr stage 3 threshold criterion showed an impact similar to that of the incorrect application of this criterion (Supplementary data, Table S4 ). We found that the KDIGO AKI guideline is described and-most probably-applied not only inconsistently, but also incorrectly. We detected this problem in eight studies and cannot exclude that it occurs more often, both in research and in clinical practice. We illustrated that application of the incorrect stage 3 SCr criterion-an increase in SCr of 4.0 mg/dL-leads to underreporting of stage 3 AKI and overreporting of stage 1 and stage 2 AKI. This underreporting was most pronounced when the stage 3 RRT criterion was not used. Therefore, incorrect application of the stage 3 SCr criterion has significant consequences for AKI severity epidemiology and the interpretation of results across studies, especially when the AKI stage is solely based on the SCr criteria. However, as the ICU and hospital mortality rates in cases misclassified as stage 1 or 2 were similar to those in correctly classified AKI stage 1 cases, the clinical decision making for misclassified cases may still have been accurate despite their misclassification. Therefore, the incorrect staging may be less of a problem in clinical practice. A potential explanation for this phenomenon may lie in the presence of CKD at ICU admission. About half of the misclassified cases had CKD at admission. While use of an incorrect stage 3 SCr criterion identifies cases with a 4.0 mg/dL increase in SCr-and may therefore only identify those with a major and rapid decrease in renal function during ICU admission-the correct criterion identifies cases with AKI with an SCr value that exceeds 4.0 mg/dL. This threshold will be reached sooner in AKI cases with a high SCr baseline or CKD at admission, also without a major decrease in renal function. Correct implementation of the stage 3 SCr criterion may therefore result in staging a subgroup of cases as stage 3 who have a lower mortality rate compared with the stage 3 cases who were identified with the ≥3 times baseline stage 3 SCr criterion or with the incorrect stage 3 SCr criterion that reflect major renal function loss during ICU admission. In line with our results, the phenomenon of lower in-hospital mortality among ICU patients with CKD experiencing AKI compared with those without CKD experiencing AKI has been described previously [17] . However, the former patients may have higher long-term mortality compared with the latter patients [18] . We wonder if the presence of CKD in an ICU patient should be taken into consideration during KDIGO AKI staging, as it may improve alignment between AKI staging and short-term mortality. This is to be addressed in future research together with investigating effects on other relevant outcomes, such as renal function recovery or post-discharge RRT dependency [19] . In conclusion, given the epidemiological implications of the incorrect application of stage 3 AKI SCr criteria, we urge researchers and clinicians to verify their AKI staging implementation. In addition, we suggest the KDIGO leadership address the apparent ambiguity in the AKI staging criteria to prevent further implementation errors. To assist, we provide an implementation of the KDIGO SCr AKI and AKI staging criteria in R (https://github.com/IYdK/RESCUE, descriptions in Supplementary data, S1 and S2). Epidemiology of acute kidney injury: how big is the problem? Acute kidney injury in Western countries Incidence, timing and outcome of AKI in critically ill patients varies with the definition used and the addition of urine output criteria Kidney Disease: Improving Global Outcomes Acute Kidney Injury Work Group. KDIGO clinical practice guideline for acute kidney injury Different applications of the KDIGO criteria for AKI lead to different incidences in critically ill patients: a post hoc analysis from the prospective observational SICS-II study The incidence, risk factors, and prognosis of acute kidney injury in adult patients with coronavirus disease 2019 Temporal trends in acute kidney injury across health care settings in the Irish health system: a cohort study Advances and challenges on new therapies and clinical targets of acute kidney injury KDIGO clinical practice guidelines for acute kidney injury Chronic kidney disease after acute kidney injury: identifying risk factors Acute kidney injury based on KDIGO (Kidney Disease Improving Global Outcomes) criteria in patients with elevated baseline serum creatinine undergoing cardiac surgery The growth of acute kidney injury: a rising tide or just closer attention to detail? The incidence, risk factors and in-hospital mortality of acute kidney injury in patients after surgery for acute type a aortic dissection: a single-center retrospective analysis of 335 patients Acute kidney injury: epidemiology and course in critically ill children Data resource profile: the Dutch National Intensive care Evaluation (NICE) registry of admissions to adult intensive care units Acute Physiology and Chronic Health Evaluation (APACHE) IV: hospital mortality assessment for today's critically ill patients Preexisting chronic kidney disease: a potential for improved outcomes from acute kidney injury Acute-on-chronic kidney injury at hospital discharge is associated with long-term dialysis and mortality Controversies in acute kidney injury: conclusions from a Kidney Disease: Improving Global Outcomes (KDIGO) conference We would like to thank the NICE registry for their support in the data acquisition. We provide an implementation of the KDIGO SCr AKI and AKI staging criteria in R (https://github.com/IYdK/RESCUE, Supplementary data, S1 and S2). The data underlying this article cannot be shared publicly due to ethical and privacy reasons. The data can only be shared upon request after the explicit consent of the Amsterdam University Medical Centres. 11 [9] [10] [11] [12] Supplementary data are available at ckj online. None declared.