key: cord-0075967-opknx8nt
authors: Grolleau, François; Porcher, Raphaël; Barbar, Saber; Hajage, David; Bourredjem, Abderrahmane; Quenot, Jean-Pierre; Dreyfuss, Didier; Gaudry, Stéphane
title: Personalization of renal replacement therapy initiation: a secondary analysis of the AKIKI and IDEAL-ICU trials
date: 2022-03-21
journal: Crit Care
DOI: 10.1186/s13054-022-03936-y
sha: 3ce9bed45795aa8f64f53ea4fa9004882bed2ffb
doc_id: 75967
cord_uid: opknx8nt

BACKGROUND: Trials comparing early and delayed strategies of renal replacement therapy in patients with severe acute kidney injury may have missed differences in survival as a result of mixing together patients at heterogeneous levels of risks. Our aim was to evaluate the heterogeneity of treatment effect on 60-day mortality from an early vs a delayed strategy across levels of risk for renal replacement therapy initiation under a delayed strategy. METHODS: We used data from the AKIKI, and IDEAL-ICU randomized controlled trials to develop a multivariable logistic regression model for renal replacement therapy initiation within 48 h after allocation to a delayed strategy. We then used an interaction with spline terms in a Cox model to estimate treatment effects across the predicted risks of RRT initiation. RESULTS: We analyzed data from 1107 patients (619 and 488 in the AKIKI and IDEAL-ICU trial respectively). In the pooled sample, we found evidence for heterogeneous treatment effects (P = 0.023). Patients at an intermediate-high risk of renal replacement therapy initiation within 48 h may have benefited from an early strategy (absolute risk difference, − 14%; 95% confidence interval, − 27% to − 1%). For other patients, we found no evidence of benefit from an early strategy of renal replacement therapy initiation but a trend for harm (absolute risk difference, 8%; 95% confidence interval, − 5% to 21% in patients at intermediate-low risk). CONCLUSIONS: We have identified a clinically sound heterogeneity of treatment effect of an early vs a delayed strategy of renal replacement therapy initiation that may reflect varying degrees of kidney demand-capacity mismatch. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1186/s13054-022-03936-y.

Acute kidney injury (AKI) affects approximately half of critically ill patients and is associated with high mortality and long-term sequelae [1] . Since its introduction in intensive care units (ICU) in the 1960s [2] , renal replacement therapy (RRT) has proved to be a major breakthrough for the treatment of AKI, saving countless lives. However, the optimal timing for RRT initiation in patients with severe AKI has been controversial. This is illustrated by opposite hypotheses regarding which of an Open Access *Correspondence: francois.grolleau@aphp.fr † Jean-Pierre Quenot, Didier Dreyfuss, and Stéphane Gaudry have contributed equally as senior authors. 1 Centre of Research in Epidemiology and Statistics (CRESS), Université de Paris, French Institute of Health and Medical Research (INSERM U1153), French National Research Institute for Agriculture, Food, and Environment (INRAE), Paris, France Full list of author information is available at the end of the article early or a delayed RRT initiation strategy would be superior to the other in the sample size calculation of recent multicenter randomized controlled trials (RCTs) [3] [4] [5] . Moreover, three trials-the largest on the tropic-did not demonstrate any survival benefit from either strategy over the other. Likewise, recent meta-analyses concluded that, in the absence of life-threatening condition, the timing of RRT initiation did not affect survival [6, 7] .

One suggested reason for the lack of conclusive findings lies in the heterogeneous baseline characteristics of patients included in these trials [8] . Meaningful differences in survival may have been missed as a result of mixing together patients with potential benefit and potential harm from a given initiation strategy. For instance, one may hypothesize that an early RRT initiation strategy is harmful to the patients who would never start it under a delayed strategy. In fact, when a delayed strategy is implemented, we observed that between a third and half of the patients never met the criteria mandating RRT initiation. Conversely, experts have speculated that the patients who would be susceptible to benefit from an early initiation strategy are those who would initiate RRT within 48 h under a delayed strategy [9] .

Patient management further tailored to individual's characteristics is much anticipated in critical care medicine [10] and AKI [11] . In that respect, the conventional subgroup analyses performed "one variable at a time" fail to convey meaningful results as they cannot fully capture all the relevant heterogeneity in patient characteristics [12] . Conversely, approaches using multivariable models have the potential to address the challenge of heterogeneous treatment effects (HTE) [13] .

The concept of kidney demand-capacity mismatch may be useful to the personalization of RRT initiation, but it has not been evaluated on robust clinical data [14] . In this study, we wished to test if estimating the degree of demand-capacity mismatch could guide RRT initiation strategies. We hypothesized that an early RRT initiation strategy is unnecessary or harmful to the patients at low risk of RRT initiation under a delayed strategy; and beneficial to the patients at a higher risk. Accordingly, we used data from two large multicenter RCTs on RRT timing to develop a risk prediction model for RRT initiation within 48 h after allocation to a delayed strategy and then estimated treatment effects within levels of predicted risks.

The AKIKI and the IDEAL-ICU trials received approval for all participating centers from competent French legal authority (Comité de Protection des Personnes d'Ile de  France VI, ID RCB 2013-A00765-40, NCT01932190 for  AKIKI and Comité de Protection des Personnes Est I ID   RCB 2012-A00519-34 for IDEAL-ICU) , and consent of patient or relatives was obtained before inclusion (except in emergencies where deferred consent was allowed by the Institutional Review Board). We transparently reported our analysis following the PATH [15] and TRI-POD [16] statements.

The study sample included participants from the AKIKI and IDEAL-ICU, two multicenter RCTs conducted in France. The AKIKI trial was conducted at 31 ICUs from September 2013 through January 2016 and recruited 619 patients with severe AKI who required mechanical ventilation, catecholamine infusion, or both (the vast majority with septic shock). The IDEAL-ICU trial recruited in 29 ICUs from July 2012 through October 2016 and included 488 patients with severe AKI and septic shock. Both trials randomly assigned (1:1) patients to either an early or a delayed strategy of RRT initiation. None of these trials showed a significant difference between the two strategies on 60-day mortality. The delayed strategy averted the need for RRT in 49% and 38% of patients in the AKIKI and IDEAL-ICU trials, respectively.

The primary outcome of this study was death at day 60. Secondary outcomes included mean differences in number of days free of RRT, mechanical ventilation and intensive care at 28 days [17] across the same levels of risk.

We developed a risk prediction model for RRT initiation within 48 h after allocation to a delayed strategy. The derivation sample consisted of the 550 patients allocated to the delayed arms of the AKIKI (n = 308) and IDEAL-ICU (n = 242) trials (Table 1) . We fit a logistic regression model, using predefined 14 predictors to predict the occurrence of RRT initiation within 48 h after the start of the delayed strategy. Candidate predictor variables were taken from the pre-randomization eligibility screening or clinical examination prior to randomization to the delayed strategy of RRT initiation and included age (years), gender (male vs female), potassium level (mmol/L), blood urea nitrogen level (mmol/L), pH (unitless), the ratio of creatinine at enrollment over creatinine at baseline (unitless), urine output (< 200 ml/day vs ≥ 200 ml/day, as was already categorized in the data), SOFA score at enrollment (unitless), weight (kg), heart failure (yes vs no), hypertension (yes vs no), diabetes mellitus (yes vs no), cirrhosis (yes vs no), non-corticosteroid immunosuppressive drug (yes vs no). Missing data were handled through multiple imputations by chained equations using outcomes as well as all aforementioned predictors in the imputation models [18] . Five independent imputed data sets were generated and analyzed separately. The nonlinearity of each continuous variable was assessed through penalized spline regression. All continuous variables appeared roughly linearly associated with the logit of the outcome probability; hence, no non-linear terms were used.

Two strategies were used to select predictors with the imputed data [19] . First, we used Wald tests for the pooled regression coefficients to simplify the model with a backward selection procedure, with P-value cut-offs mimicking the use of Akaike information criterion (e.g., a cut-off of 0.157 for variables with 1 df). We then used a conventional backward elimination procedure in each imputed data set and retained the model comprising the variables selected in most imputed data sets. Both strategies selected the same variables. Two-by-two interactions between each of the selected variables were then examined using Wald tests for the pooled regression coefficients. No higher-order interactions were considered.

All characteristics reported in the table were determined at inclusion in the AKIKI or IDEAL-ICU trial, before initiation of renal replacement therapy Data are mean (SD), median (IQR) or n (%). AIDS = Acquired Immunodeficiency Syndrome. IQR = Interquartile range. SOFA score = Sequential Organ Failure Assessment score

To convert the values for creatinine to milligrams per deciliter, divide by 88.4 *The serum creatinine concentration before ICU admission was either determined with the use of values measured in the 12 months preceding the ICU stay or was estimated Regression coefficients estimates and their variances were then pooled across imputed data sets [20] .

To evaluate the predictive ability of the model, we first calculated the apparent discrimination (c-statistic) and calibration (categorization by fifth of predicted risk) in the derivation sample. The c-statistic measures how well the model discriminates between the patients who initiated RRT within 48 h after allocation a delayed strategy and those who did not. The calibration curve, estimated using local regression [21] ], contrasts observed vs predicted probabilities of events and evaluates the accuracy of the predictions. Internal validation of the model was performed by bootstrapping, which allows to correct regression coefficients and model performance for optimism [22] . The variable selection strategy was repeated in 200 bootstrap samples, and performance of models fit in each sample was evaluated in these samples and in the original sample. The differences between these two performances were averaged and taken as a measure of overoptimism. The c-statistic as well as the calibration intercept and slope were corrected for bias by subtracting measures of overoptimism to the apparent performance metrics.

In the AKIKI (n = 619), IDEAL-ICU (n = 488) and pooled (n = 1107) samples, we categorized patients by fifths of the risk predicted by our final model. In each fifth of risk, we compared early vs delayed strategy of RRT initiation on primary and secondary outcomes. To account for censoring, death at day 60 was calculated from the Kaplan-Meier estimator. As HTE are fundamentally a scale dependent concept [15] , we evaluated treatment effects on the absolute risk difference and the hazard ratio scales. For each scale we computed a smooth curve of the treatment effect across levels of risks by using an interaction term between treatment arm and a two knots natural spline transform [23] of the predicted risk in a Cox model. We assessed the evidence for heterogeneous treatment effect by testing the null hypothesis that a Cox model using a linear interaction between treatment arm and the predicted risk fits data equally well as a Cox model using a similar interaction with a spline transform of the predicted risk [24] . Ninety-five percent confidence intervals (95% CI) were calculated by bootstrapping (1000 iterations). All analyses were performed using the R statistical software version 4.0.5 (The R Foundation). More precisely, we used the rms package for model building and internal validation, the survival package for survival analyses, the mgcv package for heterogeneous treatment effects assessment, the boot package for bootstrap, and the mice package for multiple imputation. For transparency and reproducibility, the computer code used in this study is available as an Additional file 1 at the Journal's website.

Of the 550 patients included for model derivation (see Fig. 1 Figure S1 ); there were no missing data for the event of RRT initiation. The final prediction model included potassium, blood urea nitrogen, pH, non-corticosteroid immunosuppressive drug, SOFA and weight. No two-by-two interaction between variables was added as none showed statistical significance or seemed clinically informative.

The full and final models are presented in Table 2 . The apparent and bias-corrected c-statistic were 0.73 (95% CI: 0.70 to 0.80) and 0.70 (95% CI: 0.67 to 0.77), respectively. The predictive performance of the final model was good, as measured by discrimination and calibration (Fig. 2) .

For the pooled AKIKI and IDEAL-ICU samples (n = 1,107 see Fig. 1, Panel B) , baseline characteristics at randomization are presented in Table 1 . In all fifth of risk predicted by our model, patients' characteristics appeared balanced between the randomization arms (see Additional file 2: Table S1 ). Patients' characteristics by fifth of risk predicted by our model are provided in the Additional file 2: Table S2 . Heterogeneity of treatment effect is presented by fifth of risk in Fig. 3 . There was no evidence of benefit from an early RRT initiation strategy for individuals within the lowest fifth of RRT initiation risk (absolute risk difference [ARD], 1%; 95% CI − 12% to 14%). However, patients in the fourth fifth of risk, may have benefited from an early strategy of RRT initiation (ARD, − 14%; 95% CI − 27% to − 1%). For patients with the highest risk (last fifth of risk), we found no evidence of benefit from an early initiation strategy (ARD, 7%; 95% CI − 6% to 20%). On both the absolute (i.e., ARD) and relative (i.e., event rate and hazard ratio) scales, the smooth curve suggested that an early RRT initiation strategy may be harmful in patients at an intermediate-low risk (second fifth of risk), while it may be beneficial in patients at an intermediate-high risk (fourth fifth of risk). This pattern was consistent in both the AKIKI and IDEAL-ICU trials when analyzed separately (see Additional file 2: Figure S2 ). Kaplan-Meier survival for each fifth of risk are given in Fig. 4 and in Additional file 2: Figure S3 . No difference in secondary outcomes was found between early and delayed RRT initiation strategy in any fifth of predicted risk (see Additional file 2: Figure S4 ).

An implementation of our model has been made available via a user-friendly web interface at http:// rrt-perso naliz ation. eu/. With this web application, clinicians and researchers can obtain the predicted probability of RRT initiation within 48 h after allocation to a delayed strategy in patients with severe AKI. The individual treatment effect of an early vs delayed strategy is then computed and returned with 95% CIs.

In this study, we developed a prediction model for the initiation of RRT within 48 h after allocation to a delayed strategy in patients with severe AKI in the ICU. We subsequently used the predictions from this model to identify subgroups (i.e., fifths) of patients at similar risk. We then assessed if the treatment effect of an early vs delayed strategy of RRT initiation was heterogeneous between these subgroups. We stress that although causal understanding of model predictions is always inappropriate, in the case of the present HTE, this interpretation is proper as all variables included in our model were measured prior to randomization. In our main analysis, we found substantial HTE across levels of predicted risks. Except for the upper boundary (i.e., highest levels of risks), the directions of the HTE were aligned with our prespecified hypothesis.

From a clinical standpoint, the predicted risk from our model may be viewed as a proxy for the severity of kidney demand-capacity mismatch of the patients included in the trials. Through this lens, our results seem to indicate that for the most severe patients, an invasive strategy i.e., early RRT was unnecessary and/or harmful (ARD in the last fifth of predicted risk, 7%; 95% CI, − 6% to 20%). This seemed true also of mildly severe patients (ARD in the second fifth of predicted risk, 8%; 95% CI, − 5% to 21%). The only patients who seemed to have benefited from early RRT are those at a high but nonextreme risk (ARD in the fourth fifth of predicted risk, − 14%; 95% CI, − 27% to − 1%). An interpretation for these findings is that starting RRT early could harm the lesser severe patients because they often have no need for such invasive treatment. On the other hand, early RRT could be unnecessary to the most severe patients as their prognosis may outweigh potential benefits; or early RRT could even harm them through the destabilization of a weak equilibrium.

Hitherto, the concept of demand-capacity and personalization of RRT initiation did not rely on the analysis of robust clinical data. The 2021 Surviving Sepsis Campaign guidelines argues for a pragmatic approach: propose a wait-and-see strategy for all patients with severe AKI and no life-threatening complications in the intensive care unit [25] .

We acknowledge that given large enough sample sizes, more advanced machine learning techniques could potentially yield a more precise estimation of HTEs. These techniques, often referred to as effect-modelling approaches, aim to estimate HTE through direct modelling of the treatment effect [26] . Of note, they are also vulnerable to misspecification and overfitting, and therefore require huge sample sizes [27] . In contrast, we chose to implement a risk-modelling approach and relied on the PATH guidelines for personalized medicine [15] . On the upside, this allowed us to evaluate a clinically sound, a priori-specified hypothesis [9] . Compared to black-box algorithms, we believe the transparency of our parametric modelling methodology offers researchers a window for interpretability.

Despite the good performance of our prediction model as evaluated on biased-corrected metrics, the absence of external validation for our prediction model is a limitation. However, in our methodology, the model predictions are merely a mean for a downstream purpose namely, the assessment of HTEs. A poorly performing model would have limited our ability to find evidence of HTE when treatment effects are in fact truly heterogeneous.

Last, in contrast with other instances where predictions from developed models cannot be readily calculated by clinicians or researchers, we have implemented a user-friendly web interface for our approach. We trust this will help further disseminate, replicate, or refine our findings. We purposely chose to emphasize uncertainty for the individualized treatment effects by providing all metrics along with their 95% CI. We believe that as decision tools have not been evaluated in controlled settings, clinical judgment should however prevail.

Precision medicine is an active field of research with limited clinical applications so far [28] . Data-driven decision support tools have been made available in cardiology [29] , while in critical care HTE were documented for crystalloid fluids [30] or ventilation strategies [31] , In fact, as negative trial findings are widespread, disentangling HTE were judged a research priority in critical care [32] . The identification of HTE may also inform the design of adaptive trials [33] . For instance, enrichment trials recruiting only the patients most likely to benefit from an early RRT initiation strategy could yield larger treatment effect sizes [34] .

We believe the risk-modelling methodology presented in our study is transportable to treatments as diverse as corticosteroids for sepsis [35] , proton pump inhibitors for gastrointestinal bleeding prevention [36] , or extracorporeal membrane oxygenation for acute respiratory distress syndrome [37] .

As for RRT initiation strategies, our findings will require further replication using other data sources and methodologies. The way in which this can happen is twofold. First, as in the present study, researchers can consider the static case of an early vs delayed strategy of RRT initiation and use either other RCT data or observational data coupled with robust statistical methods. Second, researchers may also account for the fundamentally dynamic nature of the question. On the one hand, AKI staging systems inaccurately reflect the timing of the underlying pathology [38] ; on the other hand definition of the criteria mandating RRT initiation under a delayed strategy ought to be refined [39, 40] . While the latter problem can be addressed with advanced causal inference techniques [41] , the former can be tackled through cutting-edge pathophysiological studies. These two approaches are, in our view, complementary and we believe researchers should strive to dig from both ends.

In this secondary analysis of the AKIKI and IDEAL-ICU trials, we have provided proof-of-concept for the HTE of early vs delayed strategy across levels of baseline risk of RRT initiation within 48 h after a delayed strategy. Though consistent between the two trials, our results will require replication and refinement before they can be implemented in practice. We believe that the risk-modelling methodology we described can help move the precision medicine agenda forward as it may be applicable to a wide variety of treatments in critical care. 

Acute kidney injury and chronic kidney disease as interconnected syndromes

Optimum time for dialysis in acute reversible renal failure. Description and value of an improved dialyser with large surface area

Timing of renal-replacement therapy in patients with acute kidney injury and sepsis

Initiation strategies for renal-replacement therapy in the intensive care unit

Timing of Initiation of Renal-Replacement Therapy in Acute Kidney Injury

Timing of renal replacement therapy initiation for acute kidney injury

Delayed versus early initiation of renal replacement therapy for severe acute kidney injury: a systematic review and individual patient data meta-analysis of randomised clinical trials

Implications of heterogeneity of treatment effect for reporting and analysis of randomized trials in critical care

Timing of renal-replacement therapy in acute kidney injury and sepsis

A research agenda for precision medicine in sepsis and acute respiratory distress syndrome: an official American Thoracic Society Research Statement

Precision medicine in acute kidney injury: a promising future?

Timing of renal support and outcome of septic shock and acute respiratory distress syndrome. A post hoc analysis of the AKIKI Randomized clinical trial

The Path to Personalized Medicine

Timing of kidney support therapy in acute kidney injury: what are we waiting for?

The Predictive Approaches to Treatment effect Heterogeneity (PATH) statement

Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): the TRIPOD statement

Statistical evaluation of ventilator-free days as an efficacy measure in clinical trials of treatments for acute respiratory distress syndrome

Multiple imputation of discrete and continuous data by fully conditional specification

Development and validation of a prediction model with missing predictor data: a practical approach

Multiple imputation in health-care databases: an overview and some applications

Graphical assessment of internal and external calibration of logistic regression models by using loess smoothers

Multivariable prognostic models: issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors

Quantifying the impact of different approaches for handling continuous predictors on the performance of a prognostic model

On p-values for smooth components of an extended generalized additive model

Surviving sepsis campaign: international guidelines for management of sepsis and septic shock 2021

Metalearners for estimating heterogeneous treatment effects using machine learning

Models with interactions overestimated heterogeneity of treatment effects and were prone to treatment mistargeting

Early returns from the era of precision medicine

Redevelopment and validation of the SYNTAX score II to individualise decision making between percutaneous and surgical revascularisation in patients with complex coronary artery disease: secondary analysis of the multicentre randomised controlled SYNTAXES trial with external cohort validation

Heterogeneity of treatment effect by baseline risk in a trial of balanced crystalloids versus saline

Subphenotypes in acute respiratory distress syndrome: latent class analysis of data from two randomised controlled trials

Identifying clinical research priorities in adult pulmonary and critical care: NHLBI working group report

Intensive care medicine in 2050: clinical trials designs

The handwriting is on the wall: there will soon be a drug for AKI

Prognostic and predictive enrichment in sepsis

Heterogeneity of treatment effect of prophylactic pantoprazole in adult ICU patients: a post hoc analysis of the SUP-ICU trial

Toward precision delivery of ECMO in COVID-19 cardiorespiratory failure

Acute kidney injury: a problem of definition

Comparison of two delayed strategies for renal replacement therapy initiation for severe acute kidney injury (AKIKI 2): a multicentre, openlabel, randomised, controlled trial

Wait and see for acute dialysis: but for how long?

Learning when-to-treat policies

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations

We thank all patients included in the AKIKI and IDEAL-ICU trials as well as their surrogates. We express our gratitude to the medical and nursing teams that participated in these trials.

The online version contains supplementary material available at https:// doi. org/ 10. 1186/ s13054-022-03936-y.Additional file 1. Computer code: analysis.R.Additional file 2. Table S1 : Characteristics of the patients at randomization in each arm by fifth of risk of RRT initiation within 48 hours after the start of a delayed strategy. Table S2 : Characteristics of the patients at randomization by fifth of risk of RRT initiation within 48 hours after the start of a delayed strategy. Figure S1 : Missing data in the delayed (Panel A) and early (Panel B) strategy arms. Figure S2 : Heterogeneity of treatment effect (early vs delayed strategy) across different levels of risk of RRT initiation within 48 hours after allocation a delayed strategy in the AKIKI and IDEALICU samples. Figure S3 : Kaplan-Meier estimates of survival at 60 days in each fifth of risk for the AKIKI, IDEAL-ICU and pooled samples. Figure S4 : Results on secondary outcomes on the mean difference scale in each fifth of risk for the AKIKI, IDEAL-ICU and pooled samples.

Study concept and design: FG, RP, SG, J-PQ, DD. Acquisition of data: SG, SB, J-PQ, DD. Analysis and interpretation of data: FG, RP. Drafting of the manuscript: FG. Critical revision of the manuscript for important intellectual content: FG, SG, SB, DH, AB, RP, J-PQ, DD. Dr. FG and Prof. RP had full access to all the data in the study and take responsibility for the integrity of the data and the accuracy of the data analysis. All authors read and approved the final manuscript.

This study received funding from Assistance-Publique -Hôpitaux de Paris. The funder of the study had no role in study design, data collection, data analysis, data interpretation, or writing of the report.

Anonymous participant data is available under specific conditions. Proposals will be reviewed and approved by the sponsor, scientific committee, and staff on the basis of scientific merit and absence of competing interests. Once the proposal has been approved, data can be transferred through a secure online platform after the signing of a data access agreement and a confidentiality agreement.

The AKIKI and the IDEAL-ICU trials received approval for all participating centers from competent French legal authority and consent of patient or relatives was obtained before inclusion.

All authors have consented to the publication of the present manuscript.

The authors have disclosed that they do not have any conflicts of interest.