key: cord-0029639-30ura5id authors: Gray, Matthew P.; Barreto, Erin F.; Schreier, Diana J.; Kellum, John A.; Suh, Kangho; Kashani, Kianoush B.; Rule, Andrew D.; Kane-Gill, Sandra L. title: Consensus Obtained for the Nephrotoxic Potential of 167 Drugs in Adult Critically Ill Patients Using a Modified Delphi Method date: 2022-04-07 journal: Drug Saf DOI: 10.1007/s40264-022-01173-4 sha: cf350b8b59e83bb316d277db83792d544eb70e1c doc_id: 29639 cord_uid: 30ura5id INTRODUCTION: The approach to evaluating nephrotoxins in studies of drug-associated acute kidney injury varies. Some studies use a list of under ten drugs for evaluation whereas others include over 100 drugs. Drugs are typically assigned a binary classification, nephrotoxic or not nephrotoxic. This oversimplifies the nephrotoxic potential of the drugs under investigation. OBJECTIVE: This study aimed to assign a nephrotoxin potential for 167 drugs used in the adult critical care setting. METHODS: A three-round, international, interdisciplinary, web-based modified-Delphi study was used to evaluate nephrotoxins used in adult critically ill patients. Twenty-four international experienced clinicians were identified through the Acute Disease Quality Initiative group and professional affiliations. Included individuals represented the fields of intensive care, nephrology, and pharmacy. One hundred and fifty-nine medications were identified from the literature, with eight additional medications added after the first round, for a total of 167 medications. The primary outcome was consensus achieved for nephrotoxicity ratings. Scores were evaluated each round to determine if a consensus was met. RESULTS: Our nephrotoxin potential index rating indicated that 20 drugs were nephrotoxicity probable or probable/definite per consensus. Nephrotoxic potential was assessed based on the standard use of medications in intensive care and the following consensus scores: 0 = no nephrotoxic potential, 1 = possible nephrotoxic potential, 2 = probable nephrotoxic potential, 3 = definite nephrotoxic potential. CONCLUSIONS: The nephrotoxin potential index rating allows for prioritization of targeted drugs with greater nephrotoxic potential for institutional nephrotoxin stewardship programs. Furthermore, the nephrotoxin potential index rating provides homogeneity for research and guidance on detailed assessments by severity for each drug. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1007/s40264-022-01173-4. Acute kidney injury (AKI) occurs in approximately 22% of adults who are hospitalized. Almost 57% of patients in intensive care units experience AKI within a week of admission, with 13% requiring renal replacement therapy [1] . The consequences associated with this syndrome are significant, with all-cause mortality rates of 24% within 6 months of AKI [2] . Acute kidney injury creates a significant economic burden on healthcare systems with incremental costs of US$9100 per episode in surgical patients and up to US$81,000 in non-surviving dialysis patients [3] . There are numerous causes of AKI that include sepsis, trauma, cardiac surgery, major non-cardiac surgery, and nephrotoxic agents [4] . In fact, drugs are the third to fifth leading cause of AKI (D-AKI), contributing to 14-26% of events in hospitalized patients [5] [6] [7] . Identifying D-AKI causes depends on premarketing studies that are often limited in sample size and not focused on kidney injury as a primary outcome. Subsequently, clinicians rely on large post-marketing studies to identify D-AKI causes, but it can take years to accrue sufficient data to be considered definitive evidence [8] . Healthcare professionals depend on primary, secondary, and tertiary information sources to enumerate potentially nephrotoxic drugs for practice and research. This is a tedious process and can be complex with the substantial discrepancy in nephrotoxins provided by various sources [9, 10] . Further, rating the identified nephrotoxins based on their potential or likelihood of causing AKI is elusive given the lack of evidentiary support for such a comparison. Potentially nephrotoxic agents are "known to have potential adverse effects on kidney function either through direct toxicity or by impairment of kidney perfusion, with the recognition that their toxicity may depend on the clinical context" [2] . The appraised nephrotoxic potential (NxP) for drugs is study specific and includes a modified Delphi method and a structured approach with an agreement between various drug compendia [8, [11] [12] [13] [14] . Perceived lists of nephrotoxins in pediatric populations determined by experienced clinicians' consensus recommendations has demonstrated to be useful in guiding nephrotoxin surveillance leading to decreasing the days of AKI, AKI severity, and AKI incidence [13, 15] . In the absence of large epidemiologic association studies, consensus agreement by clinicians about nephrotoxic drugs has utility in clinical practice and the standardization of research studies. A standardized list of nephrotoxins and associated ratings for potential kidney injury is needed to facilitate and prioritize nephrotoxin stewardship in clinical practice and provide homogeneity for comparative studies [10] . In addition, these ratings should be specific to patient populations because the frequency of use and nephrotoxin risk potential vary between critically ill and non-critically ill patients or adults compared with pediatrics. To date, a consensus-generation study assessing nephrotoxins is limited to pediatric patients [11, 13] . A previous study noted significant differences in the nephrotoxins used in pediatric and adult critically ill populations [16] . Therefore, our objective was to conduct a modified Delphi study to obtain consensus from a group of interdisciplinary, international, experienced critical care clinicians to determine the NxP index ratings for 167 drugs in adult critically ill patients. This study was reviewed by the University of Pittsburgh International Review Board (STUDY19120256) and designated as exempt for minimal risk prior to study commencement. A list of medications previously reported to have nephrotoxic effects was created through a literature review [17] [18] [19] . Clinicians actively working in an intensive care environment were identified through the Acute Disease Quality Initiative group and professional affiliations, including an international collective of intensivists, nephrologists, and pharmacists [20] . Participants represented Belgium (n = 1); Canada (n = 2); Chile (n = 2); Finland (n = 1); France (n = 1); Germany (n = 2); Ireland (n = 1); Jordan (n = 1); Singapore (n = 2); Sweden (n = 1); UK (n = 3); and USA (n = 7). A modified Delphi method was used to generate a consensus NxP index rating [21, 22] . A Delphi method is a structured technique that uses a series of rounds to gather group consensus [22] . Clinicians were invited to participate in an anonymous web-based survey via e-mail [23] . All surveys were in English. Twenty-four clinicians (12 physicians and 12 pharmacists) were recruited based on prior recommendations for panel size and heterogeneity [22] . A round of evaluation was considered complete when a total of 16 clinicians finished the surveys, with a minimum of eight pharmacists and eight physicians in each round. All experts' input was equally weighted using anonymous responses to limit stature, seniority, or authority from influencing responses [24] . Figure 1 displays the details of the three rounds for the modified Delphi method. The survey tasked clinicians to independently provide a numeric rating from 0 (none) to 3 (very high) for NxP based on clinical experience for each of the 159 medications. As the original list of 159 medications was not specific to critical care, a response indicating that medication was not used in critical care was included, and a response for "unknown" to allow clinicians to skip medications they were not familiar with. Finally, a free-text comment field was provided to allow clinicians to provide additional context to their responses, as well as identifying any medications that they believed to have NxP that were not included in the original 159 medication list. Consensus was achieved when ≥ 75% of clinicians (minimum 16) agreed on the chosen rating between 0 and 3. Consensus for removal/unknown was achieved when ≥ 50% of respondents were in agreement. Medications reaching consensus were not included in subsequent rounds. A summary of each medication's previous rating was provided to participants for rounds 2 and 3. Eight additional drugs (e.g., loop diuretics) were identified by respondents in round 1 and added in round 2. In response to feedback from the participants regarding a lack of clear delineation between the numeric rating levels, additional context was provided in round 2 using the Naranjo Adverse Drug Reaction Causality Scale (0 for no NxP in almost all situations; 1 for NxP possible but rare, may have additive NxP with other agents or pre-existing kidney detriment; 2 for NxP probable within routine use; 3 for NxP definite within routine use) [25] . To allow for differences in regional drug use, clinicians could also respond that the medication was not used or not available in their country (e.g., rofecoxib in the USA). These responses were not counted in the consensus calculations. At the end of round 1, it was evident that many medications were unlikely to reach the original definition of ≥ 75% consensus for a single rating of 0-3, regardless of the number of rounds completed. To address this, in rounds two and three, the two most commonly reported consecutive ratings were combined. If they achieved ≥ 75% consensus, the final rating was defined as falling between the two categories. For example, out of 17 total responses, a medication receiving ten ratings of "1" and five ratings of "2" would generate a final consensus rating of 1.5. This combined approach was still consistent with the goal of clinician consensus for an index rating of nephrotoxin potential. The scoring system implemented in round 2 was utilized for the third and final round. In addition to receiving an invitation to complete the survey, clinicians were also provided with a link to a repository containing articles describing each remaining medication's effect on kidney function. A minimum of one article and a maximum of two articles were provided for each drug. Systematic reviews were preferred, and if a review was unavailable, then an article providing a pro/con evaluation of nephrotoxicity was provided. Based on the scoring from rounds 1 and 2, it was known that the remaining 21 medications would have final ratings above "0," and the goal in providing these articles was to aid clinicians in gauging the relative nephrotoxicity of each remaining medication with additional information. In total, 167 drugs were evaluated (159 original, eight added based on participant feedback in round 1). Aggregate scores by participants were assessed in each round to determine if consensus was met. When consensus was reached, then drugs were not included in subsequent rounds. In round 1, 67 medications reached consensus; 19 were those with ≥75% responses for one single rating, and 48 medications with ≥ 50% indicating "unknown" or that the medication was not used in critical care. There were 92 drugs from the original list of 159 and eight drugs added per recommendations of the participants for a total of 100 drugs to be evaluated in round 2. In round 2, 79 medications reached consensus; 63 reached consensus using an updated combined rating definition of ≥ 75% consensus within two consecutive rating scores, 15 reached consensus using the original definition of ≥ 75% consensus within a single category, and one medication indicated as not being used in critical care. Following round 3, the remaining 21 medications all reached consensus, with five achieving ≥ 75% consensus within a single rating score and 16 achieving ≥ 75% consensus within two consecutive rating scores. The NxP index rating indicates (1) 21 drugs that were considered to have no NxP, (2) 51 drugs considered nephrotoxicity unlikely to be possible, (3) 12 drugs with nephrotoxicity possible, (4) 12 drugs deemed nephrotoxicity possible to probable, (5) four drugs were nephrotoxicity probable, and (6) 16 drugs rating highest with nephrotoxicity probable to definite and zero ranked exclusively as definite per consensus. The NxP of 20 drugs was rated as nephrotoxicity probable or probable to definite with a final consensus rating of 2.0 or higher (Table 1) . Physicians and pharmacists reported different consensus scores for 41 medications ( Table 2) . When the consensus score between clinician groups differed, physicians reported the higher nephrotoxicity ratings for 37 of the 41 medications. Figure 2 illustrates the NxP index ratings by drug class. A NxP index rating was determined by an interdisciplinary international experienced group of critical care clinicians to be applied to adult critically ill patients. This ranked list aimed to assist in the selection of drugs for nephrotoxin stewardship in clinical practice with an ability to prioritize surveillance based on drugs with greater NxP, especially in settings of resource constraints [10] . This NxP rating can also assist with developing knowledge for rule-based clinical decision support systems to ensure that alerts are specific to patients at high risk for developing D-AKI. Increasing the specificity of alerts could reduce false positives and alert fatigue by improving alert accuracy [26] . The NxP rating provided with this modified Delphi method can guide surveillance in clinical practice. It is stated that up to 87% of critically ill patients receive an average of nine nephrotoxins throughout their intensive care unit stay [14, 27] . Furthermore, among the 100 commonly prescribed drugs in critically ill patients, about 20% were considered to be nephrotoxic [16] . These assessments were based on comprehensive lists of potentially nephrotoxic drugs that may have little or hypothetical potential kidney injury, including acetaminophen and fentanyl in previous studies. Interestingly, angiotensin-converting enzyme inhibitors and angiotensin II receptor blockers were considered nephrotoxic despite the suggested benefits of these agents in preventing kidney disease progression, thus allowing for a permissive AKI [14, 28] . Even the comprehensive lists of potentially nephrotoxic drugs contained variation between studies, with 41 and 47 included for evaluation in two different studies. There is value in understanding the NxP index rating so that the exposure to nephrotoxins in critically ill patients can be further assessed by rating the potential for injury instead of providing equal weighting. The nephrotoxic burden is "cumulative or aggregate exposure to nephrotoxins, with consideration to nephrotoxin potential for each drug, evaluated at a given time or within a reasonable time frame depending on the elimination half-life of the drug in the body" [10] . This has also been described as nephrotoxic intensity, although it does not consider cumulative exposure [29] . Previous studies have indicated a 40-53% greater likelihood of developing AKI for each nephrotoxin a patient received [30, 31] . This assessment of burden is potentially due to the cumulative NxP of each drug added. For example, two drugs considered to have only possible nephrotoxicity potential would be expected to have less of a burden on the kidney than two drugs deemed probable/definite nephrotoxicity potential. A recent study designed to assess nephrotoxin burden reported that a higher drug burden score was significantly associated with subsequent AKI occurrence or worsening of AKI for patients with a lower severity of disease [32] . However, this study did not account for the NxP of each drug considered in the burden assessment. Clearly, this requires further investigation, but the first step is provided in this study with an NxP index rating that can be used in future studies. Another utility of the NxP index rating is to standardize lists of nephrotoxins for evaluation in research. Two studies ranked NxP based on drug information resources. They indicated that drugs cited in more references (three out of four) suggested known toxicity, with fewer references indicating a less established association [8, 12] . Another study used a modified Delphi approach in pediatric hospitalized patients and ranked potential as high and moderate risk, although this was not the primary purpose of the study [11] . Details of the Our study provides a clear process for the NxP index rating and is specific for adult critically ill patients. Notably, the list of assessed nephrotoxins in our modified Delphi study and the pediatric consensus study had several similarities with 16 of the 20 drugs on our list of probable or probable/ definite linking to the drugs ranked as high risk in the other study (Table 3) . More inconsistencies in the nephrotoxins were identified in the literature and intended for evaluation with nine drugs not overlapping between lists. The references used to generate the NxP lists for evaluation, including individual drugs or all drugs in a drug class, and the decision to include drugs that indirectly affect kidney function through intraglomerular hemodynamics created divergence [33] [34] [35] . Additional discrepancies could be because 49 drugs from the original list of 159 in our study were removed because of a lack of use in critically ill patients. An assessment of NxP varies depending on context and requires evaluation in various patient populations such as pediatrics and non-critically ill patients. Additionally, we noted differences in the ratings provided by physicians and critical care pharmacists, with the physicians providing consistently higher NxP scores, with the full differences seen in Table 2 . These differences demonstrate that physicians may be more cautious when evaluating the nephrotoxicity of a particular regimen, and supports the need for standardization in research to avoid inconsistencies in perceived NxP of medications across clinical backgrounds. An interesting element we observed in NxP rating was disagreement for drugs within the same drug class. For example, there are different NxP ratings provided for tenofovir and remdesivir [36, 37] . Both are nucleotide analogs that act as reverse-transcriptase inhibitors with concern for their metabolites causing mitochondrial injury in renal tubular epithelial cells, as documented for tenofovir after longer treatment, but not yet for remdesivir. The explanation for the difference between AKI rates with these two antivirals Notes: Nephrotoxicity ratings provided for medications where physician and pharmacist ratings differed. Medications not listed received the same consensus ratings by both physicians and pharmacists. Ratings provided are the most commonly reported responses in each clinician group during the round the medication reached consensus. Excludes medications where the consensus rating was "Unknown or Not used in Critical Care" and medications where both clinician groups reported the same ratings. In the instance of a tie, the higher of the two ratings is provided. Rating definitions are as follows: 0 = no nephrotoxic potential in almost all situations, 1 = nephrotoxic potential possible but rare, 2 = nephrotoxic potential probable within routine use, 3 = nephrotoxic potential definite within routine use could be variations in molecules, but it may also be because of exposure with shorter treatment durations for remdesivir. Another biologically plausible explanation for remdesivir being associated with AKI and liver necrosis is excipient accumulation in patients with an estimated glomerular filtration rate of less than 30 mL/min. Favipiravir, another nucleotide analog, is not associated with AKI, but it is administered orally and not intravenously. Therefore, it does not have the excipient found in injectable remdesivir. Another example of medications within the same class receiving different ratings is furosemide and torsemide, which were ranked as possible to probable and unlikely to possible, respectively. However, this perceived variation for NxP for drugs furosemide and torsemide, as observed in the modified Delphi method could be influenced by torsemide being limited to an oral formulation, which may reduce critical care clinicians' familiarity Deviations in NxP between drugs within a drug class will require further investigation. Additionally, the next steps for the NxP index rating in this study are to evaluate the clinicians' perceptions provided in the Delphi using large realworld data in future epidemiologic studies. This study is the first step in providing an NxP index rating for drugs intended for use in a critically ill patient population. We attempted to provide a comprehensive list of drugs for evaluation but it is still possible that some potential nephrotoxins were missed, could vary depending on the patient population, or were excluded because of a perceived lack of use in the intensive care unit by the study participants. The references used to generate our list of potential nephrotoxins did not include some classes of medications such as vasopressors, contrast dyes, or fluids, which have been previously examined and can highly influence the risk for AKI [33] [34] [35] . The use of a modified Delphi method allowed for a flexible process to generate consensus using a standardized definition; however, the definition of NxP used was refined based on participant feedback, and the interpretation of this changing definition may influence our results. Next, our study asked clinicians to identify the perceived nephrotoxicity of medications within the general course of their use, but the nephrotoxicity of medications can be affected by patient and environmental-specific factors, which may limit the generalizability of our results. The group of experienced clinicians was selected internationally, which had advantages and disadvantages. The advantage was a more global and generalizable context for the NxP rating. Still, some drugs were not familiar to clinicians depending on the availability in specific countries, requiring us to adjust the denominator for consensus when use was limited and preventing the generation of consensus on other medications if the denominator dropped below 50% the panel size. Perception and experience are the keys for a consensus assessment, and newer drugs included for evaluation may lack familiarity and allow for lower ratings. As more data and new drugs become available, consensus ratings will need to be updated. This is a consensus method approach to developing an NxP index rating limited to clinician perception that needs to be validated in epidemiologic association studies. Twenty drugs were considered to have probable to probably/ definite nephrotoxicity by an international group of clinicians with experience in adult intensive care units. This NxP index rating allows for prioritization of nephrotoxin stewardship targeted at drugs with greater NxP. Furthermore, the NxP index rating provides homogeneity for research evaluations and opportunities for more detailed assessments by severity ratings. The online version contains supplementary material available at https:// doi. org/ 10. 1007/ s40264-022-01173-4. Funding No funding was received for this study. The authors declare that they have no conflict of interest. Ethics approval This study was reviewed by the University of Pittsburgh International Review Board (STUDY19120256) and designated as exempt for minimal risk prior to study commencement. Consent to participate Recruitment materials explained that completion of the survey constituted consent to have the respondent's anonymous results included in the study, but that the respondent could opt out at any time. Recruitment materials explained that completion of the survey constituted consent to have the respondent's anonymous results included in the study, but that the respondent could opt out at any time. Table 3 Comparison of probable or probable/definite nephrotoxic potential in the current critical care adult modified Delphi study to high-risk nephrotoxic potential in the pediatric consensus study [11] Nephrotoxic potential Nephrotoxins Agreement in rating between studies (n = 16) Amikacin, amphotericin B, cidofovir, colistin, cyclophosphamide, cyclosporine, fludarabine, gentamicin, ibuprofen, indomethacin, ketorolac, methotrexate, naproxen, tacrolimus, tobramycin, vancomycin Discrepancy in rating between studies (n = 5) Acyclovir (possible/probable vs high) Foscarnet (probable/definite vs moderate) Immune globulin (unlikely/possible vs high) Sirolimus (possible/probable vs high) Streptomycin (possible/probable vs high) Availability of data and material Available upon request to the corresponding author. Code availability Not applicable. Author contributions MG: concept generation, materials creation, ethics approval, data analysis, manuscript drafting and revision. EB: concept generation, material review, manuscript review. DS: concept generation, material review, manuscript review. JK: subject matter expert, manuscript review. KS: material review, manuscript review. KK: subject matter expert, manuscript review. AR: subject matter expert, manuscript review. SKG: concept generation, material review and distribution, manuscript drafting and revision. All authors read and approved the final version. Critical care nephrology: core curriculum 2020 World incidence of AKI: a meta-analysis Review of the literature on the costs associated with acute kidney injury Drug-induced acute kidney injury: a focus on risk assessment for prevention Epidemiology of acute kidney injury in critically ill patients: the multinational AKI-EPI study Spectrum of acute renal failure in the intensive care unit: the PICARD experience Acute renal failure in critically ill patients: a multinational, multicenter study Drug-associated acute kidney injury identified in the United States Food and Drug Administration Adverse Event Reporting System Database Drug-induced nephrotoxicity and dose adjustment recommendations: agreement among four drug information sources Electronic health record-based predictive models for acute kidney injury screening in pediatric inpatients AKI in low-risk versus high-risk patients in intensive care Evidence-based development of a nephrotoxic medication list to screen for acute kidney injury risk in hospitalized children Drug therapy and other factors associated with the development of acute kidney injury in critically ill patients: a cross-sectional study A prospective multi-center quality improvement initiative (NINJA) indicates a reduction in nephrotoxic acute kidney injury in hospitalized children Drug-associated renal dysfunction Adverse drug events during AKI and its recovery Phenotype standardization for drug-induced kidney disease Drug class combination-associated acute kidney injury Drug management in acute kidney disease: report of the Acute Disease Quality Initiative XVI meeting The Delphi technique: myths and realities Using and reporting the Delphi method for selecting healthcare quality indicators: a systematic review Analysis of the future: the Delphi method. Rand Paper A method for estimating the probability of adverse drug reactions Technologic distractions (part 1): summary of approaches to manage alert quantity with intent to reduce alert fatigue and suggestions for alert fatigue metrics Identifying high-risk medications associated with acute kidney injury in critically ill patients: a pharmacoepidemiologic evaluation Permissive AKI" with treatment of heart failure Acute kidney injury and increasing nephrotoxic-medication exposure in noncritically-ill children Impact of an antibiotic stewardship program on the incidence of vancomycin-associated acute kidney injury in hospitalized children Risk factors for development of acute kidney injury in critically ill patients: a systematic review and meta-analysis of observational studies Nephrotoxic drug burden among 1001 critically ill patients: impact on acute kidney injury Use of inotropes and vasopressor agents in critically ill patients Effect of hydroxyethyl starch vs saline for volume replacement therapy on death or postoperative complications among high-risk patients undergoing major abdominal surgery: the FLASH randomized clinical trial Contrast-induced nephropathy Remdesivir in patients with acute or chronic kidney disease and COVID-19 Remdesivir use in the setting of severe renal impairment: a theoretical concern or real risk?