key: cord-0767385-x2c9ebqk authors: Wegwarth, Odette; Wind, Stefan; Goebel, Eva; Spies, Claudia; Meerpohl, Joerg J.; Schmucker, Christine; Schulte, Erika; Neugebauer, Edmund; Hertwig, Ralph title: Educating Pharmacists on the Risks of Strong Opioids With Descriptive and Simulated Experience Risk Formats: A Randomized Controlled Trial date: 2021-09-27 journal: MDM Policy Pract DOI: 10.1177/23814683211042832 sha: 7899cf5144faf2b42aced49d34a9f23c4de9bc15 doc_id: 767385 cord_uid: x2c9ebqk Objectives. High opioid prescription rates in the United States and Europe suggest miscalibrated risk perceptions among those who prescribe, dispense, and take opioids. Findings from cognitive decision science suggest that risk perceptions and behaviors can differ depending on whether people learn about risks by experience or description. This study investigated effects of a descriptive versus an experience-based risk education format on pharmacists’ risk perceptions and counseling behavior in the long-term administration of strong opioids to patients with chronic noncancer pain. Methods. In an exploratory, randomized controlled online trial, 300 German pharmacists were randomly assigned to either a descriptive format (fact box) or a simulated experience format (interactive simulation). Primary Outcome Measures. 1) Objective risk perception, 2) subjective risk perception, and 3) intended and 4) actual counseling behavior. Results. Both risk formats significantly improved pharmacists’ objective risk perception, but pharmacists exposed to the fact box estimated the benefit-harm ratio more accurately than those exposed to the simulation. Both formats proved equally effective in adjusting pharmacists’ subjective risk perception toward a better recognition of opioids’ harms; however, pharmacists receiving the simulation showed a greater change in their actual counseling behavior and higher consistency between their intended and actual counseling than pharmacists receiving the fact box. Conclusion. The simulated experience format was less effective than the descriptive format in improving pharmacists’ objective risk perception, equally effective in motivating pharmacists to counsel patients on less risky treatment alternatives and more effective in changing the reported actual counseling behavior. Implications. These exploratory findings provide important insights into the relevance of the description-experience gap for drug safety and raise questions for future research regarding the specific mechanisms at work. Prescribing opioids can make good sense. Most patients experience adequate pain reduction when strong opioids are used to treat acute or cancer pain. 1 However, there is little and insufficient evidence that strong opioidsdefined as step III opioids on the World Health Organization pain ladder-are effective in the long term or superior to other analgesics in patients with chronic noncancer pain. 2 Despite this lack of supporting evidence, 3, 4 strong opioids are commonly prescribed to this patient group, with increasing prescription rates in Europe (e.g., the Netherlands, 5 Germany, 6-8 the United Kingdom 9 ) and a full-blown opioid epidemic in the United States. 10, 11 In Germany alone, about 80% of patients receiving strong opioids long term (.3 months) have chronic noncancer pain, 6 even though a national evidence-and consensus-based clinical practice guideline (S3) 12 cautions against the long-term use of strong opioids in this group and recommends that they be used only after thorough assessment of the benefits and harms and with close monitoring. 12 One reason for this non-evidence-based use of strong opioids might be that many health care professionals and patients have difficulties understanding medical statistics, [13] [14] [15] [16] [17] [18] [19] [20] [21] [22] [23] resulting in unrealistic views of the benefitharm ratios of medical interventions. [24] [25] [26] Although transparent statistical formats (e.g., absolute instead of relative risks) 27 and visualizations (e.g., fact boxes) 28, 29 have been developed to improve the communication of medical statistics, 23, 30 findings suggest that not everybody benefits from these educative formats. 24 An explanation for this somewhat unexpected finding may come from research in cognitive decision sciences, which has shown that risk perceptions and behaviors can be shaped by two learning paths: through personal experience (e.g., taking a medication and experiencing its consequences firsthand) and through descriptive information (e.g., medical evidence and statistics, guidelines, patient information). Depending on whether an individual has experienced a risk and/or received a description of it, they may behave as if they overestimate, underestimate, or correctly estimate the risk. For instance, an individual who has personally experienced a rare but life-threatening risk may subsequently act as if that risk were significantly higher than is objectively the case. 31, 32 Conversely, an individual who experiences many episodes of a risky behavior without the risk materializing-because ''experience samples'' are often too small to permit the observation of a rare and possibly cumulative risk (e.g., in substance use)-may behave as if they underestimate or underweight the risk. [33] [34] [35] If the experience of risk impacts risk perceptions and behaviors, 36 could simulated experience be harnessed to educate and inform people as witnessed in areas such as financial decision making or probabilistic reasoning? [37] [38] [39] To examine the effects of the two modes of learning about risks in the field of drug safety, we set up four randomized controlled trials (RCTs) under the umbrella of the ERONA project. The RCTs investigated four groups involved in the long-term administration of strong opioids: family physicians, physicians specialized in pain therapy, patients with chronic (3 months) noncancer pain, and pharmacists who regularly dispense narcotic substances. Here, we report results from the ERONA trial with pharmacists on the effects of an educative intervention involving either a simulated experience format (interactive simulation) or a descriptive format (fact box) on their 1) objective risk perception, 2) subjective risk perception, 3) intended counseling behavior, and 4) actual counseling behavior at 9-month follow-up. The ERONA project is funded by a grant from the German Federal Ministry for Health under the guideline ''Risk perception and risk behavior among stakeholders involved in settings of drug safety concern.'' We described the designs and methods in detail in a study protocol 35 that has not since been amended, registered the trial at the German Clinical Trials Register (DRKS00020358), made trial information public on the Open Science Framework (OSF), and adhered to the CONSORT checklist. In brief, the study is based on an exploratory independent RCT with two parallel online intervention arms. Data were collected before intervention at baseline (T0), immediately after intervention (T1), and 9 months after intervention (T2). The Institutional Ethics Board of the Max Planck Institute for Human Development, Berlin (Germany), approved the study (Ethic Approval ID: A 2020-05). The sample frame comprised accredited offline and online panels of IPSOS Health (Nuremberg, Germany) consisting of general populations of pharmacists. To detect a 15% difference in a two-tailed test with a 5% level of significance and a power of 80%, the trial required 150 participants per intervention arm (for details, see Wegwarth et al. 40 ). IPSOS started enrolment for the first wave (T1) in April 2020 and concluded it in August 2020. The enrolment for the 9-month follow-up (T2) began in January 2021 and was completed in April 2021. Eligibility was determined by a set of screening questions. Randomization was achieved by simple randomization. Participants were blind to the type of intervention they received. IPSOS approached 2679 eligible pharmacists, of whom a total of 369 started the trial upon invitation; 69 abandoned it prematurely before randomization to either intervention, leaving 300 participants (150 per intervention arm; CONSORT flow chart, Supplementary Material). Nine months after participation in the first wave, participants were approached again and asked solely about their actual counseling behavior. IPSOS approached only those (n = 184) who had stated at baseline (T0) that they actively counsel chronic noncancer pain patients with a long-term prescription of strong opioids on treatment alternatives, because the primary outcome of ''counseling behavior'' could be retrieved at T0, T1, and T2 for those pharmacists only. Of these 184 pharmacists (fact box: n = 91, simulation: n = 93), 133 (fact box: n = 72, simulation: n = 61) participated in the follow-up. Informed consent was acquired prior to the study. Participation was monetarily reimbursed. A fact box format was used for the descriptive intervention and an interactive simulation was used for the simulated experience intervention (see Figure 1 ). Both risk education interventions presented information on the benefit-harm ratio of the long-term administration of strong opioids in patients with chronic noncancer pain as absolute risks, adjusted to the same denominator (here: per 100 people), and compared with a control group (here: nonopioids or placebo). Numerical estimates of the benefits and harms were based on a systematic rapid review 41 conducted for the purposes of this RCT by the Institute for Evidence in Medicine (for the Cochrane Germany Foundation). 42 The two risk education formats differed in several respects: The interactive simulation presented information on the benefits and harms of strong opioids and of nonopioids/placebo interactively and sequentially, which allowed participants to directly observe change in the outcomes over time and to explore each outcome separately by using interactive filter functions. Fact boxes typically present information on benefits and harms of each treatment in tabular, static form. To address the different levels of interactivity of the two educative formats in this RCT, we implemented the fact box using MouseLab 43 (www.mouselabweb.org): Participants had to move the mouse pointer over cells of the fact box to access the numerical information about each benefit and harm. Before completing the survey questionnaires, participants provided demographic information (age, gender, years in practice, region of practice). The primary endpoints surveyed at baseline (T0) and immediately after intervention (T1) were 1) objective risk perception, 2) subjective risk perception, and 3) reported baseline counseling on alternatives to strong opioids (T0) and reported intended counseling on alternatives to strong opioids (T1). The primary endpoint investigated at 9-month follow-up (T2) was 4) reported actual counseling on alternatives to strong opioids. 1) Objective risk perception was operationalized by a series of six questions requiring participants to provide a specific numerical estimate for each of the outcomes (benefits/harms) presented in the intervention (see Figure 1 ). 2) Subjective risk perception was measured using a 5-point Likert-type scale with five options reaching from ''The benefits of strong opioids clearly outweigh the harms'' to ''The harms of strong opioids clearly outweigh the benefits.'' 3) It is neither standard nor mandatory for pharmacists to actively counsel chronic noncancer pain patients with a long-term prescription of opioids on alternative therapies. Pharmacists were therefore asked at baseline (T0) whether they actively counsel chronic pain patients on long-term opioid prescription. If their answer was positive, they were presented with four treatment alternatives-physiotherapy, lifestyle changes (e.g., reactivating social life), psychotherapy, and multimodal pain therapy-and asked to indicate the number of patients out of 100 to whom they currently recommend each treatment alternative (''counseling at baseline'') by moving a slider between 0 and 100. After intervention (T1), only the pharmacists who reported at baseline that they actively counseled patients were presented with the four treatment alternatives again and asked to indicate any increase or decrease in the number of patients out of 100 to whom they intended to recommend each treatment alternative in the future (''intended counseling'') by readjusting the slider. 4) To investigate pharmacists' actual counseling behavior at the 9-month follow-up, we presented them with their responses on treatment alternatives at T1 and asked them to indicate any increase or decrease in their actual relative to intended counseling behavior by moving the slider. As moderator variable, we assessed participants' medical risk literacy by administering an adapted version of the validated Critical Risk Interpretation Test (CRIT). 44 To prevent participants from abandoning the interventions prematurely and based on time estimates retrieved from pilot testing, the ''move on'' button was deactivated for 3 minutes for both interventions. The phrasing of the questions was piloted with 12 German pharmacists to ensure readability and relevance, and revised on the basis of their feedback. To analyze 1) objective risk perception, we compared mean numerical estimates of each benefit and harm at T0 and T1 and calculated mean differences between the two intervention conditions. To analyze 2) subjective risk perception, we investigated change in the Likert-scale judgments from T0 to T1. To evaluate the influence of the interventions on pharmacists' counseling behavior, we calculated means and mean differences between baseline counseling behavior (T0) and counseling behavior at 9month follow-up (T2) and tested for the implementation of intended behavior 45 by investigating for the consistency between physicians' reported intended prescription behavior at T1 and their actual counseling behavior at T2. The online questionnaire did not permit item nonresponse; there were thus no missing variables. Differences between the intervention groups were assessed using independent sample t tests or Mann-Whitney U tests (for continuous variables) or x 2 tests (for categorical variables). Differences within each group (before/after comparisons) were assessed using dependent sample t tests (for continuous variables) or Wilcoxon and McNemar's Figure 1 In the descriptive risk education format, the numerical values were concealed and participants had to move the mouse pointer over the respective cells of the fact box to access the information. In the interactive simulation, participants could observe changes over time by pressing the play button or by moving the horizontal slider to look at particular moments in time, they could explore specific risks by activating and deactivating the respective buttons, and they could sort the presentation of information. tests (for ordinal data). Independent predictors (e.g., medical risk literacy) of risk perception and counseling behavior were analyzed using regression analysis. Data were stored and analyzed with IBM SPSS Statistics 26. To control for nonresponse bias, 46 we compared the demographic characteristics of respondents and nonrespondents. 47, 48 Results Table 1 reports the distribution of age, gender, years in practice, and region of practice for all pharmacists who finished the survey (respondents) and for those who abandoned the survey prematurely (nonrespondents). Relative to respondents, nonrespondents tended to be younger and less experienced in terms of years in practice. Slightly more of them were female and more of them came from the south of Germany. Respondents exposed to the fact box format and respondents exposed to the simulated experience formats did not differ in distribution of age, gender, years in practice, and region of practice. Both the simulated experience and the descriptive format significantly improved pharmacists' objective risk perception of the benefits and harms of long-term administration of strong opioids (see Table 2 ). Participants in the descriptive condition, however, arrived more often at accurate numerical estimates than did participants in the simulated experience condition (see Table 2 ). Comparison of mean estimates across the two conditions found statistically significant differences for the estimates of ''reduction in pain'' (t[295.6] = 22.93, P \ 0.01) and ''risk of obstipation, nausea, and vomiting'' (t[295.6] = 22.07, P = 0.05) in favor of the fact box condition (see Table 2 ). Figure 2 illustrates pharmacists' risk estimates for each outcome before and after intervention by group; correct estimates falling within the 610% margin of error are shown in the gray area. Both risk education formats also proved effective in changing pharmacists' subjective risk perception of the benefit-harm ratio of the long-term administration of strong opioids in patients with chronic noncancer pain (see Figure 3 ). The proportion of pharmacists who believed that the harms are on par with or outweigh the benefits significantly increased in both the fact box condition (absolute increase: 14.3%; z = 24.63, P \ 0.01) and the interactive simulation condition (absolute increase: 10.0%; z = 24.45, P \ 0.01). Subjective risk perception did not differ between the two intervention groups (P = 0.76). After intervention (T1), the proportion of pharmacists who said they intended to proactively counsel patients with chronic noncancer pain on treatment alternatives did not differ between intervention groups (P = 0.97): 60.7% (n = 91) in the fact box and 62% (n = 93) in the interactive simulation condition. Responses to the question tapping the proportion of patients to whom pharmacists intended to recommend each of four treatment alternatives indicated that lifestyle changes ranked highest in both the fact box condition and the simulation condition This hierarchy in recommendation of treatment alternatives remained consistent at the 9-month follow-up. The two intervention groups did not differ from each other in the reported actual counseling behavior for any of the four treatment alternatives. However, there were differences within the intervention groups in terms of the actual change between the counseling behavior reported at baseline (T0) and at the 9-month follow-up (T2) and in terms of consistency between intended (T1) and actual counseling behavior (T2). While both interventions led to some notable differences in the mean counseling rates of less risky therapy alternatives between T0 and T2, the simulation intervention was more effective (Table 3) . Pharmacists presented with the simulated experience condition showed an increased mean counseling rate at T2 for three out of the four alternative therapy options Compared to the descriptive format, the simulated experience format also resulted in a higher propensity to implement intended behavior, measured in terms of the consistency between intended (T1) and actual counseling behavior (T2; Table 4 ). Within the simulated experience condition, intended and actual counseling rates differed for none of the therapy options-that is, the reported actual counseling behaviors were consistent with the intentions. Within the description condition, however, intended and actual counseling rates differed for three out of the four therapy options (Table 4) , with reported actual counseling rates on alternative therapy options being lower than intended at T1. Overall, pharmacists displayed relatively high levels of medical risk literacy: 86.7% answered three or more of the five CRIT questions correctly. We did not find any association between the primary outcomes and medical risk literacy or demographic variables such as gender, years in practice, or region of practice (regression tables, Supplementary Material). Within our exploratory RCT, we found that both risk education formats were effective in recalibrating pharmacists' objective perceptions of opioids' benefits and harms, by reducing over-and underestimations and boosting more correct estimation. The descriptive format, however, was better at correcting erroneous risk estimations. One potential explanation for this findingwhich is not in line with findings from some other domains 33,37 -might be that pharmacists and health professionals in general are considerably more likely to be familiar with tabular presentations of risk information such as fact boxes (e.g., side effect tables in package leaflets) than with interactive simulations. Given that our RCT was conducted during the COVID-19 pandemic, a challenging time for health care professionals, it seems likely that pharmacists found it easier to attend to a familiar format than to an unknown format. The observation that only two of the 150 pharmacists in the simulation condition ran the simulation more than once and 13 made use of filter functions, which means that only 10% of the pharmacists harnessed one or the other additional information potential offered by the simulation, supports this assumption. We also found that both interventions proved effective in improving pharmacists' subjective perceptions toward a more realistic view of the benefit-harm ratio; here, there was no difference between the two formats. In other words, the fact that pharmacists in the fact box condition produced more correct numerical estimates on specific benefits and harms of strong opioids than did pharmacists in the simulation condition did not translate into meaningful differences in terms of subjective risk evaluation. Likewise, it did not translate into any observable differences in intended counseling behavior between the two groups: Pharmacists in both intervention groups reported equal intentions to counsel their patients on less risky treatment alternatives. The simulated experience format did, however, outperform the descriptive format in terms of actual reported counseling behavior: While intended and actual rates of recommending for each of the four treatment alternatives did not differ in the interactive simulation group, actual rates were lower than intended rates for three of the four alternative treatments in the fact box group. The simulated experience format was also more effective in changing pharmacists' counseling behavior toward recommending more alternative therapy options. We can only speculate about why the consistency between pharmacists' intended and selfreported actual counseling behavior, as well as the actual change in counseling, was higher in the interactive simulation condition than in the fact box condition. In contrast to descriptive formats, interactive simulations allow participants to sequentially observe the occurrence (and potential disappearance) of a drug's benefits and/or harms over time. Participants can thus observe, for example, that a drug can initially have potent benefits that decrease with time, while rare but serious harms may emerge over time. Insights into the sequential dynamics behind the benefit-harm ratio-insights that may also more closely mirror what pharmacists observe in their daily practice-might trigger stronger implementation intentions. 45 As our RCT is, to our knowledge, the first investigation of the effects of different modes of learning about risks on actual behavior and intentionbehavior consistency, more work is needed to replicate these findings and to better understand the underlying cognitive mechanisms. Our study has limitations. First, our results are based on a convenience sample, which may affect generalizability of results. Our nonrespondent analysis of those who left the survey prematurely suggested some differences in age, gender, and region between respondents and nonrespondents. Second, we do not know why some pharmacists did not revise their initial estimates although they diverged from the scientific evidence presented. Time pressure due to the COVID-19 pandemic may have limited pharmacists' capacity to fully attend to the educational material. We can, however, largely rule out the possibility that they did not know how to interpret the data presented: The information was presented in accordance with current guidelines for evidence-based health information and there is evidence that fact boxes are effective even for laypeople with low literacy levels. 29, 30 Third, while each intervention was introduced in a short tutorial on its interactive functions, which proved effective in pilot testing, we cannot exclude the possibility that some participants did not fully understand how to use and navigate through the interactive features of the interventions. Fourth, to achieve some degree of comparable interactivity between the descriptive and the simulated experience format, the descriptive format in our study was not static, as is usually the case. Instead, it was interactive: It required participants' active involvement by moving the mouse pointer to access each of the numerical values. While the simulated experience intervention offered comparable chances for active involvement-for example, by exploring different risk information separately using interactive filter functions-the only required function for participants to access the risk information was to press the ''play'' button in order to start the simulation; the use of all other features was optional. Further research is required to better understand to what extent the superiority of an intervention in a given outcome is driven by required active involvement and other features. These limitations notwithstanding, our RCT is the first exploratory trial on the description-experience gap 35 in the field of drug safety. It provides initial and novel evidence that two promising tools-one description-based, one simulated experience-based-exist that can affect risk-related outcomes positively, but also differently: While both tools can be used to transparently educate pharmacists about a potent but high-risk drug-with the descriptive tool being potentially more effective-the simulated experience-based tool might be better suited to prompting pharmacists to recommend less risky treatment alternatives. These exploratory findings provide important insights into the relevance of the description-experience gap to drug safety. They also raise questions about what mechanisms work in what way. Our RCT provides a starting point for future researchers interested in drug safety to study the influence of different potential mechanisms in greater detail. Opioids for cancer pain: an overview of Cochrane reviews Opioids for chronic noncancer pain: a systematic review and metaanalysis Addiction rare in patients treated with narcotics Chronic use of opioid analgesics in non-malignant pain: report of 38 cases Trends in use and misuse of opioids in the Netherlands: a retrospective, multi-source database study Increase in opioid prescription in Germany between 2000 and 2009: a studybased on insurance data Longterm opioid therapy for chronic non-cancer pain in Germany Asgard Verlagsservice GmbH Current status of opioid epidemic in the United Kingdom and strategies for treatment optimisation in chronic pain Report of the International Narcotics Control Board for What is the US opioid epidemic? Langzeitanwendung von Opioiden bei chronischen nicht-tumorbedingten Schmerzen (LONTS)-Leitlinie [Long-term use of opioids for chronic noncancer pain-LONTS guideline Germany The effects of information framing on the practices of physicians Describing treatment effects to patients: how they are expressed makes a difference Number needed to treat and relative risk reduction Analyzing the effect of information format and task on cutoff search strategies A meta-analysis of the effects of presenting treatment benefits in different formats Probabilistic reasoning in clinical medicine: problems and opportunities Interpretation by physicians of clinical laboratory results Health professionals' and service users' interpretation of screening test results: experimental study Using natural frequencies to improve diagnostic inferences Deceiving numbers: survival rates and their impact on doctors' risk communication Do physicians understand cancer screening statistics? A national survey of primary care physicians in the US US gynecologists' estimates and beliefs regarding ovarian cancer screening's effectiveness 5 years after release of the PLCO evidence When evidence says no: gynecologists' reasons for (not) recommending ineffective ovarian cancer screening Clinicians' expectations of the benefits and harms of treatments, screening, and tests Helping doctors and patients make sense of health statistics Effect of tabular and icon fact box formats on comprehension of benefits and harms of prostate cancer screening: a randomized trial Using a drug facts box to communicate drug benefits and harms The drug facts box: providing consumers with simple tabular data on drug benefit and harm Adaptive learning and risk taking Die Bedeutung von beschreibungsbasiertem versus erfahrungsbasiertem Risikoverhalten fu¨r die Arzneimitteltherapiesicherheit Rare disaster information can increase risk-taking A meta-analytic review of two modes of learning and the description-experience gap The description experience gap in risky choice The effect of safe experience on a warnings' impact: sex, drugs, and rock-n-roll The role of experience sampling and graphical displays on one's investment risk appetite Experienced probabilities increase understanding of diagnostic test results in younger and older adults Sequentially simulated outcomes: kind experience versus nontransparent description Experiencing the risk of overutilising opioids among patients with chronic non-cancer pain in ambulatory care (ERONA): the protocol of an exploratory, randomised controlled trial Methods Rapid Reviews Efficacy and safety of long-term opioid therapy in patients with chronic non-cancer pain: a systematic review and meta-analysis. Pain Monitoring Information Processing and Decisions: The Mouselab System. Center for Decision Studies Doctors and numbers: an assessment of the Critical Risk Interpretation Test Implementation intentions and goal achievement: a meta-analysis of effects and processes Nonresponse research: an underdeveloped field in epidemiology The problem of response in epidemiologic studies in Germany (Part II) The problem of response in epidemiologic studies in Germany (Part I) We thank Susannah Goss and Deb Ain (MA) for editing our manuscript. OW conceptualized the project and drafted the manuscript. OW, CSp, JJM, and RH obtained the funding for the study and supervised the project. SW, EG, and ES contributed to the development of the survey questionnaire. SW, EG, CSp, JJM, CSch, ES, EN, and RH reviewed and edited the manuscript. All authors have read and approved the final manuscript and are accountable for its accuracy. The original data set can made available to authorized individuals upon written request to the authors. Additional data will be made publicly available via the Open Science Framework under https://osf.io/swqpm/ when the ERONA project is concluded (anticipated: December 2021).