key: cord-0988286-fgbv6ns7 authors: Nguyen, Derek L.; Harvey, Susan C.; Oluyemi, Eniola; Myers, Kelly S.; Mullen, Lisa A.; Ambinder, Emily B. title: Impact of Improved Screening Mammography Recall Lay Letter Readability on Patient Follow-Up date: 2020-07-30 journal: J Am Coll Radiol DOI: 10.1016/j.jacr.2020.07.006 sha: 91b9f531ea64a4ed531a7ffb22a4cf068cb08e69 doc_id: 988286 cord_uid: fgbv6ns7 PURPOSE: In the setting of abnormal results on screening mammography, the Mammography Quality Standards Act mandates that patients receive a mailed “recall” lay letter informing them to return for additional follow-up imaging. The language used in this letter should be “easily understood by a lay person.” In February 2019, the authors’ institution revised the language of its recall lay letter to the sixth grade reading level. The purpose of this study was to analyze the effect of improved readability on patient follow-up rates. METHODS: In this retrospective study, data from all screening mammograms at a single institution with BI-RADS category 0 assessments excluding technical recalls between February 2018 to February 2019 (preintervention group) and February 2019 to February 2020 (postintervention group) were reviewed. The primary outcome measure was the percentage of patients in each intervention group who returned for their diagnostic follow-up examination within 60 days (the standard recommended by the Centers for Disease Control and Prevention). Univariate and multivariate logistic regression was done to estimate odds ratios and 95% confidence intervals for follow-up within 60 days. RESULTS: This study included 1,987 patients in the preintervention group and 2,211 patients in the postintervention group. The patient follow-up rate within 60 days increased from 90.1% (1,790 of 1,987) in the preintervention group to 93.9% (2,076 of 2,211) in the postintervention group (P < .001). When controlling for imaging site, patients in the postintervention group had 1.78-fold increased odds of returning for a diagnostic follow-up examination within 60 days (95% confidence interval, 1.40-2.27). CONCLUSIONS: Revising an institution’s recall lay letter to a lower reading grade level significantly improved timely patient follow-up. The importance of written patient communication comprehension has increased as many patients are choosing to take more active roles in their health care. In the setting of abnormal results on screening mammography, the Mammography Quality Standards Act (MQSA) mandates that patients receive a mailed "recall" lay letter within 30 days informing them to return for additional follow-up imaging [1] . MQSA states that the language used in this letter should be "easily understood by a lay person." The Centers for Disease Control and Prevention (CDC) and the National Institutes of Health recommend that all written patient communication should have between a sixth and an eighth grade reading level [2] . Findings from previous literature demonstrate that in breast imaging as well as other medical specialties, poorer comprehension of written patient materials occurs with readability higher than this recommendation [3] [4] [5] . A previous study by our group evaluated patient comprehension of perceived time to return for follow-up imaging [6] . We compared our institution's initial recall lay letter and a proposed revised statement at a lower reading grade level using a paper-based survey. The results demonstrated a significant improvement in patient comprehension and likelihood of correctly interpreting the appropriate follow-up time frame with the revised statement compared with the initial statement. Education level was found to be an important predictor of understanding; participants who had achieved less than a college degree were least likely to comprehend the original lay latter correctly. Although these were important findings, the conclusions were drawn from only surveyed participants and thus were still theoretical and require practical confirmation. To maximize the efficacy of screening mammography recall lay letters, patients need to both understand and comply with timely follow-up recommendations in order to increase the likelihood of early breast cancer detection by screening mammography [7] . Therefore, evaluating the impact of theoretically improved patient comprehension on actual patient follow-up adherence requires further research, which we addressed in this follow-up study. Our aim was to assess the impact of improved readability on patient adherence to follow-up recommendations in the setting of abnormal results on screening mammography. The hypothesis was that the revised language would improve patient follow-up rates. Before February 15, 2019, the protocol for notifying patients of an abnormality detected on screening mammography that requires additional follow-up imaging at our institution was through telephone communication and the MQSA-mandated recall lay letter, as detailed in our previous study (Appendix 1) [8] . This recall lay letter's readability was assessed using the technique of Saraiya et al [9] . We developed a revised recall lay letter using their technique, and the lower reading grade level was verified using Microsoft Word's "Show Readability Statistics" tool (Appendix 1) [9] . After our previous study, on February 15, 2019, our institution implemented this revised recall lay letter across all four of its outpatient breast imaging sites [6] . Each of these sites serves a geographically different patient population. This revised statement's reading grade level was assessed in the same manner as the initial statement used before February 15, 2019 [9] . Between February 2018 and February 2020, this was the only change made to our institution's patient notification protocol. A retrospective cohort study was performed to evaluate the impact of implementing a revised recall lay letter on timely patient follow-up after detected abnormalities on screening mammography. We reviewed data from all screening mammograms at our institution with BI-RADS category 0 assessments performed from February 15, 2018, to February 14, 2019 (the preintervention group), and from February 15, 2019, to February 14, 2020 (the postintervention group). A portion of the preintervention group data set overlaps with the 2018 data set from our previous study [8] . Technical recall is defined as a "technical deficiency in image quality," and at our institution, every technical recall at screening is also assigned a BI-RADS category 0 assessment and thus excluded from our study [10] . To identify the patients during these time periods with BI-RADS category 0 assessment screening mammograms, Current Procedural Terminology codes were used by our institution's value analytics team to extract patient medical record numbers from our electronic medical record (EMR), Epic (Epic Systems, Verona, Wisconsin). The date of the diagnostic follow-up examination (mammography and/or breast or axillary ultrasound) was subsequently extracted. For medical record numbers without electronically extracted diagnostic follow-up examination dates, manual chart review was performed by one of the authors to ensure the accuracy of the final data set. Previous literature demonstrates that sociodemographic factors such as patient age, race, and ethnicity can affect breast cancer prognosis and patient follow-up adherence [11] [12] [13] . Therefore, these and other potential covariates (marital status, employment status, insurance type, and ZIP code at the time of the examination) were extracted from Epic. Similar to a previously reported study, insurance status was categorized into three groups: private or commercial, Medicare or Medicaid, and no insurance or self-pay [14] . Patients with both Medicare and private insurance were classified as private. Extracted patient ZIP codes were used to determine the National Area Deprivation Index (ADI) as a measure of disparity from the University of Wisconsin Neighborhood Atlas [15] . The range of National ADI percentile is from 1%, representing the least disadvantaged block group, to 100%, representing the most disadvantaged block group. Because the most disadvantaged 15% of neighborhoods are associated with increased rehospitalization rates, this was used as the demarcation cutoff in our study [16] . The institutional review board at our institution reviewed this study and designated it as exempt under US Department of Health and Human Services regulations. This study was HIPAA compliant . 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 Statistical Analysis R version 2017 was used to perform the statistical analyses (R Foundation for Statistical Computing, Vienna, Austria). Patient demographics were compared between the pre-and postintervention groups using the c 2 test for categorical variables and Student's t test for continuous variables. The primary outcome of interest was the overall percentage of patients in each intervention group who returned for their diagnostic follow-up examinations within the CDC guideline of 60 days (a binary outcome) [17] . The secondary outcome of interest was the percentage of patient adherence in each intervention group to follow-up recommendations within 60 days stratified by imaging-site sociodemographic factors (eg, clinic site, race). National ADI was compared between the sites using analysis of variance for continuous variables. Univariate and multivariate logistic regression analyses were performed to estimate odds ratios and 95% confidence intervals (CIs). The preintervention group was used as the reference group for regression analyses. To assess for potential associations between sociodemographic factors and follow-up adherence, univariate and multivariate logistic regression analyses were also performed on these factors. A total of 4,315 patients had BI-RADS category 0 assessments on screening mammography during the study period. Of these, 117 patients (2.7%) were excluded because of technical recall. Baseline characteristics of patients in each group are shown in Table 1 , with a total n ¼ 1,987 within the preintervention group and n ¼ 2,211 within the postintervention group. Table 2 presents the readability metrics for the initial and revised recall lay letters. The Flesch-Kincaid grade level was found to be 12.4 for the initial statement and 6.1 for the revised statement. Following the revision of the recall lay letter statement, the percentage of patients adherent to diagnostic follow-up within 60 days significantly increased from 90.1% (1,790 of 1,987) in the preintervention group to 93.9% (2,076 of 2,211) in the postintervention group (P < .001) (Fig. 1) . Even when controlling for potential confounders, patients in the postintervention group had 1.96-fold increased odds of returning for a diagnostic follow-up examination within 60 days compared with the preintervention group (95% CI, 1.52-2.53) ( Table 3) . As a subgroup analysis, we analyzed the effect of patient demographics on patient adherence to diagnostic follow- 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 up within 60 days (Figs. 2 and 3) . On univariate analysis, race, marital status, employment status, insurance type, and National ADI were significantly associated with patient adherence (Table 3) . On multivariate analysis, race remained statistically significant, with white patients significantly more likely to adhere to timely diagnostic follow-up recommendations compared with all other races. In addition, on multivariate analysis, patients who had Medicare or Medicaid and National ADI ! 85% were significantly less likely to follow up compared with patients with private or commercial insurance and National ADI < 85%. The four clinic sites at our institution serve different populations. Clinic site 1 is our busiest site and had the highest adherence before the letter revision, at 94.0% (625 of 665), and was therefore used as the reference category for comparison analysis (Fig. 1) . Site 3 had the most improvement in follow-up within 60 days after the intervention, from 86.0% (208 of 242) to 93.3% (237 of 254) (P ¼ .01) (Fig. 4) . Univariate and multivariate results are shown in Table 3 . On univariate analysis, patients presenting to sites 3 and 4 were significantly less likely to follow up in a timely manner compared with patients at site 1. Our study illustrates that implementing a revised recall lay letter that follows the CDC and National Institutes of Health language recommendations significantly improved patient adherence to timely diagnostic follow-up recommendations within 60 days. Improved readability of the recall lay letter increased the likelihood of patient follow-up adherence from 90.1% in the preintervention group to 93.9% in the postintervention group. When controlling for possible covariates, patients in the postintervention group had 2-fold increased odds of adherence. Our findings in the present study validate the conclusions of our previous study, confirming that improved follow-up adherence is the result of improved readability of written patient communication facilitating enhanced patient comprehension [4] . This study illustrates the direct before-and-after effects of remediated readability with significantly improved follow-up of women in the setting of abnormal results on screening mammography. This was significant for every imaging site in the preintervention group, with an initial follow-up rate less than 90%. Our prior results in conjunction with our present findings demonstrate that written communication is more effective when the language used is more inclusive for women of all educational backgrounds. Of all the imaging sites, site 3 initially began with the lowest patient follow-up rate of 86%. On the basis of our state's county health rankings data, which is provided by a collaboration between the Robert Wood Johnson Foundation and the University of Wisconsin Population Health Institute, site 3's patient population resides in a county that predominantly has lower socioeconomic status [18] [19] [20] . In 2018, the percentage of high school graduates was 70% (z ¼ 3.44), median household income was $46,604 (95% CI, $44,866-$48,342), 10% of adults were uninsured (95% CI, 9%-11%), the unemployment rate was 6.3% (z ¼ 1.09), and the percentage of population below the poverty level was 21.8%. This is starkly different from the patient population of site 1, which initially began with the highest patient follow-up rate of 94.0%: the percentage of high school graduates was 88% (z ¼ 0.28), median household income was $72,305 (95% CI, $69,877-$74,733), 8% of adults were uninsured (95% CI, 7%-9%), the unemployment rate was 4.5% (z ¼ À0. 24) , and the percentage of the population below the poverty level was 9.9%. The statistics for each site were not significantly different for 2019. Site 3 had the greatest positive change in patient follow-up adherence after the intervention, demonstrating the impact of improved readability on reducing discrepancies arising from education level. Although logical, these results are convincing and suggest that minor language revisions can yield a considerable impact in health care for women with lower educational backgrounds. Independent of intervention group, however, there was a decrease in the likelihood of follow-up within 60 days for site 3 compared with site 1 which could be attributed to the innate lower socioeconomic characteristics of site 3, specifically financial. Additionally, site 3 serves patients from more disadvantaged neighborhoods, as evident by its highest National ADI percentile of the four sites. Although sites 1 and 4 reside within the same county, these sites are 14 miles apart. The majority of patients going to site 4 reside closer to the site 3 county line, which could explain the similar results. A woman can typically undergo screening mammography at no charge, even without insurance, through multiple programs such as the National Breast and Cervical Cancer Control Program or the Susan G. Komen Breast Cancer Foundation [21] . However, these programs do not cover the expenses of diagnostic workup, with the average cost of diagnostic mammography being $290 without insurance, which can be increased to a total of at least $540 if breast and/or axillary ultrasound is also required [21] . Our multivariate results showed that patients within the most disadvantaged 15% of neighborhoods and having Medicare or Medicaid were also less likely to adhere to timely follow-up recommendations compared with patients in less disadvantaged neighborhoods and having private or commercial insurance, respectively. Previous literature demonstrates that living in a disadvantaged neighborhood is associated with increased use of health services and early death [16] . This emphasizes the associated financial burden diagnostic follow-up examinations can impose on these patients. Therefore, although more disadvantaged patients may have improved understanding of the need to return for their diagnostic follow-up examinations after language revisions, they may actively decide not to follow up because of the cost. At our institution, women who are classified as no insurance or self-pay represent a combination of disadvantaged patients who do not possess insurance and wealthy international patients who pay out of pocket. This may explain why this insurance type was not associated with a similarly decreased likelihood of timely follow-up adherence as with patients with Medicare or Medicaid. After revision of the recall lay letter, all races had increases in timely patient follow-up rates, although for African American patients this was nonsignificant. Regardless of the 23 counties in our state, African American patients have the lowest median household income of any race, with white patients having the highest [18] . In 2019 for site 3's county, median household income for African American patients was $36,428, compared with $72,085 for white patients; the overall median household income was $46,762 (95% CI, $45,123-$48,401). This may explain why on multivariate analysis white race was associated with significantly higher likelihood of adhering to timely diagnostic follow-up recommendations compared with all other races. Additionally, a previous meta-analysis study demonstrated that transportation barriers to health care access exist specifically for patients with lower incomes and for racial minorities [22] . Therefore, although intuitively, improved readability should improve patient follow-up across all races, our disparate racial results suggest that even if educational disparities are addressed, there may be other underlying barriers impeding patient follow-up. Further investigation is needed to understand how to define these barriers and how to overcome these challenges for these patient populations. Moving forward, the relationship between the financial burdens of diagnostic examinations and patient follow-up requires further exploration. The ACR is an important source of referenced literature, as it consistently provides helpful resources for the radiology community. The ACR provides sample lay letters that were developed by a multidisciplinary panel for institutions to use as is or as a template for their practices [23] . The language used in the sample recall lay letter is currently written at higher than the recommended eighth grade reading level [6] . Consideration should be given to updating this sample recall lay letter to a lower reading grade level, which would align with the ACR's core purpose of empowering advancement of radiologic care. Our study had several limitations, including the possibility of limited generalizability given that it was performed at a single institution. Additionally, our EMR does not track whether patients underwent their diagnostic follow-up examinations at other institutions after undergoing their screening examinations at our institution. Only covariates routinely entered in the EMR could be included in the analysis. On March 11, 2020, the World Health Organization declared coronavirus disease 2019 as a pandemic, which may have affected results from the last month of our study [24] . The pandemic may have caused a decrease in patient compliance, making the presented results a possible underestimate of the true benefit of the revised letter. This possible underestimation is small, however, as only 14 patients did not follow up between January 11, 2020, and February 14, 2020. Last, the effect of secular trends on our patients' adherence cannot be fully assessed, although these two groups represent consecutive years, minimizing this possible confounder. In conclusion, revising our institution's recall lay letter to a lower reading grade level significantly improved timely patient follow-up in the setting of abnormal results on screening mammography. We hope that this follow-up study will solidify the importance of appropriate readability of written patient communication and potentially modify recall lay letters currently being used by other breast imaging practices. -Implementation of appropriate readability of recall lay letters into clinical practice significantly increases the likelihood of timely follow-up for additional imaging in the setting of a screening abnormality. -Imaging sites that serve patient populations with lower educational backgrounds see the largest benefit in patient follow-up rates when a lower reading grade level is used in their screening recall lay letters. -Black women, women with Medicare or Medicaid, and women from the top 15% of disadvantaged neighborhoods had a significant increase in follow-up adherence after implementing language revisions. -However, when controlling for intervention group, these women were still less likely to undergo timely follow-up examinations compared with white women, women with private insurance, and women from more advantaged neighborhoods. The authors thank Jenn Zuk and Boris Feldman for their assistance with data acquisition. Content, readability, and understandability of dense breast notifications by state Assessing readability of patient education materials: current role in orthopaedics Mammography result notification letters: are they easy to read and understand? Evaluation of the written information sent to women who are called back for further investigation of breast screening in the UK Improving patient comprehension of screening mammography recall lay letters Breast cancer screening for average-risk women: recommendations from the ACR Commission on Breast Imaging Impact of telephone communication on patient adherence with follow-up recommendations after an abnormal screening mammogram Breast density notification letters and websites: are they too "dense RADS frequently asked questions-follow-up and outcome monitoring Available at Delays in breast cancer diagnosis and treatment by racial/ethnic group Racial/ethnic disparities in time to follow-up after an abnormal mammogram Body mass index and prognosis of breast cancer: an analysis by menstruation status when breast cancer diagnosis Diffusion of digital breast tomosynthesis among women in primary care: associations with insurance type Area Deprivation Index v2 Neighborhood socioeconomic disadvantage and 30-day rehospitalization: a retrospective cohort study Insurance-based differences in time to diagnostic follow-up after positive screening mammography Measuring socioeconomic status (SES) in the NCVS: background, options, and recommendations Discuss your options Traveling towards disease: transportation barriers to health care access Mammography sample lay report letters World Health Organization. WHO director-general's opening remarks at the media briefing on COVID-19-11 Additional resources can be found online at: https://doi. org/10.1016/j.jacr.2020.07.006.