key: cord-0976574-vnb5s1uq
authors: de Andrade, Joao A.; Kulkarni, Tejaswini; Neely, Megan L.; Hellkamp, Anne S.; Case, Amy Hajari; Culver, Daniel A.; Guntupalli, Kalpalatha; Bender, Shaun; Conoscenti, Craig S.; Snyder, Laurie D.
title: Associations between resources and practices of ILD centers and outcomes in patients with idiopathic pulmonary fibrosis: data from the IPF-PRO Registry
date: 2022-01-07
journal: Respir Res
DOI: 10.1186/s12931-021-01921-7
sha: a33bd172104558cbf0a8aa7148c82408b5bfb331
doc_id: 976574
cord_uid: vnb5s1uq

BACKGROUND: Performance benchmarks for the management of idiopathic pulmonary fibrosis (IPF) have not been established. We used data from the IPF-PRO Registry, an observational registry of patients with IPF managed at sites across the US, to examine associations between the characteristics of the enrolling sites and patient outcomes. METHODS: An online survey was used to collect information on the resources, operations, and self-assessment practices of IPF-PRO Registry sites that enrolled ≥ 10 patients. Site variability in 1-year event rates of clinically relevant outcomes, including death, death or lung transplant, and hospitalization, was assessed. Models were adjusted for differences in patient case mix by adjusting for known predictors of each outcome. We assessed whether site-level heterogeneity existed for each patient-level outcome, and if so, we investigated potential drivers of the heterogeneity. RESULTS: All 27 sites that enrolled ≥ 10 patients returned the questionnaire. Most sites were actively following > 100 patients with IPF (70.4%), had a lung transplant program (66.7%), and had a dedicated ILD nurse leader (77.8%). Substantial heterogeneity was observed in the event rates of clinically relevant outcomes across the sites. After controlling for patient case mix, there were no outcomes for which the site variance component was significantly different from 0, but the p-value for hospitalization was 0.052. Starting/completing an ILD-related quality improvement project in the previous 2 years was associated with a lower risk of hospitalization (HR 0.60 [95% CI 0.44, 0.82]; p = 0.001). CONCLUSIONS: Analyses of data from patients with IPF managed at sites across the US found no site-specific characteristics or practices that were significantly associated with clinically relevant outcomes after adjusting for patient case mix. Trial registration ClinicalTrials.gov, NCT01915511. Registered 5 August 2013, https://clinicaltrials.gov/ct2/show/NCT01915511 SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1186/s12931-021-01921-7.

Idiopathic pulmonary fibrosis (IPF) is a progressive interstitial lung disease (ILD) associated with decline in lung function and high mortality [1] . Although international guidelines for the diagnosis and management of IPF have Open Access *Correspondence: joao.de.andrade@vumc.org 1 Vanderbilt University School of Medicine, Nashville, TN, USA Full list of author information is available at the end of the article de Andrade et al. Respiratory Research (2022) 23:3 been published by the American Thoracic Society (ATS), European Respiratory Society (ERS), Japanese Respiratory Society (JRS), and Latin American Thoracic Association (ALAT) [1] [2] [3] [4] , performance benchmarks for centers diagnosing and managing these patients have not been established. A retrospective study conducted at a single US center found that greater adherence to a bundle of care based on the 2011 ATS/ERS/JRS/ALAT guidelines was associated with improved transplant-free survival after adjustment for age and forced vital capacity (FVC) at baseline [5] . However, there remain few data on how site-specific management practices and resources relate to outcomes in patients with IPF. We hypothesized that the resources, procedures, or organizational characteristics of the sites at which patients with IPF are managed may influence outcomes. The IPF-PRO Registry (NCT01915511) is an observational multi-center US registry that has enrolled patients with IPF at pulmonary clinics across the US [6] . Registries provide an opportunity to compare practices and outcomes across enrolling centers to generate evidence that may improve clinical care. Previous analyses of data from the IPF-PRO Registry identified a number of patient characteristics that were associated with death or lung transplant [7, 8] . We used data from this registry to describe the enrolling centers' characteristics and to assess associations between these characteristics and patient outcomes.

The design of the IPF-PRO Registry has been published [6] . Briefly, patients with IPF that was diagnosed or confirmed at the enrolling center in the past 6 months were eligible for enrollment. Patients who were participating in a randomized clinical trial or listed for lung transplant could not be enrolled, but patients could participate in a clinical trial or be listed for lung transplant after enrollment. A total of 1002 patients were enrolled at 46 sites (as listed in the "Acknowledgments") between June 2014 and October 2018. For this analysis, data were extracted from the database in March 2020.

An online survey was used to gather information on the resources, operations, and self-assessment practices of all sites that had enrolled ≥ 10 patients. The survey was developed by adapting the framework used by the US Cystic Fibrosis Foundation clinical benchmarking project [9] . The threshold of 10 patients was selected to ensure that reliable site-level estimates were obtained. Sites completed the questionnaire between 5 February and 1 June 2020, and were instructed to report on their practices and resources prior to the COVID-19 pandemic. Responses based on continuous variables are presented as median (25th percentile, 75th percentile) and categorical variables are presented as number and percentage of sites. The characteristics of patients enrolled at sites included versus not included in this analysis are presented descriptively.

For every site included in the analysis, we estimated the 1-year event rate of the following outcomes from the time of enrollment: (i) death or lung transplant; (ii) hospitalization; (iii) decline in FVC ≥ 10% (mL or % predicted), decline in diffusing capacity of the lungs for carbon monoxide (DLco) ≥ 15% (mmol/min/kPa or % predicted), death, or lung transplant; and (iv) worsening in each patient-reported outcome, death, or lung transplant. The patient-reported outcomes used were the St. George's Respiratory Questionnaire (SGRQ) [10] , the Cough and Sputum Assessment Questionnaire (CASA-Q) [11] , the 12-item short-form survey (SF-12) [12] and the EuroQoL 5-D (EQ-5D) index score and visual analog scale (VAS) [13] . The thresholds for worsening of the patient-reported outcomes, i.e. an increase in SGRQ total score ≥ 7, increase in SGRQ activity score ≥ 5, increase in SGRQ impact score ≥ 7, increase in SGRQ symptoms score ≥ 8, decrease in CASA-Q cough domains ≥ 11, decrease in SF-12 mental component summary (MCS) score ≥ 6, decrease in SF-12 physical component summary (PCS) score ≥ 5, decrease in EQ-5D index score ≥ 0.06 and decrease in EQ-5D VAS ≥ 8, were based on published estimates for minimal clinically important differences [14] [15] [16] [17] [18] .

Site-specific event rates were estimated using the Kaplan-Meier method for all outcomes except hospitalization, for which the cumulative incidence function was used. Site variability in event risk was assessed by fitting a Cox proportional hazards model with a random baseline hazard for each site. Baseline hazard can be interpreted as the relative hazard of a patient at a given site meeting the endpoint relative to a patient at another randomly selected site. The models were adjusted for differences in patient case mix by adjusting for known predictors of each outcome. These predictors were identified through modeling of data from all patients in the IPF-PRO Registry (see Additional file 1: Appendix S1 for details). Age, body mass index (BMI), forced expiratory volume in 1 s (FEV 1 ) % predicted, FVC % predicted, DLco % predicted, oxygen use with activity, oxygen use at rest, coronary artery disease or heart failure at enrollment, and diagnosis of IPF prior to referral to the enrolling center, were included as adjustment variables in the model assessing death or lung transplant. BMI, FEV 1 % predicted and oxygen use at rest at enrollment were included as adjustment variables in the model assessing hospitalization. The presence of clinically significant emphysema on HRCT in the opinion of the investigator at enrollment was included as an adjustment variable in the model assessing decline in FVC, death, or lung transplant. Sex, distance to the enrolling site and hospitalization prior to enrollment were included as adjustment variables in the model assessing decline in DLco, death, or lung transplant. Sex and the value of the respective patient-reported outcome at enrollment were included as adjustment variables in the models assessing worsening in a patient-reported outcome, death, or lung transplant.

To generate a valid model fit, sites that enrolled < 25 patients were grouped. To assess whether site-level heterogeneity existed for each patient-level outcome, we tested whether the variance of a random site effect was > 0. If there was evidence of site-level heterogeneity, i.e. if the random site effect was > 0, we investigated potential drivers of the heterogeneity by looking at associations between site practices and outcomes using forward stepwise selection (with an alpha-to-stay of 0.05). That is, covariates were selected one-by-one based on the covariate with the smallest p-value. At each step, the model was adjusted for covariates selected in previous steps, and the selection process terminated when the p-values of all remaining covariates were > 0.05. In the Cox proportional hazards models, missing data were handled using multiple imputation. The Full Conditional Specification method was used to fill in the missing data five times to generate five complete data sets. Each complete data set was analyzed using standard statistical analyses and the results were averaged to generate the final inferential results. All analyses were conducted using SAS version 9.4 or higher (SAS Institute, Cary, NC).

All 27 sites that enrolled ≥ 10 patients and were sent the questionnaire completed it. Twenty-one of these 27 sites were considered academic sites (with a medical school). One site did not complete the section on staffing models. The responses are presented in Table 1 . The majority of sites were actively following > 100 patients with IPF (70.4%) and had a lung transplant program at the site (66.7%). Most sites had a dedicated ILD nurse leader to coordinate clinical activities (77.8%), access to a chest radiologist (96.3%) and access to a lung pathologist (100%). The median number of ILD physician specialists was 6. Almost half of the sites (48.1%) held weekly multidisciplinary conferences to discuss patients. Physicians, nurses and nurse practitioners/physician assistants were the most frequent providers seeing patients in the clinic (Fig. 1 ). Patients routinely participated in some form of remote monitoring (telehealth, remote pulmonary function tests, electronic medical records held at center, or other forms of remote monitoring) at 22.2% of the sites. An ILD-related quality improvement project had been started or completed in the last 2 years at 40.7% of the sites.

The sites that enrolled ≥ 10 patients provided 920 (91.8%) of the 1002 patients in the registry. The median (25th percentile, 75th percentile) number of patients enrolled across the 27 sites was 26 (19, 45) . Age, FVC, DLco and oxygen use were similar in these patients compared with patients enrolled at sites not included in the analysis (Additional file 1: Table S1 ).

Substantial heterogeneity in site-specific event rates was observed ( Table 2 ). The median (Q1, Q3) site-specific 1-year event rates were 9.8% (6.3%, 17.5%) for death or lung transplant and 21.3% (12.5%, 30.8%) for hospitalization. Similar heterogeneity was observed for the declines in lung function and the composite outcomes that included deterioration in patient-reported outcomes ( Table 2) .

Twelve sites enrolled between 10 and 25 patients and were grouped in the models. This accounted for 22.2% of the cohort (204 patients). The responses to the questionnaire from sites that enrolled < 25 versus ≥ 25 patients are presented in Additional file 1: Table S2 . There were no outcomes for which the site variance component was significantly different from 0, i.e., there was no significant (p < 0.05) site-level heterogeneity for any outcome after controlling for patient case mix, but the p-value for hospitalization was 0.052 (Table 3) . When the relationship between site practices and risk of hospitalization was assessed, "starting/completing an ILD-related quality improvement project in the previous 2 years" was associated with a lower risk of hospitalization (HR 0.60 [95% CI 0.44, 0.82]; p = 0.001) and "patients routinely participate in some form of remote monitoring" was associated with a higher risk of hospitalization (HR 1.46 [95% CI 1.04, 2.05]; p = 0.028). After controlling for patient case mix and these site practices, there was no significant site-level heterogeneity for hospitalization (p = 0.17). The responses to the questionnaire from sites with versus without an ILD-related quality improvement project are presented in Additional file 1: Table S3 .

We used data from the IPF-PRO Registry to investigate potential associations between the resources and practices of centers with experience in the diagnosis and management of ILD and outcomes in US patients with IPF. To our knowledge, these are the first data investigating such associations. Substantial heterogeneity was observed in the event rates of clinically relevant outcomes across the sites. However, after controlling for differences in known predictors of the outcomes, there were no outcomes for which significant site-level heterogeneity existed i.e., there was no evidence that differences in site practices contributed to the heterogeneity in outcomes across the sites. It remains possible that site-level heterogeneity in outcomes would have been observed if sites with greater differences in resources and practices, e.g. larger academic or regional referral expert centers versus smaller community practices, were compared.

Previous studies have suggested that delayed access to a tertiary care center is associated with worse outcomes in patients with IPF or other ILDs. A prospective study of 129 patients with IPF evaluated at a US tertiary care center found that a greater time from onset of dyspnea to evaluation at the tertiary care center was associated with an increased risk of mortality, after adjustment for age, sex, FVC, payer, and educational attainment [19] . Among 247 patients with IPF from two specialist ILD centers in the UK, patients who were reviewed at a specialist center within 12 months of referral had higher FVC and lower mortality than patients who waited longer to be reviewed [20] . Three-year survival was significantly higher among 144 patients with non-IPF ILDs who received care at a specialized ILD clinic supported by a multidisciplinary team than in a historical cohort of 127 patients whose care was provided by pulmonologists without subspecialty training in ILD or at general clinics without specialized nursing support [21] . The implementation of a multidisciplinary care model at a Canadian clinic was associated with a reduction in the rate of respiratoryrelated hospitalizations among patients with IPF [22] .

Almost half of the IPF-PRO Registry sites that we surveyed had started or completed an ILD-related quality improvement project in the previous 2 years. Quality improvement projects are designed to improve the safety, effectiveness and experience of patient care by enhancing healthcare system performance [23, 24] . We found that patients at sites that had undertaken an ILD-related quality improvement project had a numerically lower risk of hospitalization. The reasons for this finding are unclear, as the changes that sites made to their practices as a result of participating in the quality improvement project are unknown and there were no site practices that were clearly associated with better outcomes after controlling for differences in patient case mix.

Data are median (25th percentile, 75th percentile) or n (%) of sites. Three centers did not provide data on the number of ILD physician specialists; one center did not provide data on written care protocols a Other responses: "Will likely be rolling out more telehealth in the next 1-2 years", "Did not do this until the COVID epidemic; now telehealth is big in our program; and will likely remain so" b Other responses: "First 3 days of week, within 1 day, otherwise several days", "We usually send to the emergency department for serious issues" Started or completed an ILD-related quality improvement project in last 2 years 11 (40.7)

Outcomes self-assessment process in place 2 (7.4) National Institutes of Health (NIH)-funded research in last 2 years (anyone at center or on team) 18 (66.7)

Center is a member of the Pulmonary Fibrosis Foundation Care Center Network 24 (88.9)

Institution has a lung transplant program 18 (66.7)

Written care protocols/clinical pathways for drug safety monitoring 13 (50.0) Surprisingly, patients from sites where patients participated in routine remote monitoring had a numerically higher risk of hospitalization. The reason for this observation is unknown. By providing more frequent measurements of lung function, monitoring of FVC through home spirometry may enable earlier detection of disease progression [25] , but the evidence to support this is limited. While it is possible that patients who participated in remote monitoring had disease progression detected earlier and so were more likely to be hospitalized, it seems unlikely that patients with IPF who had a deterioration that required hospitalization would not have been hospitalized in the absence of remote monitoring. It is possible that in-person visits associate with additional assessments (e.g., chest CT) that may improve clinicians' comfort not to hospitalize symptomatic patients, or allow earlier intervention that prevents hospitalization.

Strengths of our analyses include the use of a large cohort of patients with IPF enrolled using broad inclusion criteria at multiple sites across the US and adjustment for known predictors of the outcomes. Our analyses also have some limitations. The survey was developed by the research team using the framework of a benchmarking project for a different patient population; however, our survey is aligned with a recently published Delphi survey on the essential components of a specialized ILD clinic [26] . Sites in the IPF-PRO Registry are, in general, regional or national referral centers, which are not representative of all centers at which patients with IPF are managed in the US. It is possible that a study that included more community-based sites as well as referral centers, and so included a greater variety of sites, may have detected associations between site practices and outcomes. The questionnaire used in this study did not collect details of site practices such as quality improvement or palliative care programs. Data on site-specific follow-up and prescription practices were not collected. The use of antifibrotic drugs across the enrolling centers was not assessed in this study, but has previously been shown to be variable across sites in this registry [27] . The association between antifibrotic drug use and outcomes will be the subject of future work. The patient-reported outcome measures used to assess changes in quality of life in the IPF-PRO Registry were not developed in patients with IPF and have limitations as measures of short-term change. Our analyses were based on site practices prior to the COVID-19 pandemic, which resulted in changes in the use of telemedicine that are unlikely to be entirely reversed. 

This analysis of data from over 900 patients with IPF managed at sites with experience in the diagnosis and management of ILD across the US found no site-specific characteristics or practices that were significantly associated with clinically relevant outcomes after adjusting for factors known to be associated with these outcomes. Further studies are needed on resources, systems and management practices that may improve outcomes in patients with IPF.

A podcast of Joao de Andrade and Tejaswini Kulkarni discussing these data is available at: https:// www. ussci comms. com/ respi ratory/ deAnd rade/ IPF-PROsi tepra ctices 

The online version contains supplementary material available at https:// doi. org/ 10. 1186/ s12931-021-01921-7.

Additional file 1: Appendix S1. Identification of predictors of clinical outcomes used in adjustment of models. Table S1 . Baseline characteristics of patients enrolled at sites included versus not included in the analysis. Table S2 . Responses to questionnaire from sites that enrolled < 25 versus ≥ 25 patients. Table S3 . Responses to questionnaire from sites with versus without an ILD-related quality improvement project.

Froedtert & The Medical College of Wisconsin Community Physicians

Columbia University Medical Center/New York Presbyterian Hospital

Ather Siddiqi (formerly Wael Asi)

The authors did not receive payment for development of this article. Writing support was provided by

Diagnosis of idiopathic pulmonary fibrosis. An official ATS/ERS/JRS/ALAT clinical practice guideline

An official ATS/ERS/JRS/ALAT statement: idiopathic pulmonary fibrosis: evidence-based guidelines for diagnosis and management

An official ATS/ERS/JRS/ALAT clinical practice guideline: treatment of idiopathic pulmonary fibrosis. An update of the 2011 clinical practice guideline

Home oxygen therapy for adults with chronic lung disease. An official American Thoracic Society clinical practice guideline

A bundled care approach to patients with idiopathic pulmonary fibrosis improves transplant-free survival

Rationale for and design of the Idiopathic Pulmonary Fibrosis-PRospective Outcomes (IPF-PRO) registry

Predictors of death or lung transplant after a diagnosis of idiopathic pulmonary fibrosis: insights from the IPF-PRO Registry

Associations between patientreported outcomes and death or lung transplant in idiopathic pulmonary fibrosis. Data from the Idiopathic Pulmonary Fibrosis Prospective Outcomes Registry

Key findings of the US Cystic Fibrosis Foundation's clinical practice benchmarking project

The St George's respiratory questionnaire

Development and validation of a cough and sputum assessment questionnaire

A 12-item short-form health survey: construction of scales and preliminary tests of reliability and validity

EQ-5D: a measure of health status from the EuroQol Group

Estimation of minimally important differences in EQ-5D utility and VAS scores in cancer

The SF-36 and SGRQ: validity and first look at minimum important differences in IPF

Estimation of minimal clinically important difference in EQ-5D visual analog scale score after pulmonary rehabilitation in subjects with COPD

Psychometric properties and minimal important differences of SF-36 in idiopathic pulmonary fibrosis

Minimal clinically important differences for patient-reported outcome measures of cough and sputum in patients with COPD

Delayed access and survival in idiopathic pulmonary fibrosis: a cohort study

Time taken from primary care referral to a specialist centre diagnosis of idiopathic pulmonary fibrosis: an opportunity to improve patient outcomes?

Implementing an interstitial lung disease clinic improves survival without increasing health care resource utilization

Beyond idiopathic pulmonary fibrosis diagnosis: multidisciplinary care with an early integrated palliative approach is associated with a decrease in acute care utilization and hospital deaths

What is "quality improvement" and how can it transform healthcare?

The Quality Improvement Education (QIE) roadmap: a pathway to our future. The alliance for continuing education in the health professions

Daily home spirometry: an effective tool for detecting progression in idiopathic pulmonary fibrosis

Essential components of an interstitial lung disease clinic: results from a Delphi survey and patient focus group analysis

Antifibrotic drug use in patients with idiopathic pulmonary fibrosis. Data from the IPF-PRO Registry

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations

MLN, CSC and LDS were involved in the design of the study. JAdA, AHC, DAC and KG were involved in data acquisition. MLN and ASH were involved in data analysis. All authors were involved in the interpretation of the data and in the writing and critical review of the manuscript. All authors read and approved the final manuscript.

The IPF-PRO/ILD-PRO ™ Registry is funded by Boehringer Ingelheim Pharmaceuticals, Inc. (BIPI) and co-ordinated by the Duke Clinical Research Institute (DCRI).

The datasets analyzed during the current study are not publicly available, but are available from the corresponding author on reasonable request.

The study was approved by the Duke University Institutional Review Board (Pro00046131). The protocol was also approved by the relevant Institutional Review Boards and/or local Independent Ethics Committees prior to patient enrollment at each site listed in the "Acknowledgments". All patients provided informed consent.

Not applicable.

JAdA reports personal fees from BI. TK reports speaker fees from BI. MLN, ASH and LDS are faculty members at DCRI, which receives funding from BIPI to coordinate the IPF-PRO/ILD-PRO Registry. AHC reports personal fees and nonfinancial support from BI, personal fees from Genentech, and non-financial support from DCRI. DAC reports personal fees from BI and Genentech. KG has nothing to disclose. SB and CSC are employees of BIPI.