key: cord-0022592-7hc0vuxe authors: Messé, Steven R.; Erus, Guray; Bilello, Michel; Davatzikos, Christos; Andersen, Grethe; Iversen, Helle K.; Roine, Risto O.; Sjöstrand, Christina; Rhodes, John F.; Søndergaard, Lars; Kasner, Scott E. title: Patent Foramen Ovale Closure Decreases the Incidence but Not the Size of New Brain Infarction on Magnetic Resonance Imaging: An Analysis of the REDUCE Trial date: 2021-08-30 journal: Stroke DOI: 10.1161/strokeaha.121.034451 sha: 916cf5648cd6daf67236688419449be1f3d9497a doc_id: 22592 cord_uid: 7hc0vuxe BACKGROUND AND PURPOSE: Randomized patent foramen ovale closure trials have used open-label end point ascertainment which increases the risk of bias and undermines confidence in the conclusions. The Gore REDUCE trial prospectively performed baseline and follow-up magnetic resonance imaging (MRIs) for all subjects providing an objective measure of the effectiveness of closure. METHODS: We performed blinded evaluations of the presence, location, and volume of new infarct on diffusion-weighted imaging of recurrent clinical stroke or new infarct (>3 mm) on T2/fluid attenuated inversion recovery from baseline to follow-up MRI at 2 years, comparing closure to medical therapy alone. We also examined the effect of shunt size and the development of atrial fibrillation on infarct burden at follow-up. RESULTS: At follow-up, new clinical stroke or silent MRI infarct occurred in 18/383 (4.7%) patients who underwent closure and 19/177 (10.7%) medication-only patients (relative risk, 0.44 [95% CI, 0.24–0.81], P=0.02). Clinical strokes were less common in closure patients compared with medically treated patients, 5 (1.3%) versus 12 (6.8%), P=0.001, while silent MRI infarcts were similar, 13 (3.4%) versus 7 (4.0%), P=0.81. There were no differences in number, volumes, and distribution of new infarct comparing closure patients to those treated with medication alone. There were also no differences of number, volumes, and distribution comparing silent infarcts to clinical strokes. Infarct burden was also similar for patients who developed atrial fibrillation and for those with large shunts. CONCLUSIONS: The REDUCE trial demonstrates that patent foramen ovale closure prevents recurrent brain infarction based on the objective outcome of new infarcts on MRI. Only clinical strokes were reduced by closure while silent infarctions were similar between study arms, and there were no differences in infarct volume or location comparing silent infarcts to clinical strokes. REGISTRATION: URL: https://www.clinicaltrials.gov; Unique identifier: NCT00738894. proposed as an intervention to reduce recurrent stroke risk in patients with presumed PFO-associated stroke and transcatheter closure devices have been used in clinical practice before definitive evidence proving their efficacy. 3 Randomized trials were undertaken to confirm or refute the benefit of PFO closure and up to this point 6 studies have been completed. [4] [5] [6] [7] [8] [9] To ensure study feasibility, each of these trials used an openlabel design with both patients and treating clinicians aware of the treatment assignment and actual treatment received. However, this methodological approach increases the risk of bias and potentially undermines the confidence in the conclusions of the studies. The Gore REDUCE study was the only trial that required all patients to undergo magnetic resonance imaging (MRI) at baseline and after a clinical neurological event or at 2-years of follow-up. The change in volume of infarct from baseline to follow-up MRI is an objective outcome which could provide additional support for the important findings of this clinical trial. The initial publication reported that while clinical stroke was reduced by PFO closure compared with medical therapy alone, the number of patients with new silent MRI infarcts were not significantly different between the study arms. 7 However, there was no assessment of whether PFO closure reduced the size and number, or altered the location of infarcts. We performed an analysis of MRI data from the REDUCE trial, assessing volumes, numbers, and locations of new brain infarcts on followup MRI compared with the baseline MRI. Our hypothesis was that patients who underwent closure would have fewer numbers and smaller volumes of infarct compared with subjects who only took medication. The study data may be made available upon reasonable request to the sponsor. As described in a previous publication, the Gore REDUCE clinical trial enrolled 664 patients under age 60 with a PFO with right-to-left shunt, an embolic-appearing ischemic stroke within the past 6 months, and no alternative mechanism identified after a complete work up. 7 Written informed consent was obtained, and subjects were randomized in a 2:1 ratio to closure with the GORE HELEX/CARDIOFORM Septal Occluder plus antiplatelet medical therapy or antiplatelet medical therapy alone. Institutional review boards at enrolling centers approved this study. Per the protocol, all subjects underwent brain MRI before randomization and again at 2 years if they remained free of clinical stroke symptoms. At every follow-up timepoint, patients were assessed for a new stroke which included use of a validated questionnaire to objectively detect new stroke symptoms. If screening for symptoms was positive or a clinical stroke was suspected, MRI was required by protocol to confirm or refute an infarct. A blinded MRI core lab reviewed all brain MRIs for evidence of new ischemic injury of 3 mm or greater comparing T2/fluid attenuated inversion recovery (FLAIR)sequences between the screening MRI and follow-up MRI. For this analysis, we included all 37 patients with clinical stroke or core lab identified new ischemic injury comparing baseline to follow-up T2/FLAIR-sequence MRI. If there was no clinical event and no follow-up MRI, these cases were excluded from the analysis. Figure 1 shows the CONSORT (Consolidated Standards of Reporting Trials) flow diagram for this analysis. New infarcts, defined as acute diffusion-weighted imaging lesion at time of recurrent clinical stroke or new T2/FLAIR lesion >3 mm in any dimension from baseline to follow-up MRI at 2 years, were identified and segmented using a semiautomated methodology blinded to treatment assignment. T2/ FLAIR scans were automatically corrected for image inhomogeneities, and baseline scans were linearly registered with follow-up timepoints. 10, 11 New infarcts were identified and segmented on the follow-up timepoint by a radiologist using ITK-Snap. 12 The baseline apparent diffusion coefficient and diffusion-weighted imaging scans of each subject were also used to identify new lesions, if the information on T2/FLAIR scans was not sufficient alone for the decision. A multi-atlas skull stripping algorithm was applied for the removal of extra-cranial material on T1-weighted scans. 13 Each scan was segmented into a set of anatomic regions of interest using a multi-atlas label fusion method. 14 Regional infarct volumes and counts were calculated within each regions of interest, as well as in larger anatomic regions obtained by grouping single regions of interests within a hierarchical representation. Vascular distributions, anterior or posterior, were then determined using these regions of interest maps. To evaluate the effect on shunt size on infarct outcomes, we used the echocardiography core lab assessment of shunt size (occluded, trivial [0-5 bubbles in left atrium], moderate [6-25 bubbles], or large [>25]). If there was no core lab assessment, we used the site assessment of the shunt. For patients in the medical arm, we used the baseline shunt size assessment, for the closure arm we used the assessment from the study closest to the 12-month follow-up visit. The event rates between patients assigned to medical therapy alone and those assigned to PFO closure were compared using the risk difference Z test (Wald method), χ 2 , or Fisher exact tests, as appropriate. Infarct volumes were compared between study arms using Wilcoxon rank sum given that these data were not normally distributed. The comparison of the distribution of fluid attenuated inversion recovery MRI magnetic resonance imaging PFO patent foramen ovale infarct locations were also tested using similar nonparametric methods. Finally, we assessed whether the development of atrial fibrillation after PFO closure was associated with increased risk of new infarcts or increased infarct volume and also whether shunt size was associated with increased infarct volume as well using similar methods. Analysis was performed using STATA 16 (College Station, TX). There were 3 subjects with MRI-negative clinically determined strokes in this study, 1 subject (0.4%) in the medical arm and 2 (0.5%) in the closure arm. Excluding patients with MRI-negative clinical events, among those with new infarct, the total and discrete infarct lesion volumes and number of lesions were not different between treatment arms (Table 1 ). Figure 2 presents the distribution of total infarct volumes dichotomized by treatment arm. A sensitivity analysis including the MRI-negative clinical strokes and assigning them minimally detectable volumes (30 mm3), did not change these findings ( Table I in the Data Supplement). Infarct distribution was also similar for patients in the closure arm compared with patients given medical treatment only (Table 2) . Tables 3 and 4 demonstrate that across patients in both arms of the study, there were no differences in total and discrete infarct lesion volume, number, or distribution comparing patients with clinical stroke to those with silent infarct. Of the 383 patients who underwent closure and had follow-up MRI, 28 developed atrial fibrillation (7.3%) including 20 patients who experienced atrial fibrillation within 30 days of the procedure and 8 after this period, with 1 of these patients developing a clinical stroke during follow-up. Of the 28 who developed atrial fibrillation after closure, 17 (61%) were placed on an oral anticoagulant at least temporarily. There was no increased risk of recurrent clinical stroke or silent infarct among those who developed atrial fibrillation compared with those who did not, 1/28 (3.6%) versus 16/355 (4.5%), risk difference, −0.9% (95% CI, −8.1% to 6.3%), P=0.79. Among those This preplanned analysis of blinded MRI data from the REDUCE trial provides objective confirmation that undergoing PFO closure with the GORE HELEX/CARDIO-FORM Septal Occluder is associated with a reduction in new brain infarct, cutting the risk by about half. As was described in the initial publication, there was a significant reduction in recurrent clinical strokes but no difference in the number of patients with silent subclinical infarcts comparing patients randomized to closure with patients who only received antiplatelet medication. 7 The explanation for this discrepancy between clinical strokes and subclinical infarcts is not clear. Catheter-based cardiac procedures may lead to embolization and findings of small infarcts on MRI are not uncommon after such procedures. 15 Thus, some patients who underwent PFO closure may have had small subclinical periprocedural infarcts, or infarcts with clinical symptoms that were not identified or were attributed to anesthesia effects. In contrast, patients who did not undergo closure would have slowly accumulated these lesions over time, and the follow-up duration was not long enough to show a distinction between the groups. Finally, it is possible that the differential impact on clinical stroke versus subclinical infarct reflects ascertainment bias, if the patients' and clinicians' expectation is that closure is effective. Regardless of the cause for this finding, this analysis reaffirms that PFO closure reduces the combination of clinical stroke and subclinical infarct overall. We also found that there were no differences in the size and locations of new infarcts, comparing patients who underwent closure to those who received medicine alone. These findings are in contrast to the RESPECT trial (Randomized Evaluation of Recurrent Stroke Comparing PFO Closure to Established Current Standard of Care Treatment) which performed a post hoc analysis of infarct size of recurrent ischemic strokes and reported that there was a trend towards fewer large infarcts in patients who underwent closure compared with patients treated medically, 1/7 (14%) versus 9/13 (69%), P=0.06. 16 However, only patients with recurrent clinical strokes underwent MRI in that study whereas all patients in the REDUCE trial were expected to have protocolmandated MRI studies, with only 7.5% failing to do so. We found that neither shunt size nor postclosure atrial fibrillation was associated with subsequent infarct burden. Importantly, overall we also saw no difference in the volume, number, or distribution of new subclinical MRI infarcts compared with clinically apparent strokes. This finding is in contrast with numerous prior studies evaluating the relationship between clinical stroke and infarct volume on MRI. Among patients who present with symptoms of stroke, acute infarct size on MRI has been strongly correlated with symptom severity and longterm outcome from stroke. 17, 18 Similarly, multiple studies of patients who receive screening MRIs and clinical assessments for stroke after a surgical procedure have reported that patients with clinical stroke have significantly larger infarct volumes compared with those with clinically silent lesions. [19] [20] [21] As such, our finding of the lack of difference in volume between clinical stroke and silent infarction together with the observation that only clinical stroke events were reduced by closure, supports the possibility that open-label end point ascertainment may have resulted in bias, with more medically treated patients, or fewer patients assigned to closure, being referred for clinical stroke end point adjudication. To varying degrees, the completed PFO closure trials attempted to mitigate the effects of unblinded end point ascertainment. Most of the trials used validated stroke symptom detection questionnaires, adjudication of outcome events by a blinded center Clinical Events Committee, and protocol-mandated MRI if an event was suspected. The REDUCE trial used all of these strategies and, while this analysis of infarct size raises the possibility that there was ascertainment bias, there were other data from this trial that were more reassuring. As noted in the Appendix of the initial publication, a total of 176 subjects (26.5%) had one or more adverse events submitted to the Clinical Event Committee for possible primary end point adjudication: 104 (23.6%) in the closure group and 72 (32.5%) in the medical-therapy group. Unscheduled MRIs were performed for suspected new stroke or TIA events in 59 (13.4%) patients in the closure group and 46 (20.6%) in the medical-therapy group while the final confirmed stroke rates following blinded adjudication was 1.4% in the closure arm and 5.4% in the medication alone arm. This suggests that there was a higher sensitivity for clinical stroke in the closure arm given that more patients who were referred for adjudication were determined to not have a stroke, compared with patients in the medical arm. Other PFO closure trials have reported mixed results in this regard. One trial noted numerically more referred stroke events in the medical arm negated by adjudication, while another reported similar referrals of possible stroke events for adjudication when using a validated stroke questionnaire. 5, 22 The potential for bias in study design is a prominent consideration for developers of clinical practice guidelines. During the systematic review of available evidence addressing a particular clinical question, guideline developers rate the risk of bias for each study, which then informs the strength of the related recommendations. The Cochrane Handbook for Systematic Reviews of Interventions specifically notes that, "The outcome assessment is potentially influenced by knowledge of intervention received" and that the reviewers must make a judgement, "whether it is likely that participants' reporting of the outcome was influenced by knowledge of intervention received, in which case risk of bias is considered high. " 23 Similarly, the American Academy of Neurology guideline development manual recommends classifying randomized studies with open-label end point ascertainment as class II evidence regardless of blinded adjudication of events. 24 Guidelines that relied on data from the initial 3 closure trials did not recommend routine PFO closure. [25] [26] [27] With the accumulation of positive randomized trial data, more recent guidelines have supported PFO closure in select patients, although there has remained a concern about the open-label methodologies in these trials. 28 This analysis using objective neuroimaging-based outcome data strongly supports the conclusion that PFO closure reduces the risk of recurrent brain infarct in select patients with otherwise cryptogenic embolic-appearing stroke. This study has important limitations. Given that MRI was obtained at the time of suspected clinical stroke, which occurred more often in the medical arm, it is possible that we have underestimated the benefit of closure as there may have been a larger number of infarcts and total infarct volume for medically treated patients with additional follow-up time. However, acute diffusionweighted imaging infarct size is typically larger than late final infarct volume measured on T2/FLAIR which would bias our results in favor of closure. 29 In addition, although our focus on both clinical and MRI silent infarction did result in more events than the purely clinical outcomes of other PFO closure trials, we were likely underpowered to rule out potentially clinically meaningful associations such as small differences in size or location of infarcts for the comparison between treatment arms. We were similarly underpowered to demonstrate differences in size or location of infarcts comparing clinical stroke and silent infarct. Also, MRI data were missing in 7.5% of patients overall which may impact generalizability of our results, although sensitivity analyses suggest that the findings are unlikely to have been meaningfully different. Our conclusions regarding clinical strokes and subclinical infarcts in patients who developed atrial fibrillation after closure compared with those who did not should be interpreted with caution as over half of patients who developed atrial fibrillation were treated with anticoagulation, which would mitigate much of this risk. Finally, we utilized a cutoff of >3 mm for detection of new infarcts in this analysis, as this what was used by the core lab in this trial MRI and has been cited as a reasonable threshold in the American Heart Association statement on stroke definitions. 30 Moreover, the measurement of lesions smaller than this threshold becomes less reliable due to MRI noise, motion artifacts, and other sources of error when we approach the level of the voxel size used in our semi-automated method. As a result, we may have overlooked smaller infarcts. The REDUCE study demonstrated that new brain infarcts on MRI, an objective outcome measure of efficacy, were significantly reduced by PFO closure. Overall, only clinical strokes were reduced by closure while there were similar rates of subclinical infarcts between treatment arms. In addition, clinical and silent infarcts were similar in volume, number, and distribution, raising the possibility of ascertainment bias of clinical outcomes in open-label PFO closure studies. Objective measures should be used in open-label stroke prevention trials whenever possible. Interatrial septal abnormalities and stroke: a meta-analysis of case-control studies Silent cerebral infarcts in patients with pulmonary embolism and a patent foramen ovale: a prospective diffusion-weighted MRI study Trends in the use of percutaneous closure of patent foramen ovale and atrial septal defect in adults CLOSURE I Investigators. Closure or medical therapy for cryptogenic stroke with patent foramen ovale PC Trial Investigators. Percutaneous closure of patent foramen ovale in cryptogenic embolism Tirschwell DL; RESPECT Investigators. Long-term outcomes of patent foramen ovale closure or medical therapy after stroke Gore REDUCE Clinical Study Investigators. Patent foramen ovale closure or antiplatelet therapy for cryptogenic stroke CLOSE Investigators. Patent foramen ovale closure or anticoagulation vs. antiplatelets after stroke Cryptogenic stroke and high-risk patent foramen ovale: the defense-pfo trial N4ITK: improved N3 bias correction Improved optimization for the robust and accurate linear registration and motion correction of brain images User-guided 3D active contour segmentation of anatomical structures: significantly improved efficiency and reliability Multi-atlas skull-stripping Alzheimer's Neuroimaging Initiative. MUSE: MUlti-atlas Stroke region Segmentation utilizing Ensembles of registration algorithms and parameters, and locally optimal atlas selection Silent cerebral infarcts associated with cardiac disease and procedures Tirschwell DL; RESPECT Investigators. Closure of patent foramen ovale versus medical therapy after cryptogenic stroke Is the association of National Institutes of Health Stroke Scale scores and acute magnetic resonance imaging stroke volume equal for patients with right-and left-hemisphere ischemic stroke? Is early ischemic lesion volume on diffusion-weighted imaging an independent predictor of stroke outcome? A multivariable analysis Determining Neurologic Outcomes from Valve Operations (DeNOVO) Investigators. Stroke after aortic valve surgery: results from a prospective cohort Effect of cerebral embolic protection devices on CNS infarction in surgical aortic valve replacement: a randomized clinical trial New ischaemic brain lesions on MRI after stenting or endarterectomy for symptomatic carotid stenosis: a substudy of the International Carotid Stenting Study (ICSS) Steering Committee of the RESPECT Investigators. Patent foramen ovale and cryptogenic stroke Cochrane Handbook for Systematic Reviews of Interventions Clinical Practice Guideline Process Manual. The American Academy of Neurology Practice advisory: recurrent stroke with patent foramen ovale (update of practice parameter): Report of the Guideline Development, Dissemination, and Implementation Subcommittee of the American Academy of Neurology Heart, and Stroke Foundation Canada Canadian Stroke Best Practices Advisory Committee. Canadian stroke best practice recommendations: secondary prevention of stroke guidelines, update American Heart Association Stroke Council, Council on Cardiovascular and Stroke Nursing, Council on Clinical Cardiology, and Council on Peripheral Vascular Disease. Guidelines for the prevention of stroke in patients with stroke and transient ischemic attack: a guideline for healthcare professionals from the Practice advisory update summary: Patent foramen ovale and secondary stroke prevention: Report of the Guideline Subcommittee of the American Academy of Neurology Evolution of cerebral infarct volume assessed by diffusion-weighted magnetic resonance imaging American Heart Association Stroke Council, Council on Cardiovascular Surgery and Anesthesia; Council on Cardiovascular Radiology and Intervention; Council on Cardiovascular and Stroke Nursing; Council on Epidemiology and Prevention; Council on Peripheral Vascular Disease; Council on Nutrition, Physical Activity and Metabolism. An updated definition of stroke for the 21st century: a statement for healthcare professionals from the The REDUCE PFO Closure Trial was sponsored by WL Gore & Associates, although there was no funding provided to the authors for this analysis. Dr Davatzikos has received funding from the National Institutes of Health related to the imaging analysis. Drs Messé, Andersen, Iversen, Roine, Sjöstrand, Rhodes, Søndergaard, and Kasner received grant funding from WL Gore and Associates. Dr Messé reports grants from Novartis, Biogen, and Mallinkrodt outside the submitted work. Dr Kasner reports grants and personal fees from Medtronic, personal fees from Abbott, grants and personal fees from Bristol-Myers Squibb, and personal fees from Abbvie outside the submitted work. The other authors report no conflicts. Online Table I