key: cord-0771078-zauma08e authors: Friedman, Daniela B.; Escoffery, Cam; Noblet, Samuel B.; Agnone, Christine M.; Flicker, Kimberly J. title: Building Capacity in Implementation Science for Cancer Prevention and Control Through a Research Network Scholars Program date: 2021-07-09 journal: J Cancer Educ DOI: 10.1007/s13187-021-02066-3 sha: 426909b6b416c64da9f53a57ad6c6ab198160a87 doc_id: 771078 cord_uid: zauma08e Building capacity of researchers and practitioners in the dissemination and implementation (D&I) of evidence-based interventions is greatly needed to improve cancer prevention and control. A diverse workforce trained in D&I science is critical for improving cancer outcomes and reducing cancer-related health disparities. The US Centers for Disease Control and Prevention’s (CDC) Cancer Prevention and Control Research Network (CPCRN) Scholars Program aimed at training students, researchers, and practitioners in D&I for cancer prevention and control launched in 2021. The purpose of this paper is to describe the creation of the training program, curriculum, and evaluation plans, and to present the baseline results and lessons learned. CPCRN investigator and partner input and formative interviews (n = 16) with assistant professors, postdoctoral fellow, doctoral and undergraduate students, and a program manager guided development of the program. Twenty of 24 applicants were accepted into the inaugural year of the program. The majority of accepted scholars identified as female (80%) and were graduate students (50%). Thirty-five percent were of racially diverse backgrounds. Most self-rated their previous D&I experience and competencies at a beginner level. The multi-step approach used for development of this training program and lessons learned will be helpful for others collaborating on preparing the research and practice workforce in D&I science. The USA spent $150.8 billion on cancer care in 2018 and this cost is expected to rise according to projections from the International Agency of Research on Cancer [1] . As both the national and global populations age, global cancer cases and deaths are expected to increase along with the cost of care and treatment. This growing public health challenge has prompted the World Bank to advise countries it finances to be both efficient and effective at addressing cancer prevention and control [2] . Yet with evidence-based research taking on average 17 years to matriculate through clinical research to patient practice [3] , there is an even greater urgency for dissemination and implementation (D&I) science research to reach practitioners [4] [5] [6] . At its core, D&I science is understanding how to effectively promote the systematic uptake of evidence-based interventions and/or practices and translate them into the real world to maximize positive health behaviors and outcomes [7, 8] . Cancer-focused mentored training programs have been implemented for clinicians and medical students [9] [10] [11] [12] and postdoctoral fellows and/or early career scientists [13] [14] [15] [16] [17] to increase D&I competencies. Some training programs are degree seeking while others are one-time offerings or episodic depending on the sponsoring organization. There is great variability in the focus and reporting of findings from such capacity-building programs [18] . The dissemination and sharing of detailed processes used for these training programs would be beneficial for those planning programming in different settings and across different contexts [19] . Since D&I is a relatively young field and there are many cancerrelated health disparities, there is a tremendous need to build capacity in this area [20, 21] . Creating a pipeline of diverse cancer-focused research scholars and practitioners is needed to meet the growing demand of translating cancer research to timely practice. The Cancer Prevention and Control Research Network (CPCRN) is a national network of academic, public health, and community partners who are charged to "reduce the burden of cancer, especially among those disproportionately affected" [22] . Eight funded centers work with the Centers for Disease Control and Prevention (CDC) and the National Cancer Institute (NCI) to expedite evidence-based interventions and strategies to reduce cancer and to build a workforce in cancer D&I research [22] . In recognition of the need to increase the pipeline of student, researcher, and practitioner scholars focused on D&I science, CPCRN investigators proposed a cross-center workgroup that would provide mentored training in this area. The CPCRN Scholars Program is guided by a prior CDC-funded student-focused scholars program focused on cognition aging [23] and an in-depth formative evaluation. The purpose of this paper is to describe the process of creating a training program in D&I for cancer prevention and control among CPCRN students, researchers, and practitioner scholars, the curriculum, and evaluation plan. In addition, we present the baseline results of selected scholars. The CPCRN Scholars Workgroup, consisting of faculty, researchers, and students from six CPCRN centers, affiliate members, and federal agency partners, collaborated on development of a program aimed to train students (undergraduate through doctoral), postdoctoral fellows, junior faculty, practitioners, and health professionals in D&I science focused on cancer prevention and control and health equity. A multi-step approach was used for program development. The idea for the Scholars Program was proposed at the annual meeting of the CPCRN in January 2020 at which 50 members and affiliates attended. The idea was guided by a student-focused scholars program that was developed for the CDC-funded Healthy Brain Research Network (HBRN; [23] ). The HBRN aimed to train racially/ethnically, geographically, and gender-diverse students in Alzheimer's disease research through mentored, collaborative research. Following the CPCRN annual meeting, CPCRN investigators interested in leading the Scholars Workgroup (CE and DBF), worked collaboratively with interested CPCRN investigators, affiliates, and federal agency partners to develop a workgroup charter that presented the main goals of the workgroup and potential deliverables with clear timeline. In Spring 2020, the charter was presented at a CPCRN steering committee meeting that consisted of CPCRN principal investigators, project directors, and federal agency partners. The charter was approved at that meeting and Scholar Workgroup members (n = ~ 25) started meeting monthly to develop program components. The workgroup consisted of six CPCRN centers, two affiliate members, and NCI partners. Guided by the model developed for the HBRN Scholars Program, the Workgroup began to consider training components for the program that would prepare them for D&I work in cancer prevention and control. Workgroup members wanted to ensure that tracks were created and that program components were tailored for different groups of scholars, in particular, students, postdoctoral fellows/faculty researchers, and practitioners. Three tracks were created that included foundational readings about the CPCRN network, implementation science and health equity; interactive webinars and discussion; and an option of completing one of two curricula-the CPCRN network-developed Putting Public Health Evidence in Action (PPHEA) [24] and the NCI-developed Training Institute for Dissemination and Implementation Research in Cancer (TIDIRC) program [25] . PPHEA supports community program planners and health educators in developing skills in using evidence-based approaches and learning about new tools for planning and evaluating community health interventions. It is a self-paced curriculum with activities and tools. TIDIRC provides participants with foundational information and resources for conducting D&I research with a focus on cancer prevention and control. Online training materials are open access (see Table 1 for an overview of the CPCRN Scholars Program curriculum by track). In order to gain input from potential scholars and to ensure the program we developed met the needs of CPCRN scholars, Workgroup members emailed student, faculty/ researcher, and practitioner contacts from CPCRN centers to invite them to participate in a 30-min interview with workgroup project co-directors (CA and SB). Workgroup members co-developed the interview guide. Questions can be found in Table 2 . Following the open coding of Scholar interview transcripts in Microsoft Excel [26] , findings were presented back to the Workgroup and the Workgroup finalized the curriculum and expectations for the first year of the Scholars program. Development of the scholar application form was an iterative process. A draft was presented by Workgroup co-leads to Workgroup members and feedback was incorporated. The CPCRN Coordinating Center turned the Word version of the application into an online format using Qualtrics and one of the CPCRN Collaborating Centers co-leading the Scholars Program efforts managed the data once the call for applications was released in Fall 2020. The application consisted of questions about demographics (race, ethnicity, gender), institutional affiliation, area of study/concentration, current position, how they learned about the program, names of current mentors, CPCRN workgroup of interest, proposed project, one to three goals and related activities they had for participation, and how their proposed project and goals aligned with the CPCRN strategic plan and/or logic model. Finally, applicants were asked to self-rate their competencies in D&I science (beginner, intermediate, advanced) based on published competencies in Padek et al. [27] . The competencies focused on D&I background knowledge, theory and approaches, study design and analysis, and practice-based considerations were used for student, postdoctoral, and faculty applicants. Practitioner applicants rated their D&I competencies using a separate list of competencies used for the PPHEA curriculum. Data were downloaded into Microsoft Excel for descriptive analyses (frequencies, percentages). The Scholars Workgroup drafted an email call for applications which was sent to members of the CPCRN Steering Committee with a request to distribute the email and link to the electronic application form. Steering Committee members distributed the email via student listservs at their home institutions. Workgroup project co-directors assigned two reviewers to each application. The review form was guided by the scholar application questions and rated applications on the following criteria using 1 = excellent, 2 = fair, and 3 = poor. • Evidence of interest in cancer prevention and control and/ or D&I science • Clear, concise description of proposed project • Clear description of the proposal goals and activities • Feasibility of the proposed project and activities (9-month timeline for program) • How proposed goals and activities contributed to diversity of the training program Reviewers were also asked to provide qualitative comments, recommend two CPCRN mentors, and whether they would admit, deny, or waitlist each applicant. Interviews with 16 potential CPCRN scholars were conducted via Zoom across 4 CPCRN centers in Summer 2020 to help gather information to guide the formation of the CPCRN training program. Of the 16 interviews conducted, 4 were with assistant professors, 1 with a postdoctoral fellow, 8 with PhD students, 2 with undergraduates, and 1 with a program manager. Table 3 presents demographic data on the inaugural cohort of scholars. The findings from the interviews informed program development. Emergent themes regarding reasons for participating in the program included individuals' desire to increase their D&I knowledge and connect with others across the CPCRN network, produce scholarly deliverables with mentored support, and obtain skills to teach others about D&I. Most participants indicated they would prefer the program to be 1 year in length and they were interested in mentorship focused on D&I and cancer prevention and control research as well as professional development. This feedback guided development of the curriculum for different scholar tracks (i.e., students, researchers/faculty, and practitioners). We received a total of 24 scholar applications. The 24 scholar applications were randomly assigned to two of nine workgroup members for review. The review criteria included interest in D&I science and/or cancer prevention and control, details of a proposed project, specificity of proposed goals and objectives, and how the proposed work aligned with the CPCRN efforts. These nine areas were scored on a scale of 1-3 with 1-excellent, 2-fair, and 3-poor. The average scores of the 24 applications ranged from 1.06 to 3. The cutoff for 20 scholars was 2.05 out of 3. This cutoff was selected because there was a larger difference between the 20th and 21st application compared with the other applications. Following the scoring of the applications, scores were presented back to all Workgroup members for approval, and then Workgroup co-leads notified scholars and their primary mentors about results of the reviews. Of the 20 individuals selected for year 1 of the Scholars Program, 10 were students, 3 were postdoctoral fellows, 4 were faculty researchers, and 3 were practitioners. We held a kickoff webinar that was held in January 2021 at which scholars met each other and received information about the program curriculum components and expectations. The scholars were presented a task management software, Trello, to help organize and stay on track with completing the assigned training components. The Trello boards were created for each of the three tracks and each scholar received access to their own board. The boards allow scholars to move curriculum items from To-do, Doing, and Completed columns. This will help monitor the progress of each scholar throughout the program. Each track has two CPCRN faculty co-leads to serve as liaisons for scholars and to help them advance through the program, troubleshoot as needed, and connect with mentors and workgroups. The majority of scholars rated their previous D&I experience as being at a beginner level (n = 13, 65%) ( Table 4) . Nineteen of the 20 scholars rated themselves on the Padek et al. [27] D&I competencies. In all section categories (definition, background, and rationale; theory and approaches; design and analysis; practice-based considerations), scholars considered themselves as beginners. The majority of scholars rated their experience as intermediate for only three competencies (determine which evidence-based interventions are worth disseminating and implementing (n = 11, 57.9%); describe a range of D&I strategies, models, and frameworks (n = 12, 63.1%); and describe the importance of incorporating the perspectives of different stakeholder groups (n = 12, 63.1%)). Only one of the scholars completed the checklist of more practice-focused competencies and ratings were "beginner" for 15 items and "intermediate" for 5 items. The program is self-paced with some synchronous meetings, including a kickoff meeting, planned webinars with all scholars, and a closing meeting. Scholars work on their projects and either curriculum-NCI's D&I modules [25] or CPCRN's PPHEA program [28] . They also are invited to collaborate with a CPCRN workgroup, attend the annual CPCRN meeting, and network with other Scholars or cancer researchers (see Table 1 for curriculum). The end products A CPCRN Scholars Program Evaluation Subcommittee has been formed. The evaluation of the program will employ mixed methods to understand the short-term and long-term impacts of the training program. In addition, we will evaluate specific program components. For example, we are sending electronic evaluations following educational webinars to get scholars' feedback on content, format, and speakers, and to ask them for input on future webinar focus areas. The evaluation will be informed by Kirkpatrick's model of 4 levels of training evaluation (reactions, learning, behavior, and results) [29] and will assess outcomes presented in the logic model in Fig. 1 . Through the multi-component training program, the scholars will immediately improve their knowledge and skills in D&I concepts and methodology, complete their project, and increase networking with D&I researchers. This will lead to learning transfer to their practice, increase in grants and quality of D&I research and practice, increased research collaborations, and an increase in the D&I workforce. These will consequently impact D&I cancer research and practice, and subsequently cancer incidence and health inequities. At the end of the program, all scholars will complete an immediate post-test that will evaluate the program components, discuss strategies for learning transfer to their training or jobs, and provide them with the opportunity to make suggestions for improvements. We will interview selected scholars to learn about their experience, the benefits of the program, integration of D&I into and completion of their projects, and how they are applying their knowledge and skills. We will conduct annual surveys with program alumni for 3 years to evaluate the continued use of the training content, and track products and deliverables emerging from the program and beyond, and progress in their D&I journey. The CPCRN Scholars Program is the first CDC-funded network to establish a formal scholars program for three groups-students, postdoctoral fellows/researchers, and practitioners. Development of the program components and processes was guided by prior work of the CDC-funded HBRN's student scholars program [23] . The intention of the Scholars Workgroup was not to recreate the wheel and duplicate existing programs such as the NCI-sponsored TIDRIC or TIDIHR programs [15, 30] but to incorporate open-access components into a broad, self-paced curriculum specifically for the CPCRN network. The ultimate goal is to grow the pipeline of scholars through the CPCRN network that often involves students, researchers, and practitioner partners in D&I work but not in a formal manner. The success of program development can be attributed in large part to the input from potential scholars during the formative interview process and from recommendations and collaborations with network experts, affiliates, and federal agency partners. The CPCRN Scholars Workgroup has learned greatly from the development of the program and launch that will be helpful for future program years and for other similar D&I, capacity-building training programs. First, we kept our outreach efforts within the CPCRN network for the first year of the program in order to keep the cohort size manageable. CPCRN sites were asked to recruit scholars through their institution listservs; thus, we had a greater response from students and researchers/faculty members compared with practitioners. It has been reported elsewhere that capacity of such practitioner-focused trainings is limited and the trainings may not be feasible for or meet the needs of intended provider implementers [9] . Moving forward, we will make a more concerted and targeted effort to recruit practitioner scholars and this will be done with the support of CPCRN center partners and federal agency partners conducting work in capacity building for cancer prevention and control. Second, we will be more intentional in recruiting a diverse cohort of scholars from underrepresented minority groups. Reducing cancer-related health disparities in pursuit of health equity will require purposeful efforts, particularly in D&I training, including increasing the minority scholar workforce in our cancer prevention and control work and diversifying research participants. Training scholars in culturally relevant methods and programming is critically needed if we are to make a significant impact on reducing health disparities [31] . Training programs that address barriers or purposefully recruit marginalized researchers within medicine and biomedical research [32, 33] demonstrate participant success and reduction in disparities among underrepresented communities. We also plan to consider race and/ or gender matching of scholars and mentors which was not conducted in this inaugural year. Third, while we asked applicants to include names of primary and secondary mentors in their application, we did not specify roles of the scholar mentors upfront. For the next round of the CPCRN Scholars Program, we will describe a clearer role for mentors (e.g., guide progress through the curriculum, help connect scholars with CPCRN workgroups) upfront during the application process and once scholars are selected for participation. Finally, disseminating our call for applications was slightly delayed given the COVID-19 pandemic and so the inaugural cohort will have 9 months to complete the program. For the next cohort, we will release the call for applications prior to the start of the grant year so that scholars have a full year to complete the training. Guided by input from grant network collaborators and the inaugural cohort of scholars and mentors, the The CPCRN Scholars Program is a multi-component training program to increase knowledge and skills related to D&I for cancer control. The program will train students through researchers and build the pipeline of translational researchers and enhance the capacity of practitioners working in cancer control. Evaluation of the program will inform program strengths and weaknesses, learning transfer, and integration of D&I concepts into their practices. Ultimately, the program hopes to catalyze D&I research across the USA and have results that will impact cancer-related health disparities. Projections of the cost of cancer care in the United States: 2010-2020 Need for national commitments to cancer research to guide public health investment and practice Managing clinical knowledge for health care improvement Concocting that magic elixir: successful grant application writing in dissemination and implementation research Researcher readiness for participating in community-engaged dissemination and implementation research: a conceptual framework of core competencies Dissemination and implementation science training needs: insights from practitioners and researchers Welcome to implementation science Alliance for Health Policy and Systems Research, World Health Organization (2013) Implementation research in health: a practical guide Bridging the chasm: challenges, opportunities, and resources for integrating a dissemination and implementation science curriculum into medical education Dissemination and implementation of cognitive behavioral therapy for depression in the Kaiser Permanente Health Care System: evaluation of initial training and clinical outcomes Dissemination and implementation of the ICAMP Tisch Cancer Institute Scholars Program: mentored cancer research training pipeline for medical students Building the next generation of researchers: mentored training in dissemination and implementation science Mentored training and its association with dissemination and implementation research output: a quasi-experimental evaluation The US training institute for dissemination and implementation research in health A framework for training health professionals in implementation and dissemination science Training scholars in dissemination and implementation research for cancer prevention and control: a mentored approach Mapping training needs for dissemination and implementation research: lessons from a synthesis of existing D&I research training programs Building capacity in dissemination and implementation science: a systematic review of the academic literature on teaching and training initiatives A multi-level model to understand cervical cancer disparities in Appalachia Participatory implementation science to increase the impact of evidence-based cancer prevention and control Training the next generation of aging and cognitive health researchers Scaling up and tailoring the "Putting Public Health in Action" training curriculum Training Institute for Dissemination and Implementation Research in Cancer (TIDIRC) OpenAccess Qualitative research & evaluation methods: integrating theory and practice, 4th edn Developing educational competencies for dissemination and implementation research training programs: an exploratory analysis using card sorts Cancer Prevention and Control Research Network. Putting Public Health Evidence in Action Kirkpatrick's four levels of training evaluation Building capacity: a cross-sectional evaluation of the US Training Institute for Dissemination and Implementation Research in Health Addressing health and health-care disparities: the role of a diverse workforce and the social determinants of health Helping scholars overcome socioeconomic barriers to medical and biomedical careers: creating a pipeline initiative Building integrated pathways to independence for diverse biomedical researchers: Project Pathways, the BUILD program at Xavier University of Louisiana Funding This publication is supported by the Centers for Disease Control and Prevention of the US Department of Health and Human Services (HHS) as part of financial assistance awards (U48 DP006401; U48 DP006377) totaling $599,998 with 100 percent funded by CDC/ HHS. The contents are those of the authors and do not necessarily represent the official views of, nor an endorsement by, CDC/HHS or the US government.