key: cord-0988322-itg9a22e
authors: Jessani, Nasreen S.; Rohwer, Anke; Schmidt, Bey-Marrie; Delobelle, Peter
title: Integrated knowledge translation to advance noncommunicable disease policy and practice in South Africa: application of the Exploration, Preparation, Implementation, and Sustainment (EPIS) framework
date: 2021-05-17
journal: Health Res Policy Syst
DOI: 10.1186/s12961-021-00733-x
sha: d4e63a9445482fbe56f3027e7718e772ca6e0796
doc_id: 988322
cord_uid: itg9a22e

BACKGROUND: In response to the “know–do” gap, several initiatives have been implemented to enhance evidence-informed decision-making (EIDM). These include individual training, organizational culture change management, and legislative changes. The importance of relationships and stakeholder engagement in EIDM has led to an evolution of models and approaches including integrated knowledge translation (IKT). IKT has emerged as a key strategy for ensuring that engagement is equitable, demand-driven, and responsive. As a result, the African-German Collaboration for Evidence-Based Healthcare and Public Health in Africa (CEBHA+) incorporated an IKT approach to influence noncommunicable diseases (NCD) policy and practice. We documented the phased process of developing, implementing, and monitoring the IKT approach in South Africa; and explored the appropriateness of using the exploration, preparation, implementation, and sustainment (EPIS) framework for this purpose. METHODS: We mapped the South Africa IKT approach onto the EPIS framework using a framework analysis approach. Notes of team meetings, stakeholder matrices, and engagement strategies were analysed and purposefully plotted against the four phases of the framework in order to populate the different constructs. We discussed and finalized the analysis in a series of online iterations until consensus was reached. RESULTS: The mapping exercise revealed an IKT approach that was much more iterative, dynamic, and engaging than initially thought. Several constructs (phase-agnostic) remained important and stable across EPIS phases: stable and supportive funding; committed and competent leadership; skilled and dedicated IKT champions; diverse and established personal networks; a conducive and enabling policy environment; and boundary-spanning intermediaries. Constructs such as “innovations” constantly evolved and adapted to the changing inner and outer contexts (phase-specific). CONCLUSIONS: Using the EPIS framework to interrogate, reflect on, and document our IKT experiences proved extremely relevant and useful. Phase-agnostic constructs proved critical to ensure resilience and agility of NCD deliberations and policies in the face of highly dynamic and changing local contexts, particularly in view of the current coronavirus disease 2019 (COVID-19) pandemic. Bridging IKT with a framework from implementation science helps to reflect on this process and can guide the development and planning of similar interventions and strategies.

Background Effective translation of research evidence into policy and practice is important for improving health outcomes and reducing health inequities [1, 2] . There are several complexities, however, associated with how and to what extent research evidence is translated into policy and practice [2] . These complexities (also referred to as the "know-do" gap) can be explained by factors related to researchers, decision-makers, their engagement, and the context in which they operate [3] [4] [5] [6] [7] . For example, researchers may misunderstand the needs of decisionmakers and present the "right answers to the wrong questions" [8] . Decision-makers may not use existing research evidence in their decision-making, or they may use research evidence in a manner that was not intended by the research community, or they may adapt research evidence to fit certain political needs and agendas [8] . Similarly, decision-makers are often unable to articulate their research needs as answerable research questions [2, 9, 10] . Continuous and effective engagement between researchers and decision-makers requires time and resources. It is often reliant on long-standing and/or personal relationships, which has advantages, such as longterm trust and confidence in the partnership, but also risks when key actors for example change position and are no longer able to facilitate the engagement [11, 12] . Complex social and political factors (played out in the relationship between researchers and decision-makers) also enhance or hinder effective use or uptake of research evidence into policy and practice [13] .

In response to the "know-do" gap, several initiatives have been promoted, including individual training, organizational culture change management, and legislative changes such as resolutions to better use research evidence for decision-making [14] . This has given rise to several models and frameworks for enhancing evidence-informed decision-making (EIDM) [15] [16] [17] [18] [19] [20] [21] . The increased focus on the importance of relationships [11, 12, [22] [23] [24] [25] [26] and stakeholder engagement [8, [27] [28] [29] [30] [31] led to further evolution of these frameworks to what is now referred to as integrated knowledge translation (IKT): "an approach or set of processes that can lead to the generation of knowledge for optimizing healthcare delivery systems and improving health system performance and associated outcomes" [32] . Implementation science, on the other hand, is defined as the "scientific study of methods to promote the systematic uptake of research findings and other evidence-based practices into routine practice, and, hence, to improve the quality and effectiveness of health services and care" [33] . Applying an implementation science lens to systematically reflect on and draw out experiences of IKT approaches or processes provides an opportunity to address the "know-do" gap [34] . Additionally, there is a need for research on the implementation, monitoring and evaluation of interventions or approaches for translating research evidence in health policy and practice decision-making, specifically in African settings [35, 36] .

The Collaboration for Evidence-Based Healthcare and Public Health in Africa (CEBHA+) (https:// www. cebha-plus. org/) is an African-German research consortium funded by the Federal Ministry of Education and Research (BMBF) in Germany. It focuses on three noncommunicable diseases (NCDs) (road traffic injuries, diabetes, and hypertension), and includes an IKT approach to ensure the uptake and use of research. Research objectives for each partner country were formulated as part of a priority-setting exercise carried out with health decision-makers and researchers in sub-Saharan Africa [37] . The five African country partners (Ethiopia, Malawi, Rwanda, Uganda, and South Africa) developed countryspecific IKT approaches, which are currently implemented and monitored alongside the different research activities. In South Africa, the CEBHA+ country partners include the Centre for Evidence-Based Health Care (CEBHC) at Stellenbosch University, the Chronic Disease Initiative for Africa (CDIA) at the University of Cape Town, and Cochrane South Africa (CSA) at the South African Medical Research Council (SAMRC).

The CEBHA+ coordinated IKT approach was envisioned as a six-step process [38] (Fig. 1 ) that commenced with a foundational workshop for all CEBHA+ partners. This workshop was designed and implemented by CEBHC [39] in October 2018. Draft stakeholder analyses and IKT strategies for key identified CEBHA+ stakeholders were developed by each CEBHA+ African country at the workshop (Step 1). These were further refined with input from objective deliberations and policies in the face of highly dynamic and changing local contexts, particularly in view of the current coronavirus disease 2019 (COVID-19) pandemic. Bridging IKT with a framework from implementation science helps to reflect on this process and can guide the development and planning of similar interventions and strategies. Keywords: South Africa, Low-and middle-income countries, Integrated knowledge translation, Research uptake, Embedded research, Implementation research, Noncommunicable diseases, Stakeholder engagement, Exploration, preparation, implementation, and sustainment framework, Evidence-informed decision-making colleagues (Step 2) several of the identified stakeholders (Step 3), and then finalized (Step 4). While the strategies varied by stakeholder and country, in South Africa some of the activities included regular scheduled meetings between CEBHA+ and stakeholders; being available for ad hoc consultations on NCD-related matters; tailoring outputs to their preferences; organizing a national NCD symposium; disseminating research products such as publications, presentations, and issue briefs; and providing regular programme updates. Implementation commenced in February 2019, with monitoring embedded throughout the process (Step 5) and an overall evaluation of IKT activities and processes across the consortium (Step 6). The entire process, however, was iterative in nature and supported by a working group with IKT methods expertise, training opportunities.

Step 6-a semi-external cross-country evaluation of the CEBHA+ IKT approach-will be implemented by one of the German partners, the Ludwig Maximilian University of Munich (LMU), which is not directly involved in operationalizing country-specific IKT approaches [38] .

The objective of this paper is to complement the multi-site semi-external evaluation with a deep-dive description of the South African six-step IKT approach, using an implementation science lens guided by the exploration, preparation, implementation, and sustainment (EPIS) framework [40] . This will lead to two outcomes: one, a documentation of the phased process of developing, implementing and monitoring the IKT approach, in order to contribute to growing research in the field from African settings; and two, exploration of the appropriateness and relevance of the EPIS framework for this purpose, thereby providing new insights into the intersection between IKT and implementation science.

We used a systematic approach to reflect on and map the planning and implementation of our IKT approach based on a cycle of internal discussions, including exploring the relevance of existing implementation frameworks. The discussion was initiated by a group deliberation in workshop format to screen the constructs of the Consolidated Framework for Intervention Research (CFIR) developed by Damschroder et al. [41] for its applicability to mapping the IKT approach in South Africa. CFIR is a well-known and popular framework that presents a taxonomy for conceptualizing and distinguishing between a wide range of contextual determinants of implementation success, including characteristics of the intervention, the implementing organization (inner setting), the outer setting, characteristics of individuals, and details of the implementation process. Given that deductive reasoning can be used to identify barriers and enablers that influence implementation outcomes, CFIR is considered a "determinants" framework in the classification of models, theories, and frameworks of implementation science proposed by Nilsen [42] .

Despite its comprehensiveness and flexibility, however, the CFIR was found to be less suitable to capture the dynamics at play between the inner and outer settings of IKT implementation in our context [43] , which involved boundary spanners and the importance of reciprocity [38] in stakeholder relationships. It was decided to revisit the literature and conduct a more extensive mapping of available implementation frameworks and constructs, informed by the review by Tabak et al. [44] and complemented by models included in the Dissemination-Implementation Webtool (https:// disse minat ion-imple menta tion. org/ conte nt/ diMain. aspx) based on a consensus to identify a model that would capture the stages of operationalization from conception to sustainability; interconnections between people, institutions, and constructs; and knowledge translation models used in health services policy. Several models were assessed based on their field of origin (public/health services sector), construct flexibility, implementation focus, and application at different levels of the socio-ecological framework [40, [45] [46] [47] [48] and the EPIS framework selected for this paper. Table 1 below provides a summary of the models that were assessed, as well as their relative applicability to this study.

The EPIS framework, developed by Aarons et al. [40] , describes four distinct phases to guide and describe the implementation process; enumerates factors within and across the inner and outer context across these phases; and outlines the factors that bridge the outer and inner context, as well as the interconnections and interlinkages that characterize the dynamics, complexity, and interplay of inner and outer contexts (Fig. 2) . The EPIS framework was developed based on a literature review of implementation in public sector social and allied health service systems in the United States and found to be applicable to other countries and settings. However, until recently, the framework has shown limited prescriptive guidance for its use [56] , and this paper aims to add evidence to the body of literature by focusing on its use in an uppermiddle-income country.

The six different steps of the CEBHA+ IKT approach in South Africa were first mapped onto the different phases of the EPIS Framework (the sustainment phase was excluded given that the programme is still underway). The framework was then retrospectively applied to the process of IKT planning, implementation, and monitoring within CEBHA+ using a matrix analysis approach as described by Morse and Field [57] . Matrices allow mapping of relationships between as well as among constructs of interest. They also assist with exploring the relationship between constructs and theoretical concepts.

Several electronic data sources that were part of the South African planning and implementation folders were used to populate the EPIS matrix of constructs and phases. From the period since Step 1 (November 2018) until this reflection paper-Steps 5 and 6 (December 2020)-these sources include the South African CEBHA+ stakeholder analysis (November 2018), notes and minutes from eight quarterly South Africa CEBHA+ IKT team meetings, minutes from four consortium-wide meetings on IKT across all five countries, two presentations (2019 and 2020), and three scientific meeting presentations and posters (2020). We also consulted the individually tailored stakeholder engagement (or IKT) strategies for six stakeholders deemed to be priorities for the South African CEBHA+ team. Constructs were added or edited where appropriate or necessary, and analysis was continued through a series of online iterations until consensus on the mapping was reached by all authors.

The mapping exercise revealed an IKT approach that was much more iterative, dynamic, and engaging than initially thought. The original plan ( Fig. 1 ) evolved with several of the six steps overlapping across phases and interacting bidirectionally and with each other, as shown in Fig. 3 .

Several factors remained important and stable across phases (phase-agnostic), whereas others constantly evolved and adapted to the changing inner and outer contexts (phase-specific). Within each set of factors we discuss the EPIS subconstructs that are relevant to guide the interpretation of results. Other reflections and subconstructs not in the narrative can be found in Fig. 4 as well as Table 2 , in which the constructs are embedded and colour-coded by phase. Factors that cut across phases remain in white, whilst those that are particular to a phase are shaded to match the colour of the relevant EPIS phase.

The idea to design and implement a comprehensive IKT approach as part of the CEBHA+ project was developed by CEBHA+ members during the exploration phase [37] . Although this was not a funding requirement or priority at that stage [58] , our approach was very well received by the BMBF and led to an increased interest in and emphasis on IKT across the three phases reported on in this paper. Interest also grew amongst other BMBF-funded health networks during the preparation and implementation phases, allowing us to reflect on the interorganizational environment and network sub-constructs. For instance, during the implementation phase, interest in learning and adapting the approach developed by CEBHA+ resulted in an invited presentation and training workshop by CEBHA+ colleagues at the BMBF cross-network meeting in Ghana in January 2020.

Another pervasive factor across the three phases was the policy environment in South Africa that not only considered NCDs a national priority but also promoted 19:82 Adapted from the overview by Tabak et al. [44] and a comparative analysis using the Dissemination-Implementation Webtool (https:// disse minat ion-imple menta tion. org/ viewA ll_ di. aspx) # D = Dissemination / I = Implementation. The focus is on dissemination and/or implementation activities. D--only focuses on an active approach of spreading evidence-based interventions to target audience via determined channels using planned strategies. D = I, D > I, and I > D means there is some focus on both dissemination and implementation. I-only focuses on process of putting to use or integrating evidence-based interventions within a setting 

Highly committed, competent, and supportive leadership was found to be integral to the IKT approach across the three phases, particularly given its novelty to the programme and "learning by doing" design. Furthermore, at the individual level, some members of the CEBHC team that had worked across sectors and organizations with specific experience and knowledge of IKT served as IKT trainers for the whole CEBHA+ project.

In addition, some government colleagues had a background in research and were therefore able to navigate the academic requirements associated with the CEBHA+ research projects. This was enhanced by several organizational characteristics, including organizational structure and culture. For example, having all three institutions in Cape Town within proximity to each other permitted efficient communication, engagement, and co-leadership on several aspects of the CEBHA+ project but also IKT endeavours. Convening stakeholder meetings, embarking on joint approaches, and sharing of administrative, financial, and human resources was therefore easier. The fact that IKT was already implemented by the different partners as a pillar of their institutional vision also contributed to and facilitated stakeholder buy-in, championship, design, and integration of an IKT approach into the CEBHA+ project.

Unique to the project was a recognition that several colleagues from the three partners as well as many stakeholders acted as intermediaries, or boundary spanners, who traversed easily between environments and roles, in turn providing a better appreciation and understanding of the complexities of the respective institutional structures and cultures. These boundary spanners facilitated the breaking of silos, enhancing mutual understanding between settings, building of trust, and creating a more empathetic relationship. Colleagues serving as intermediaries who are skilled in diplomacy and conflict management also helped to overcome challenges with roles, communication, and finance issues. The German coordinator, the funders, and technical support partners of CEBHA+ also played key bridging roles more internationally and across other health research networks.

Long-standing community-academic partnerships between individual team members at the three institutions with policy-makers at the provincial and national level facilitated access to many stakeholders. Furthermore, the fact that many colleagues from the National Department of Health (NDoH) had these positive ongoing relationships with members of the three institutions prior to the launch of the CEBHA+ project led to mutual trust, willingness to attend meetings, collaborate, and demand evidence from CEBHA+ partners to contribute to South African NCD policies and practices. As CEBHA+ research was rolled out and results and their implications shared, different stakeholders were involved at various times. For instance, the CEBHC recently convened stakeholders from the government (NDoH), research institutions (SAMRC), and civil society (The Cancer Association of South Africa) to discuss preliminary findings of a situation analysis of population-level interventions for diabetes and hypertension in South Africa. Similarly, multi-stakeholder engagement with management, health practitioners, and patients at two primary care clinics in Cape Town advanced individual counselling and enhanced group education for common NCDs, in turn leading to capacity strengthening of key partners.

With respect to the interorganizational environment, we highlight that having all three institutions based in Cape Town was a notable strength with respect to a pre-existing relationship with the Western Cape DoH. However, this geographical concentration also proved to be a significant weakness, especially during the preparation phase, given the limited or absent relationships with other provincial DoHs. The implementation phase brought with it expanded networks including emerging relationships with other provincial DoHs, facilitated mainly through an NCD symposium co-hosted by the CEBHA+ partners in South Africa and the NDoH. This is particularly important given the decentralization of health services in South Africa, which lends executive decision-making power to different tiers of government.

In the implementation phase, each country, including South Africa, had to adapt the IKT approach to an evolving outer context. For instance, shifting priorities in the policy environment during the COVID-19 pandemic required swift pivots within the IKT process. 

While all three South African CEBHA+ partners had previously engaged with stakeholders, support by the funder in the preparation phase increased the relative priority of IKT and provided an opportunity for a more structured and explicit IKT design in the preparation and implementation phases. This led to a deliberate CEBHA+ South African IKT approach developed in line with the broader CEBHA+ programme across all African CEBHA+ partner countries during the preparation phase. During the early stage of implementation, organizational characteristics such as readiness for change and absorptive capacity were found to be important. Although IKT was a priority within CEBHA+ , the extent to which activities (that fell) within the remit of IKT would be rewarded, supported, and expected was relative to institutional priorities as well as readiness for change.

Although the time for monitoring and implementing IKT in parallel with other CEBHA+ research activities proved challenging, the learning climate was very encouraging with the team feeling not only valued but also free to try new strategies and methods. In addition, the structured reflection allowed dedicated commitment from IKT team members as an organizational staffing strategy. Finally, individual adopter characteristics were important, as instituting a systematic approach to IKT was new and proved challenging for many colleagues. Although individual attitudes were favourable, in the larger team there were some champions, some passive supporters, and some confusion. Due to varying experience in IKT and implementation science, some team members perceived a pressure to lead and successfully implement IKT in South Africa because peers were looking for guidance. For quality, fidelity, monitoring, and support purposes, virtual meetings were organized bimonthly during the implementation phase to monitor progress and adjust where necessary. This was complemented by informal communication, whether face to face or via email, as and when needed.

As per Nilsen [42] , innovation is the "implementation object", which in this case was an embedded IKT approach. The ability of the IKT approach to be adaptable to a complex system that involved many stakeholders and • Funding from BMBF ---

• Interested and engaged government ofϐicials ---evolving relationships was a key element of innovation characteristics. While the IKT approach and strategy was implemented mostly according to plan, it was adapted according to opportunity, changing political context, and input from stakeholders. This resulted in convening an NCD research symposium as a key activity in 2020 but also strengthened the need to monitor implementation indicators despite missing data being a challenge at times. Innovation fit therefore was an important consideration. In the preparation phase, this included conducting a thorough stakeholder analysis, a stakeholder prioritization exercise, and design of a detailed IKT strategy for each priority stakeholder. Frequent meetings with key stakeholders permitted a better understanding of their engagement preferences, evidence needs, training requests, and output/product choices. A tailored engagement strategy and response was implemented based on this information, and adapted according to opportunities, changing political context, and input from stakeholders. At the implementation phase, this was supported by the NDoH.

Outcomes were captured systematically through a monitoring strategy maintained by IKT focal points across the three CEBHA+ partner institutions. Planned as well as opportunistic or demand-led engagements were captured in the IKT strategy documents in which the team reflected on process and progress, which was reported on as per donor requirements. This is particularly important for three reasons: (1) to adapt and evolve the IKT strategy as deemed necessary; (2) to share IKT experiences with other African CEBHA+ countries; and (3) to collect data relevant for external evaluation of the programme.

Strong stakeholder relationships paid dividends during the implementation phase when key members of the NDoH facilitated engagement with other government stakeholders. For instance, when the South Africa CEBHA+ team hosted an NCD symposium in March 2020, we were able to rely on our social capital in the government to secure the attendance and contribution of the Minister of Health. Similarly, when decision-makers wanted to understand more about COVID-19 and its intersection with NCDs, South Africa CEBHA+ colleagues were considered key academics to be consulted for rapid evidence reviews [59, 60] .

Since knowledge translation in global health started to gain traction in the lead-up towards the Millennium Development Goals [61, 62] , efforts to bridge the implementation gap between knowledge production and EIDM in health policy have increased substantially. In low-and middle-income countries (LMICs), the marked inability of health systems to effectively implement evidence-informed interventions resulted in a call for implementation research in the design and execution of evidence-informed policy [63] . Although the relative paucity of peer-reviewed literature on IKT remains, there is an upward trend in documenting these experiences [64] as well as developing appropriate protocols [65] . Examples in Africa include the development of a KT platform in Zambia [66] and Malawi [67] , and reflecting on KT strategies in Tunisia and Ivory Coast [35] .

In this study, we documented our experience of developing, implementing, and monitoring the IKT approach in South Africa using the EPIS framework. As Becan et al. [34] pointed out, the EPIS model allows for examination of change processes at multiple levels, across time, and through successive stages toward implementation. The model was therefore well suited to understand and analyse our IKT approach. We combined the temporal aspect to demonstrate the dynamic and iterative IKT strategy that proved sensitive to changes in both the outer and inner context and was dependent on relationships and linkages between these. Using the EPIS framework to interrogate and document our IKT experiences proved extremely useful, particularly when mapping out the various phases as well as dynamic interactions that underpinned our IKT approach.

As outlined by Aarons et al. in their seminal paper [40] , few implementation models explicitly recognize that different variables play crucially different roles at different time points during the process of implementation. In our study, several constructs remained stable across the three EPIS phases of exploration, preparation, and implementation, including stable and supportive funding, committed and competent leadership, skilled and dedicated IKT champions, diverse and established personal networks, a conducive and enabling policy environment, and boundary-spanning intermediaries. These phase-agnostic 

• Individuals traverse the inner and outer setting serving as intermediaries or boundary spanners, which facilitates the breaking of silos, mutual understanding of the two settings, builds trust and creates a more empathetic relationship. • A constantly changing inner setting, outer setting, individuals, networks require a dynamic and evolving, non-linear, highly integrated process. factors proved critical to ensure resilience and agility in the face of highly dynamic and changing local contexts and relationships, particularly as the COVID-19 pandemic hit. Some determinants of success were, however, phase-specific, which makes intuitive sense with respect to innovations. The IKT approach benefited from adaptation as the inner and outer context evolved. As a result, the team was able to respond to unanticipated demanddriven requests from decision-makers as well as pivot swiftly in response to crises. This agility will be important in the sustainment phase which we reflect later in the paper.

Reflections on the interlinkages and bridging constructs support the literature on the boundary spanners or knowledge brokers. Network analyses have often been used to unpack the role and power of such actors as both intermediaries as well as gatekeepers [26, [68] [69] [70] [71] [72] . While our experience with most stakeholders were positive in nature, several subconstructs within the inner context and outer context may shift this balance with a need for revised stakeholder analyses and relationship management [11, 73] .

These findings will likely have implications for the sustainment phase where it will be important to capitalize on the phase-agnostic factors while managing for the phase-specific ones. Based on our experience and data, an institutionalization of IKT principles and practices such as authentic and mutually beneficial collaborations, a culture of EIDM, and capacity and resources for engagement and network maintenance will be critical. We propose that this can be imagined prospectively in our case as follows: (a) documenting the implementation of the IKT approach, specifically stakeholder engagement activities, will help us understand the changing needs and gaps in IKT or EIDM skills, and competencies amongst stakeholders; (b) maintaining collaborations as well as engaging with new stakeholders, particularly due to current and anticipated turnover within the government [11] , potential internal organizational restructuring and/or staffing, and new actors in the external environment; (c) ensuring resilient institutional connections between CEBHA+ and stakeholders by going beyond single connections so as to have depth and breadth as well as diversity [26, 68] ; (d) anticipating and planning for changing policy or decision-making processes; (e) continuously monitoring the implemented IKT approach to identify conversion or interchange between phase-agnostic and phase-specific factors across time, and whether newer strategies or innovations are required-this adaptation will be key to sustainment [56] ; and (f ) budgeting for cost-intense activities related to IKT. Longitudinal research of the CEBHA+ IKT strategy, as well as future initiatives such as the one described in this paper, would need to track some indicators to better understand sustainability and scalability which need more attention [56] . Such studies would help to understand the applicability of an IKT approach for projects and programmes beyond CEBHA+ that embed implementation science and IKT research into their design.

Having used the EPIS framework retrospectively, we were able to appreciate its value in prospective planning. This permits us to reflect on some lessons: had we used the framework earlier in the CEBHA+ project, we may well have considered what models best fit the IKT intervention in both our inner and outer context, keeping the diversity of our stakeholders as well as challengesanticipated as well as unanticipated-in mind. The current IKT implementation and monitoring has relied on a handful of key individuals within the CEBHA+ team. More training of the rest of the team and perhaps even of stakeholders may have enhanced acceptability, fidelity, adaptation, and fit. Furthermore, as mentioned earlier, more deliberate thought to the sustainment of the value and benefit of the IKT approach would have likely occurred. With respect to capturing our dynamic programme, using a tool such as the framework for reporting adaptations and modifications (FRAME) [74] to capture change would perhaps have been helpful. This could be particularly important in approaching monitoring from a systems lens that needs to adjust for the complex nature of the IKT approach, which naturally introduces limitations to using any framework with inherent constraints and boundaries.

We acknowledge that our reflection has some limitations. Stakeholder engagement often happens on an ad hoc basis by CEBHA+ IKT team members and is not always formally captured. This may have resulted in missing data and limited analysis with room for more elaboration. Furthermore, documenting the process of stakeholder engagement also proved difficult in terms of how best to measure the success of engagement. Finally, research projects within CEBHA+ have started at various time points, resulting in new stakeholders being added to the IKT approach on a regular basis.

Given the reflexive nature of this paper, we recognize that the authors are all researchers on the CEBHA+ project and provide only one perspective of the IKT approach in South Africa. The paper is therefore limited to presentation of our own views and perspectives. However, the importance of stakeholder perspectives has been planned [38] and will be reported in a future publication that seeks to evaluate the CEBHA+ IKT approach across all African partner sites. We envisage that our perspective complements the broader evaluation, as it provides more in-depth contextualized information to help interpret the CEBHA+ IKT process and outcome results. Finally, we have not yet been able to reflect on the sustainment phase of the EPIS framework in our analysis given the ongoing implementation of the IKT approach.

The challenge as well as opportunity in implementation science lies in the very nature of working in complex contexts with changing realities. Adapting the CEBHA+ IKT approach to respond to these changes was what permitted us to be agile, responsive, relevant, and useful to key decision-makers deliberating NCD policies and practices in a time of emergent crises. Bridging IKT with a framework from implementation science can be extremely beneficial not only when reflecting post facto on an IKT approach but also when planning and implementing such strategies. Documenting experiences from South Africa can contribute to strengthening the evidence base of such approaches from an LMIC perspective. 

Integrated knowledge translation with public health policy makers: a scoping review

Knowledge translation for public health in low-and middle-income countries: a critical interpretive synthesis

Making research matter: a civil society perspective on health research

Bridging the divide between research and policy in Nigeria: the role of a health policy advisory committee

Enhancing evidence informed policymaking in complex health systems: lessons from multi-site collaborative approaches

Health policy-makers' perceptions of their use of evidence: a systematic review

A systematic review of barriers to and facilitators of the use of evidence by policymakers

Researcher and policymaker dialogue: the Policy BUDDIES Project in Western Cape Province, South Africa

The use of research evidence in public health decision making processes: systematic review

Increasing capacity for knowledge translation: understanding how some researchers engage policy makers

Exploring the evolution of engagement between academic public health researchers and decision-makers: from initiation to dissolution

Factors affecting engagement between academic faculty and decisionmakers: learnings and priorities for a school of public health

Knowledge translation in health: how implementation science could contribute more

Resolution on the use of evidence in developing health care policies, plans, standards and protocols in the ECOWAS region

Knowledge brokering: the missing link in the evidence to action chain?

Toward a model of the effective transfer of scientific knowledge from academicians to practitioners: qualitative evidence from the commercialization of university technologies

Steps toward an integrated model of research utilization

Connecting research and policy

How can research organizations more effectively transfer research knowledge to decision makers?

Assessing country-level efforts to link research to action

Lost in knowledge translation: time for a map?

Knowledge brokers or relationship brokers? The role of an embedded knowledge mobilisation team

Strengthening networks and building relationships to increase the impact of global development research

The role of intermediaries in getting evidence into policy and practice: some useful lessons from examining consultancy-client relationships

Partnership experiences: involving decision-makers in the research process

Relationships between public health faculty and decision-makers at four governmental levels: a social network analysis

Deliberative dialogues as a mechanism for knowledge translation and exchange in health systems decision-making

Evaluating deliberative dialogues focussed on healthy public policy

Chapter 05: How collaboration, early engagement and collective ownership increase research impact: strengthening community-based child protection mechanisms in Sierra Leone

Community engagement is… revisiting Boyer's model of scholarship

The scholarship of engagement

Integrated knowledge translation (IKT) in health care: a scoping review

Welcome to implementation science

A model for rigorously applying the Exploration, Preparation, Implementation, Sustainment (EPIS) framework in the design and measurement of a large scale collaborative multi-site study

Reflecting on knowledge translation strategies from global health research projects in Tunisia and the Republic of Cote d'Ivoire

Advancing the evaluation of integrated knowledge translation

An approach for setting evidence-based and stakeholder-informed research priorities in low-and middle-income countries

A mixed method evaluation of the CEBHA+ integrated knowledge translation approach: a protocol

University curricula in evidenceinformed decision making and knowledge translation: integrating best practice, innovation, and experience for effective teaching and learning. Front Public Health

Advancing a conceptual model of evidence-based practice implementation in public service sectors

Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science

Making sense of implementation theories, models and frameworks

Applying the consolidated framework for implementation research to integrated knowledge translation: experiences from South Africa. Non Communicable Disease Symposium

Bridging research and practice: models for dissemination and implementation research

Implementing health research through academic and clinical partnerships: a realistic evaluation of the Collaborations for Leadership in Applied Health Research and Care (CLAHRC)

An evidence integration triangle for aligning science with policy and practice

The dynamic sustainability framework: addressing the paradox of sustainment amid ongoing change

Making sense of complexity in context and implementation: the context and implementation of complex interventions (CICI) framework

Planning for innovation through dissemination and utilization of knowledge

The utilization of policy analysis by state agency officials

The utilization of public policy analysis: a conceptual framework

The PARIHS framework-a framework for guiding the implementation of evidence-based practice

Pathways to "evidence-informed" policy and practice: a framework for action

Advancing a conceptual model of evidence-based practice implementation in public service sectors

A framework for enhancing the value of research for dissemination and implementation

Systematic review of the exploration, preparation, implementation, sustainment (EPIS) framework

-metho ds-for-health-profe ssion als/ book5 128. • fast, convenient online submission • thorough peer review by experienced researchers in your field • rapid publication on acceptance • support for research data, including large and complex data types • gold Open Access which fosters wider collaboration and increased citations maximum visibility for your research: over 100M website views per year • At BMC, research is always in progress. Learn more biomedcentral.com/submissions Ready to submit your research Ready to submit your research ?

Federal Ministry of Education and Research. The Africa Strategy 2014-1028: Africa as Partner in Education and Research

South African Therapeutic Guidelines Sub-Committee for COVID-19

Covid-19 rapid reviews

Taking stock of the evidence: COVID-19 and diabetes, hypertension, asthma, occupational lung diseases, coronary heart disease, heart failure and stroke

Knowledge translation in global health

Bridging the implementation gap between knowledge and action for health. Bull World Health Organ

Implementation research evidence uptake and use for policy-making

Evidence map of knowledge translation strategies, outcomes, facilitators and barriers in African health systems

Moving knowledge into action for more effective practice, programmes and policy: protocol for a research programme on integrated knowledge translation

Creating a knowledge translation platform: nine lessons from the Zambia forum for health research

Building a knowledge translation platform in Malawi to support evidence-informed health policy

Do academic knowledge brokers exist? Using social network analysis to explore academic research-to-policy networks from six schools of public health in Kenya

Documenting the development of social capital in a community Safety Promotion Network: it's not what you know but who you know

Leadership in complex networks: the importance of network position and strategic action in a translational cancer research network

Exploring the function and effectiveness of knowledge brokers as facilitators of knowledge translation in health-related settings: a systematic review and thematic analysis

Using social network analysis to monitor and assess the effectiveness of knowledge brokers at connecting scientists and decision-makers: an Australian case study

How to engage stakeholders in research: design principles to support improvement

The FRAME: an expanded framework for reporting adaptations and modifications to evidencebased interventions

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations

The authors thank Prof. Taryn Young (Stellenbosch University) and Dr Tamara Kredo (South African Medical Research Council) for their support and invaluable contributions to various aspects of the paper. We also acknowledge all the South African CEBHA+ members who are engaging with various stakeholders and take part in quarterly meetings as well as German and African partners involved in implementing and supporting the overall CEBHA+ IKT approach.

Authors' contributions NJ spearheaded the development of the manuscript. All authors were involved in the data analysis and interpretation. All authors contributed to the writing of the manuscript, and all authors critically reviewed, read, and approved the final manuscript.

This work is part of the Collaboration for Evidence-Based Healthcare and Public Health in Africa (CEBHA+) (http:// cebha-plus. org/). This is supported through the Federal Ministry for Education and Research (Germany) of the Research Networks for Health Innovation in Sub-Saharan Africa without restrictions on the research content or approach. The content is solely the responsibility of the authors and does not necessarily represent the official views of the funder.

The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.

Ethics approval and consent to participate Not applicable.

Not applicable.

The authors declare that they have no competing interests. 1 Division of Epidemiology and Biostatistics, Centre for Evidence-Based Health