key: cord-0695151-si0h1mwp authors: Li, Qianrui; Luo, Xiaochao; Li, Ling; Ma, Bin; Yao, Minghong; Liu, Jiali; Ge, Long; Chen, Xiaofan; Wu, Xi; Deng, Hongyong; Zhou, Xu; Wen, Zehuai; Li, Guowei; Sun, Xin title: Toward better translation of clinical research evidence into rapid recommendations for traditional Chinese medicine interventions: A methodological framework date: 2022-03-05 journal: Integr Med Res DOI: 10.1016/j.imr.2022.100841 sha: ba08e633022af4e8c714b79a0263cb5c0461f0ea doc_id: 695151 cord_uid: si0h1mwp nan In the era of modernization of traditional Chinese medicine (TCM), the generation and translation of clinical research evidence about TCM interventions -both for effectiveness and safety -are among the central topics of TCM development. Clinical practice guidelines represent an effective approach to translate research evidence into practice for TCM interventions. In recent years, increasing effort s have been devoted to the development and implementation of guidelines for TCM interventions, with approximately one-third of guidelines produced by Chinese developers focusing on TCM. 1 However, the current practice of guideline development may not be optimal in the context of TCM. First, the current development of guidelines is often focused on the use of TCM interventions in a class of disorders (e.g., neurological diseases) or a specific disease (e.g., stroke), which are broad topics containing a variety of questions that required a large volume of research evidence to address. Although this pattern may offer a comprehensive set of recommendations about the use of TCM interventions, many recommendations developed lack strong clinical evidence as the basis, given the limited number of high-quality clinical studies in the field. Moreover, the volume production of evidence for TCM interventions is not yet ready, and as a result, regular updating of guidelines about TCM interventions -usually every two yearsmay continue to be faced with the lack of evidence for recommendations on certain topics. On the other hand, when high-quality clinical evidence emerges for TCM interventions, its translation into practice would sometimes be very slow under the current guideline development framework, thus postponing the adoption of best practice. A main reason for this delay is again due to the periodical guideline update mechanism, as a result of which, potentially practice-changing evidence would not change daily practice until the guideline update is due. Given the special context of TCM, the classical guideline development process might not best utilize clinical research evidence about TCM interventions and efficiently translate it into practice. With an alternative approach, the recommendations for TCM interventions, on a case-wise manner, may be changed immediately upon the availability of emerging practice-changing studies. A practice-changing study is a critical study that dominates the evidence body, and hence its findings, when systematically evaluated with all available evidence, could derive recommendations that change existing practice. The core strength of this approach is a rapid translation of practice-changing evidence to ready-to-use recommendations, which is not only important for evidence-based practice in TCM, but also promotes the use of TCM interventions in daily practice. A recent global innovation in guideline development methodology is the proposal of a rapid recommendation framework, which has the potential to add value to the translation of evidence to practice for TCM interventions. Rapid recommendation was first officially proposed in 2016 as a solution to create and disseminate timely and trustworthy guidelines. 2 Up to now, more than 180 rapid recommendations have been published in the BMJ and other journals, 3 , 4 but none of them is pertaining to TCM interventions. Hence, we specifically proposed the development of rapid recommendations for TCM interventions, as a useful complement to classical guidelines, to facilitate timely translation of evidence about TCM interventions. Rapid recommendation is a novel methodological framework for developing clinical practice guidelines, which shares the basic features of classical guidelines -to provide recommendations to a clinical practice question, developed by main stakeholders, and on the basis of a systematic review and evaluation of evidence using a GRADE approach. 5 But rapid recommendations differ from classical clinical practice guidelines in its 'rapid' development process, with an aim of translating practice-changing studies to recommendations typically within 90 days. The clinical question discussed by a rapid recommendation often focuses on a specific practice issue and is enlightened by a potentially practice-changing study (a.k.a., a triggering study). Clinical questions identified solely from clinical knowledge, without a recently published triggering study, are also acceptable as topics for rapid recommendations. A typical workflow and target times of developing a rapid recommendation is presented as Fig. 1 . In this framework, either a clinician or a researcher may first identify the publication of a practice-changing study, and propose a clinical question for recommendation development considering both the triggering study and current clinical needs. The clinician then works with a methodologist to evaluate and finalise the clinical question given its scientific soundness, rigorousness, and applicability. When the clinical question is defined, a multidisciplinary panel meets to create a research plan, with detailed requirements for evidence synthesis. This panel often consists of clinicians, methodologists, and systematic review experts; some studies might also invite patients, caregivers, health economists, and members of other relevant background. With the finalized research plan, an independent evidence synthesis group tailor search strategy, systematically review the literature, and evaluate the quality of evidence using the GRADE approach. On the basis of evidence, all clinicians in the panel meet to create recommendations through a consensus process. Meanwhile, the evidence synthesis group compose one or more systematic reviews to be published as separate articles accompanying the rapid recommendation. Eventually, the recommendations and systematic reviews are disseminated after peer review. Despite the shared basic features with classical clinical practice guidelines, rapid recommendations are developed more rapidly, with a more focused topic, by a multi-disciplinary development As earlier discussed, high-quality evidence about TCM interventions is often available for specific topics but lacking in a systematic manner, and thus it is less likely that classical broadly-focused guidelines ensure sufficient strong evidence for all recommendations. 8 , 9 Moreover, due to the periodical update mechanism and tedious development procedure of classical guidelines, emerging high-quality practice-changing evidence for TCM interventions often fails to translate into practice in a timely manner. Thus, the rapid recommendation framework is proposed and appreciated for its efficiency to develop recommendations from practice-changing evidence as soon as the evidence emerges, given its utilization of the triggering study. Meanwhile, this framework also incorporates a systematic review and assessment of all available evidence and expert consensus, guaranteeing the trustworthiness of recommendations. However, TCM interventions have specific features that render the evidence synthesis process in recommendation development different from western medicine interventions. Firstly, clear differences exist in the theoretical basis and underlying philosophies between TCM and western medicine. The basic theoretical system of TCM includes the holistic conception, Yin-Yang and five elements theory, and Zang-Fu and meridian theory, which focuses on the pathological changes of body functions. In comparison, western medicine is based on reductionism and focuses on histopathological changes of a disease, which is centered on the changes of body materials. Secondly, TCM interventions form a highly complex system and the use of them is often more individualized than western medicine. A universal principle of TCM practice in the routine clinical setting is syndrome differentiation and treatment, which requires differentiation of disease severity and body resistance for an individual patient when providing treatment. Consequently, for patients with a same disease from the western medicine's perspective, the prescription of Chinese herbs might be different, as well as the selection of acupoints and intensity of electroacupuncture. Even for the same patient at a different time in the disease course, the prescription of TCM interventions would change dynamically according to the change of syndromes. In addition, TCM interventions are often used in combination with western medicine, and this integrative approach would make the assessment of clinical effects of TCM interventions more challenging. 10 These specific features of TCM interventions strongly warrant appropriate modification to the rapid recommendation framework. In developing rapid recommendations for western medicine in-terventions, randomized controlled trials (RCTs) are the primary source of evidence about effects of interventions. For TCM interventions, however, the practice-changing study may not always be a classical RCT (i.e., explanatory RCTs), since the complex features of TCM interventions might not be fully reflected by explanatory RCTs. In addition, rare but serious adverse drug reactions (ADRs) pose another important issue in assessing effects of TCM interventions, for example, the Chinese herbal injections. 11 As such, realworld evidence (RWE), including pragmatic trials or observational studies using real-world data, is another important evidence pillar for TCM interventions. 10 Consequently, the nature of multi-dimensional evidence sources for TCM interventions -including classical RCTs and RWE -would require a more sophisticated methodological approach to synthesize and evaluate the totality of evidence about effects of TCM interventions. In the effort s to respond to these needs, we have proposed a specific approach to developing rapid recommendations for TCM interventions -the Multi-dimensional Evidence Synthesis, Evaluation and Recommendations for TCM interventions (MESERT), as presented in Fig. 2 . This approach is built upon an established methodological framework for generating multi-dimensional evidence about TCM interventions (i.e., the 4R approach, 10 ) including RCTs, regardless of explanatory or pragmatic nature, and observational studies, using patient registry data or routinely collected data. Compared with the established rapid recommendation framework, the unique features of MESERT approach are the inclusion of multi-dimensional evidence appropriate for TCM interventions, systematic synthesis of multi-dimensional evidence, assessment of the strength of causal effects in the synthesized evidence. Novel techniques, such as natural language processing, 12 could help evidence identification and screening and accelerate evidence translation. However, two methodological challenges warrant future effort s. First, since multi-dimensional evidence -trials and RWE -is synthesized to generate summary evidence for TCM interventions, sophisticated statistical models would usually be involved depending on the nature and diversity of evidence. One special need, which is methodologically sophisticated, is the quantitative summarization of evidence across trials and RWE. This is particularly warranted when trial evidence may not fully address the effects of TCM interventions or when the event rate is low. In such cases, Bayesian models may help solve this issue. 13 Second, the assessment of quality of synthesized evidence would be more sophisticated than the usual GRADE approach, since the synthesized evidence may encompass trials and observational RWE. On the ground of the established GRADE method, one would carefully assess the strengths of causal inference derived from the synthesized evidence and the magnitude of effects. Standardized criteria are warranted to facilitate this work. Using the MESERT approach, certain TCM interventions with adequate evidence, such as acupuncture and Chinese patent medicines, 14 , 15 may be the desirable candidates for developing rapid recommendations. Although no established examples have been readily available, we illustrated two examples as potentially appropriate topics for generating rapid recommendations. Acupuncture has been frequently studied for treating knee osteoarthritis (KOA), but given the lack of high-quality evidence, recommendations in current clinical practice guidelines were constantly of a low strength. 16 Recently, a multicenter RCT was published to assess the efficacy of acupuncture for KOA treatment, 17 in which 480 patients were randomized to receive electroacupuncture, manual acupuncture or sham acupuncture 3 times weekly for 8 weeks. The efficacy was measured as the response rate, which was the proportion of participants who simultaneously achieved at least 2-point improvement on the numeric rating scale (NRS) and at least 6-point improved on the 68-point Western Ontario and McMaster Universities Osteoarthritis Index (WOMAC) function subscale. This trial found that intensive electroacupuncture significantly reduced pain and improved function at week 8 (between-group differences in response rate: 13.0% [97.5%CI, 0.2% to 25.9%; P = 0.0234]), and these effects persisted though week 26. Although no benefit was found for intensive manual acupuncture at week 8 (11.3% [97.5%CI, -1.6% to 24.4%; P = 0.0507]), significant benefits were observed during follow-up. Findings of this trial have the potential to dominate the evidence body and to formulate valuable recommendations for acupuncture practice. However, due to the periodical guideline updating mechanism, it might take years for this piece of evidence to be used for guideline development. Moreover, although this trial provides high quality evidence to support acupuncture use in KOA treatment, evidence remains lacking for many other aspects of acupuncture practice, and hence, the evidence-base for a full-length guideline might still be suboptimal. In this case, the development of a rapid recommendation would help efficient translation of high-quality evidence. In fact, using this trial as a triggering study, our team has launched the development of a rapid recommendation. In practice, this trial was first noticed by the clinical chair, and after evaluation from both the clinical and methodological aspect, a final recommendation topic was defined to be the use of acupuncture (including both electro-acupuncture and manual acupuncture) for KOA. Then a panel meeting was held to discuss the research plan, during which, a consensus process was used to select the clinical outcomes to measure acupuncture efficacy and safety in KOA patients and to finalize the subgroup analyses. Later, a systematic review and evaluation of the evidence was performed, based on which, recommendations were formulated. In another example, a recently published RCT found that 14 days of Danhong injection (i.e., a type of Chinese patent medicine) in combination with standard western medicine treatment was more effective than western medicine alone for relieving angina in patients with coronary artery disease, with an increased proportion of patients with clinically significant changes on the anginafrequency, as assessed by the Seattle Angina Questionnaire (difference in proportion: 12 18 Moreover, a post-market surveillance study showed good tolerance of Danhong injection in a real-world setting, with an incidence rate of adverse drug events (ADEs) being 0.35%, among which 92.6% events were mild to moderate (e.g., pruritus, dizziness, headache, superficial phlebitis, flushing). 19 These studies may not make up sufficient evidence ground for a guideline about the overall clinical application of Danhong injection. But the RCT 18 exploring Danhong injection's improvement of angina may serve as a triggering study, and would be analyzed in combination with the RWE evidence, using the MESERT approach, to develop a rapid recommendation for Danhong injection use in angina management. In the future, a complete system is needed to support the application of the MESERT approach for TCM interventions. This includes at least an established set of methodological standards, a network of multidisciplinary experts, and a lively updating pool of established recommendations. In the early efforts, priorities may be given to TCM interventions with high quality evidence, and then for interventions with moderate and low-quality evidence. In this paper, we discussed rapid recommendations as a useful framework to develop clinical practice guidelines for TCM interventions. We specifically proposed the MESERT approach, an enhanced rapid recommendation framework for TCM interventions. This approach fully embraces the special features of TCM interventions and captures all the merits of the original rapid recommendation framework, by which clinical evidence about TCM interventions would be efficiently translated into practice. We anticipate that the MESERT approach would well complement classical guideline development, both of which would serve as tools for promoting evidence-based practice of TCM. None to declare. Not applicable. Not applicable. Clinical practice guidelines in China Introduction to BMJ Rapid Recommendations Colorectal cancer screening with faecal immunochemical testing, sigmoidoscopy or colonoscopy: a clinical practice guideline AGA rapid recommendations for gastrointestinal procedures during the COVID-19 pandemic GRADE: an emerging consensus on rating quality of evidence and strength of recommendations WHO Handbook for Guideline Development Scottish Intercollegiate Guidelines Network (SIGN) Appraising the quality of clinical practice guidelines in traditional Chinese medicine using AGREE II instrument: A systematic review Assessing the quality of the first batch of evidence-based clinical practice guidelines in traditional Chinese medicine Assessing clinical effects of traditional Chinese medicine interventions: moving beyond randomized controlled trials Safety profile of traditional Chinese herbal injection: An analysis of a spontaneous reporting system in China Natural language processing was effective in assisting rapid title and abstract screening when updating systematic reviews Methods for the inclusion of real-world evidence in network meta-analysis Chinese patent medicines for the treatment of the common cold: a systematic review of randomized clinical trials Randomized Controlled Trials of Acupuncture (1997-2007): An Assessment of Reporting Quality with a CONSORT-and STRICTA-Based Instrument. Evid-based Complement Alternat Med American College of Rheumatology/Arthritis Foundation guideline for the management of osteoarthritis of the hand, hip, and knee Efficacy of intensive acupuncture versus sham acupuncture in knee osteoarthritis: a randomized controlled trial Detection of an anti-angina therapeutic module in the effective population treated by a multitarget drug Danhong injection: a randomized trial Postmarketing safety surveillance and reevaluation of danhong injection: clinical study of 30888 cases. Evid-based