key: cord-1055048-vszsiepa authors: Almazrou, Saja H; Alsubki, Layan A; Alsaigh, Norah A; Aldhubaib, Wadha H; Ghazwani, Sharifah M title: Assessing the Quality of Clinical Practice Guidelines in the Middle East and North Africa (MENA) Region: A Systematic Review date: 2021-02-09 journal: J Multidiscip Healthc DOI: 10.2147/jmdh.s284689 sha: e13fc615a7a26514c64bff1d730b187576591d94 doc_id: 1055048 cord_uid: vszsiepa AIM: Clinical practice guidelines (CPGs) have progressively become a popular tool for making optimal clinical decisions. The literature shows that the poor quality of CPGs can form a barrier against adhering to them, resulting in a suboptimal level of healthcare. The objective of this systematic review is to evaluate the quality of CPGs in the Middle East and North Africa (MENA) region using the Appraisal of Guidelines for Research & Evaluation II (AGREE II) Instrument. METHODS: The authors searched in the MEDLINE and EMBASE databases through the Ovid interface on May 25, 2019. Keywords relating to CPGs and MENA countries were combined using Boolean search operators. The search was not limited to specific diseases. The quality of guidelines was appraised by two reviewers independently using the AGREE II Instrument. Discrepancies within a group were resolved through the involvement of a principle investigator. RESULTS: A total of 61 CPGs were appraised. These guidelines were mainly from Saudi Arabia, and the most covered disease topic was cancer. Among the six domains of the AGREE II Instrument, CPGs scored the highest on clarity of presentation (mean 82%), while the lowest score was granted to the rigor of development domain (mean 28%). This indicates substantial deficiencies in reporting the developmental processes of CPGs and the resources used for the synthesis of evidence. CONCLUSION: From this review, it was found that the number of retrieved guidelines published in the MENA region is limited considering the large geographical area of the MENA region. The main domains that have higher quality scores were clarity of presentation and scope and purpose, whereas domains with the lowest scores were rigor of development and applicability. The authors’ findings will help policymakers identify areas for improvement in CPGs, which can lead them to implement strategies such as the training of individuals and recruitment of international experts to ultimately develop high-quality CPGs. Clinical practice guidelines (CPGs) are defined by the Institute of Medicine (IOM) as statements that include recommendations intended to optimize patient care that are informed by a systematic review of evidence and an assessment of the benefits and harms of alternative care options. 1 CPGs can provide several benefits to clinicians, institutions, and patients. The use of recommendations from CPGs assists clinicians in making decisions about individual patient management. 2 On an institutional level, the use of CPGs allows the provision of standardized care to patients with the aim of decreasing variations in clinical practice. 3 They also improve the quality of care and reduce preventable errors in medication. 3 These possible benefits can eventually promote cost-effective care. 4 Also, patients can benefit from some CPGs that are accompanied by "consumer" versions, which include a simple summary of the benefits and harms of available options. 5 Thus, it empowers patients to make more informed healthcare choices and to consider their personal needs and preferences in selecting the best option. 5 Nowadays, the number of published CPGs is progressively expanding. 6 However, the quality of those guidelines is still inconclusive. [7] [8] [9] The AGREE II Instrument (Appraisal of Guidelines for Research & Evaluation II) is one of the widely used, validated tools for evaluating CPGs. The instrument includes specific assessment questions that cover many aspects of the quality of guidelines with a focus on methodological rigor. 10 It has been widely used to assess guidelines in various clinical conditions. [11] [12] [13] [14] [15] [16] High-quality clinical practice guidelines could have substantial positive impact on patients and healthcare providers. Evidence suggests that high quality could improve patients' clinical outcomes, provide an equitable clinical recommendation that are effective, safe and appropriate to the target population. 17, 18 To our knowledge, there is no study that reviews the quality of published guidelines for clinical practice in the Middle East and North Africa (MENA) region. Several systematic reviews have been conducted to compare the quality of guidelines among high-income countries including the United states [19] [20] [21] and Europe. 22-26 Similar systematic reviews were also performed for low-and middle-income countries including Turkey, 7 China, 9 and Sri Lanka. 8 The quality of clinical practice guidelines varies across countries. In the United States and Europe, lowest scores were assigned to "applicability" and "editorial independence", whereas, in other developing countries including Turkey, China and Sri Lanka, the rigour of development received low scores on AGREE II Instrument. The MENA region consists of high-, middle-, and lowincome countries. 27, 28 In addition, there are variations in the financing of healthcare and the socioeconomic contexts in these countries. 29 Therefore, conclusions from the previously mentioned systematic reviews cannot be generalized to the MENA region. The aim of this study is to assess the quality of CPGs in the MENA region using the validated AGREE II Instrument. 10 The review's protocol is registered with the International Prospective Register of Systematic Reviews (PROSPERO; registration number: CRD42019132437). The sources were the MEDLINE and EMBASE databases through the Ovid interface, and the review was conducted on May 25, 2019, to identify CPGs. Additionally, gray literature has been manually searched to identify CPGs in all relevant health organization websites including those of the ministries of health and medical organizations of the MENA countries involved (Appendix 1). Keywords and terms relating to CPGs and all the MENA countries were combined using Boolean search operators (Appendix 2). We used the institution of medicine (IOM) definition for clinical practice guidelines: Statements that include recommendations intended to optimize patient care that are informed by a systematic review of evidence and an assessment of the benefits and harms of alternative care options. 1 Therefore, the included guidelines should fulfil the following criteria: 1. Guidelines are developed by medical societies or governmental institutions. 2. Guidelines should describe the methods used to search the literature and identify eligible studies. 3. Guidelines should provide structured recommendations based on reviewed studies. We included English language guidelines that were produced by countries with MENA region organizations. 27,28 Short summaries, narrative and systematic reviews, abstracts, and posters were excluded. The detailed criteria are listed in Table 1 . then full text to select eligible guidelines. Conflicts and disagreements were resolved by discussion or by the involvement of an independent reviewer, if necessary. Also, two authors independently extracted and assessed the quality of the selected CPGs. Extracted data included the CPG name, specialty, year of publication, and country. The AGREE II Instrument consists of six major domains that include a total of 23 different items. 10 The domains includes, scope and purpose, stakeholder involvement, rigor of development, clarity of presentation, applicability and editorial independence. Following these domains, there are two general rating items also known as overall assessments. The first overall assessment question requires the user to make a judgment regarding the overall quality of a guideline, taking into consideration the criteria considered in the assessment process. In the second overall assessment question, the user is asked whether she/he recommends using the CPG or not. 10 Each of the 23 items of the six domains and the overall assessment questions were rated as a part of the quality assessment. The AGREE II Instrument provides a rating scale from 1 to 7 with 1 indicating strong disagreement and 7 indicating strong agreement. The points between 2 and 6 can be chosen depending on the quality of reporting and its completeness. After rating the items, the score of each domain should be calculated independently. This is done by the summation of each item's score in the domain and then calculating the total by scaling the domain's score as percentage of the maximum possible score. The formula for calculating the scaled score is as follows: Obtained score -Minimum possible score/Maximum possible score -Minimum possible score. No specific score is defined as a minimum score by the AGREE II consortium. Thus, determining whether a CPG is of high or low quality is the decision of the user of the instrument. Consequently, for this review, a quality score threshold was selected considering all six domain scores to be 60% and above based on consensus among the authors. Therefore, high-quality guidelines will be those in which all domains score 60% or more. 10 We used descriptive statistics with mean (SD), median, and range for each domain score, calculated using Microsoft Excel (2016). 30 Following the authors' systematic search strategy, a total of 346 records were identified in the previously described databases, with an additional 19 papers identified through the gray literature search. After removing duplicates, the number of guidelines was 314, of which 235 were found to be irrelevant after screening by title and abstract, and 6 were excluded as duplicates. Therefore, 73 guidelines were considered for full-text screening, and 12 of these were excluded for different reasons mentioned in the flow chart ( Figure 1 ). The final number of included guidelines was 61. The description of the general characteristics of the assessed guidelines including the date and origin is illustrated in [85] [86] [87] and one was from each of the following countries: Iran, 88 Egypt, 89 and Jordan. 90 The main domains that had higher scores were clarity of presentation (mean 82%, range 39-100%) and scope and purpose (mean 63%, range 3-100%); meanwhile, domains with the lowest scores were rigor of development (mean 28%, range 0-71%), applicability (mean 29%, range 0-75%), stakeholders' involvement (mean 53%, range 14-97%), and editorial independence (mean 59%, range 0-100%). Out of the 61 guidelines, 58 (95%) guidelines scored >60% in the clarity of presentation domain, whereas only 5 (8%) and 7 (11.5%) scored >60% in applicability and rigor of development, respectively. The summary statistics for CPG quality assessment are presented in Table 3 . The detailed assessment is presented in Appendix 3. This study was performed to examine the quality of CPGs in the MENA region using the AGREE II Instrument. In this review, a total of 61 guidelines were suitable for inclusion, and their quality varied. Among the six domains of the AGREE II Instrument, CPGs scored the highest on clarity of presentation (mean 82%), while the lowest score was granted to the rigor of development domain (mean 28%). Our results were consistent with those of similar reviews assessing CPGs in Turkey, Sri Lanka, and China. [7] [8] [9] The similarities were that the lowest scores were attributed to the rigor of development and applicability domains, whereas the highest scores were attained in the clarity of presentation followed by the scope and purpose domain. As opposed to the findings of Hu et al 9 , editorial independence, which includes the role of funding bodies and potential conflicts of interest, was sufficiently reported in 50% of the included guidelines. This indicates the transparency of the guideline development process in the MENA region. The impact of economic status on clinical practice and research has been widely investigated. [91] [92] [93] Few systematic DovePress reviews have been conducted to compare and identify the gaps in several guidelines in low-income and middleincome countries compared with high-income countries. [94] [95] [96] Since some of the MENA countries are classified as low-income and middle-income, as described in the data of the World Bank, the results of such research can be taken into consideration. 28 Results from those reviews found several factors in the CPGs of low-and middle-income countries that had an impact on their quality and resulted in less clear and applicable guidelines. 28, 95 These factors can be broadly classified into evidencerelated and contextual-related. 97, 98 Regarding evidencerelated factors, the ability to search and critique clinical evidence is limited in developing countries. 97, 98 Moreover, Baradaran-Seyed et al state that despite the awareness of health-research priorities and needs, using existing knowledge from daily practice to inform larger clinical studies is suboptimal. 97 Additionally, Owolabi et al found that there is a lack of compliance with the trustworthiness standards as defined in the Institute of medicine for guideline development. 95 One of the quality assessment items within the rigor of development domain was procedure for updating. 10 Some reviews showed that most of these guidelines were outdated, older than 5 years, which is an issue since medical knowledge is evolving and many updates occur regularly. 28, 95 Contextual-related factors mainly affect the applicability of guidelines. 10 Healthcare policies and economic and contextual factors vary among different countries of the MENA region. 99 For example, the access and efficient utilization of primary healthcare services in the region is suboptimal. 100 In addition, despite the global reduction of communicable disease and the increasing rate of noncommunicable diseases, some countries in the MENA region, such as Egypt and Morocco, have an increasing trend for both types. 99 Workforce in the region is a major concern, and the number of physicians per 1000 people is lower than expected for middle-income countries such as Yemen, Morocco, the West Bank and Gaza, and Iraq. This factor is also superimposed with a lack of training and professional development, especially in rural regions. 101 Finally, out-of-pocket expenditures account for 74% of private health expenditures, a factor that negatively affects the disadvantaged population. This may explain the reasons behind the poor quality of CPGs in the MENA region, especially in the development and applicability domains. To the authors' knowledge, this is the first review performed on the assessment of the quality of CPGs in the MENA region. The search for clinical practice guidelines extends beyond medical journals, and this breadth enhances the inclusiveness of the search strategy. A major limitation in this study is that our search strategy excludes non-English language studies, and this exclusion may result in language and publication bias. Moreover, poorly indexed studies and those not indexed in PubMed, EMBASE, databases might be missed. In addition, the included clinical practice guidelines have several weaknesses in their design and reporting that may limit the conclusions of this systematic review. The quality assessment of guidelines was assessed by two appraisers, according to the AGREE II guidance, the preferred number of appraisers is four which increases the reliability. Finally, we could not access the hard copies published by governmental bodies and ministries of health, this could limit the comprehensiveness of grey literature search. Identifying weaknesses and areas for improvement in CPGs of the MENA region can guide policymakers and organizations, such as the ministries of health, to implement several strategies to develop high-quality CPGs. First, a guideline development group should consist of a multidisciplinary team including clinicians, epidemiologists and statisticians, policymakers, and patients' advocates. These members need to receive special training in the development process for guidelines, which includes but is not limited to effective searching in medical databases, critical appraisal, and utilization of The Grading of Recommendations Assessment, Development, and Evaluation (GRADE tool). 102 In addition, the strengthening of collaboration between clinicians, researchers, professional societies, and stakeholders in the MENA region is urgently needed. 103 This can be achieved by inviting clinicians and researchers to join guideline development groups, thereby creating a healthy environment where local and international experts meet and share their experience. The involvement of patients and the general public is important in the guideline development phase as it enhances the shared decision-making process and thus improves patient outcomes. 104, 105 Despite the importance of such involvement, studies have reported suboptimal engagement. Therefore, effective utilization of patient support groups and health charity associations as a potential source for targeted patients is warranted. Tackling these issues could potentially enhance the quality of local guidelines and thus increase their implementation and potential impact. From this review, it was found that the number of retrieved guidelines published in the MENA region is limited considering the large geographical area of the MENA region. The main domains with higher quality scores were clarity of presentation and scope and purpose, whereas domains with the lowest scores were rigor of development and applicability. The authors' findings will help policymakers identify areas for improvement in CPGs, and this identification can lead them to implement strategies such as the training of individuals and the recruitment of international experts to ultimately develop high-quality CPGs. The authors report no conflicts of interest for this work. Clinical practice guidelines we can trust Adding "value" to clinical practice guidelines Guide to clinical practice guidelines: the current state of play A systematic review and appraisal of clinical practice guidelines for musculoskeletal soft tissue injuries and conditions Potential benefits, limitations, and harms of clinical guidelines The quality of clinical practice guidelines over the last two decades: a systematic review of guideline appraisal studies Quality assessment of clinical practice guidelines developed by professional societies in Turkey Sri Lankan clinical practice guidelines: a methodological quality assessment utilizing the AGREE II instrument AGREE II: advancing guideline development, reporting and evaluation in health care Methodological quality of clinical practice guidelines with physical activity recommendations for people diagnosed with cancer: a systematic critical appraisal using the AGREE II tool Quality assessment of kidney cancer clinical practice guidelines using AGREE II instrument: a critical review A systematic review of the content and quality of clinical practice guidelines for management of the neurogenic bladder following spinal cord injury The quality of clinical practice guidelines for management of pediatric type 2 diabetes mellitus: a systematic review using the AGREE II instrument Screening for osteoporosis: a systematic assessment of the quality and content of clinical practice guidelines, using the AGREE II instrument and the IOM standards for trustworthy guidelines Assessment of the quality and content of clinical practice guidelines for post-stroke rehabilitation of aphasia Why are clinical practice guidelines not followed? Clinical practice guidelines: tools to support high quality patient care AGREE II assessments of recent acne treatment guidelines: how well do they reveal trustworthiness as defined by the U.S. Institute of Medicine criteria? Systematic appraisal of the American College of Rheumatology Clinical Practice Guidelines A systematic review of recommendations and guidelines for the management of osteoarthritis: the chronic osteoarthritis management initiative of the U.S. Bone and Joint Initiative Nordic clinical guidelines for orthotic treatment of osteoarthritis of the knee: a systematic review using the AGREE II instrument Acute pain management in burn patients: appraisal and thematic analysis of four clinical guidelines A critical appraisal and comparison of the quality and recommendations of glaucoma clinical practice guidelines Review of European and American guidelines for the diagnosis of Lyme borreliosis World Bank Country and Lending Groups Public health in the Arab World: at a crossroads Microsoft Corporation Saudi lung cancer prevention and screening guidelines Practical guidelines for screening and treatment of retinopathy of prematurity in Saudi Arabia The Saudi clinical practice guideline for the prophylaxis of venous thromboembolism in medical and critically ill patients The Saudi clinical practice guideline for the management of overweight and obesity in adults Saudi Oncology Society and Saudi Urology Association combined clinical management guidelines for testicular germ cell tumors The Saudi Initiative for Asthma-2016 update: guidelines for the diagnosis and management of asthma in adults and children The golden hour approach: practical guidelines of the Saudi neonatology society on managing very low birth weight infants in the first hour of life Clinical practice guidelines on the screening and treatment of precancerous lesions for cervical cancer prevention in Saudi Arabia National guidelines for colorectal cancer screening in Saudi Arabia with strength of recommendations and quality of evidence: tripartite task force from Saudi Society of Colon & Rectal Surgery, Saudi Gastroenterology Association and Saudi Oncology Society Prophylaxis and treatment of venous thromboembolism in patients with cancer: the Saudi clinical practice guideline The Saudi clinical practice guideline for the diagnosis of the first deep venous thrombosis of the lower extremity guidelines for osteoporosis in Saudi Arabia: recommendations from the Saudi Osteoporosis Society Saudi oncology society and Saudi urology association combined clinical management guidelines for prostate cancer The Saudi Clinical Practice Guideline for the treatment of venous thromboembolism: outpatient versus inpatient management Saudi guidelines on the diagnosis and treatment of pulmonary hypertension: pregnancy in pulmonary hypertension Saudi guidelines on the diagnosis and treatment of pulmonary hypertension: 2014 updates The Saudi guidelines for the diagnosis and management of COPD Saudi guidelines for the diagnosis and management of hepatocellular carcinoma: technical review and practice guidelines: created and endorsed by the Saudi Association for the Study of Liver Diseases and Transplantation and the Saudi Oncology Society Saudi guidelines for testing and treatment of latent tuberculosis infection The Saudi Center for Evidence Based Health Care. Clinical practice guideline on the timing of initiation of dialysis The Saudi Center for Evidence Based Health Care. Clinical practice guideline on prevention of venous thromboembolism in patients with stroke The Saudi Center for Evidence Based Health Care. Clinical practice guideline on allergic rhinitis in asthma The Saudi Center for Evidence Based Health Care. Clinical practice guideline on the use of thrombolytic therapy in acute stroke Saudi Oncology Society and Saudi Urology Association combined clinical management guidelines for urothelial cell carcinoma of the urinary bladder 2017 The Saudi Center for Evidence Based Health Care. Clinical practice guideline on the role of vitamin D, calcium and exercise in fracture prevention in elderly The Saudi Center for Evidence Based Health Care. Clinical practice guideline on antithrombotic treatment of patients with non-valvular atrial fibrillation The Saudi Center for Evidence Based Health Care. Clinical practice guideline on the treatment of venous thromboembolism The Saudi Center for Evidence Based Health Care. Clinical practice guideline on the use of screening strategies for the detection of breast cancer Saudi Oncology Society and Saudi Urology Association combined clinical management guidelines for renal cell carcinoma 2017 Saudi lung cancer management guidelines 2017 The saudi clinical practice guideline for the prophylaxis of venous thromboembolism in long-distance travelers The Saudi Thoracic Society guidelines for diagnosis and management of noncystic fibrosis bronchiectasis Management of convulsive status epilepticus in children: an adapted clinical practice guideline for pediatricians in Saudi Arabia Guidelines for the secondary prevention of rheumatic heart disease: endorsed by Saudi Pediatric Infectious Diseases Society (SPIDS) Modification and implementation of NCCN guidelines TM on breast cancer in the Middle East and North Africa region Modification and implementation of NCCN guidelines TM on lymphomas in the Middle East and North Africa Region Arab treatment guidelines for the management of major depressive disorder Pan Arab Osteoporosis Society guidelines for osteoporosis management Modification and implementation of NCCN guidelines TM on colon cancer in the Middle East and North Africa Region Modification and implementation of NCCN guidelines TM on prostate cancer in the Middle East and North Africa Region Modification and implementation of NCCN guidelines TM on hepatobiliary cancers in the Middle East and North Africa Region Guidelines for the pharmacological treatment of peripheral neuropathic pain: expert panel recommendations for the Middle East region Clinical practice guidelines for the treatment of invasive Aspergillus infections in adults in the Middle East region: expert panel recommendations Clinical practice guidelines for the management of invasive Candida infections in adults in the Middle East region: expert panel recommendations Journal of Multidisciplinary Healthcare 2021:14 submit your manuscript | www Guidelines for acute management of hyperammonemia in the Middle East region Modification and implementation of NCCN guidelines TM on non-small cell lung cancer in the Middle East and North Africa Region The Lebanese Society of Infectious Diseases and Clinical Microbiology: guidelines for the treatment of urinary tract infections The Lebanese Society for Infectious Diseases and Clinical Microbiology (LSIDCM) guidelines for adult community-acquired pneumonia (CAP) in Lebanon LSN MS guidelines for the management of multiple sclerosis Ministry of public health. National guidelines for tuberculosis prevention, care and elimination in Lebanon Protocol for prescription and follow up of biologics and targeted synthetic disease modifying anti-rheumatic drugs (b/tsDMARDS) in the management of chronic inflammatory rheumatic diseases National Guidelines for diagnosis and management of HIV infected adults FRAX based Lebanese osteoporosis guidelines Guideline on Middle East respiratory syndrome coronavirus (MERS-CoV) Ministry of Health Kingdom of Bahrain. Management of Influenza A (H1N1) and Influenza like Illness (ILI) Recommendations for the clinical management of hepatitis C in Iran: a consensus-based national guideline Egyptian hypertension guidelines Jordanian Osteoporosis Prevention Society. The practical guide for management of osteoporosis Barriers for conducting clinical trials in developing countries-a systematic review Evidence-based public health: what does it offer developing countries? Securing the public good of health research and development for developing countries Gaps in hypertension guidelines in low-and middle-income versus high-income countries: a systematic review Gaps in guidelines for the management of diabetes in low-and middle-income versus high-income countries-a systematic review A systematic comparison of key features of ischemic stroke prevention guidelines in lowand middle-income vs. high-income countries Barriers of clinical practice guidelines development and implementation in developing countries: a case study in Iran Barriers and enablers for the development and implementation of allied health clinical practice guidelines in South African primary healthcare settings: a qualitative study Review of health systems of the Middle East and North Africa Region. Int Encycl Public Health Quality, safety and performance management in primary health care: from scoping review to research priority setting and implementation plan in the Eastern Mediterranean Region Public Health in the Middle East and North Africa: Meeting the Challenges of the Twenty-First Century Use of health systems and policy research evidence in the health policymaking in eastern Mediterranean countries: views and practices of researchers Decision aids for people facing health treatment or screening decisions Do patients benefit from participating in medical decision making? Longitudinal follow-up of women with breast cancer Competing norms: Canadian rural family physicians' perceptions of clinical practice guidelines and shared decision-making Improving the use of research evidence in guideline development 10. Integrating values and consumer involvement Lebanese Society of Infectious Diseases and Clinical Microbiology Guidelines for the use of antimicrobial therapy in complicated intra-abdominal infections in the era of antimicrobial resistance World Bank Country and Lending Groups Saudi Oncology Society and Saudi Urology Association combined clinical management guidelines for renal cell carcinoma Clinical practice guideline on the diagnosis of suspected first deep vein thrombosis of lower extremity: Saudi Center for Evidence based Healthcare The Journal of Multidisciplinary Healthcare is an international, peerreviewed open-access journal that aims to represent and publish research in healthcare areas delivered by practitioners of different disciplines. This includes studies and reviews conducted by multidisciplinary teams as well as research which evaluates the results or conduct of such teams or healthcare processes in general. The journal covers a very wide range of areas and welcomes submissions from practitioners at all levels, from all over the world. The manuscript management system is completely online and includes a very quick and fair peer-review system. Visit http://www.dovepress.com/testimonials. php to read real quotes from published authors.