Abstract
Introduction
Clinical Practice Guidelines (CPGs) development and implementation in the Kingdom of Saudi Arabia are suboptimal. The Kingdom’s Vision 2030 envisages a transformational change to achieve an effective, integrated, value-based ecosystem focused on patient health.
Objectives
This study aimed to develop a CPG appraisal tool that will support the realization of the Kingdom’s Vision 2030 through the development of high-quality and highly implementable CPGs. To maximize its impact, all vital healthcare paradigms, such as systems thinking, value-based healthcare, and information technology, will robustly be incorporated in the tool.
Methods
The Saudi Health Council through its National Center of Evidence-Based Medicine (NCEBM) embarked on a program to develop this appraisal tool. A taskforce of experts was selected based on their experience in evidence-based practice and training. The task force, through a methodology of extensive literature review, deliberation, outside experts’ feedback, and Delphi and consensus voting, developed a prototype appraisal tool that was named the Holistic Appraisal Tool for CPGs (HAT-CPG).
Results
The HAT-CPG was developed comprising three sections: an initial basic information section, an internal validity section, and an external validity section with a total of 13 section items and 73 reporting elements.
Conclusion
It is envisaged that the Holistic Appraisal Tool will support CPG developers and users in Saudi Arabia in realizing the objectives for which it was developed.
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
1 Saudi Arabia Healthcare System Transformation
Vision 2030, Saudi Arabia’s national growth and economic development strategy, calls for the country’s reliance on oil to be reduced, its economy to be diversified, and public service sectors such as health and education, as well as infrastructure, recreation, and tourism, to be strengthened. The Kingdom of Saudi Arabia’s (KSA) healthcare system is set to undergo major changes under Vision 2030. The healthcare transformation initiative seeks to “restructure the Saudi health sector in order to improve its status and capacities as an effective, integrated, value-based ecosystem focused on patient health.” These objectives will also be met by implementing new healthcare paradigms and promoting public health and disease prevention [1]. To meet the needs of an ever-growing population, the healthcare system must be completely overhauled.
The Kingdom’s current critical issues, including rising healthcare spending [2], an aging population, and an increase in the incidence of non-communicable diseases [3], highlight the need for such a change. The high levels of dissatisfaction among healthcare users, as evidenced by patient complaints [4,5,6], increased harm to patients [7,8,9], healthcare providers’ burnout [10], and lawsuit [11] concerns, exacerbate these issues.
2 Clinical Practice Guidelines
Evidence-based healthcare recommendations provided by well-developed clinical practice guidelines (CPGs) can benefit all stakeholders—from policymakers and healthcare workers to patients and healthy individuals. According to the Institute of Medicine, CPGs are statements that include recommendations based on a systematic review of evidence and an assessment of the benefits and drawbacks of alternative care options that are designed to optimize patient care [12]. They contribute to the development of clinical policy and the widespread use of evidence throughout the healthcare system and help improve clinical decision-making in the context of patient care [13]. Although CPGs play an important role in health policy development, they are designed to cover a wide range of healthcare topics (e.g., health promotion, screening, diagnosis, therapy, etc.) [13]. However, the quality of CPG recommendations varies greatly, and some fall short of the basic standards and may even be harmful or inaccurate [14,15,16].
Healthcare practitioners in the United Kingdom follow CPGs developed and/or approved by the National Institute for Health and Care Excellence (NICE) or the Scottish Intercollegiate Guidelines Network (SIGN), while practitioners in Germany follow the Association of Scientific Medical Societies (AMWF), and those in Canada follow the International Centre for Evidence-Based Medicine Canada. No such national reference exists for health practitioners to follow in Saudi Arabia. Depending on where they were trained, healthcare practitioners in the KSA use a variety of CPGs. This variation in healthcare management has resulted in inconsistencies in the quality of healthcare for the country’s most prevalent and costly diseases such as diabetes, hypertension, and ischemic heart disease. Furthermore, due to factors such as lifestyle, culture, and religious values, these guidelines may not always address the appropriate care required for the Saudi community and residents.
3 Challenges and Solutions
CPGs’ quality and implementation in the Gulf States and Saudi Arabia have been deficient [17]. Despite significant advances in medical science and the availability of numerous CPGs, high-quality healthcare and the anticipated outcomes have yet to be realized [18, 19].
More than 40 CPG appraisal tools have been developed to date to accelerate CPG development, credibility (internal validity), and applicability (external validity) [20, 21]. Despite the availability of these tools, CPGs’ quality and implementation remain suboptimal [22, 23]. However, it is important to note that most guideline evaluation tools focus on the methods used to generate guidelines rather than on how they should be implemented.
Implementation issues are caused by a variety of factors. Two factors contribute to this weakness in CPGs: trustworthiness (credibility) and implementation (applicability) [24,25,26,27]. Guidelines will be of limited use if they are not put into meaningful practice. This is especially true if they were not created with the goal of effective implementation in mind [28,29,30]. While a CPG score derived from appraisal tools may appear high, its actual impact on practice may be minimal or non-existent [31]. Current CPGs clearly have a significant weakness in terms of implementation [32]. The evidence, on the other hand, clearly indicates that CPGs that include implementation tools have a higher success rate of raising standards of care [33,34,35]. CPGs should therefore include all relevant implementation tools in their guidance for solving or resolving healthcare challenges. Four components of the healthcare system should be addressed and targeted (organization/healthcare setting, healthcare professionals, patients, and the community). Each system element has a relevant and evidence-based implementation tool or tools. Multifaceted interventions outperform isolated interventions in terms of effectiveness [12]. Moreover, tools that target non-healthcare systems may be just as important, if not more so, than those that do. Accordingly, an assessment tool that considers CPG implementation at all levels of healthcare, as well as non-healthcare system interventions, is required. It should also uphold the moral and cultural values of the people it serves. Adherence to certain sociocultural aspects aids the successful implementation of CPGs [36].
4 Call for Action
The Saudi Health Council (SHC) is a government organization authorized to coordinate all healthcare provider programs in Saudi Arabia. Its goal is to develop and implement healthcare service standards by managing and coordinating health communities’ programs. The SHC’s vision is to serve as a model for a world-class Saudi health system that improves the Saudi people’s health in a scalable, consistent, and responsible manner. The SHC has established the National Center for Evidence-Based Medicine (NCEBM), which is dedicated to developing evidence-based health practices. The center’s mission is to serve as the health system’s approved national reference center for knowledge and scientific evidence to support the development of more effective health practices.
One of the NCEBM’s pioneering goals was to develop a CPG appraisal tool that outperformed current appraisal tools while being tailored to the needs of the Saudi population. More importantly, the new CPG appraisal tool was intended to advise and support CPG developers and users in the KSA by providing them with practical leverage tools critical to achieving the 2030 healthcare transformation initiative.
Existing appraisal tools have been modified and reformed into the Holistic Appraisal Tool for Clinical Practice Guidelines (HAT-CPG), which examines the methodological rigor, transparency, and implementation actions required to develop a guideline.
5 Holistic Appraisal Tool for Clinical Practice Guidelines Appraisal Tool
The HAT-CPG was created to increase the likelihood of CPGs being implemented successfully by drawing attention to issues that should be considered when appraising or developing guidelines. Two areas of focus were chosen. The first was a greater emphasis on implementation. The second was an innovative scoring system expected to improve the objectivity of this critical component. It is important to note that current CPG appraisal tool scoring systems and final scores, such as those obtained with the Appraisal of Guidelines for Research and Evaluation (AGREE) II tool, have no bearing on the success or failure of a guideline and its implementation as they focus on the methodological quality of CPGs. The HAT-CPG’s internal and external validity sections include nine paradigms that characterize modern healthcare: evidence-based practice, quality-based practice (patient safety), competency-based training and certification, value-based healthcare, patient- and family-centeredness, high-reliability organization principles, health information technology, artificial intelligence, and sociocultural acceptance. Furthermore, the CPG appraisal assessment includes critical and appropriate dissemination, implementation, and monitoring tools relevant to these paradigms, which are intended to strategically enlighten and educate CPG developers and users about these tools, thereby promoting their incorporation and successful implementation in modern CPGs. Table 1 illustrates some of the tools. The HAT-CPG is currently undergoing extensive validation. It is expected and planned that the tool will be complemented by a robust hands-on educational program on the tool’s various aspects and paradigms.
6 Conclusion
The NCEBM is dedicated to developing evidence-based CPGs. To accomplish this, the newly developed HAT-CPG appraisal tool is expected to help advise and support CPG developers and users in the KSA. The HAT-CPG was created to draw attention to issues that should be considered when evaluating or developing CPGs. It aims to increase the likelihood of CPGs being implemented successfully. This will help standardize healthcare delivery and management across the KSA based on the Saudi population’s sociocultural needs. The launch of the NCEBM and the development of the HAT-CPG can help achieve three strategic goals: 1) establish a national standard for health practice by approving and implementing evidence-based CPGs; 2) improve the quality of health services and patient safety by strengthening evidence-based health practices; and 3) support digital transformation in the field of evidence-based medicine.
Availability of Data and Materials
Not applicable.
Abbreviations
- AGREE:
-
Appraisal of Guidelines for Research and Evaluation
- AMWF:
-
Association of Scientific Medical Societies
- CPG:
-
Clinical Practice Guidelines
- HAT-CPG:
-
Holistic Appraisal Tool for Clinical Practice Guidelines
- KSA:
-
Kingdom of Saudi Arabia
- NCEBM:
-
National Center for Evidence-Based Medicine
- NICE:
-
National Institute for Health and Care Excellence
- SHC:
-
Saudi Health Council
- SIGN:
-
Scottish Intercollegiate Guidelines Network
References
https://www.vision2030.gov.sa/v2030/vrps/hstp/. Accessed 3 Jan 2022.
Alkhamis A, Hassan A, Cosgrove P. Financing healthcare in Gulf Cooperation Council countries: a focus on Saudi Arabia. Int J Health Plann Manage. 2014;29(1):e64–82. https://doi.org/10.1002/hpm.2213. (Epub 2013 Aug 28).
Herzallah HK, Antonisamy BR, Shafee MH, Al-Otaibi ST. Temporal trends in the incidence and demographics of cancers, communicable diseases, and non-communicable diseases in Saudi Arabia over the last decade. Saudi Med J. 2019;40(3):277–86. https://doi.org/10.15537/smj.2019.3.23585.
Al Fraihi KJ, Latif SA. Evaluation of outpatient service quality in Eastern Saudi Arabia Patient’s expectations and perceptions. Saudi Med J. 2016;37(4):420–8. https://doi.org/10.15537/smj.2016.4.14835.
Al-Momani MM. Gap analysis between perceptions and expectations of medical-surgical patients in a public hospital in Saudi Arabia. Med Princ Pract. 2016;25(1):79–84. https://doi.org/10.1159/000441000. (Epub 2015 Oct 27).
Senitan M, Alhaiti AH, Gillespie J. Patient satisfaction and experience of primary care in Saudi Arabia: a systematic review. Int J Qual Health Care. 2018;30(10):751–9. https://doi.org/10.1093/intqhc/mzy104.
Aidah S, Gillani SW, Alderazi A, Abdulazeez F. Medication error trends in Middle Eastern countries: a systematic review on healthcare services. J Educ Health Promot. 2021;30(10):227. https://doi.org/10.4103/jehp.jehp_1549_20. (eCollection 2021).
Al Wahabi S, Farahat F, Bahloul AY. Prevalence and preventability of sentinel events in Saudi Arabia: analysis of reports from 2012 to 2015. East Mediterr Health J. 2017;23(7):492–9. https://doi.org/10.26719/2017.23.7.492. (PMID: 28853133).
Aljadhey H, Mahmoud MA, Ahmed Y, Sultana R, Zouein S, Alshanawani S, Mayet A, Alshaikh MK, Kalagi N, Al Tawil E, El Kinge AR, Arwadi A, Alyahya M, Murray MD, Bates D. Incidence of adverse drug events in public and private hospitals in Riyadh, Saudi Arabia: the (ADESA) prospective cohort study. BMJ Open. 2016;6(7):e010831. https://doi.org/10.1136/bmjopen-2015-010831.
Rotenstein LS, Torre M, Ramos MA, Rosales RC, Guille C, Sen S, Mata DA. Prevalence of burnout among physicians: a systematic review. JAMA. 2018;320(11):1131–50. https://doi.org/10.1001/jama.2018.12777.
Almannie R, Almuhaideb M, Alyami F, Alkhayyal A, Binsaleh S. The status of medical malpractice litigations in Saudi Arabia: Analysis of the annual report. Saudi J Anaesth. 2021;15(2):97–100. https://doi.org/10.4103/sja.SJA_908_20. (Epub 2021 Apr 1).
Institute of Medicine (US) Committee on Standards for Developing Trustworthy Clinical Practice Guidelines, Graham R, Mancher, M, Miller Wolman D, Greenfield S, Steinberg E (eds) (2011) Clinical practice guidelines we can trust. National Academies Press (US). https://doi.org/10.17226/13058
Brouwers MC, Florez ID, McNair SA, Vella ET, Yao X. Clinical practice guidelines: tools to support high quality patient care. Semin Nucl Med. 2019;49(2):145–52. https://doi.org/10.1053/j.semnuclmed.2018.11.001. (Epub 2019 Jan 10).
Shaneyfelt TM, Mayo-Smith MF, Rothwangl J. Are guidelines following guidelines? The methodological quality of clinical practice guidelines in the peer-reviewed medical literature. JAMA. 1999;281(20):1900–5.
Grilli R, Magrini N, Penna A, Mura G, Liberati A. Practice guidelines developed by specialty societies: the need for critical appraisal. Lancet. 2000;355:103–6.
Burgers JS, Fervers B, Haugh M, Brouwers M, Browman G, Phillip T, Cluzeau FA. International assessment of the quality of clinical practice guidelines in oncology using the Appraisal of Guidelines and Research and Evaluation Instrument. J Clin Oncol. 2004;22:2000–7.
Koornneef E, et al. The development, implementation and evaluation of clinical practice guidelines in Gulf Cooperation Council (GCC) countries: a systematic review of literature. J Eval Clin Pract. 2015;21(6):1006–1013. https://doi.org/10.1111/jep.12337.
Cabana MD, Rand CS, Powe NR, Wu AW, Wilson MH, Abboud PA, Rubin HR. Why don’t physicians follow clinical practice guidelines? A framework for improvement. JAMA. 1999;282(15):1458–65. https://doi.org/10.1001/jama.282.15.1458.
Barth JH, Misra S, Aakre KM, Langlois MR, Watine J, Twomey PJ, Oosterhuis WP. Why are clinical practice guidelines not followed? Clin Chem Lab Med. 2016;54(7):1133–9. https://doi.org/10.1515/cclm-2015-0871.
Siering U, Eikermann M, Hausner E, Hoffmann-Eßer W, Neugebauer EA. Appraisal tools for clinical practice guidelines: a systematic review. PLoS One. 2013;8(12):e82915.
Vlayen J, Aertgeerts B, Hannes K, Sermeus W, Ramaekers DA. Systematic review of appraisal tools for clinical practice guidelines: multiple similarities and one common deficit. Int J Qual Health Care. 200;17(3):235–242. https://doi.org/10.1093/intqhc/mzi027.
Hébert C, Watkins-Martin K, Ciquier G, Azzi M, Drapeau M. The quality of six clinical practice guidelines in health and social sciences: are we on the right track? Adm Policy Ment Health. 2021;48(5):821–9. https://doi.org/10.1007/s10488-021-01132-8. (Epub 2021 Apr 18).
Eikermann M, Holzmann N, Siering U, Rüther A. Tools for assessing the content of guidelines are needed to enable their effective use–a systematic comparison. BMC Res Notes. 2014;26(7):853. https://doi.org/10.1186/1756-0500-7-853.
Correa VC, Lugo-Agudelo LH, Aguirre-Acevedo DC, Contreras JAP, Borrero AMP, Patiño-Lugo DF, Valencia DAC. Individual, health system, and contextual barriers and facilitators for the implementation of clinical practice guidelines: a systematic metareview. Health Res Policy Syst. 2020;18(1):74. https://doi.org/10.1186/s12961-020-00588-8.
Almazrou SH, Alfaifi SI, Alfaifi SH, Hakami LE, Al-Aqeel SA. Barriers to and Facilitators of Adherence to Clinical Practice Guidelines in the Middle East and North Africa region: a systematic review. Healthcare (Basel). 2020;8(4):564. https://doi.org/10.3390/healthcare8040564.
Keiffer MR. Utilization of clinical practice guidelines: barriers and facilitators. Nurs Clin North Am. 2015;50(2):327–45. https://doi.org/10.1016/j.cnur.2015.03.007.
Correa VC, et al. Individual, health system, and contextual barriers and facilitators for the implementation of clinical practice guidelines: a systematic metareview. Health Res Policy Syst. 2020;18(1):74. Published 2020 Jun 29. https://doi.org/10.1186/s12961-020-00588-8.
Grimshaw J, Russell I. Effect of clinical guidelines on medical practice: a systematic review of rigorous evaluations. Lancet. 1993;342:1317–22.
Grol R. Success and failures in the implementation of evidence-based guidelines for clinical practice. Med Care. 2001;39(8 Suppl 2):1146–54.
Davis DA, Taylor-Vaisey A. Translating guidelines into practice: a systematic review of theoretic concepts, practice experience and research evidence in the adoption of clinical practice guidelines. CMAJ. 1997;157(4):408–16.
Brouwers MC, Kho ME, Browman GP, Burgers JS, Cluzeau F, Feder G, Fervers B, Graham ID, Grimshaw J, Hanna SE, Littlejohns P, Makarski J, Zitzelsberger L. AGREE II: advancing guideline development, reporting and evaluation in health care AGREE Next Steps Consortium. CMAJ. 2010;182(18):E839–42. https://doi.org/10.1503/cmaj.090449. (Epub 2010 Jul 5).
de Vasconcelos LP, Melo DO, Stein AT, de Carvalho HB. Even high-quality CPGs seldom include implementation strategies. Front Pharmacol. 2021;11:593894. https://doi.org/10.3389/fphar.2020.593894. (eCollection 2020).
Gagliardi AR, Brouwers MC, Bhattacharyya OK. The development of guideline implementation tools: a qualitative study. CMAJ Open. 2015;3(1):E127–33. https://doi.org/10.9778/cmajo.20140064. (eCollection2015Jan-Mar).
Sabharwal S, Patel NK, Gauther S, et al. High methodological quality but poor applicability: assessment of the AAOS guidelines using the AGREE II instrument [published erratum in Clin Orthop Relat Res 2014;472:2309]. Clin Orthop Relat Res. 2014;472:1982–8.
Dobbins M, Hanna SE, Ciliska D, Manske S, Cameron R, Mercer SL, O’Mara L, DeCorby K, Robeson P. A randomized controlled trial evaluating the impact of knowledge translation and exchange strategies. Implement Sci. 2009;23(4):61. https://doi.org/10.1186/1748-5908-4-61.
Saha S, Beach C, Cooper L. Patient Centeredness, Cultural Competence, and Healthcare Quality. JNMA. 2008;100(11):1275–85. https://doi.org/10.1016/S0027-9684(15)31505-4.
Funding
No funding was received.
Author information
Authors and Affiliations
Contributions
HMA contributed to conceptualization and writing original draft. AAM, ASM, and HA were involved in writing, draft review and editing. SAA and AA performed draft review and editing. MS and NA were responsible for final draft review, approval, and supervision. IH contributed to conceptualization, supervision, and final draft approval.
Corresponding author
Ethics declarations
Conflict of interest
There are no competing interests to declare.
Ethics Approval and Consent to Participate
Not applicable.
Consent for Publication
All the authors give their consent for publication.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Abdellatif, H.M., Al-Muallem, A., Almansoof, A.S. et al. Clinical Practice Guidelines in an Era of Accountability, Saudi Arabia: A Call for Action. J Epidemiol Glob Health 13, 391–396 (2023). https://doi.org/10.1007/s44197-023-00135-y
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s44197-023-00135-y