Abstract
The development and implementation of clinical practice guidelines has flourished over the past two decades. Unfortunately, many studies have found that the quality of such guidelines is highly variable (Alonso-Coello et al. in Qual Safe Health Care 19:e58, 2010; MacQueen et al. in Can J Psychiatry 62:11–23, 2016); research suggests that some of the guidelines used in psychology have been developed using poor methods for guideline development (Bennett et al. in Depress Anxiety 35:330–340, 2018; Trepanier et al. in: Can Psychol 58: 211–217, 2017). While there remains a dearth of research in this area, typically, it is guidelines themselves that are examined by researchers, while too little attention is paid to the developers, and more specifically to how the guideline development groups are composed and the nature of the expertise of those involved in developing the guidelines. Given the importance of grounding guidelines in science, it is key that guideline development groups be comprised of research experts that will help ensure that this essential aspect be respected. In this brief paper, we provide findings from a recent study in which group composition as well as the expertise of guideline development committee members at the Order of Psychologists of Quebec (OPQ) was examined, as defined by academic research productivity. As results highlighted a clear imbalance between clinical and research expertise in these specific committees, with only a small percentage of researchers being represented, we conclude that major improvements need to be made for research to properly reach practitioners and make recommendations to facilitate this.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
AGREE Next Steps Consortium. (2017). The AGREE II instrument. [Electronic version]. Retrieved from https://www.agreetrust.org/wp-content/uploads/2017/12/AGREE-II-Users-Manual-and-23-item-Instrument-2009-Update-2017.pdf
Alonso-Coello, P., Irfan, A., Solà, I., Gich, I., Delgado-Noguera, M., Rigau, D., et al. (2010). The quality of clinical practice guidelines over the last two decades: A systematic review of guideline appraisal studies. Quality and Safety in Health Care, 19, e58. https://doi.org/10.1136/qshc.2010.042077.
Beauchamp, S., Drapeau, M., & Dionne, C. (2015a). The development of practice guidelines in the social and human sciences. Canadian Psychology/Psychologie canadienne, 56, 357–367. https://doi.org/10.1037/a0038811.
Beauchamp, S., Drapeau, M., Dionne, C., & Duplantie, J. P. (2015). Institut national d’excellence en santé et en services sociaux (INESSS): Cadre d’élaboration des guides de pratique dans le secteur des services sociaux [Policy statement]. Montreal, Canada: Author. Retrieved from INESSS website. https://www.inesss.qc.ca/fileadmin/doc/INESSS/Rapports/ServicesSociaux/INESSS_Cadre_elaboration_guides_pratique_servicessociaux.pdf
Beauchamp, S., & Duplantie, J-P. (2012). Vers une méthode d’élaboration des guides de pratique dans le secteur des services sociaux. Institut National D’excellence en Santé et en Services Sociaux. https://www.inesss.qc.ca/fileadmin/doc/INESSS/ServicesSociaux/Guide_pratique/GuidePratique_ServicesSociaux.pdf
Bennett, K., Courtney, D., Duda, S., Henderson, J., & Szatmari, P. (2018). An appraisal of the trustworthiness of practice guidelines for depression and anxiety in children and youth. Depression and Anxiety, 35, 330–340. https://doi.org/10.1002/da.22752.
Bornmann, L., & Daniel, H. (2009). The state of h index research: Is the h index the ideal way to measure research performance? EMBO Reports, 10(1), 2–6. https://doi.org/10.1038/embor.2008.233.
Brouwers, M. C., Kho, M. E., Browman, G. P., Burgers, J. S., Cluzeau, F., Feder, G., et al. (2010). AGREE II: Advancing guideline development, reporting and evaluation in health care. Canadian Medical Association Journal, 182, E839–E842. https://doi.org/10.1503/cmaj.090449.
Carleton, R. N., Parkerson, H. A., & Horswill, S. C. (2012). Assessing the publication productivity of clinical psychology professors in Canadian Psychological Association-accredited Canadian psychology departments. Canadian Psychology/Psychologie canadienne, 53, 226–237. https://doi.org/10.1037/a0027731.
Ciquier, G., Azzi, M., Hébert, C., Watkins- Martin, K., & Drapeau, M. (2020). Assessing the quality of seven clinical practice guidelines from four professional regulatory bodies in Quebec: What’s the verdict? Journal Evaluation in Clinical Practice. https://doi.org/10.1111/jep.13374.
Fretheim, A., Schunemann, H. J., & Oxman, A. D. (2006). Improving the use of research evidence in guideline development: 5. Group processes. Health Resources and Policy Systems, 4, 17–35. https://doi.org/10.1186/1478-4505-4-17.
Gordon, J., & Cooper, B. (2010). Talking knowledge—practising knowledge: A critical best practice approach to how social workers understand and use knowledge in practice. Practice, 22, 245–257. https://doi.org/10.1080/09503153.2010.495768.
Graham, I. D., Mancher, M., Wolman, D. M., Greenfield, S., & Steinberg, E. (2011). Clinical practice guidelines we can trust. Washington, DC: Institue of Medicine National Academies Press.
Hirsch, J. E. (2005). An index to quantify an individual’s scientific research output. PNAS, 102, 16569–16572. https://doi.org/10.1073/pnas.0507655102.
Kunz, R., Fretheim, A., Cluzeau, F., Wilt, T. J., Qaseem, A., Lelgemann, M., et al. (2012). Guideline group composition and group processes, article 3 in Integrating and coordinating efforts in COPD guideline development: An official ATS/ERS workshop report. Proceedings of the American Thoractic Society, 9, 229–233. https://doi.org/10.1513/pats.201208-056ST.
Lobé, C., Renaud, J., Brassard, J., & Fournier, Monique. (2017). Élaboration et adaptation des guides de pratique. Institut national d’excellence en santé et en services sociaux. https://www.inesss.qc.ca/fileadmin/doc/INESSS/Rapports/OrganisationsSoins/Elaboration_guides_pratique/INESSS_Elaboration_adaptation_guides_de_pratique.pdf
MacQueen, G., Santaguida, P., Keshavarz, H., Jaworska, N., Levine, M., Beyene, J., & Raina, P. (2016). Systematic review of clinical practice guidelines for failed antidepressant treatment response in major depressive disorder, dysthymia, and subthreshold depression in adults. The Canadian Journal of Psychiatry, 62, 11–23. https://doi.org/10.1177/0706743716664885.
National Institute for Health Care Excellence. (2015). Developing NICE guidelines: The manual: National Institute for Health and Care Excellence (NICE).
Ng, C. F. (2018). Research productivity and impact of professors in Canadian undergraduate psychology programmes. Canadian Psychology/Psychologie canadienne, 59, 211–218. https://doi.org/10.1037/cap0000137.
Office of Professions of Quebec. (2018). Code of ethics for psychologists (c. C26, r. 212, a. 5) [Online reference]. Retrieved from www.legisquebec.gouv.qc.ca/
Ordre des psychologues du Québec (OPQ). (2012). Guidelines for autism spectrum disorder: Clinical evaluation. Montreal, Canada: Author. Retrieved from https://www.ordrepsy.qc.ca/documents/26707/63191/spectre-de-lautisme/868d8894-44f1-471d-941d-94a5f571395c
Ordre des psychologues du Québec (OPQ). (2006). Guidelines for the assessment of a child in connection with a request for derogation to the age of school admission. Montreal, Canada: Author. Retrieved from https://www.ordrepsy.qc.ca/documents/26707/0/Les+lignes+directrices+pour+l%27%C3%A9valuation+d%27un+enfant+en+vue+d%27une+demande+de+d%C3%A9rogation+%C3%A0+l%27%C3%A2ge+d%27admission+%C3%A0+l%27%C3%A9cole/b2c2e606-7fad-4b18-8ec8-883fb69e572e
Ordre des psychologues du Québec (OPQ). (2006). Guidelines for expert assessment concerning child custody and access rights. Montreal, Canada: Author. Retrieved from https://www.ordrepsy.qc.ca/documents/26707/6319/Lignes+directrices+pour+l%27expertise+en+mati%C3%A8re+de+garde+d%27enfants+et+des+droits+d%27acc%C3%A8s/d0c94c08-c04d-49ae-8fea-b37bd0ed83b8
Ordre des psychologues du Québec (OPQ). (2007). Guidelines for the assessment of mental retardation. Montreal, Canada: Author. Retrieved from https://www.ordrepsy.qc.ca/documents/26707/63191/Lignes+directrices+pour+l%27%C3%A9valuation+du+retard+mental/f20a2002-4535-4070-8a03-15889a9d5450
Ordres des Psychologues du Québec (OPQ). (2008). Explanatory guide to the code of ethics of the psychologists of Quebec. Retrieved from https://www.ordrepsy.qc.ca/documents/26707/63191/Explanatory+guide+to+the+Code+of+ethics+of+the+psychologists+of+Quebec+-+version+anglaise+du+Guide+explicatif+du+code+d%27%C3%A9thique+des+psychologues/8f490d45-9e8d-456a-b0c5-5d7cbf60bd01
Ordre des psychologues du Québec (OPQ). (2014). Guidelines for the evaluation of dyslexia in children. Montreal, Canada: Author. Retrieved, from http://www.ordrepsy.qc.ca/documents/26707/63191/Lignes+directrices+pour+l%27%C3%A9valuation+de+la+dyslexie+chez+les+enfants/139edf81-9163-4060-9c66-06f02eee0ed8
Oxman, A. D., Fretheim, A., & Schunemann, H. J. (2006). Improving the use of research evidence in guideline development: Introduction. Health Resources and Policy Systems, 4, 12–18. https://doi.org/10.1186/1478-4505-4-12.
Schünemann, H. J., Wiercioch, W., Etxeandia, I., Falavigna, M., Santesso, N., Mustafa, R., et al. (2014). Guidelines 2.0: Systematic development of a comprehensive checklist for a successful guideline enterprise. Canadian Medical Association Journal, 186, E123–E142. https://doi.org/10.1503/cmaj.131237.
Scottish Intercollegiate Guideline Network. (2015). SIGN 50: A guideline developers’ handbook 2015. SIGN.
Sekercioglu, C. H. (2008). Quantifying coauthor contributions. Science, 322, 371–371. https://doi.org/10.1126/science.322.5900.371a.
Shiffman, R. N. (2016). Best practices for implementation of clinical decision support. Clinical Decision Support Systems, 2, 99–109. https://doi.org/10.1007/978-3-319-31913-1_6.
Stamoulos, C., Reyes, A., Trepanier, L., & Drapeau, M. (2014). The methodological quality of clinical practice guidelines in psychology: a pilot study of the guidelines developed by the ordre des Psychologues du Québec. Canadian Psychology/Psychologie canadienne, 55(3), 177–186. https://doi.org/10.1037/a0037287.
The ADAPTE Collaboration (2009). The ADAPTE process: Resource toolkit for guideline adaptation (Version 2.0). Retrieved from the Guidelines International Network (G-I-N) website. http://wwwg-i-n.net.
Trepanier, L., Stamoulos, C., & Reyes, A. (2017). Assessing the quality of the OPQ’s guidelines for the evaluation of dyslexia in children using the appraisal of guidelines for research and evaluation (AGREE) II: A brief report. Canadian Psychology/Psychologie canadienne, 58, 211–217. https://doi.org/10.1037/cap0000121.
World Health Organization (WHO). (2010). WHO handbook for guideline development. Geneva, Switzerland: Author. Retrieved from http://www.who.int/hiv/topics/mtct/grc_handbook_mar2010_1.pdf
Wold Health Organization (WHO). (2012). WHO handbook for guideline development. Geneva, Switzerland: Author. Retrieved from https://apps.who.int/iris/bitstream/handle/10665/75146/9789241548441_eng.pdf?sequence=1
Zhang, C. (2009). A proposal for calculating weighted citations based on author rank. EMBO Reports, 10, 416–417. https://doi.org/10.1038/embor.2009.74.
Funding
The work of Lyane Trepanier was supported by the SSHRC Joseph-Bombardier Canada Graduate Scholarship Doctoral Award. The work of Martin Drapeau was supported by SSHRC Research Grant. The work of Constantina Stamoulos was supported by the SSHRC Doctoral Award and FQRSC Doctoral Research Training Scholarship, and Andrea Reyes was supported by the Fonds de Recherche sur la Société et la Culture du Québec (FRQSC). No funding body had any input into any aspect of this research.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Trepanier, L., Reyes, A., Stamoulos, C. et al. Can We Develop Evidence-Based Guidelines Without Research Expertise?. Adm Policy Ment Health 48, 937–941 (2021). https://doi.org/10.1007/s10488-021-01110-0
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10488-021-01110-0