Intensive Care Medicine

, Volume 36, Issue 10, pp 1636–1643

A critical appraisal of the quality of critical care pharmacotherapy clinical practice guidelines and their strength of recommendations

  • Sean K. Gorman
  • Michelle Ho Chung
  • Richard S. Slavik
  • Peter J. Zed
  • Kerry Wilbur
  • Vinay K. Dhingra

DOI: 10.1007/s00134-010-1786-8

Cite this article as:
Gorman, S.K., Chung, M.H., Slavik, R.S. et al. Intensive Care Med (2010) 36: 1636. doi:10.1007/s00134-010-1786-8



Clinical practice guideline (CPG) quality assessment is important before applying their recommendations. Determining whether recommendation strength is consistent with supporting quality of evidence is also essential. We aimed to determine quality of critical care pharmacotherapy CPGs and to assess whether high quality evidence supports strong pharmacotherapy recommendations.


MEDLINE (1966–February 2008), EMBASE (1980–February 2008), National Guideline Clearinghouse (February 2008) and personal files were searched to identify CPGs. Four appraisers evaluated each guideline using the appraisal of guidelines, research and evaluation (AGREE) instrument. AGREE assesses 23 items in six domains that include scope/purpose, stakeholder involvement, rigor of development, clarity, applicability and editorial independence. Standardized domain scores (0–100%) were determined to decide whether to recommend a guideline for use. One appraiser extracted strong pharmacotherapy recommendations and supporting evidence quality.


Twenty-four CPGs were included. Standardized domain scores were clarity [69% (95% confidence interval (CI) 62–76%)], scope/purpose [62% (95% CI 55–68%)], rigor of development [51% (95% CI 42–60%)], editorial independence [39% (95% CI 26–52%)], stakeholder involvement [32% (95% CI 26–37%)] and applicability [19% (95% CI 12–26%)]. The proportion of guidelines that could be strongly recommended, recommended with alterations and not recommended was 25, 37.5 and 37.5%, respectively. High quality evidence supported 36% of strong pharmacotherapy recommendations.


Variation in AGREE domain scores explain why one-third of critical care pharmacotherapy CPGs cannot be recommended. Only one-third of strong pharmacotherapy recommendations were supported by high quality evidence. We recommend appraisal of guideline quality and the caliber of supporting evidence prior to applying recommendations.


Clinical practice guideline Critical appraisal Quality of evidence Critical care Pharmacotherapy 

Supplementary material

134_2010_1786_MOESM1_ESM.doc (34 kb)
Supplementary material 1 (DOC 34 kb)

Copyright information

© Copyright jointly held by Springer and ESICM 2010

Authors and Affiliations

  • Sean K. Gorman
    • 1
  • Michelle Ho Chung
    • 2
  • Richard S. Slavik
    • 3
  • Peter J. Zed
    • 1
    • 4
  • Kerry Wilbur
    • 5
  • Vinay K. Dhingra
    • 6
    • 7
  1. 1.Department of Pharmacy, Capital District Health Authority, College of PharmacyDalhousie UniversityHalifaxCanada
  2. 2.Department of PharmacySt. Paul’s HospitalVancouverCanada
  3. 3.Pharmacy Department, Interior Health Authority, Faculty of Pharmaceutical SciencesUniversity of British ColumbiaKelownaCanada
  4. 4.Department of Emergency MedicineDalhousie UniversityHalifaxCanada
  5. 5.College of PharmacyQatar UniversityDohaQatar
  6. 6.Intensive Care UnitVancouver General HospitalVancouverCanada
  7. 7.Faculty of MedicineUniversity of British ColumbiaVancouverCanada

Personalised recommendations