Skip to main content

Advertisement

Log in

Critical appraisal of clinical practice guidelines in pediatric infectious diseases

  • Research Article
  • Published:
International Journal of Clinical Pharmacy Aims and scope Submit manuscript

Abstract

Background There is a need to critically appraise clinical practice guidelines in order to ensure safe and effective practices are being implemented to optimize patient care. Appraising guidelines within one therapeutic area enable recommendations for improvement during guideline creation and dissemination. Objectives Study objectives were to systematically appraise selected published guidelines used in the treatment of pediatric infectious diseases and to make recommendations for improvement throughout the development and dissemination processes. Setting The study occurred between collaborative academic and practice-based institutions located in Canada and Qatar. Methods A literature search identified guidelines for management of pediatric infectious diseases from 1997 to 2013. Each guideline was appraised by four independent assessors, according to the appraisal of guidelines for research and evaluation II (AGREE II) instrument. Standardized domain scores were calculated for each guideline and pooled. Final endorsements for use in clinical practice were also determined. Inter-rater reliability was assessed using intraclass correlation coefficients. Main outcome measure Standardized domain scores according to the AGREE II instrument. Results Twenty guidelines met inclusion criteria and were appraised. Pooled domain scores were: scope and purpose (69.9), stakeholder involvement (40.1), rigour of development (47.1), clarity of presentation (73.4), applicability (23.7), editorial independence (46.7), and overall assessment (55.8). Two (10 %) guidelines were recommended for use without revision, 13 (65 %) guidelines were recommended with modifications, and 5 (25 %) guidelines were not recommended for implementation into practice. Inter-rater reliability was moderate to good with intra-class correlations of 0.65–0.93 per guideline. Conclusion The majority of appraised guidelines were moderately rated, with a 25 % of guidelines not recommended for use. Strategies for improvement require the involvement of all key stakeholders (caregivers, patients, and allied health professionals), and consideration of facilitators, barriers and resource implications during implementation. Additionally, critical appraisal of guidelines should become standard practice prior to adoption into clinical settings.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1

Similar content being viewed by others

References

  1. Institute of Medicine, Graham R, Mancher M, Wolman DM, Greenfield S, Steinberg E, editors. Clinical practice guidelines we can trust. Washington, DC: National Academies Press; 2011.

    Google Scholar 

  2. Woolf SH. Potential benefits, limitations, and harms of clinical guidelines. BMJ. 1999;318:527. doi:10.1136/bmj.318.7182.527.

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  3. Silagy C, Stead L, Lancaster T. Use of systematic reviews in clinical practice guidelines: case study of smoking cessation. Br Med J. 2001;323:833–6.

    Article  CAS  Google Scholar 

  4. GRADE Working Group. Welcome page. 2005–2014. http://www.gradeworkinggroup.org.

  5. Gundersen L. The effect of clinical practice guidelines on variations in care. Ann Intern Med. 2000;133:317–8.

    Article  CAS  PubMed  Google Scholar 

  6. Gilli R, Magrini N, Penna A, Mura G, Liberati A. Practice guidelines developed by specialty societies: the need for a critical appraisal. Lancet. 2000;355:103–6.

    Article  Google Scholar 

  7. Brouwers M, Kho ME, Browman GP, Burgers JS, Cluzeau F, Feder G. AGREE II: advancing guideline development, reporting and evaluation in healthcare. Can Med Assoc J. 2010;182:E839–42.

    Article  Google Scholar 

  8. Vlayen J, Aertgeerts B, Hannes K, Sermeus W, Ramaekers D. A systematic review of appraisal tools for clinical practice guidelines: multiple similarities and one common deficit. Int J Qual Health Care. 2005;17:235–42.

    Article  PubMed  Google Scholar 

  9. Gorman S, Chung MH, Slavik R, Zed PJ, Wilbur K, Dhingra VK. A critical appraisal of the quality of critical care pharmacotherapy clinical practice guidelines and their strength of recommendations. Int Care Med. 2010;36:1636–43.

    Article  Google Scholar 

  10. Cates J, Young D, Bowerman D, Porter R. An independent AGREE evaluation of the occupational medicine practice guidelines. Spine J. 2006;6:72–7.

    Article  PubMed  Google Scholar 

  11. Pediatric Infectious Diseases Society. Home. 2015. http://www.pids.org/.

  12. Infectious Diseases Society of America. IDSA practice guidelines. 2015. http://www.idsociety.org/IDSA_Practice_Guidelines.

  13. Tunkel AR, Hartman BJ, Kaplan SL, Kaufman BA, Roos KL, Scheld WM, et al. Practice guidelines for the management of bacterial meningitis. Clin Infect Dis. 2004;39:1267–84.

    Article  PubMed  Google Scholar 

  14. National Institute for Health and Clinical Excellence. Management of bacterial meningitis and meningococcal septicaemia in children and young people younger than 16 years in primary and secondary care. NICE guidelines CG102. 2010. http://www.nice.org.uk/guidance/cg102.

  15. Lieberthal AS, Carroll AE, Chonmaitree Ganiats TG, Hoberman A, Jackson MA, et al. The diagnosis and management of acute otitis media. Pediatrics. 2013;131:e964–99. doi:10.1542/peds.2012-3488.

    Article  PubMed  Google Scholar 

  16. American Academy of Pediatrics. Subcommittee on management of sinusitis, committee of quality improvement. Clinical practice guidelines: management of sinusitis. Pediatrics. 2001;108:798–808.

    Google Scholar 

  17. Gerber MA, Baltimore RS, Eaton CB, Gewitz M, Rowley AH, Shulman ST, et al. Prevention of rheumatic fever and diagnosis and treatment of acute streptococcal pharyngitis. Circulation. 2009;119:1541–51. doi:10.1161/CIRCULATIONAHA.109.191959.

    Article  CAS  PubMed  Google Scholar 

  18. Shulman ST, Bisno AL, Clegg HW, Gerber MA, Kaplan EL, Lee G, et al. Clinical practice guideline for the diagnosis and management of group A streptococcal pharyngitis: 2012 update by the Infectious Diseases Society of America. Clin Infect Dis. 2012;55(10):e86–102. doi:10.1093/cid/cis629.

    Article  PubMed  Google Scholar 

  19. Chow AW, Benninger MS, Brook I, Brozek JL, Goldstein EJ, Hicks LA, et al. IDSA clinical practice guideline for acute bacterial rhinosinusitis in children and adults. Clin Infect Dis. 2012;54(8):e72–112. doi:10.1093/cid/cir1043.

    Article  PubMed  Google Scholar 

  20. Jadavji T, Law B, Lebel MH, Kennedy WA, Gold R, Wang EE. A practical guide for the diagnosis and treatment of pediatric pneumonia. Can Med Assoc J. 1997;156(suppl):S703–11.

    CAS  Google Scholar 

  21. American Academy of Pediatrics Subcommittee on Diagnosis and Management of Bronchiolitis. Diagnosis and management of bronchiolitis. Pediatrics. 2006;118:1774–93.

  22. Bradley JS, Byington CL, Shah SS, Alverson B, Carter ER, Harrison C, et al. The management of community-acquired pneumonia in infants and children older than 3 months of age: clinical practice guidelines by the Pediatric Infectious Diseases Society and the Infectious Diseases Society of America. Clin Infect Dis. 2011;53(7):e25–76. doi:10.1093/cid/cir531.

    Article  PubMed  Google Scholar 

  23. Guarino A, Albano F, Ashkenazi S, Gendrel D, Hoekstra JH, Shamir R, et al. European Society for paediatric gastroenterology, hepatology, and nutrition/European Society for paediatric infectious diseases evidence-based guidelines for the management of acute gastroenteritis in children in Europe. J Pediatr Gastroenterol Nutr. 2008;46:S81–184. doi:10.1097/MPG.0b013e31816f7b16.

    Article  PubMed  Google Scholar 

  24. Solomkin JS, Mazuski JE, Bradley JS, Rodvold KA, Goldstein EJ, Baron EJ, et al. Diagnosis and management of complicated intra-abdominal infection in adults and children: guidelines by the Surgical Infection Society and the Infectious Diseases Society of America. Clin Infect Dis. 2010;50(2):133–64. doi:10.1086/649554.

    Article  PubMed  Google Scholar 

  25. National Institute for Health and Clinical Excellence. Urinary tract infection in children: diagnosis, treatment and long-term management. NICE guidelines CG54. 2007. http://www.nice.org.uk/guidance/CG54.

  26. Subcommittee on Urinary Tract Infection, Steering Committee on Quality Improvement and Management, Roberts KB. Urinary tract infection: clinical practice guideline for the diagnosis and management of the initial UTI in febrile infants and children 2 to 24 months. Pediatrics. 2011;128(3):595–610. doi:10.1542/peds.2011-1330.

  27. Indian Society of Pediatric Nephrology, Vijayakumar M, Kanitkar M, Nammalwar BR, Bagga A. Revised statement on management of urinary tract infections. Indian Pediatr. 2011;48(9):709–17.

  28. Ammenti A, Cataldi L, Chimenz R, Fanos V, La Manna A, Marra G, et al. Febrile urinary tract infections in young children: recommendations for the diagnosis, treatment and follow-up. Acta Paediatr. 2012;101:451–7. doi:10.1111/j.1651-2227.2011.02549.x.

    Article  PubMed  Google Scholar 

  29. Brierley J, Carcillo JA, Choong K, Cornell T, Decaen A, Deymann A, et al. Clinical practice parameters for hemodynamic support of pediatric and neonatal septic shock: 2007 update from the American College of Critical Care Medicine. Crit Care Med. 2009;37(2):666–88. doi:10.1097/CCM.0b013e31819323c6.

    Article  PubMed Central  PubMed  Google Scholar 

  30. Committee on Infectious Diseases. Therapy for children with invasive pneumococcal infections. Pediatrics. 1997;99(2):289–99.

    Article  Google Scholar 

  31. Koletzko S, Jones NL, Goodman KJ, Gold B, Rowland M, Cadranel S, et al. Evidence-based guidelines from ESPGHAN and NASPGHAN for Helicobacter pylori infection in children. J Pediatr Gastroenterol Nutr. 2011;53(2):230–43. doi:10.1097/MPG.0b013e3182227e90.

    PubMed  Google Scholar 

  32. Liu C, Bayer A, Cosgrove SE, Daum RS, Fridkin SK, Gorwitz RJ, et al. Clinical practice guidelines by the Infectious Diseases Society of America for the treatment of methicillin-resistant staphylococcus aureus infections in adults and children. Clin Infect Dis. 2011;52(3):e18–55. doi:10.1093/cid/ciq146.

    Article  PubMed  Google Scholar 

  33. Practice parameter: the management of acute gastroenteritis in young children. American Academy of Pediatrics, Provisional Committee on Quality Improvement, Subcommittee on Acute Gastroenteritis. Pediatrics. 1996;97:424–35.

  34. Goldstein B, Giroir B, Randolph A, et al. International pediatric sepsis consensus conference: definitions for sepsis and organ dysfunction in pediatrics. Pediatr Crit Care Med. 2005;6:2–8.

    Article  PubMed  Google Scholar 

  35. Chiappini E, Principi N, Mansi N, Serra A, Masi De, Camaioni A, et al. Management of acute pharyngitis in children: summary of the Italian National Institute of Health Guidelines. Clin Ther. 2012;34(1442–1458):e2.

    PubMed  Google Scholar 

  36. Uehara S, Sunakawa K, Eguchi H, Ouchi K, Okada K, Kurosaki T, et al. Japanese guidelines for the management of respiratory infectious diseases in children 2007 with focus on pneumonia. Pediatr Int. 2011;53:264–76.

    Article  PubMed  Google Scholar 

  37. Lo B, Field MJ, editors. Conflict of interest in medical research, education, and practice. Washington: National Academies Press (US); 2009.

    Google Scholar 

  38. Fay D, Borrill C, Amir Z, Haward R, West MA. Getting the most out of multidisciplinary teams: a multi-sample study of team innovation in health care. J Occup Organ Psychol. 2006;79:553–67.

    Article  Google Scholar 

Download references

Funding

This study was funded by a Qatar University Internal Grant (QUUG-CPH-CPH-12/12-3).

Conflicts of interest

The authors report no conflicts of interest to declare.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Kyle John Wilby.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wilby, K.J., Black, E.K., MacLeod, C. et al. Critical appraisal of clinical practice guidelines in pediatric infectious diseases. Int J Clin Pharm 37, 799–807 (2015). https://doi.org/10.1007/s11096-015-0123-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11096-015-0123-2

Keywords

Navigation