Advertisement

Developing Lifelong Learning Skills: Using a Traffic Light Report to Promote Competency Standards and Self-Assessment Among Pharmacy Undergraduates

  • Rosie Nash
  • Leanne Chalmers
  • Ieva Stupans
  • Natalie Brown
Chapter

Abstract

The authors explore an educational initiative designed to enhance the development of self-assessment skills whilst increasing familiarity with a profession’s competency standards. The initiative was trialled with pharmacy students at one Australian university. This chapter examines how educational design, student-led learning and illumination of competency standards can offer students with opportunities to develop the knowledge, skills and attributes essential for entry into their profession. Specifically, this chapter illustrates the importance of a “needs based” curriculum for the professions, specifically the health disciplines. Using Boud’s Sustainable Assessment Framework the chapter explores how higher education can support students to step onto their “competence continuum” by providing opportunities to develop familiarity with their profession’s competency standards and practice self-assessment, both essential to a becoming professional.

Keywords

Competency standards Life-long learning Continued professional development Profession Pharmacy Health education Educational design Sustainable assessment Self-assessment Traffic Light Report 

Notes

Acknowledgements

The authors acknowledge the contribution of all participants—students and educators. Thank you to Peter Gee for ensuring my design ideas could be captured in the Access database. Thank you to Cameron McShane and Colin Curtain for your assistance with writing queries in the database so the Traffic Light Reports could be made available to students for their learning.

References

  1. Anderson, C., Bates, I., Brock, T., Brown, A., Bruno, A., Futter, B., & Rouse, M. (2012). Needs-based education in the context of globalization. American Journal of Pharmaceutical Education, 76(4), 1–56.CrossRefGoogle Scholar
  2. Andrade, H., & Valtcheva, A. (2009). Promoting learning and achievement through self-assessment. Theory into Practice, 48(1), 12–19.  https://doi.org/10.1080/00405840802577544CrossRefGoogle Scholar
  3. Austin, Z., & Gregory, P. (2007). Evaluating the accuracy of pharmacy students’ self-assessment skills. American Journal of Pharmaceutical Education, 71(5), 1–89.CrossRefGoogle Scholar
  4. Australian Government Department of Education and Training. (2015). Higher Education Standards Framework (Threshold Standards) (Vol. F2015L01639, pp. 4, 7, 8). Australia.Google Scholar
  5. Australian Hospitals and Healthcare Association. (2014). Background research and consultation to inform the review of pharmacy competency standards. Retrieved April 7, 2015, from http://ahha.asn.au/sites/default/files/docs/page/consultation_paper_for_publication_revised_19.12.14_0.pdf
  6. Australian Hospitals and Healthcare Association. (2015). Pharmacy standards review project—Final report. Deakin, ACT.Google Scholar
  7. Australian Pharmacy Council. (2012). Accreditation Standards for Pharmacy Programs in Australia and New Zealand. Retrieved February 26, 2015, from http://pharmacycouncil.org.au/content/index.php?id=17
  8. Australian Qualifications Framework Council. (2013). Australian Qualifications Framework Second Edition. Retrieved from http://www.aqf.edu.au/aqf/in-detail/aqf-levels/
  9. Biggs, J. (1996). Enhancing teaching through constructive alignment. Higher Education, 32(3), 347–364.CrossRefGoogle Scholar
  10. Biggs, J., & Collis, K. (1982). A system for evaluating learning outcomes: The SOLO taxonomy. New York: Academic Press.Google Scholar
  11. Boud, D. (1999). Avoiding the traps: Seeking good practice in the use of self assessment and reflection in professional courses. Social Work Education, 18(2), 121–132.  https://doi.org/10.1080/02615479911220131CrossRefGoogle Scholar
  12. Boud, D. (2000). Sustainable assessment: Rethinking assessment for the learning society. Studies in Continuing Education, 22(2), 151–167.  https://doi.org/10.1080/713695728CrossRefGoogle Scholar
  13. Boud, D. (2010). Assessment for developing practice. In J. Higgs, I. Fish, S. Goulter, J.-A. Loftus, & F. Trede (Eds.), Education for future practice (pp. 251–262). Rotterdam, Netherlands: Sense Publishers.Google Scholar
  14. Boud, D., & Falchikov, N. (2005). Redesigning assessment for learning beyond higher education. Research and Development in Higher Education, 28, 34–41.Google Scholar
  15. Boud, D., & Soler, R. (2015). Sustainable assessment revisited. Assessment & Evaluation in Higher Education, 1–14.  https://doi.org/10.1080/02602938.2015.1018133CrossRefGoogle Scholar
  16. Bourke, R. (2014). Self-assessment in professional programmes within tertiary institutions. Teaching in Higher Education, 19(8), 908–918.  https://doi.org/10.1080/13562517.2014.934353CrossRefGoogle Scholar
  17. Brown, A., Gilbert, B., Bruno, A., & Cooper, G. (2012). Validated competency framework for delivery of pharmacy services in Pacific-Island countries. Journal of Pharmacy Practice, 42(4), 268–272.CrossRefGoogle Scholar
  18. Brownie, S., Bahnisch, M., & Thomas, J. (2011). Competency-based education and competency-based career frameworks: Informing Australia health workforce development. Adelaide: National Health Workforce Planning & Research Collaboration.Google Scholar
  19. Chalmers, D., & Fuller, R. (1996). Teaching for learning at university. London: Kogan Page.Google Scholar
  20. Coombes, I., Bates, I., Duggan, C., & Galbraith, K. (2011). Developing and recognising advanced practitioners in Australia: An opportunity for a maturing profession? Journal of Pharmacy Practice and Research, 41(1), 17.CrossRefGoogle Scholar
  21. Creswell, J. (2013). Research design qualitative, quantitative and mixed methods approaches (2nd ed.). Thousand Oaks, CA: Sage Publications.Google Scholar
  22. Deyo, Z., Huynh, D., Rochester, C., Sturpe, D., & Kiser, K. (2011). Readiness for self-directed learning and academic performance in an abilities laboratory course. American Journal of Pharmaceutical Education, 75(2), 1–25.  https://doi.org/10.1177/0001848191041002003CrossRefGoogle Scholar
  23. Dyke, J., Gidman, W., Wilson, S., & Becket, G. (2009). Personal development planning: First-year master of pharmacy students’ engagement with, and attitudes towards, reflective self-assessment. The International Journal of Pharmacy Practice, 17(1), 61–66.CrossRefGoogle Scholar
  24. Eva, K., & Regehr, G. (2008). “I’ll never play professional football” and other fallacies of self-assessment. Journal of Continuing Education in the Health Professions, 28(1), 14–19.CrossRefGoogle Scholar
  25. Epstein, R., Siegel, D., & Silberman, J. (2008). Self-monitoring in clinical practice: A challenge for medical educators. Journal of Continuing Education in the Health Professions, 28, 5–13.CrossRefGoogle Scholar
  26. French, E., Summers, J., Kinash, S., Lawson, R., Taylor, T., Herbert, J., & Hall, C. (2014). The practice of quality in assuring learning in higher education. Quality in Higher Education, 20(1), 24–43.  https://doi.org/10.1080/13538322.2014.889432CrossRefGoogle Scholar
  27. Hamilton, G., Byatt, G., & Hodgkinson, J. (2011). The color coded project portfolio—Where is the balance? Retrieved May 24, 2016, from http://www.pmhut.com/the-color-coded-project-portfolio-where-is-the-balance
  28. Hattie, J. (2008). Visible learning: A synthesis of over 800 meta-analyses relating to achievement. Retrieved from http://UTAS.eblib.com.au/patron/FullRecord.aspx?p=367685CrossRefGoogle Scholar
  29. Hinett, K., & Weeden, P. (2000). How am I doing?: Developing critical self-evaluation in trainee teachers. Quality in Higher Education, 6(3), 245–257.  https://doi.org/10.1080/13538320020005981CrossRefGoogle Scholar
  30. Hodgson, C., & Pyle, K. (2010). A literature review of assessment for learning in science. Retrieved May 24, 2016, from http://nfernew.dudobi.com/nfer/publications/AAS01/AAS01.pdf
  31. Huddle, T., & Heudebert, G. (2007). Viewpoint: Taking apart the art: The risk of anatomizing clinical competence. Academic Medicine, 82(6), 536–541.CrossRefGoogle Scholar
  32. International Pharmaceutical Federation. (2009). FIP statement of policy quality assurance of pharmacy education. Retrieved February 3, 2014, from http://www.fip.org/pe_resources
  33. International Pharmaceutical Federation Pharmacy Education Taskforce. (2012). A global competency framework for services provided by pharmacy workforce. Retrieved February 3, 2015, from http://www.fip.org/pe_resources
  34. Janke, K., Traynor, A., & Sorensen, T. (2011). Refinement of strengths instruction in a pharmacy curriculum over eight years. American Journal of Pharmaceutical Education, 75(3), 1–45.CrossRefGoogle Scholar
  35. Knowles, M. (1975). Self directed learning: A guide for learners and teachers. New York: Pearson Learning Cambridge Adult Education.Google Scholar
  36. Krathwohl, D. (2002). A revision of Bloom’s taxonomy: An overview. Theory into Practice, 41(4), 212–218.CrossRefGoogle Scholar
  37. Krause, K.-L., Scott, G., Aubin, K., Alexander, H., Angelo, T., Campbell, S., & Pattison, P. (2014). Assuring learning and teaching standards through inter-institutional peer review and moderation. Final report of the project. Retrieved from University of Western Sydney website: http://www.uws.edu.au/__data/assets/pdf_file/0007/576916/External_Report_2014_Web_3.pdf
  38. Laaksonen, R., Bates, I., & Duggan, C. (2007). Training, clinical medication review performance and self-assessed competence: Investigating influences. Pharmacy Education, 7(3), 257–265.  https://doi.org/10.1080/15602210701610367CrossRefGoogle Scholar
  39. Malone, K., & Supri, S. (2012). A critical time for medical education: The perils of competence-based reform of the curriculum. Advances in Health Sciences Education, 17(2), 241–246.CrossRefGoogle Scholar
  40. McMahon, N., & Henman, M. (2007). Introduction of competency based assessment to MSc in hospital pharmacy programme. Paper presented at the Monash and King’s Pharmacy Education Symposium 2007, Prato, Italy.Google Scholar
  41. Merriam, S., & Bierema, L. (2013). Adult learning: Linking theory and practice. San Francisco: John Wiley & Sons.Google Scholar
  42. Mészáros, K., Barnett, M., McDonald, K., Wehring, H., Evans, D., Sasaki-Hill, D., & Knapp, K. (2009). Progress examination for assessing students’ readiness for advanced pharmacy practice experiences. American Journal of Pharmaceutical Education, 73(6), 1–109.CrossRefGoogle Scholar
  43. Miller, G. (1990). The assessment of clinical skills, competence, performance. Academic Medicine, 65(9), S63–S67.CrossRefGoogle Scholar
  44. Motycka, C., Rose, R., Ried, D., & Brazeau, G. (2010). Self-assessment in pharmacy and health science education and professional practice. American Journal of Pharmaceutical Education, 74(5), 1–7.CrossRefGoogle Scholar
  45. Mumm, K., Karm, M., & Remmik, M. (2015). Assessment for learning: Why assessment does not always support student teachers’ learning. Journal of Further and Higher Education, 1–24.  https://doi.org/10.1080/0309877x.2015.1062847CrossRefGoogle Scholar
  46. Nash, R., (2016). Bringing students to their profession and the profession to students through competency standards. PhD thesis, University of Tasmania, Chapter 5b, 165–197.Google Scholar
  47. Nash, R., Chalmers, L., Brown, N., Jackson, S., & Peterson, G. (2015). An international review of program wide use of competency standards in pharmacy education. Pharmacy Education Journal, 15(1), 131–141.Google Scholar
  48. Nash, R., Chalmers, L., Stupans, I., & Brown, N. (2015). A reciprocal relationship: informing a profession’s competency standards. Paper presented at the Higher Education Research and Development Society of Australasia (HERDSA), Melbourne, Australia.Google Scholar
  49. Nash, R., Chalmers, L., Stupans, I., & Brown, N. (2016). Knowledge, use and perceived relevance of a profession’s competency standards; implications for pharmacy education. International Journal of Pharmacy Practice, Early View Version of Record online: 21 April 2016.  https://doi.org/10.1111/ijpp.12267CrossRefGoogle Scholar
  50. Nash, R., Stupans, I., Chalmers, L., & Brown, N. (2016). Traffic Light Report provides a new technique for Assurance of Learning. Journal of Learning Design, 9(1), 37–54.CrossRefGoogle Scholar
  51. National Competency Standards Framework for Pharmacists in Australia. (2010). Retrieved January 30, 2015, from http://www.psa.org.au/supporting-practice/national-competency-standards
  52. Nguyen, T., & Walker, M. (2014). Sustainable assessment for lifelong learning. Assessment & Evaluation in Higher Education, 1–15.  https://doi.org/10.1080/02602938.2014.985632CrossRefGoogle Scholar
  53. Petit, P., Foriers, A., & Rombaut, B. (2008). The introduction of new teaching methods in pharmacy education—II. The starting point. Pharmacy Education, 8(1), 19–28.CrossRefGoogle Scholar
  54. Pfleger, D., McHattie, L., Diack, H., McCaig, D., & Stewart, D. (2008). Views, attitudes and self-assessed training needs of Scottish community pharmacists to public health practice and competence. Pharmacy World & Science, 30(6), 801–809.  https://doi.org/10.1007/s11096-008-9228-1CrossRefGoogle Scholar
  55. Pharmaceutical Society of Australia. (2014). Code of ethics for pharmacists. Retrieved April 26, 2015, from http://www.psa.org.au/membership/ethics
  56. Pharmacy Board of Australia. (2015). Revised Registration Standard: Continuing professional development. Retrieved December 21, 2015, from http://www.pharmacyboard.gov.au/News/2015-10-30-registration-standards.aspx
  57. Pharmacy Board of Australia. (2016). Obligations of a registered pharmacist. Retrieved June 3, 2016, from http://www.pharmacyboard.gov.au/Registration.aspx
  58. Plaza, C., Draugalis, J., Slack, M., Skrepnek, G., & Sauer, K. (2007). Curriculum mapping in program assessment and evaluation. American Journal of Pharmaceutical Education, 71(2), 1–20.Google Scholar
  59. Professions Australia. (2015). Ethics resource centre; Code of ethics. Code Principles. Retrieved April 7, 2015, from http://www.professions.com.au/codeprinciples.html
  60. Ronfeldt, M., & Grossman, P. (2008). Becoming a professional: Experimenting with possible selves in professional preparation. Teacher Education Quarterly, 35, 41–60.Google Scholar
  61. Sadler, D. (1989). Formative assessment and the design of instructional systems. Instructional Science, 18(2), 119–144.CrossRefGoogle Scholar
  62. Sargeant, J., Eva, K., Armson, H., Chesluk, B., Dornan, T., Holmboe, E., & van der Vleuten, C. (2011). Features of assessment learners use to make informed self-assessments of clinical performance. Medical Education, 45(6), 636–647.CrossRefGoogle Scholar
  63. Schunk, D. (2003). Self-efficacy for reading and writing: Influence of modeling, goal setting, and self-evaluation. Reading &Writing Quarterly, 19(2), 159–172.CrossRefGoogle Scholar
  64. Sharif, S., Gifford, L., Morris, G., & Barber, J. (2007). An investigation of the self-evaluation skills of first year pharmacy students. Pharmacy Education, 7(4), 295–302.  https://doi.org/10.1080/15602210701725272CrossRefGoogle Scholar
  65. Szilagyi, J. (2008). Curricular progress assessments: The mileMarker. American Journal of Pharmaceutical Education, 72(5), 1–101.CrossRefGoogle Scholar
  66. Talbot, M. (2004). Monkey see, monkey do: A critique of the competency model in graduate medical education. Medical Education, 38(6), 587–592.  https://doi.org/10.1046/j.1365-2923.2004.01794.xCrossRefGoogle Scholar
  67. ten Cate, T., Snell, L., & Carraccio, C. (2010). Medical competence: The interplay between individual ability and the health care environment. Medical Teacher, 32(8), 669–675.CrossRefGoogle Scholar
  68. Thompson, W., Nissen, L., & Hayward, K. (2013). Australian pharmacists’ understanding of their continuing professional development obligations. The Australian Journal of Pharmacy, 94(1123), 58–60.Google Scholar
  69. Tran, D., Tofade, T., Thakkar, N., & Rouse, M. (2014). US and international health professions’ requirements for continuing professional development. American Journal of Pharmaceutical Education, 78(6), 129.  https://doi.org/10.5688/ajpe786129CrossRefGoogle Scholar
  70. Van den Akker, J., Gravemeijer, K., McKenney, S., & Nieveen, N. (2006). Educational design research. Abingdon, Oxon: Routledge.CrossRefGoogle Scholar
  71. Van der Vleuten, C., & Schuwirth, L. (2005). Assessing professional competence: From methods to programmes. Medical Education, 39(3), 309–317.CrossRefGoogle Scholar
  72. Wass, V., Van der Vleuten, C., Shatzer, J., & Jones, R. (2001). Assessment of clinical competence. The Lancet, 357(9260), 945–949.  https://doi.org/10.1016/S0140-6736(00)04221-5CrossRefGoogle Scholar
  73. Watson, L. (2003). Lifelong learning in Australia. Canberra: Commonwealth of Australia. Retrieved from http://www.forschungsnetzwerk.at/downloadpub/australia_lll_03_13.pdf

Copyright information

© The Author(s) 2019

Authors and Affiliations

  • Rosie Nash
    • 1
  • Leanne Chalmers
    • 2
  • Ieva Stupans
    • 3
  • Natalie Brown
    • 1
  1. 1.University of TasmaniaHobartAustralia
  2. 2.Faculty of Health SciencesSchool of Pharmacy and Biomedical Sciences, Curtin UniversityBentleyAustralia
  3. 3.School of Health and Biomedical Sciences, RMIT UniversityMelbourneAustralia

Personalised recommendations