Advertisement

Higher Education

, Volume 74, Issue 5, pp 877–896 | Cite as

Dynamics of undergraduate student generic problem-solving skills captured by a campus-wide study

  • Andis KlegerisEmail author
  • Stephanie Barclay McKeown
  • Heather Hurren
  • Lindsay Joy Spielman
  • Maegan Stuart
  • Manpreet Bahniwal
Article

Abstract

The ability to effectively problem solve is a highly valued competency expected of university graduates, independent of their area of study. Evaluation of problem-solving skill (PSS) development is hindered by a shortage of available tools for monitoring student progress and by lack of defined instructional strategies for development of these skills. Our research is aimed at addressing these problems. We have developed an evaluation tool, which we applied to study the dynamics of undergraduate student PSS. We tested first- and upper-year students from 26 different courses (total enrollment of 2229 students). Overall improvement of PSS was detected for the first-year students over their first term of study. There were no significant differences between the PSS of first- and upper-year students, and no improvement was detected over a single term by measuring PSS in upper-year students. Only three courses were effective at facilitating PSS. Our data indicate that most of the standard lecture approaches do not develop undergraduate student PSS and that universities and individual instructors must take active steps to advance this critical skill set in university students.

Keywords

Assessment Campus-wide study Generic problem-solving skills Student competencies Problem-solving test University students 

Abbreviations

OECD

Organization for Economic Co-operation and Development

PBL

Problem-based learning

PSS

Problem-solving skills

PISA

Programme for International Student Assessment

PIAAC

Programme for the International Assessment of Adult Competencies

Notes

Acknowledgements

We would like to thank the University of British Columbia Okanagan Campus, BC, Canada for providing us with funding to carry out this research. We would also like to thank the course instructors who allowed us to perform our study in their classrooms, as well as all the students who participated in our research.

Compliance with ethical standards

Study protocols were approved by the Human Research Ethics Board of our university, and students willing to participate in the study voluntarily signed an appropriate consent form. The research team ensured that each student’s consent and research data were hidden from the course instructors, who were offered access to data summaries only.

Supplementary material

10734_2016_82_MOESM1_ESM.docx (18 kb)
ESM 1 (DOCX 18 kb)

References

  1. Adeyemo, S. A. (2010). Students’ ability level and their competence in problem-solving task in physics. Int J Edu Res Technol, 1(2), 35–47.Google Scholar
  2. Ameredes, B. T., Hellmich, M. R., Cestone, C. M., Wooten, K. C., Ottenbacher, K. J., Chonmaitree, T., Anderson, K. E., & Braisier, A. R. (2015). The multidisciplinary translational team (MTT) model for training and development of translational research investigators. Clin Trans Sci, 8(5), 533–541.CrossRefGoogle Scholar
  3. Anderson, W. L., Mitchell, S. M., & Osgood, M. P. (2008). Gauging the gaps in student problem-solving skills: assessment of individual and group use of problem-solving strategies using online discussions. CBE Life Sci Edu, 7(2), 254–262.CrossRefGoogle Scholar
  4. Arvanitakis, J., & Hornsby, D. J. (2016). Are universities redundant? In J. Arvanitakis & D. J. Hornsby (Eds.), Universities, the citizen scholar and the future of higher education (pp. 7–20). New York, NY: Palgrave Macmillan.Google Scholar
  5. Bonikowska, A., Green, D. A., & Riddell, W. C. (2008). Literacy and the labour market: cognitive skills and immigrant earnings (catalogue no. 89–552-M no. 020). Survey. Ottawa, CA: International Adult Literacy.Google Scholar
  6. Bonwell, C. C., & Eison, J. A. (1991). Active learning: creating excitement in the classroom. ASHE-ERIC higher education report no. 1. Washington, DC: George Washington University.Google Scholar
  7. Brenner, E. (2016). Changing mindsets: moving from the acceptance of facts to critical thinking. In J. Arvanitakis & D. J. Hornsby (Eds.), Universities, the citizen scholar and the future of higher education (pp. 155–171). New York, NY: Palgrave Macmillan.Google Scholar
  8. Brooks, T. E., Case, B. J., & Young, M. J. (2003). Assessment report: timed versus untimed testing conditions and student performance. Retrieved from http://images.pearsonassessments.com/images/tmrs/tmrs_rg/TimedUntimed.pdf?WT.mc_id=TMRS_Timed_Versus_Untimed_Testing. Accessed 28 Oct 2016.
  9. Chetty, N. (2014). The first year augmented programme in physics: a trend towards improved student performance. S Afr J Sci, 110(1/2), 1–9.CrossRefGoogle Scholar
  10. Chi, M. T. H., Glaser, R., & Rees, E. (1982). Expertise in problem solving. In R. J. Sternberg (Ed.), Advances in the psychology of human intelligence (pp. 7–76). Hillsdale, NJ: Erlbaum.Google Scholar
  11. Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Erlbaum.Google Scholar
  12. Cohen, J., Kennedy-Justice, M., Pai, S., Torres, C., Toomey, R., DePierro, E., & Garafalo, F. (2000). Encouraging meaningful quantitative problem solving. J Chem Educ, 77(9), 1166–1173.CrossRefGoogle Scholar
  13. Cooper, M. M., Cox Jr., C. T., Nammouz, M., & Case, E. (2008). An assessment of the effect of collaborative groups on students’ problem-solving strategies and abilities. J Chem Educ, 85(6), 866–873.CrossRefGoogle Scholar
  14. Crocker, L., & Algina, J. (1986). Introduction to classical and modern test theory. New York, NY: Holt, Rinehart, and Winston.Google Scholar
  15. Demetriou, A. (2003). Mind, self, and personality: dynamic interactions from late childhood to early adulthood. J Adult Dev, 10(3), 151–171.CrossRefGoogle Scholar
  16. Duch, B. J., Groh, S. E., & Allen, D. E. (2001). The power of problem-based learning: a practical “how to” for teaching undergraduate courses in any discipline. Sterling, VA: Stylus Publishing.Google Scholar
  17. Fallows, S., & Steven, C. (2000). Building employability skills into the higher education curriculum: a university-wide initiative. Educ Train, 42(2), 75–82.CrossRefGoogle Scholar
  18. Finney, R. (2003). Research in problem-solving: improving the progression from novice to expert. Retrieved from http://www.colorado.edu/physics/phys4810/phys4810_fa06/4810_readings/finney.pdf. Accessed 28 Oct 2016.
  19. Gagne, R. M. (1985). The conditions of learning (4th ed.). New York, NY: Holt, Rinehart &Winston.Google Scholar
  20. Gayon, E. E. P. (2007). The problem-solving ability of high school chemistry students and its implications in redefining chemistry education. Paper presented at the International Conference on Science and Mathematics Education, Ponang, Malaysia.Google Scholar
  21. Greiff, S., Holt, D. V., & Funke, J. (2013). Perspectives on problem solving in educational assessment: analytical, interactive, and collaborative problem solving. J Probl Solv, 5(2), 71–91.Google Scholar
  22. Greiff, S., Wüstenberg, S., Csapó, B., Demetriou, A., Hautamäki, J., Graesser, A., & Martin, R. (2014). Domain-general problem solving skills and education in the twenty-first century. Edu Res Rev, 13, 74–83.CrossRefGoogle Scholar
  23. Hanushek, E. A., Schwerdt, G., Wiederhold, S., & Woessmann, L. (2013). Returns to skills around the world: evidence from PIAAC. National Bureau of Economic Research. http://www.nber.org/papers/w19762.pdf. Accessed 28 Oct 2016.
  24. Inhelder, B., & Piaget, J. (1958). The growth of logical thinking from childhood to adolescence. New York, NY: Basic Books.CrossRefGoogle Scholar
  25. Klegeris, A., & Hurren, H. (2011). Impact of problem-based learning in a large classroom setting: student perception and problem-solving skills. Adv Physiol Educ, 35(4), 408–415.CrossRefGoogle Scholar
  26. Klegeris, A., Bahniwal, M., & Hurren, H. (2013a). Improvements in generic problem-solving abilities of students by use of tutor-less problem-based learning in a large classroom setting. CBE Life Sci Education, 12(1), 73–79.CrossRefGoogle Scholar
  27. Klegeris, A., Bahniwal, M., & Hurren, H. (2013b). Tutor-less problem-based learning in a large classroom setting significantly enhances generic problem-solving skills of undergraduate students. Paper presented at the 6th International Conference of Education, Research and Innovation (ICERI). Seville, Spain: IATEDGoogle Scholar
  28. Lakens, D. (2013). Calculating and reporting effect sizes to facilitate cumulative science: a practical primer for t-tests and ANOVAs. Frontiers in Psychology: Cognition, 4, 1–12.CrossRefGoogle Scholar
  29. Lang, J. M. (2008). On course: a week-by-week guide to your first semester of college teaching. Cambridge, MA: Harvard University Press.Google Scholar
  30. Latterell, C. (2003). Testing the problem-solving skills of students in an NCTM-oriented curriculum. Math Educ, 13(1), 5–14.Google Scholar
  31. Lian, J., & He, F. (2013). Improved performance of students instructed in a hybrid PBL format. Biochem Mol Biol Educ, 41(1), 5–10.CrossRefGoogle Scholar
  32. Lind, J. M. (2016). Medical education: training for the desirable traits in past, present and future doctors? In J. Arvanitakis & D. J. Hornsby (Eds.), Universities, the citizen scholar and the future of higher education (pp. 172–186). New York, NY: Palgrave Macmillan.Google Scholar
  33. Lowden, K., Hall, S., Elliot, D. & Lewin, J. (2011). Employer’s perceptions of the employability skills of the new graduates. Edge/The SCRE Centre, University of Glasgow. http://www.educationandemployers.org/wp-content/uploads/2014/06/employability_skills_as_pdf_-_final_online_version.pdf. Accessed 28 Oct 2016.
  34. Meo, S. A. (2014). Undergraduate medical student’s perceptions on traditional and problem based curricula: pilot study. J Pak Med Assoc, 64(7), 775–779.Google Scholar
  35. Organisation for Economic Co-operation and Development, OECD (2004). Problem solving for tomorrow’s world: first measures of cross-curricular competencies from PISA 2003. Paris: OECD https://www.oecd.org/edu/school/programmeforinternationalstudentassessmentpisa/34009000.pdf. Accessed October 28 2016.Google Scholar
  36. Organisation for Economic Co-operation and Development, OECD (2012). Assessment of Higher Education Learning Outcomes (AHELO) feasibility study report (volume I). Paris: OECD http://www.oecd.org/education/skills-beyond-school/AHELOFSReportVolume1.pdf. Accessed 28 October 2016.Google Scholar
  37. Organisation for Economic Co-operation and Development, OECD (2014a). PISA 2012 results: creative problem solving: student’ skills in tackling real-life problems (volume V). Paris: OECD http://www.oecd.org/pisa/keyfindings/pisa-2012-results-volume-v.htm. Accessed 28 October 2016.Google Scholar
  38. Organisation for Economic Co-operation and Development, OECD (2014b). PISA 2012 results in focus: what 15-year olds know and what they can do with what they know. Paris: OECD https://www.oecd.org/pisa/keyfindings/pisa-2012-results-volume-I.pdf. Accessed 28 October 2016.Google Scholar
  39. Perry Jr., W. G. (1970). Forms of intellectual and ethical development in the college years: a scheme. New York, NY: Holt, Rinehart, and Winston.Google Scholar
  40. Pool, L. D., & Sewell, P. (2007). The key to employability: developing a practical model of graduate employability. Educ Train, 49(4), 277–289.CrossRefGoogle Scholar
  41. Ryan, J., & Brockmann, F. (2011). A practitioner’s introduction to equating: with primers on classical test theory and item response theory. Council of Chief State School Officers. http://www.ccsso.org/Documents/2008/A_Practritioners_Introduction_To_2008.pdf. Accessed 28 Oct 2016.
  42. Schommer-Aikins, M., & Hutter, R. (2002). Epistemological beliefs and thinking about everyday controversial issues. J Psychol, 136(1), 5–20.CrossRefGoogle Scholar
  43. Sireteanu, N. A., & Bedrule-Grigoruta, M. V. (2007). Perspectives of knowledge management in universities. Soc Sci Res Network (SSRN) Electron J. doi: 10.2139/ssrn.1029990 .Accessed 28 October 2016Google Scholar
  44. Statistics Canada. (2011). Learning a living: first results of the adult literacy and life skills survey, Chapter 5, Adult problem solving skills. http://www.oecd.org/education/innovation-education/34867438.pdf. Accessed 28 Oct 2016.
  45. Tricot, A., & Sweller, J. (2014). Domain-specific knowledge and why teaching complex skills does not work. Educ Psychol Rev, 26(2), 265–283.CrossRefGoogle Scholar
  46. Tune, J. D., Sturek, M., & Basile, D. P. (2013). Flipped classroom model improves graduate student performance in cardiovascular, respiratory, and renal physiology. Adv Physiol Educ, 37(4), 316–320.CrossRefGoogle Scholar
  47. Walsh, K. (2013). Tutor-less problem-based learning in a large classroom setting—could it also save costs? CBE Life Sci Edu, 12(3), 315.CrossRefGoogle Scholar
  48. Woods, D. R. (1998). The McMaster problem solving (MPS) program. Retrieved from http://chemeng.mcmaster.ca/mcmaster-problem-solving-mps-program. Accessed 28 Oct 2016.
  49. Zivkovic, S. (2016). A model of critical thinking as an important attribute for success in the twenty-first century. GlobELT, 2016(232), 102–108.Google Scholar
  50. ñiga-Vicente, J. A., González, A. B., & Román, C. P. (2011). How similar or different are the generic skills among different areas of knowledge? A comparative analysis in the Spanish higher education. Paper presented at the International Conference on Education and New Learning Technologies, Barcelona, Spain.Google Scholar

Copyright information

© Springer Science+Business Media Dordrecht 2016

Authors and Affiliations

  1. 1.Department of BiologyUniversity of British Columbia Okanagan CampusKelownaCanada
  2. 2.Planning and Institutional ResearchUniversity of British Columbia Okanagan CampusKelownaCanada
  3. 3.Centre for Teaching and LearningUniversity of British Columbia Okanagan CampusKelownaCanada

Personalised recommendations