Abstract
The results of teaching evaluations are very often used by universities as a basis for personnel decision making, including promotion and tenure of instructors. The evaluations are commonly based on end-of-semester students’ ratings of their teachers through the qualitative Likert-type Student Evaluations of Teaching (SETs). Unfortunately, research on the validity of the SET-type evaluations frequently produces misleading results. One serious problem is the use of survey questions that are qualitative rather than quantitative, result in evaluations that reflect the students’ personal opinion of the class, rather than the effectiveness of the teaching. The focus of this paper is to present a design for an effective student evaluation that embraces the constructivist approach to teaching. The role of the teacher becomes that of a coach who creates a collaborative work environment, presenting relevant and interesting problems for students to solve. Assessing the educational quality of such a method requires a multi-dimensional instrument that qualitatively measures the effectiveness of both teaching and learning. Our study accentuates the need for an effective, knowledgeable teacher-coach, along with skilled, motivated students, and a supportive cohesive university atmosphere.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
ABET Engineering Accreditation Commission. Criteria for Accrediting Engineering Programs Effective for Reviews during the 2020–2021 Accreditation Cycle (2020)
Aizman, A., Bernold, L., Díaz, B., Olivares, A., Mora, C., Alarcón, H.: Introduction to engineering: a STEM approach. In: Proceeding of the 7th Research in Engineering Education. Research in Engineering Education Network, July 6–8, pp. 715–722. Bogota, Colombia (2017)
Bernold, L.E.: Evaluations for construction engineering and management: opportunity to move us forward. J. Constr. Eng. Manag. ASCE, 133(2), 146–156 (2007)
Bernold, L., Ubilla, J., Alarcon, H., Garcia, G.: Coaching engineering learning skills to freshman class using STEAM and PBL. In: Proceeding of Sociedad Chilena de Educación en Ingeniería (SOCHEDI), 10–12 Oct, Vina de Mar. Chile (2018)
Bloom, B.S.: Taxonomy of educational objectives: the classification of educational goals. Cognitive Domain (1956)
Bloom, A., Saeki, H.: Employability and Skill Set of Newly Graduated Engineers in India. American Psychological Association (APA) (2011). https://doi.org/10.1037/e596532012-001
Boyer Commission on Educating Undergraduates in the Research University: Reinventing Undergraduate Education: A Blueprint for America's Research Universities. State University of New York at Stony Brook for the Carnegie Foundation for the Advancement of Teaching (1998)
Carrell, S.E., West, J.E.: Does professor quality matter? Evidence from random assignment of students to professors. J. Polit. Econ. 118(3), 409–432 (2010)
Dewey, J.: Democracy and Education: An Introduction to the Philosophy of Education. Macmillan, NJ (1923)
Dewey, J.: Experience and Education. Collier-MacMillan Canada Ltd., Toronto (1938)
Díaz, B., Bernold, L., González, L.F., Aizman, A.: STE (A) M: Art, design and architecture in the formation of engineers at UTFSM. In: Proceeding of the 7th Research in Engineering Education. Research in Engineering Education Network, July 6–8, pp. 826–834. Bogota, Colombia (2017)
Engineering Council.: Standard for professional Engineering competence and Commitment (UK-SPEC). https://www.engc.org.uk/ukspec (2021)
Engineers Australia.: The Engineering profession, A Statistical Overview, Fourteenth Edution. https://www.engineersaustralia.org.au/sites/default/files/resources/Public%20Affairs/2019/The%20Engineering%20Profession%2C%20A%20Statistical%20Overview%2C%2014th%20edition%20-%2020190613b.pdf (2019)
Hampden-Thompson, G., Bennett, J.: Science teaching and learning activities and students’ engagement in science. Int. J. Sci. Educ. 35(8), 1325–1343 (2013)
Hossain, M., Robinson, G.M.: How to motivate US students to pursue STEM (science, technology, engineering and mathematics) careers. Online Submission, US-China Education Review A 4, p. 442–451 (2012)
Jackson, D.: Factors influencing job attainment in recent bachelor graduates. High. Educ. 68(1), 135–153 (2014). https://doi.org/10.1007/s10734-013-9696-7
Johnson, V.E.: Grade Inflation: A Crisis in College Education. Springer Science & Business Media (2006)
Kolb, D.A.: Organizational Psychology. Englewood Cliffs, Prentice-Hall, NJ, USA (1971)
Kolmos, A., Holgaard, J.E.: Employability in engineering education: are engineering students ready for work? In: Christensen, S.H., Delahousse, B., Didier, C., Meganck, M., Murphy, M. (eds.) The Engineering-Business Nexus: Symbiosis, Tension and Co-Evolution, pp. 499–520. Springer International Publishing (2019). https://doi.org/10.1007/978-3-319-99636-3_22
Krautmann, A.C., Sander, W.: Grades and student evaluations of teachers. Econ. Educ. Rev. 18(1), 59–63 (1999)
Markes, I.: A review of literature on employability skill needs in engineering. Null 31(6), 637–650 (2006). https://doi.org/10.1080/03043790600911704
McKeachie, W.J.: Student ratings: the validity of use. Am. Psychol. 52, 1218–1225 (1997)
McPherson, M.A., Jewell, R.T., Kim, M.: What determines student evaluation scores? A random effects analysis of undergraduate economics classes. East. Econ. J. 35(1), 37–51 (2009). https://doi.org/10.1057/palgrave.eej.9050042
McPherson, M.A.: Determinants of how students evaluate teachers. J. Econ. Educ. 37(1), 3–20 (2006). https://doi.org/10.3200/JECE.37.1.3-20
Montaigne.: 1580 On Schoolmasters’ Learning. M. Screech, trans., Book I, p. 154 (1991)
Lane, E.S., Harris, S.E.: A new tool for measuring student behavioral engagement in large university classes. J. Coll. Sci. Teach. 44(6), 83–91 (2015)
Loconte, J.: Bologna: Birthplace of the University. National Review (2021). https://www.nationalreview.com/2021/08/bologna-birthplace-of-the-university/
Oakley, B., Sejnowski, T., McConville, A.: Learning How to Learn: How to Succeed in School Without Spending all Your Time Studying; A Guide for Kids and Teens. Penguin (2018)
Olson, S., Riordan, D.G.: Engage to excel: producing one million additional college graduates with degrees in science, technology, engineering, and mathematics. Report to the president. Executive Office of the President (2012)
Piaget, J.: Intellectual evolution from adolescence to adulthood. Hum. Dev. 15, 1–12 (1972). https://dx.doi.org/10.1159/000271225
Piaget, J.: Piaget’s Theory. In P. H. Mussen, & W. Kessen (eds.) Handbook of Child Psychology, vol. I History, Theory, and Methods (pp. 41–102). New York: John Wiley (1983)
Piaget and Vygotsky: theory and practice in early education. In: Good, T.L. (ed.) 21st Century Education: A Reference Handbook, vol. 1. Sage Publication (2008)
Ramadi, E., Ramadi, S., Nasr, K.: Engineering graduates’ skill sets in the MENA region: a gap analysis of industry expectations and satisfaction. Eur. J. Eng. Educ. 41(1), 34–52 (2016)
Seldin, P.: The use and abuse of student ratings of professors. Chronicle High. Educ. 39(46), A40 (1993)
Simkin, J.: Education in the Roman Empire. Spartacus Educational Publisher, Ltd. (2020). www.spartacus-educational.com. Accessed 1 June 2022
Vygotsky, L.S., Cole, M.: Mind in society: Development of higher psychological processes. Harvard University Press (1978)
Weinberg, B.A., Hashimoto, M., Fleisher, B.M.: Evaluating teaching in higher education. J. Econ. Educ. 40(3), 227–261 (2009)
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Bernold, L.E., Díaz-Michell, B. (2023). A Multi-dimensional Quality Assessment Instrument for Engineering Education. In: da Silva, L.F.M., Ferreira, A.J.M. (eds) 3rd International Conference on Science and Technology Education 2022. STE 2022. Proceedings in Engineering Mechanics. Springer, Cham. https://doi.org/10.1007/978-3-031-25401-7_10
Download citation
DOI: https://doi.org/10.1007/978-3-031-25401-7_10
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-25400-0
Online ISBN: 978-3-031-25401-7
eBook Packages: Physics and AstronomyPhysics and Astronomy (R0)