Abstract
This chapter focuses on the contribution scientific evaluation can make to the modeling and measurement of competencies in higher education. The chapter is divided into three parts. In the first section, the basics of scientific evaluation are briefly described with a specific focus on relevant aspects of program evaluation.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Atria, M., Reimann, R., & Spiel, C. (2006). Qualitatssicherung durch Evaluation. Die Bedeutung von Zielexplikation und evaluativer Haltung [Quality assurance by evaluation. The importance of goal explication and an evaluative mindset]. In C. Steinebach (Ed.), Handbuch Psychologische Beratung [Handbook of psychological counselling] (pp. 574–586). Stuttgart: Klett-Cotta.
Berk, R. A., & Rossi, P.H. (1998). Thinking about program evaluation. Thousand Oaks, CA: Sage.
Bortz, J., & Doring, N. (2006) Forschungsmethoden und Evaluation fur Human- und Sozialwissenschaftler [Research methods and evaluation for human and social research] (4th ed.). Berlin: Springer.
Calhoun, J. G., ten Haken, J. D., & Woolliscroft, J. O. (1990). Medical students’ development of self- and peer-assessment skills: A longitudinal study. Teaching and Learning in Medicine, 2, 25–29.
Clack, G. B. (1994). Medical graduates evaluate the effectiveness of their education. Medical Education, 28, 418–431.
Deutsche Gesellschaft fur Evaluation (DeGEval)., (2002). Standards fur Evaluation [Standards for evaluation]. Cologne: DeGEval.
Fink, A. (1995). Evaluation for education & psychology. Thousand Oaks, CA: Sage.
Gerrity, M. S., & Mahaffy, J. (1998).Evaluating change in medical school curricula: How did we know where we were going? Academic Medicine, 73, 55–59.
Guba, E.G., & Lincoln, Y. S. (1989). Fourth generation evaluation. Newbury Park, CA: Sage.
Hewson, M. G., Copeland, H. L., & Fishleder, A. J. (2001). What’s the use of faculty development? Program evaluation using retrospective self-assessments and independent performance ratings. Teaching and Learning in Medicine, 13, 153–160.
Hill, J., Rolfe, I. E., Pearson, S. A., & Heathcote, A. (1998). Do junior doctors feel they are prepared for hospital practice? A study of graduates from traditional and non-traditional medical schools. Medical Education, 32, 19–24.
Joint Committee on Standards for Educational Evaluation (JCSEE). (1994). The program evaluation standards (2nd ed.). Thousand Oaks, CA: Sage.
Kirkpatrick, D. L. (1998). Evaluating training programs. The four levels. San Francisco, CA: Berrett- Koehler.
Kirkpatrick, J. D., & Kirkpatrick, D. L. (2005). Transferring learning to behavior. Using the four levels to improve performance. San Francisco: Berrett-Koehler.
Klieme, E. (2004). Was sind Kompetenzen und wie lassen sie sich messen? [What are competencies and how can these be measured?] Padagogik, 56(6), 10–13.
Klieme, E., & Leutner, D. (2006). Kompetenzmodelle zur Erfassung individueller Lernergebnisse und zur Bilanzierung von Bildungsprozessen - Beschreibung eines neu eingerichteten Schwerpunktprogramms der DFG [Competence models for the recording of individual learning results and for the assessment of educational processes - The German Research Association (DFG)’s plans for new fields of emphasis]. Zeitschrift fur Padagogik, 52(6), 876–903.
Marsh, H. W. (1982). Validity of students’ evaluations of college teaching: A multitrait-multimethod analysis. Journal of Educational Psychology, 74, 264–279.
Merl, P. A., Csanyi, G. S., Petta, P., Lischka, M., & Marz, R. (2000). The process of defining a profile of student competencies at the University of Vienna Medical School. Medical Education, 34, 216–221.
Morrison, J. (2003). ABC of learning and teaching in medicine: Evaluation. British Medical Journal, 326, 385–387.
Patton, M. Qu. (1996). Utilization-focused evaluation (3rd ed.). Thousand Oaks, CA: Sage.
Pawson, R., & Tilley, N. (1997). Realistic evaluation. London: Sage.
Rolfe, I. E., Andren, J. M., Pearson, S., Hensley, M. J., & Gordon, J. J. (1995). Clinical competence of interns. Medical Education, 29, 225–230.
Rossi, P.H., & Freeman, H.E. (1993). Evaluation. A systematic approach (5th ed.). Newbury Park, CA: Sage.
Schober, B., Spiel, C.,& Reimann, R.,(2004). Young physicians’ competences from different points of view. Medical Teacher, 26, 451–457.
Schober, B., Wagner, P., Reimann, R., & Spiel, C. (2008). Vienna E-Lecturing (VEL): Learning how to learn self-regulated in an internet based blended learning setting. International Journal on E-learning, 7, 703–723.
Schunk, D. H., & Ertmer, P. H. (2000). Self-regulation and academic learning: Self efficacy enhancing interventions. In M. Boekaerts, P.R. Pintrich, & M. Zeidner (Eds.), Handbook of self-regulation (pp. 631–650). San Diego, CA: Academic Press.
Schweer, M. K. W. (2001). Evaluation der Lehre [Evaluation of teaching]. In D. H. Rost (Ed.), Handworterbuch Padagogische Psychologie [Handbook of educational psychology] (2nd ed., pp. 466–471). Weinheim: PVU.
Shadish, W. R., Newman, D. L., Scheirer, M. A., & Wye, Ch. (1995). Guiding Principles for Evaluators (New Directions for Program Evaluation, No. 66). San Francisco, CA: Jossey-Bass.
Sonneck, G.. (1994). Bildungsziele und Lehrveranstaltungen im Medizinstudium [Goals and courses of medical education]. Vienna: Facultas.
Spiel, C. (2001), Program evaluation. In N. J. Smelser & P. B. Baltes (Eds.), International encyclopedia of the social & behavioral sciences (Vol. 18, pp. 12169–12173). Oxford: Elsevier Science.
Spiel, C. (2010). Hochschulzugang: Bestandsaufnahme und Empfehlungen [University admission: Review and regards]. In AQA - Osterreichische Qualitatssicherungsagentur [Austrian quality assurance agency], Mobilitat, Durchlassigkeit und Qualitat [Mobility, permeability and quality] (pp. 39–43). Vienna: Facultas.
Spiel, C., Finsterwald, M., & Schober, B. (2009). Anerkennung non-formalen und informellen Lernens an Universitaten [Admission of non-formal and informal learning at universities]. In E. Westphal & M. Friedrich (Eds.), Anerkennung von non-formalen und informellen Lernen an Universitaten [Admission of non-formal and informal learning at universities] (pp. 29–83). Graz: Leykam.
Spiel, C., Gradinger, P., & Luftenegger, M. (2010). Grundlagen der Evaluationsforschung [Principles of scientific evaluation]. In H. Holling H. & B. Schmitz (Eds.), Handbuch Statistik, Methoden und Evaluation [Handbook of statistics, methods and evaluation] (pp. 223–232). Gottingen: Hogrefe.
Spiel, C., Litzenberger, M., & Haiden, D. (2007). Bildungswissenschaftliche und psychologische Aspekte von Auswahlverfahren [Educational and psychological aspects of selection procedures]. In C. Badelt, W. Wegscheider & H. Wulz (Eds.), Hochschulzugang in Osterreich [university admission in Austria] (pp. 479–552). Graz: Grazer Universitatsverlag.
Spiel, C., Luftenegger, M., Gradinger, P., & Reimann, R. (2010). Zielexplikation und Standards in der Evaluationsforschung [Goal explication and standards in scientific evaluation]. In H. Holling H. & B. Schmitz (Eds.), Handbuch Statistik, Methoden und Evaluation [Handbook of statistics, methods and evaluation] (pp. 252–260). Gottingen: Hogrefe.
Spiel, C., Schober, B., & Litzenberger, M. (2008). Evaluation der Eignungstests fur das Medizinstudium in Osterreich [Evaluation of the selection procedures for medical studies in Austria]. Projektbericht fur das Bundesministerium fur Wissenschaft und Forschung, Wien [Project report for the ministry of science and research, Vienna]. Vienna: University of Vienna, Faculty of Psychology.
Spiel, C., Schober, B., & Reimann, R. (2006). Evaluation of curricula in higher education: Challenges for evaluators. Evaluation Review, 30, 430–450.
Widmer, T., Landert, C., & Bachmann, N. (2000). Evaluations-Standards der Schweizerischen Evaluationsgesellschaft (SEVAL-Standards) [Evaluation standards of the Swiss evaluation association]. Retrieved from http://www.seval.ch/de/documents/seval_Standards_2001_dt.pdf.
Wottawa, H., & Thierau, H. (1998). Lehrbuch Evaluation [Textbook evaluation]. Bern: Hans Huber.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Sense Publishers
About this chapter
Cite this chapter
Spiel, C., Schober, B., Reimann, R. (2013). Modeling and Measurement of Competencies in Higher Education – The Contribution of Scientific Evaluation. In: Blömeke, S., Zlatkin-Troitschanskaia, O., Kuhn, C., Fege, J. (eds) Modeling and Measuring Competencies in Higher Education. Professional and Vet Learning, vol 1. SensePublishers, Rotterdam. https://doi.org/10.1007/978-94-6091-867-4_14
Download citation
DOI: https://doi.org/10.1007/978-94-6091-867-4_14
Publisher Name: SensePublishers, Rotterdam
Online ISBN: 978-94-6091-867-4
eBook Packages: Humanities, Social Sciences and LawEducation (R0)
