Skip to main content
SpringerLink
Log in

Large-Scale Assessment of Vocational Education and Training

  • Chapter
  • First Online:
International Handbook of Research in Professional and Practice-based Learning

Part of the book series: Springer International Handbooks of Education ((SIHE))

Abstract

Our study is part of a European endeavor to measure effects of workplace learning by an international large-scale assessment in the fields of business and administration until 2020. We demonstrate how job-typical workplace tasks can be identified on a European level and, then, assessed at a web-based virtual workplace, which provides a broad spectrum of authentic tasks that typically have to be worked out at real workplaces and form the basis of assessment. By a field study – as a first step – we proved our assumptions, won data on the fulfillment of typical actions of clerks and used item response theory for evaluating a corresponding competence model as basis for a large-scale assessment of the effects of workplace learning.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 549.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 699.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Achtenhagen, F. (2001). Criteria for the development of complex teaching-learning-environments. Instructional Science, 29, 361–380.

    Article  Google Scholar 

  • Achtenhagen, F. (2012). The curriculum-instruction-assessment triad. Empirical Research in Vocational Education and Training, 4, 5–25.

    Google Scholar 

  • Achtenhagen, F., & Grubb, W. N. (2001). Vocational and occupational education: Pedagogical complexity, institutional diversity. In V. Richardson (Ed.), Handbook of research on teaching (4th ed., pp. 604–639). Washington, DC: American Educational Research Association.

    Google Scholar 

  • Achtenhagen, F., & John, E. G. (Eds.). (1992). Mehrdimensionale Lehr-Lern-Arrangements. Wiesbaden: Gabler.

    Google Scholar 

  • Achtenhagen, F., & Weber, S. (2003). “Authentizität” in der Gestaltung beruflicher Lernumgebungen. In A. Bredow, R. Dobischat, & J. Rottmann (Eds.), Berufs- und Wirtschaftspädagogik von A-Z (pp. 185–199). Baltmannsweiler: Schneider.

    Google Scholar 

  • Achtenhagen, F., & Weber, S. (2008). Transferability, flexibility, mobility as targets of vocational education and training – The COST action A 11. In F. Rauner & R. Maclean (Eds.), Handbook of technical and vocational education and training research (pp. 683–695). Dordrecht: Springer.

    Google Scholar 

  • Achtenhagen, F., & Winther, E. (2009). Konstruktvalidität von Simulationsaufgaben: Computergestützte Messung berufsfachlicher Kompetenz – am Beispiel der Ausbildung von Industriekaufleuten. Bericht für das BMBF. Göttingen: Seminar für Wirtschaftspädagogik.

    Google Scholar 

  • Achtenhagen, F. in Cooperation with Nijhof, J. W., & Raffe, D. (1995). Feasibility study: Research scope for vocational education in the framework of COST social sciences. European commission: Directorate-general science, research and development, COST technical committee social sciences (Vol. 3). Brussels/Luxembourg: ECSC-EC-EAEC.

    Google Scholar 

  • Adams, R. J., Wilson, M., & Wang, W.–. C. (1997). The multidimensional random coefficients multinomial logit model. Applied Psychological Measurement, 21, 1–23.

    Article  Google Scholar 

  • Anderson, L. W., & Krathwohl, D. R. (with Airasian, P. W., Cruikshank, K. A., Mayer, R. E., Pintrich, P. R., et al.) (Eds.). (2001). A taxonomy for learning, teaching, and assessing. A revision of Bloom’s taxonomy of educational objectives. New York: Longman.

    Google Scholar 

  • Baethge, M., & Arends, L. (Eds.). (2009). Feasibility study VET-LSA. A comparative analysis of occupational profiles and VET programmes in eight European countries. International report. Bonn: BMBF.

    Google Scholar 

  • Baethge, M., Achtenhagen, F., Arends, L., Babic, E., Baethge-Kinsky, V., & Weber, S. (2006). PISA-VET – A feasibility-study. Stuttgart: Steiner.

    Google Scholar 

  • Black, P., Harrison, C., Lee, C., Marshall, B., & Wiliam, D. (2003). Assessment for learning. London: Open University Press.

    Google Scholar 

  • Breuer, K., Hillen, S., & Winther, E. (2009). Comparative international analysis of occupational tasks and qualification requirements for the labor market and assessment tasks at the end of VET in participating countries – Business and Administration. In M. Baethge & L. Arends (Eds.), Feasibility study VET-LSA. A comparative analysis of occupational profiles and VET programmes in eight European countries. International report (pp. 71–84). Bonn: BMBF.

    Google Scholar 

  • Busemeyer, M. R., & Trampusch, C. (Eds.). (2012). The political economy of collective skill formation. Oxford: Oxford University Press.

    Google Scholar 

  • Buttler, F. (1992). Bildungslandschaft bis 2010. In F. Achtenhagen & E. G. John (Eds.), Mehrdimensionale Lehr-Lern-Arrangements (pp. 162–182). Wiesbaden: Gabler.

    Google Scholar 

  • Buttler, F. (2009). To learn makes people grow large and strong – developing trends in gainful occupation, learning competence and social inclusion in an international perspective. In F. Oser, U. Renold, E. G. John, E. Winther, & S. Weber (Eds.), VET boost: Towards a theory of professional competencies. Essays in honor of Frank Achtenhagen (pp. 361–370). Rotterdam: Sense.

    Google Scholar 

  • Gelman, R., & Greeno, J. G. (1989). On the nature of competence: Principles for understanding in a domain. In L. B. Resnick (Ed.), Knowing, learning and instruction. Essays in Honor of Robert Glaser (pp. 125–186). Hillsdale: Erlbaum.

    Google Scholar 

  • Glaser, R. (1976). Cognitive psychology and instructional design. In D. Klahr (Ed.), Cognition and instruction (pp. 303–316). Hillsdale: Lawrence Erlbaum.

    Google Scholar 

  • Greeno, J. G., Riley, M. S., & Gelman, R. (1984). Conceptual competence and children’s counting. Cognitive Psychology, 16, 94–143.

    Article  Google Scholar 

  • Griffin, P., McGaw, B., & Care, E. (Eds.). (2012). Assessment and teaching of 21st century skills. Dordrecht: Springer.

    Google Scholar 

  • Hartig, J. (2007). Skalierung und Definition von Kompetenzniveaus. In B. Beck & E. Klieme (Eds.), Sprachliche Kompetenzen (pp. 83–99). Weinheim: Beltz.

    Google Scholar 

  • ILO. (2008). ISCO. International standard classification of occupations. Geneva: ILO.

    Google Scholar 

  • James, S. (2008). Learning to cook: Analysing apprentice’s knowledge and skill construction in the workplace. In F. Rauner & R. Maclean (Eds.), Handbook of technical and vocational education and training research (pp. 674–683). Dordrecht: Springer.

    Google Scholar 

  • Janesick, V. J. (2006). Authentic assessment. New York: Lang.

    Google Scholar 

  • Keep, E., & Mayhew, K. (2008). The assessment: Knowledge, skills and competitiveness. In F. Rauner & R. Maclean (Eds.), Handbook of technical and vocational education and training research (pp. 660–674). New York: Springer.

    Google Scholar 

  • Malloch, M., Cairns, L., Evans, K., & O’Connor, B. N. (Eds.). (2011). The SAGE handbook of workplace learning. Los Angeles: Sage.

    Google Scholar 

  • Mertens, D. (1974). Schlüsselqualifikationen. Mitteilungen aus der Arbeitsmarkt- und Berufsforschung, 70, 36–43.

    Google Scholar 

  • Nijhof, W. J., & Streumer, J. N. (Eds.). (1998). Key qualifications in work and education. Dordrecht/Boston/London: Kluwer.

    Google Scholar 

  • Oates, T. (2004). The role of outcome-based national qualifications in the development of an effective vocational education and training system: The case of England and Wales. Policy Futures in Education, 2(1), 53–71.

    Article  Google Scholar 

  • OECD. (1995). Literacy, economy and society. Results of the first international adult literacy survey. Paris: OECD.

    Google Scholar 

  • OECD. (2003). The PISA 2003 assessment framework – Mathematics, reading, science and problem solving knowledge and skills. Paris: OECD.

    Google Scholar 

  • Oser, F., Renold, U., John, E. G., Winther, E., & Weber, S. (Eds.). (2009). VET boost: Towards a theory of professional competencies. Essays in honor of Frank Achtenhagen. Rotterdam: Sense.

    Google Scholar 

  • Pellegrino, J. W. (2010). The design of an assessment system for the race to the top: A learning sciences perspective on issues of growth and measurement. Princeton: Educational Testing Service.

    Google Scholar 

  • Peterson, N. G., Mumford, M. D., Borman, W. C., Jeanneret, P. R., & Fleishman, E. A. (1999). An occupational information system for the 21st century: The development of O*NET. Washington, DC: American Psychological Association.

    Google Scholar 

  • Rauner, F., & Maclean, R. (Eds.). (2008). Handbook of technical and vocational education and training research. Dordrecht: Springer.

    Google Scholar 

  • Rauner, F., & Spöttl, G. (2002). Aufgabenanalyse für die Neuordnung der Berufe im Kfz-Sektor. http://itb.uni-bremen.de/downloads/Sonstiges/Kfz-Neuordnung-Bericht4.pdf

  • Renkl, A. (2007). Lehrbuch Pädagogische Psychologie. Bern: Haupt.

    Google Scholar 

  • Rychen, D. S., & Salganik, L. H. (Eds.). (2003). Key competencies for a successful life and a well-functioning society. Cambridge/Göttingen: Hogrefe & Huber.

    Google Scholar 

  • Scott, J. C., & Reynolds, D. H. (Eds.). (2010). Handbook of workplace assessment. San Francisco: Wiley.

    Google Scholar 

  • Shavelson, R. J., Baxter, G. P., & Pine, J. (1992). Performance assessments: Political rhetoric and measurement reality. Educational Researcher, 21(4), 22–27.

    Google Scholar 

  • Shrout, P. E., & Fleiss, J. L. (1979). Intraclass correlations – Used in assessing rater reliability. Psychological Bulletin, 86, 420–428.

    Article  Google Scholar 

  • Spencer, L. M., & Spencer, S. M. (Eds.). (1993). Competence at work. New York: Wiley.

    Google Scholar 

  • UNESCO. (2006). ISCED 1997. International standard classification of education. Montreal: UIS.

    Google Scholar 

  • Wilson, M. (2005). Constructing measures. Mahwah: Erlbaum.

    Google Scholar 

  • Wilson, M. (2008). Cognitive diagnosis using item response models. Journal of Psychology, 216(2), 74–88.

    Google Scholar 

  • Winterton, J. (2009). Competence across Europe: Highest common factor or lowest common denominator? Journal of European Industrial Training, 33, 681–700.

    Article  Google Scholar 

  • Winther, E. (2010). Kompetenzmessung in der beruflichen Bildung. Bielefeld: Bertelsmann.

    Google Scholar 

  • Winther, E., & Achtenhagen, F. (2008). Kompetenzstrukturmodell für die kaufmännische Bildung. Zeitschrift für Berufs- und Wirtschaftspädagogik, 104, 511–538.

    Google Scholar 

  • Winther, E., & Achtenhagen, F. (2009). Skalen und Stufen kaufmännischer Kompetenz. Zeitschrift für Berufs- und Wirtschaftspädagogik, 105, 521–556.

    Google Scholar 

  • Winther, E., & Klotz, V. (2013). Measurement of vocational competences: An analysis of the structure and reliability of current assessment practices in economic domains. Empirical Research in Vocational Education and Training, 5(2), 1–12.

    Google Scholar 

  • Wu, M. L., Adams, R. J., Wilson, M., & Haldane, S. A. (2007). ACER CONQUEST. Version 2.0. Camberwell: ACER Press.

    Google Scholar 

  • Yuan, K., Steedle, J., Shavelson, R., Alonzo, A., & Oppezzo, M. (2006). Working memory, fluid intelligence, and science learning. Educational Research Review, 1, 83–98.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Faculty of Economics, University of Göttingen, Göttingen, Germany

    Frank Achtenhagen

  2. Business Administration and Economics, University of Paderborn, Paderborn, Germany

    Esther Winther

Authors
  1. Frank Achtenhagen
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Esther Winther
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Esther Winther .

Editor information

Editors and Affiliations

  1. School of Education and Professional Studies, Adult and Vocational Education, Griffith University, Brisbane, Queensland, Australia

    Stephen Billett

  2. Institute of Educational Science, University of Paderborn, Paderborn, Germany

    Christian Harteis

  3. Institute of Educational Science, University of Regensburg, Regensburg, Germany

    Hans Gruber

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer Science+Business Media Dordrecht

About this chapter

Cite this chapter

Achtenhagen, F., Winther, E. (2014). Large-Scale Assessment of Vocational Education and Training. In: Billett, S., Harteis, C., Gruber, H. (eds) International Handbook of Research in Professional and Practice-based Learning. Springer International Handbooks of Education. Springer, Dordrecht. https://doi.org/10.1007/978-94-017-8902-8_48

Download citation

Publish with us

Policies and ethics

Search

Navigation