Skip to main content
SpringerLink
Log in

Critical factors in the use of evaluation in Italian universities

  • Published:
Higher Education Aims and scope Submit manuscript

Abstract

The use made of evaluation output is crucial for understanding the position and effectiveness of evaluation systems. This article examines the development of evaluation in the Italian university system from the 1990 s onwards where serious problems have been and continue to be addressed in the use of evaluation output to improve academic activities and make universities accountable for their behaviour. There is a tendency for evaluation to generate inappropriate or undesired effects and for those being assessed to adopt opportunistic behaviour. Underestimation of the universities’ organisational features is the main reason for so many difficulties.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

Notes

  1. In 1980, the total number of students was 1,060,274 and in 1999, 1,673,960. During the same period, the number of professors increased from a total of 8,122 to 30,945.

References

  • Biolcati Rinaldi, F., Checchi, D., Guglielmetti, C., Salini, S., & e Turri, M. (2008). Ranking e valutazione: il caso delle classifiche delle università. Rassegna Italiana di Valutazione, 12(41), 81–114.

    Google Scholar 

  • Boffo, S., & Moscati, R. (1998). Evaluation in the Italian higher educational system: Many tribes, many territories… many godfathers. European Journal of Education, 33(3), 349–360.

    Google Scholar 

  • Bressan, M. (2008). Caratteristiche e dimensione dal VTR. In E. Reale, et al. (Eds.), La valutazione della ricerca pubblica. Una analisi della valutazione triennale della ricerca (pp. 17–37). Milano: Franco Angeli.

    Google Scholar 

  • Capano, G. (2003). Administrative traditions and policy change: When policy paradigms matter. The case of Italian administrative reform during the 1990 s. Public Administration, 81(4), 781–801.

    Article  Google Scholar 

  • Capano, G. (2008). Looking for serendipity: The problematical reform of government within Italy’s Universities. Higher Education, 55(4), 481–504.

    Article  Google Scholar 

  • Chelimsky, E. (1997). The coming transformations in evaluation. In E. Chelimsky & W. Shadish (Eds.), Evaluation for the 21th Century (pp. 1–26). Thousand Oaks: Sage.

    Google Scholar 

  • Chiesi, A. M. (2008). La valutazione della produzione sociologica. Quaderni di sociologia, 52(47), 123–134.

    Google Scholar 

  • CIVR. (2004). Valutazione triennale della ricerca (VTR). Bando di partecipazione all’esercizio 2001-2003. http://www.civr.it. Accessed September 7 2009.

  • CNVSU. (2002). L’evoluzione del sistema di valutazione negli ultimi dieci anni. Atenei 5-6 pp. 15–35 http://www.vsu.it. Accessed September 7 2009.

  • Cohen, M. D., & March, J. G. (1974). Leadership and ambiguity: The American college president. New York: McGraw-Hill.

    Google Scholar 

  • De Rita, G. (2003). Intervento di saluto. In C. Casciotti (Ed.), La valutazione: un indispensabile strumento di garanzia e di governance (pp. 21–24). Roma: CRUI.

    Google Scholar 

  • Dente, B. (2006). I nuclei di valutazione dell’Università. Una ricerca promossa dal CNVSU. http://www.vsu.it. Accessed March 7 2009.

  • DiMaggio, P. J., & Powell, W. (1983). “The iron cage revisited” institutional isomorphism and collective rationality in organizational fields. American Sociological Review, 48, 147–160.

    Google Scholar 

  • ENQA. (2005). Standards and guidelines for quality assurance in the European higher education area. http://www.enqa.net. Accessed September 7 2009.

  • Garegnani, P. (2007). Sulla valutazione della ricerca economica. Rivista italiana degli economisti, 2, 177–190.

    Google Scholar 

  • Henkel, M. (1998). Evaluation in higher education: Conceptual and epistemological foundations. European Journal of Education, 33(3), 285–297.

    Google Scholar 

  • Hood, C. (2007). Public service management by numbers: Why does it vary? Where has it come from? What are the gaps and the puzzles? Public Money and Management, 27(2), 95–102.

    Article  Google Scholar 

  • Luzzatto, G., & Moscati, R. (2005). University reform in Italy: Fears, expectations and contradictions. In A. Gornitzka, M. Kogan, & A. Amaral (Eds.), Reform and change in higher education (pp. 153–168). Dordrecht: Cher-Springer.

    Chapter  Google Scholar 

  • Meyer, M. W., & Gupta, V. (1994). The performance paradox. Research in Organizational Behavior, 16, 309–369.

    Google Scholar 

  • Minelli, E., Rebora, G., & Turri, M. (2008a). How can evaluation fail? The case of Italian universities. Quality in Higher Education, 14(2), 157–173.

    Article  Google Scholar 

  • Minelli, E., Rebora, G., & Turri, M. (2008b). The structure and significance of the Italian research assessment exercise (VTR). In C. Mazza, P. Quattrone, & A. Riccaboni (Eds.), European universities in transition (pp. 221–236). London: Edward Elgar Publishing.

    Google Scholar 

  • Minelli, E., Rebora, G., Turri, M., & Huisman, J. (2006). The impact of research and teaching evaluation in universities: comparing an Italian and a Dutch case. Quality in Higher Education, 12(2), 109–124.

    Article  Google Scholar 

  • Mintzberg, H. (1983). Structure in fives: Designing effective organizations. Englewood Cliffs: Prentice-Hall.

    Google Scholar 

  • MIUR. (2004). Puntualità alle lezioni, chiarezza didattica e disponibilità. Gli studenti universitari giudicano i loro docenti. Università & Ricerca Informazioni, 3, 98–99.

    Google Scholar 

  • Moscati, R. (2001). Italian university professors in transition. Higher Education, 41(1), 103–129.

    Article  Google Scholar 

  • Moynihan, D. (2008). Advocacy and Learning: An interactive-dialogue approach to perfomance information use. In W. Van Dooren, W. Van Dooren, & S. van de Walle (Eds.), Performance information in the public sector: How it is used. Basingstoke: Palgrave Mc Millan.

    Google Scholar 

  • O’Connell, B. T. (2004). Enron. Con: He that filches from me my good name…makes me poor indeed. Critical Perspectives on Accounting, 15, 733–749.

    Article  Google Scholar 

  • Osservatorio nazionale per la valutazione del sistema universitario. (1998). University Funding Mechanisms and related issues. Doc. 3. http://www.vsu.it. Accessed September 7 2009.

  • Osservatorio nazionale per la valutazione del sistema universitario. (1998). Ruolo, organizzazione e attività dei Nuclei di valutazione interna delle università: Doc. 10 http://www.vsu.it Accessed September 7 2009.

  • Patton, M. (1997). Utilization-focused evaluation. Thousand Oaks: Sage.

    Google Scholar 

  • Perrin, B. (1998). Effective use and misuse of performance measurement American. Journal of Evaluation, 19(3), 367–379.

    Google Scholar 

  • Power, M. (1997). The audit society. Oxford: Oxford University Press.

    Google Scholar 

  • Rauhvargers, A., Deane, C. e Pauwels W. (2009). Bologna process stocktaking report 2009. Report from working groups appointed by the Bologna Follow-up Group to the Ministerial Conference in Leuven/Louvain-la-Neuve. 28–29 April 2009. http://www.ond.vlaanderen.be/hogeronderwijs/bologna/conference/documents/Stocktaking_report_2009_FINAL.pdf Accessed May 29 2009.

  • Rebora, G. (1999). La valutazione dei risultati nelle amministrazioni pubbliche. Milano: Guerini e Associati.

    Google Scholar 

  • Rebora, G., & Turri, M. (2009). Governance in higher education: An analysis of the Italian experience. In J. Huisman (Ed.), International perspectives on the governance of higher education. Alternative frameworks for coordination (pp. 13–31). Routledge: Abingdon.

    Google Scholar 

  • Smith, P. (1995). On the unintended consequences of publishing performance indicators in the public sector. International Journal of Public Administration, 18, 277–310.

    Article  Google Scholar 

  • Stefani, E. (2006). Qualità nell’università. Milano: Franco Angeli.

    Google Scholar 

  • Turri, M. (2002). Le esperienze di valutazione nelle università italiane: un’analisi critica. In E. Minelli, G. Rebora, & M. Turri (Eds.), Il valore dell’università (pp. 65–96). Milano: Guerini e Associati.

    Google Scholar 

  • Turri, M. (2005). La valutazione dell’università. Un’analisi dell’impatto istituzionale e organizzativo. Milano: Guerini e Associati.

    Google Scholar 

  • Turri, M. (2007). I fattori di crisi dei controlli nel caso delle Università. In G. Rebora (Ed.), La crisi dei controlli: imprese e istituzioni a confronto (pp. 279–323). Milano: Pearson Education Italia.

    Google Scholar 

  • Van de Walle, S., & Van Dooren, W. (2008). Introduction: using public sector performance information. In W. Van Dooren & S. Van de Walle (Eds.), Using public sector performance information (pp. 1–11). Hampshire: Palgrave Macmillan.

    Google Scholar 

  • VanThiel, S., & Leeuw, F. L. (2002). The performance paradox in the public sector. Public performance and management review, 25(3), 267–281.

    Article  Google Scholar 

  • Weick, K. E. (1976). Educational organizations as loosely coupled systems. Administrative Science Quarterly, 21(1), 1–20.

    Article  Google Scholar 

  • Weiss, C. (1972). Utilization of evaluation: Toward comparative study. In C. Weiss (Ed.), Evaluating action programs (pp. 318–326). Boston: Allyn & Bacon.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Università Cattaneo LIUC, C.so Matteotti, 22, 21053, Castellanza, VA, Italy

    Gianfranco Rebora

  2. Università degli studi di Milano, via conservatorio, 7, 20122, Milano, Italy

    Matteo Turri

Authors
  1. Gianfranco Rebora
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Matteo Turri
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Matteo Turri.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Rebora, G., Turri, M. Critical factors in the use of evaluation in Italian universities. High Educ 61, 531–544 (2011). https://doi.org/10.1007/s10734-010-9347-1

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10734-010-9347-1

Keywords

Search

Navigation