E-Government Implementation Evaluation: Opening the Black Box

  • Maddalena Sorrentino
  • Raffaella Naggi
  • Pietro Luca Agostini
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5693)


This paper perceives e-government evaluation as a research field that can produce the cognitive input to help us understand the causal nexus that should attribute the effects of an e-government programme to its implementation and transform this learning into an effective intervention tool. Drawing on contributions from Organization Theory and Policy Studies, we propose an interpretive key that assigns a dual role to e-government evaluation: valuable cognitive resource and tool of accountability for the policymakers. The reflections offered here are based on an exploratory case study of a City of Milan project and aim to provide further insights for e-government research and help better inform managerial praxis.


e-government Evaluation Implementation Interdisciplinary Approach Policy Studies Organization Theory 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Foley, P.: The Real Benefits, Beneficiaries and Value of E-Government. Public Money & Management 25, 4–6 (2005)Google Scholar
  2. 2.
    Lim, J.H., Tang, S.-Y.: Urban E-Government Initiatives and Environmental Decision Performance in Korea. Journal of Public Administration Research and Theory 18, 109–138 (2008)CrossRefGoogle Scholar
  3. 3.
    Weiss, C.H.: Evaluation: Methods for Studying Programs and Policies. Prentice Hall, Englewood Cliffs (1998)Google Scholar
  4. 4.
    OECD: The e-Government Imperative. OECD, Paris (2004)Google Scholar
  5. 5.
    Majone, G., Wildavsky, A.B.: Implementation as Evolution. In: Pressman, J.L., Wildavsky, A.B. (eds.) Implementation. University of California Press, Berkeley (1984)Google Scholar
  6. 6.
    Yin, R.K.: Case Study Research: Design and Methods. Sage, Thousand Oaks (2003)Google Scholar
  7. 7.
    Darke, P., Shanks, G., Broadbent, M.: Successfully Completing Case Study Research: Combining Rigour, Relevance and Pragmatism. Information Systems Journal 8, 273–289 (1998)CrossRefGoogle Scholar
  8. 8.
    Pressman, J.L., Wildavsky, A.B.: Implementation, 3rd edn. University of California Press, Berkeley (1984)Google Scholar
  9. 9.
    Lippi, A.: La valutazione delle politiche pubbliche. Il Mulino, Bologna (2007)Google Scholar
  10. 10.
    Browne, A., Wildavsky, A.B.: What Should Evaluation Mean to Implementation? In: Pressman, J.L., Wildavsky, A.B. (eds.) Implementation, 3rd edn. University of California Press, Berkley (1984)Google Scholar
  11. 11.
    Regonini, G.: Capire le politiche pubbliche. Il Mulino, Bologna (2001)Google Scholar
  12. 12.
    Scriven, M.: Evaluation Thesaurus. Sage, Newbury Park (1991)Google Scholar
  13. 13.
    Gregory, D., Martin, S.: Crafting Evaluation Research in the Public Sector: Reconciling Rigour and Relevance. British Journal of Management 5, 43 (1994)CrossRefGoogle Scholar
  14. 14.
    Rebora, G.: La valutazione dei risultati nelle amministrazioni pubbliche: proposte operative e di metodo. Guerini e Associati, Milano (1999)Google Scholar
  15. 15.
    Rossi, P.H., Freeman, H.E., Lipsey, M.W.: Evaluation, a Systematic Approach. Sage, Thousands Oaks (1999)Google Scholar
  16. 16.
    Stewart, J., Walsh, K.: Performance Measurement: When Performance Can Never Be Finally Defined. Public Money & Management 14, 45–49 (1994)CrossRefGoogle Scholar
  17. 17.
    Lindblom, C.E.: The Science of ‘Muddling’ Through. Public Administration Review 19, 79–88 (1959)CrossRefGoogle Scholar
  18. 18.
    Guba, E.G., Lincoln, Y.S.: Fourth Generation Evaluation. Sage, Newbury Park (1989)Google Scholar
  19. 19.
    Barrett, S., Fudge, C.: Policy and Action: Essays on the Implementation of Public Policy. Routledge, London (1981)Google Scholar
  20. 20.
    Stame, N.: Classici della valutazione. FrancoAngeli, Milano (2007)Google Scholar
  21. 21.
    Directive 2008/50/EC of the European Parliament and of the Council of 21 May 2008 on Ambient Air Quality and Cleaner Air for Europe,
  22. 22.
    European Environment Agency,
  23. 23.
    Fountain, J.E.: The Virtual State: Transforming American Government? National Civic Review 90, 241–252 (2001)CrossRefGoogle Scholar
  24. 24.
    Mayer-Schönberger, V., Lazer, D.: E-Gov and the Coming Revolution of Information Government. Working Paper, Belfer Center for Science and International Affairs (2008)Google Scholar
  25. 25.
    Macintosh, A., Whyte, A.: Evaluating how eParticipation Changes Local Democracy. In: Irani, Z., Ghoneim, A. (eds.) Proceedings of the eGovernment Workshop, eGov 2006, pp. 1–16. Brunel University, London (2006)Google Scholar
  26. 26.
    Fountain, J.: Paradoxes of Public Sector Customer Service. Governance: An International Journal of Policy and Administration 14, 55–73 (2001)CrossRefGoogle Scholar
  27. 27.
    Lindblom, C.E.: The Intelligence of Democracy: Decision Making Through Mutual Adjustment. The Free Press, New York (1965)Google Scholar
  28. 28.
    Dente, B., Vecchi, G.: La valutazione e il controllo strategico. In: Azzone, G., Dente, B. (eds.) Valutare per governare. Etas, Milano (1999)Google Scholar
  29. 29.
    Thompson, J.D.: Organizations in Action. McGraw-Hill, New York (1967)Google Scholar
  30. 30.
    Maggi, B.: Razionalità e benessere: studio interdisciplinare dell’organizzazione. Etas, Milano (1990)Google Scholar
  31. 31.
    Maggi, B.: De l’agir organisationnel: un point de vue sur le travail, le bien-être, l’apprentissage. Octarès, Toulouse (2003)Google Scholar
  32. 32.
    Alter, S.L.: Information Systems: A Management Perspective. Benjamin-Cummings Publishing, Redwood City (1995)Google Scholar
  33. 33.
    Veryard, R.: The Economics of Information Systems and Software. Butterworth-Heinemann, Oxford (1991)Google Scholar
  34. 34.
    Scheirer, M.A.: A Template for Assessing the Organizational Base for Program Implementation. New Directions for Program Evaluation 1996, 61–79 (1996)CrossRefGoogle Scholar
  35. 35.
    Scheirer, M.: Approaches to the Study of Implementation. IEEE Transactions on Engineering Management 30, 76–82 (1983)CrossRefGoogle Scholar
  36. 36.
    Sorrentino, M., Ferro, E.: Does the Answer to eGovernment Lie in Intermunicipal Collaboration? An Exploratory Italian Case Study. In: Wimmer, M.A., Scholl, H.J., Ferro, E. (eds.) EGOV 2008. LNCS, vol. 5184, pp. 1–12. Springer, Heidelberg (2008)CrossRefGoogle Scholar
  37. 37.
    Roberts-Gray, C., Scheirer, M.A.: Checking the Congruence between a Program and its Organizational Environment. New Directions for Program Evaluation 1988, 63–82 (1988)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Maddalena Sorrentino
    • 1
  • Raffaella Naggi
    • 2
  • Pietro Luca Agostini
    • 3
  1. 1.Dip. di Scienze Economiche, Aziendali e StatisticheUniversità degli Studi di MilanoMilanoItalia
  2. 2.Luiss Guido CarliRomaItalia
  3. 3.Dip. di Scienze dell’Economia e della Gestione AziendaleUniversità Cattolica del Sacro CuoreMilanoItalia

Personalised recommendations