Abstract
Policy evaluations are increasingly considered a taken-for-granted prerequisite for a well-performing public sector. In this chapter, we address the question whether this view reflects the actual situation concerning evaluation capacity and culture in Europe. First, we reflect on the history of policy evaluation in Europe, by distinguishing between two ‘waves of evaluation’: the countries in Northwestern Europe that have conducted evaluations since the 1960s and the countries in the rest of Europe for which evaluation is a more recent phenomenon. Next, to illustrate the two waves of evaluation, we zoom in on three political systems that represent the national, regional, and international level in Europe: the United Kingdom (UK), Flanders (Belgium), and the EU. For each system, we map evaluation culture and capacity by analyzing six indicators. The chapter concludes with a reflection on current trends in evaluation research and possibilities for future research.
This is a preview of subscription content, log in via an institution to check access.
References
Bachtler, J., & Wren, C. (2006). The evaluation of EU cohesion policy: Research questions and policy challenges. Regional Studies, 40, 143–153.
Bourgeois, G. (2008). Mededeling aan de Vlaamse Regering van 8 September 2008 betreffende de evaluatie van de toepassing van de reguleringsimpactanalyse (RIA) en van de compensatieregel voor administratieve lasten—uitvoering van de regeringsbeslissing van 15 December 2006. VR 2008 1909 MED.0421.
Brans, M., & Vancoppenolle, D. (2005). Policy-making reforms and civil service: An exploration of agendas and consequences. In M. Painter & J. Pierre (Eds.), Challenges to state policy capacity: Global trends and comparative perspectives (pp. 164–184). Basingstoke: Palgrave Macmillan.
Brazier, A., & Fox, R. (2011). Reviewing select committee tasks and modes of operation. Parliamentary Affairs, 64, 354–369.
Bussmann, W. (2010). Evaluation of legislation: Skating on thin ice. Evaluation, 16, 279–293.
Cullen, A. E., Coryn, C. L., & Rugh, J. (2011). The politics and consequences of including stakeholders in international development evaluation. American Journal of Evaluation, 32, 345–361.
Dahler-Larsen, P. (2012). The evaluation society. Stanford: University Press.
De Peuter, B., & Pattyn, V. (2009). Evaluation capacity: enabler or exponent of evaluation culture? In A. Fouquet & L. Méasson (Eds.), L’évaluation des politiques publiques en Europe: Cultures et Futurs Policy and programme evaluation in Europe: Cultures and Prospects (pp. 133–142). Paris: l’Harmattan.
Derlien, H., & Rist, R. C. (2002). Conclusion: Policy evaluation in international comparison. In J .-E. Furubo, C. Rayand, & R. Sandahl (Eds.), International atlas of evaluation (pp. 439–455). New Brunswick: Transaction.
Dunlop, C. A. (2010). The temporal dimension of knowledge and the limits of policy appraisal. Policy Sciences, 43, 343–363.
European Commission. (2015). Better regulation toolbox [complement to SWD(2015)111]. Brussels: European Commission.
European Court of Auditors. (2010). Impact assessments in the EU institutions: Do they support decision-making? (Special report No. 3). Luxembourg: European Court of Auditors.
Fitzpatrick, T. (2012). Evaluating legislation: An alternative approach for evaluating EU internal market and services law. Evaluation, 18, 477–499.
Furubo, J. -E., & Sandahl, R. (2002). Introduction: A diffusion perspective on global developments in evaluation. In J. -E. Furubo, R. C. Rist, & R. Sandahl (Eds.), The international atlas of evaluation (pp. 1–23). New Brunswick: Transaction.
Giddens, A. (1998). The third way. Oxford: Polity Press.
Gray, A., & Jenkins, B. (2002). Policy and program evaluation in the United Kingdom: A Reflective state. In J. -E. Furubo, R. C. Rist, & R. Sandahl (Eds.), International atlas of evaluation: Comparative policy evaluation, 9. New Brunswick: Transaction. 129–153.
Henry, G. T., & Mark, M. M. (2003). Beyond use: Understanding evaluation’s influence on attitudes and actions. American Journal of Evaluation, 24, 293–314.
HM Treasury. (1988). Policy evaluation: A guide for managers. London: HMSO.
HM Treasury. (1997/2003/2011). Appraisal and evaluation in central government—The green book. London: HM Treasury.
HM Treasury. (2011). The magenta book—Guidance for evaluators. London: HM Treasury.
Højlund, S. (2015). Evaluation in the European Commission: For accountability of learning? European Journal of Risk Regulation, 1, 35–46.
Jacob, S., Speer, S., & Furubo, J.-E. (2015). The institutionalization of evaluation matters: Updating the international atlas of evaluation 10 years later. Evaluation, 21, 6–31.
John, P. (2014). Policy entrepreneurship in UK central government: The behavioural insights team and the use of randomized controlled trials. Public Policy and Administration, 29, 257–267.
Johnson, K., Greenseid, L. O., Toal, S. O., King, J. A., Lawrenz, F., & Volkov, B. (2009). Research on evaluation use: A review of the empirical literature from 1986 to 2005. American Journal of Evaluation, 30, 377–410.
Kenniscel Wetsmatiging. (2006). Richtlijnen voor de opmaak van een Regulerings Impact Analyse. Brussel: Vlaamse Overheid.
Labin, S. N., Duffy, J. L., Meyers, D. C., Wandersman, A., & Lesesne, C. A. (2012). A research synthesis of the evaluation capacity building literature. American Journal of Evaluation, 33, 307–338.
Loud, M. L. (2014). Institutionalization and evaluation culture—interplay between the one and the other. In M. L. Loud & J. Mayne (Eds.), Enhancing evaluation use: Insights from internal evaluation units (pp. 55–82). London: Sage.
Lynn, L. E. (2006). Public management: Old and new. New York: Routledge.
Mastenbroek, E., Van Voorst, S., & Meuwese, A. (2015). Closing the regulatory cycle? A meta evaluation of ex-post legislative evaluations by the European Commission. Journal of European Public Policy. Electronic publication ahead of print. http://www.tandfonline.com/eprint/kPHKRG4wwrMCsamnGbDk/full#.Vi9L0n6rTcs, (doi:10.1080/13501763.2015.1076874).
National Audit Office. (2013). Evaluation in government. London: NAO.
National Audit Office. (2015). Annual report and accounts 2014–2015. London: NAO.
Neave, G. (1988). On the cultivation of quality, efficiency and enterprise: An overview of recent trends in higher education 1986–1988. European Journal of Education, 23, 7–23.
Nielsen, S. B., Lemire, S., & Skov, M. (2011). Measuring evaluation capacity—results and implications of a Danish study. American Journal of Evaluation, 32, 324–344.
Nutley, S. (2003). Bridging the policy/research divide. Reflections and lessons from the UK. Keynote paper presented at the National Institute of Governance Conference. Australia: Canberra.
Office, Cabinet. (1999). Professional policy making for the twenty first century. London: Cabinet Office.
Parker, D. (2016). Enterprise and competition. In C. A. Dunlop & C. M. Radaelli (Eds.), Handbook of regulatory impact assessment. Cheltenham: Edward Elgar.
Pattyn, V. (2014a). Policy evaluation (in)activity unraveled. A configurational analysis of the incidence, number, locus and quality of policy evaluations in the Flemish public sector [Ph.D. Dissertation]. Leuven: KU Leuven.
Pattyn, V. (2014b). Why organisations (do not) evaluate? Explaining evaluation activity through the lens of configurational comparative methods. Evaluation: The International Journal of Theory, Research and Practice, 20, 348–367.
Pattyn, V. (2015). Explaining Variance in Policy evaluation regularity. The case of the Flemisch public sector. Public Management Review, 17, 1475–1495.
Pattyn, V., & Brans, M. (2014). Explaining organisational variety in evaluation quality assurance. Which conditions matter? International Journal of Public Administration, 37, 363–375.
Poptcheva, E. M. (2013). Library briefing. Policy and legislative evaluation in the EU. Brussels: European Parliament.
Put, V. (2005). Normen in performance audits van Rekenkamers. Een casestudy bij de Algemene Rekenkamer en het National Audit Office [Ph.D. Dissertation]. Leuven: KU Leuven.
Schwab, O. (2009). Europeanisation of German evaluation culture? On the effect of obligatory evaluation of European Union funds in Germany. In A. Fouquet & L. Méasson (Eds.), L’évaluation des politiques publiques en Europe. Cultures et futures (pp. 115–123). Paris: l′ Harmattan.
Scriven, M. 1991. Evaluation Thesaurus (4th ed.) Newbury Park, CA: Sage.
SERV (Sociaal-Economische Raad van Vlaanderen). (2015). Tien denksporen voor ex post decreetsevaluatie in en door het Vlaams Parlement. Brussel: SERV.
Shaw, J., & Campbell, R. (2013). The ‘‘Process’’ of process use: Methods for longitudinal assessment in a multisite evaluation. American journal of evaluation, 35, 250–260.
Smismans, S. (2015).Policy evaluation in the EU: The challenges of linking Ex Ante and Ex Post Appraisal. European journal of risk regulation, 6(1), 6–26.
Speer, S., Pattyn, V., & De Peuter, B. (2015). The growing role of evaluation in plarliaments: Holding governments accountable. International Review of Administrative Sciences, 81, 37–57.
Stame, N. (2008). The European project, federalism and evaluation. Evaluation, 14, 117–140.
Stephenson, P. (2015). Reconciling audit and evaluation? The shift to performance and effectiveness at the European Court of Auditors. European Journal of Risk Regulation, 1, 79–89.
Stern, E. (2009). Evaluation policy in the European Union and its institutions, in W.M.K. Trochim, M. M. Mark, & L. J. Cooksy (Eds.), Evaluation policy and evaluation practice: New directions for evaluation (pp. 67–85). San Fransisco, CA: Jossey-Bass.
Summa, H., & Toulemonde, J. (2002). Evaluation in the European Union: Addressing complexity and ambiguity. In J. Furubo, R. C. Rist, & R. Sandahl (Eds.), International atlas of evaluation (pp. 407–424). New Brunswick: Transaction.
Szanyi, M., Azzam, T., & Galen, M. (2013). Research on evaluation: A needs assessment. The Canadian Journal of Program Evaluation, 27, 39–64.
Vedung, E. (2010). Four waves of evaluation diffusion. Evaluation, 16, 263–277.
Verlet, D., Lemaître, J., & Carton, A. (2015). Beleidsevaluatie binnen de Vlaamse overheid. Een Overzicht van de resultaten uit de bevraging van de leidinggevenden. Presentatie Studiedag Vlaams Evaluatieplatform. 17/12/2015.
Weiss, C. H. (1977). Research for policy’s sake: The enlightenment function of social research. Policy Analysis, 3(4), 531–545.
Zwaan, P., Van Voorst, S., & Mastenbroek, E. (2016). Ex-post regulatory evaluation in the European Union: Questioning the use of evaluations as instruments for accountability. International Review of Administrative Sciences. doi:10.1177/0020852315598389.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Copyright information
© 2018 The Author(s)
About this chapter
Cite this chapter
Pattyn, V., van Voorst, S., Mastenbroek, E., Dunlop, C.A. (2018). Policy Evaluation in Europe. In: Ongaro, E., Van Thiel, S. (eds) The Palgrave Handbook of Public Administration and Management in Europe. Palgrave Macmillan, London. https://doi.org/10.1057/978-1-137-55269-3_30
Download citation
DOI: https://doi.org/10.1057/978-1-137-55269-3_30
Published:
Publisher Name: Palgrave Macmillan, London
Print ISBN: 978-1-137-55268-6
Online ISBN: 978-1-137-55269-3
eBook Packages: Political Science and International StudiesPolitical Science and International Studies (R0)