Synonyms
Definition
Outcome refers to changes resulting from a certain action (such as a policy decision).
Introduction
Evaluation of the outcomes and effects attributable to policy-making processes and their resulting policies has long been part and parcel of higher education practice and scholarship. The variety of contributions on the theme is overwhelming and makes the study of policy outcomes and effects in higher education an empirically complex undertaking, both in methodology and in concepts. Aiming to deconstruct the complexity, this entry opens with a clarification of major terms and contexts relevant to the problematic. Terminological clarification is followed by presentation of major conceptual premises and the methodological challenges associated with the evaluation of impacts. Three challenges – causality, isolation of net effects, and utility in complex environments – are discussed in some detail, leading into a concluding outline of an agenda for future research....
This is a preview of subscription content, log in via an institution.
References
Arbo, P., and P. Benneworth. 2007. Understanding a regional contribution of higher education institutions: A literature review. OECD Education Working Paper No. 9, Paris.
Bamberger, Michael. 2012. Introduction to mixed methods in impact evaluation. Impact Evaluation Notes 3: 1–38.
Bjurulf, Staffan, Evert Vedung, and C.G. Larsson. 2013. A triangulation approach to impact evaluation. Evaluation 19 (1): 56–73.
Bledsoe, Katrina L., and James A. Graham. 2005. The use of multiple evaluation approaches in program evaluation. American Journal of Evaluation 26 (3): 302–319.
Brennan, John, and Ulrich Teichler. 2008. The future of higher education and of higher education research. Higher Education 56 (3): 259–264.
Cummings, Rick. 2006. ‘What If’: The counterfactual in program evaluation. Evaluation Journal of Australasia 6 (2): 6–15.
Dowe, Phil. 1992a. Wesley Salmon’s process theory of causality and the conserved quantity theory. Philosophy of Science 59 (2): 195–216.
Dowe, Phil. 1992b. Process causality and asymmetry. Erkenntnis 37 (2): 179–196.
Freitag, Markus, and Raphaela Schlicht. 2009. Educational federalism in Germany: Foundations of social inequality in education. Governance 22 (1): 47–72.
Hill, Michael. 2005. The public policy process. 4th ed. London: Pearson.
Leiber, Theodor. 2014. Evaluation of the success or failure of quality assurance in higher education institutions: Methodology and design. Journal of the European Higher Education Area 4 (2): 39–74.
Leiber, Theodor, Bjørn Stensaker, and Lee Harvey. 2015. Impact evaluation of quality assurance in higher education: Methodology and causal designs. Quality in Higher Education 21 (3): 288–311.
Lewis, David. 1973a. Counterfactuals. Vol. 70. Oxford: Blackwell Publishers.
Lewis, David. 1973b. Causation. Journal of Philosophy 70 (17): 556–567.
Mackie, John L. 1974. The cement of the universe: A study of causation. Oxford: Clarendon Press.
Maxwell, Joseph A. 2004. Using qualitative methods for causal explanation. Field Methods 16 (3): 243–264.
Pawson, Ray, and Nick Tilley. 1997. Realistic evaluation. London: SAGE Publications.
Przeworski, Adam, and Henry Teune. 1982. The logic of comparative social inquiry. Malabar: R.E. Krieger Pub. Co.
Reichenbach, Hans. 1956. The direction of time. Berkeley: University of California Press.
Reiss, J. 2009. Causation in the social sciences: Evidence, inference, and purpose. Philosophy of the Social Sciences 39 (1): 20–40.
Rihoux, Benoît, and Heike M. Grimm, eds. 2006. Innovative comparative methods for policy analysis: Beyond the quantitative–qualitative divide. New York: Springer.
Rossi, Peter H., Mark W. Lipsey, and Howard E. Freeman. 2004. Evaluation: A systematic approach. 7th ed. Thousand Oaks: Sage.
Salmon, Wesley C. 1994. Causality without counterfactuals. Philosophy of Science 61 (2): 297–312.
Steel, Daniel. 2011. Causality, causal models, and social mechanisms. In The SAGE handbook of the philosophy of social sciences, ed. Ian C. Jarvie and Jesus Zamora-Bonilla, 288–304. Thousand Oaks: SAGE Publications.
Stensaker, Bjørn. 2003. Trance, transparency and transformation: The impact of external quality monitoring on higher education. Quality in Higher Education 9 (2): 151–159.
Suppes, Patrick. 1970. A probabilistic theory of causality. Amsterdam: North-Holland Publishing Company.
Teichler, Ulrich. 2005. Research on higher education in Europe. European Journal of Education 40 (4): 447–469.
Tight, Malcolm. 2004. Higher education research: An A-theoretical community of practice? Higher Education Research and Development 23 (4): 395–411.
Tight, Malcolm. 2014. Discipline and theory in higher education research. Research Papers in Education 29 (1): 93–110.
van der Knaap, Leontien M., Frans L. Leeuw, Stefan Bogaerts, and Laura T.J. Nijssen. 2008. Combining Campbell standards and the realist evaluation approach: The best of two worlds? American Journal of Evaluation 29 (1): 48–57.
Author information
Authors and Affiliations
Corresponding author
Section Editor information
Rights and permissions
Copyright information
© 2018 Springer Science+Business Media Dordrecht
About this entry
Cite this entry
Kohoutek, J., Nekola, M. (2018). Policy Outcomes and Effects in Higher Education. In: Encyclopedia of International Higher Education Systems and Institutions. Springer, Dordrecht. https://doi.org/10.1007/978-94-017-9553-1_139-1
Download citation
DOI: https://doi.org/10.1007/978-94-017-9553-1_139-1
Received:
Accepted:
Published:
Publisher Name: Springer, Dordrecht
Print ISBN: 978-94-017-9553-1
Online ISBN: 978-94-017-9553-1
eBook Packages: Springer Reference EducationReference Module Humanities and Social SciencesReference Module Education