Skip to main content

Policy Outcomes and Effects in Higher Education

  • Living reference work entry
  • First Online:
  • 121 Accesses

Synonyms

Impact

Definition

Outcome refers to changes resulting from a certain action (such as a policy decision).

Introduction

Evaluation of the outcomes and effects attributable to policy-making processes and their resulting policies has long been part and parcel of higher education practice and scholarship. The variety of contributions on the theme is overwhelming and makes the study of policy outcomes and effects in higher education an empirically complex undertaking, both in methodology and in concepts. Aiming to deconstruct the complexity, this entry opens with a clarification of major terms and contexts relevant to the problematic. Terminological clarification is followed by presentation of major conceptual premises and the methodological challenges associated with the evaluation of impacts. Three challenges – causality, isolation of net effects, and utility in complex environments – are discussed in some detail, leading into a concluding outline of an agenda for future research....

This is a preview of subscription content, log in via an institution.

References

  • Arbo, P., and P. Benneworth. 2007. Understanding a regional contribution of higher education institutions: A literature review. OECD Education Working Paper No. 9, Paris.

    Google Scholar 

  • Bamberger, Michael. 2012. Introduction to mixed methods in impact evaluation. Impact Evaluation Notes 3: 1–38.

    Google Scholar 

  • Bjurulf, Staffan, Evert Vedung, and C.G. Larsson. 2013. A triangulation approach to impact evaluation. Evaluation 19 (1): 56–73.

    Article  Google Scholar 

  • Bledsoe, Katrina L., and James A. Graham. 2005. The use of multiple evaluation approaches in program evaluation. American Journal of Evaluation 26 (3): 302–319.

    Article  Google Scholar 

  • Brennan, John, and Ulrich Teichler. 2008. The future of higher education and of higher education research. Higher Education 56 (3): 259–264.

    Article  Google Scholar 

  • Cummings, Rick. 2006. ‘What If’: The counterfactual in program evaluation. Evaluation Journal of Australasia 6 (2): 6–15.

    Article  Google Scholar 

  • Dowe, Phil. 1992a. Wesley Salmon’s process theory of causality and the conserved quantity theory. Philosophy of Science 59 (2): 195–216.

    Article  Google Scholar 

  • Dowe, Phil. 1992b. Process causality and asymmetry. Erkenntnis 37 (2): 179–196.

    Article  Google Scholar 

  • Freitag, Markus, and Raphaela Schlicht. 2009. Educational federalism in Germany: Foundations of social inequality in education. Governance 22 (1): 47–72.

    Article  Google Scholar 

  • Hill, Michael. 2005. The public policy process. 4th ed. London: Pearson.

    Google Scholar 

  • Leiber, Theodor. 2014. Evaluation of the success or failure of quality assurance in higher education institutions: Methodology and design. Journal of the European Higher Education Area 4 (2): 39–74.

    Google Scholar 

  • Leiber, Theodor, Bjørn Stensaker, and Lee Harvey. 2015. Impact evaluation of quality assurance in higher education: Methodology and causal designs. Quality in Higher Education 21 (3): 288–311.

    Article  Google Scholar 

  • Lewis, David. 1973a. Counterfactuals. Vol. 70. Oxford: Blackwell Publishers.

    Google Scholar 

  • Lewis, David. 1973b. Causation. Journal of Philosophy 70 (17): 556–567.

    Article  Google Scholar 

  • Mackie, John L. 1974. The cement of the universe: A study of causation. Oxford: Clarendon Press.

    Google Scholar 

  • Maxwell, Joseph A. 2004. Using qualitative methods for causal explanation. Field Methods 16 (3): 243–264.

    Article  Google Scholar 

  • Pawson, Ray, and Nick Tilley. 1997. Realistic evaluation. London: SAGE Publications.

    Google Scholar 

  • Przeworski, Adam, and Henry Teune. 1982. The logic of comparative social inquiry. Malabar: R.E. Krieger Pub. Co.

    Google Scholar 

  • Reichenbach, Hans. 1956. The direction of time. Berkeley: University of California Press.

    Google Scholar 

  • Reiss, J. 2009. Causation in the social sciences: Evidence, inference, and purpose. Philosophy of the Social Sciences 39 (1): 20–40.

    Article  Google Scholar 

  • Rihoux, Benoît, and Heike M. Grimm, eds. 2006. Innovative comparative methods for policy analysis: Beyond the quantitative–qualitative divide. New York: Springer.

    Google Scholar 

  • Rossi, Peter H., Mark W. Lipsey, and Howard E. Freeman. 2004. Evaluation: A systematic approach. 7th ed. Thousand Oaks: Sage.

    Google Scholar 

  • Salmon, Wesley C. 1994. Causality without counterfactuals. Philosophy of Science 61 (2): 297–312.

    Article  Google Scholar 

  • Steel, Daniel. 2011. Causality, causal models, and social mechanisms. In The SAGE handbook of the philosophy of social sciences, ed. Ian C. Jarvie and Jesus Zamora-Bonilla, 288–304. Thousand Oaks: SAGE Publications.

    Chapter  Google Scholar 

  • Stensaker, Bjørn. 2003. Trance, transparency and transformation: The impact of external quality monitoring on higher education. Quality in Higher Education 9 (2): 151–159.

    Article  Google Scholar 

  • Suppes, Patrick. 1970. A probabilistic theory of causality. Amsterdam: North-Holland Publishing Company.

    Google Scholar 

  • Teichler, Ulrich. 2005. Research on higher education in Europe. European Journal of Education 40 (4): 447–469.

    Article  Google Scholar 

  • Tight, Malcolm. 2004. Higher education research: An A-theoretical community of practice? Higher Education Research and Development 23 (4): 395–411.

    Article  Google Scholar 

  • Tight, Malcolm. 2014. Discipline and theory in higher education research. Research Papers in Education 29 (1): 93–110.

    Article  Google Scholar 

  • van der Knaap, Leontien M., Frans L. Leeuw, Stefan Bogaerts, and Laura T.J. Nijssen. 2008. Combining Campbell standards and the realist evaluation approach: The best of two worlds? American Journal of Evaluation 29 (1): 48–57.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jan Kohoutek .

Section Editor information

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer Science+Business Media Dordrecht

About this entry

Check for updates. Verify currency and authenticity via CrossMark

Cite this entry

Kohoutek, J., Nekola, M. (2018). Policy Outcomes and Effects in Higher Education. In: Encyclopedia of International Higher Education Systems and Institutions. Springer, Dordrecht. https://doi.org/10.1007/978-94-017-9553-1_139-1

Download citation

  • DOI: https://doi.org/10.1007/978-94-017-9553-1_139-1

  • Received:

  • Accepted:

  • Published:

  • Publisher Name: Springer, Dordrecht

  • Print ISBN: 978-94-017-9553-1

  • Online ISBN: 978-94-017-9553-1

  • eBook Packages: Springer Reference EducationReference Module Humanities and Social SciencesReference Module Education

Publish with us

Policies and ethics