How to Increase PhD Completion Rates? An Impact Evaluation of Two Reforms in a Selective Graduate School, 1976–2012
- 1.2k Downloads
Graduate and doctoral schools around the world struggle to shorten the long time to degree and to prevent high dropout rates. While most of previous research studied individual determinants of PhD completion, we analyze the impact of two structural reforms of the doctoral program on thesis completion at a selective European graduate school. Exploiting a unique PhD dataset covering 30 entry cohorts, we identify reform effects on PhD outcomes using an interrupted time-series regression design. We find that the first reform improved timely completion rates by between 10 and 15 percentage points (according to the specific outcome), whereas the second reform increased completion rates by between 9 and 20 percentage points. Additionally, each reform reduced dropout rates by 7 percentage points. The results are robust to various sensitivity checks. At the end, we discuss lessons learned for those in charge of graduate schools and/or PhD programs.
KeywordsDoctoral program Time-to-degree Attrition Dropout Interrupted time-series analysis
We would like to thank the European University Institute for providing us with the data and Ken Hulley for precious guidance on the information contained in the dataset. We would like to thank the participants to our seminar at the EUI’s Economics Department (2015) and at the COMPIE Conference at the Catholic University of Milan (2016) for useful comments. We would also like to express our gratitude to Hans-Peter Blossfeld, Andrea Ichino, Michael Grätz, Hannes Kröger, Loris Vergolini, and Nadir Zanini, as well as two reviewers who provided stimulating remarks on a previous version of this article. All remaining errors are our own.
- Ballarino, G., & Colombo, S. (2010). Occupational outcomes of PhD graduates in Northern Italy. Italian Journal of Sociology of Education, 2(2), 149–171.Google Scholar
- Baum, C. F., & Schafer, M. E. (2013). actest: Stata module to perform Cumby-Huizinga general test for autocorrelation in time series. Statistical Software Components s457668, Boston College Department of Economics. http://ideas.repec.org/c/boc/bocode/s457668.html.
- Bernal, J. L., Cummins, S., & Gasparrini, A. (2017). Interrupted time series regression for the evaluation of public health interventions: A tutorial. International Journal of Epidemiology, 46(1), 348–355.Google Scholar
- Bowen, W. G., & Rudenstine, N. L. (1992). In pursuit of the Ph.D. Princeton, NJ: Princeton University Press.Google Scholar
- Byrne, J., Jørgensen, T., & Loukkola, T. (2013). Quality assurance in doctoral education—results of the ARDE project. Brussels: European University Association.Google Scholar
- Council of Graduate Schools. (2010). Ph.D. completion and attrition: Policies and practices to promote student success. Washington DC: CGS.Google Scholar
- Ehrenberg, R. G., Jakubson, G. H., Groen, J. A., So, E., & Price, J. (2007). Inside the black box of doctoral education: What program characteristics influence doctoral students’ attrition and graduation probabilities? Educational Evaluation and Policy Analysis, 29(2), 134–150.CrossRefGoogle Scholar
- Frasier, H. (2013). An analysis of institutional characteristics that contribute to extended time to doctoral degree. Unpublished doctoral dissertation, University of Maryland, College Park.Google Scholar
- Gelman, A., & Imbens, G. (2014). Why high-order polynomials should not be used in regression discontinuity designs. NBER Working Paper No. 20405. doi: 10.3386/w20405.
- Gottman, J. M. (1981). Time-series analysis. A comprehensive introduction for social scientists. New York: Cambridge University Press.Google Scholar
- Groen, J. A. (2012). Time to the doctorate and labor demand for new PhD recipients. Cornell Higher Education Research Institute, mimeo.Google Scholar
- Hansen, W. L. (1990). Educating and training new economics PhDs: How good a job are we doing? American Economic Review, 80(2), 437–450.Google Scholar
- Linden, A. (2015). Conducting interrupted time-series analysis for single-and multiple-group comparisons. Stata Journal, 15(2), 480–500.Google Scholar
- Linden, A. (2017). A comprehensive set of postestimation measures to enrich interrupted time-series analysis. Stata Journal, 17(1), 73–88.Google Scholar
- Lovitts, B. E. (2001). Leaving the ivory tower: The causes and consequences of departure from doctoral study. Lanham: Rowman & Littlefield.Google Scholar
- National Science Foundation. (2013). Doctorate Recipients from U.S. Universities 2012. Special Report NSF 14-305. Arlington, VA. Retrieved September 3, 2017 from http://www.nsf.gov/statistics/sed/digest/2012.
- Price, J. (2006). Does a spouse slow you down? Marriage and graduate student outcomes. Cornell University, School of Industrial and Labor Relations site. Retrieved September 3, 2017 from http://digitalcommons.ilr.cornell.edu/workingpapers/147.
- Rodriguez-Planas, N. (2012). Longer-term impacts of mentoring, educational services, and learning incentives: Evidence from a randomized trial in the United States. American Economic Journal: Applied Economics, 4(4), 121–139.Google Scholar
- Shadish, W.R., Cook, T. D., & Campbell, D. T. (2002). Experimental and quasi-experimental designs for generalized causal inference. Wadsworth Cengage learning.Google Scholar
- Smallwood, S. (2004). Doctor dropout. The Chronicle of Higher Education, 16th January. Retrieved December, 2015.Google Scholar
- StataCorp. (2015). Stata Statistical Software: Release 14. College Station: StataCorp LP.Google Scholar
- Tinto, V. (1993). Leaving college: Rethinking the causes and cures of student attrition (Rev ed.). Chicago: University of Chicago Press.Google Scholar
- Van der Haert, M., Arias Ortiz, E., Emplit, P., Halloin, V., & Dehon, C. (2014). Are dropout and degree completion in doctoral study significantly dependent on type of financial support and field of research? Studies in Higher Education, 39(10), 1–25.Google Scholar
- Williams, R. (2012). Using the margins command to estimate and interpret adjusted predictions and marginal effects. Stata Journal, 12(2), 308–331.Google Scholar
- Zhou, E. & Okahana, H. (2016). The role of department supports on doctoral completion and time-to-degree. Journal of College Student Retention: Research, Theory & Practice. doi: 10.1177/1521025116682036