Abstract
Close to two million first-year undergraduates enroll in developmental education each year. According to recent national estimates, less than half of students who start in developmental education go on to complete gateway courses and less than one-third eventually earn a degree. However, more research is needed to better assess potential relationships between developmental courses and student outcomes. This study comprehensively analyzes the effects of enrolling in and completing developmental education on associate degree completion—a key student outcome in the 2-year sector. Data for this study came from the Education Longitudinal Study of 2002 and the accompanying Postsecondary Education Transcript Study. Propensity score analysis and doubly robust techniques were used to estimate more accurate causal effects, while accounting for the non-random assignment into the treatment conditions. Furthermore, this study introduces propensity score matching for multivalued treatment conditions or dose–response analysis to the study of developmental education in order to estimate the average causal effects of enrolling in various quantities of developmental education on associate degree completion. Overall, when two groups of statistically similar students were compared, developmental education generally improved the chances of earning an associate degree. The dose–response analysis revealed that the relationship between the number of developmental courses a student takes and associate degree completion is not strictly linear.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Attewell, P., Lavin, D., Domina, T., & Levey, T. (2006). New evidence on college remediation. The Journal of Higher Education, 77(5), 886–924.
Bahr, P. R. (2007). Double jeopardy: Testing the effects of multiple basic skill deficiencies on successful remediation. Research in Higher Education, 48(6), 695–725.
Bahr, P. R. (2008). Does mathematics remediation work? A comparative analysis of academic attainment among community college students. Research in Higher Education, 49(5), 420–450.
Bahr, P. R. (2010a). Preparing the underprepared: An analysis of racial disparities in postsecondary mathematics remediation. The Journal of Higher Education, 81(2), 209–237.
Bahr, P. R. (2010b). Revisiting the efficacy of postsecondary remediation: The moderating effects of depth/breadth of deficiency. The Review of Higher Education, 33(2), 177–206.
Bangm, H., & Robins, J. M. (2005). Doubly robust estimation in missing data and causal inference models. Biometrics, 61(4), 962–973.
Bettinger, E. P., & Long, B. T. (2009). Addressing the needs of under-prepared students in higher education: Does college remediation work? Journal of Human Resources, 44(3), 736–771.
Bia, M., & Mattei, A. (2008). A Stata package for the estimation of the dose-response function through adjustment for the generalized propensity score. The Stata Journal, 8(3), 354–373.
Complete College America. (2012). Remediation: Higher education’s bridge to nowhere. http://www.completecollege.org/docs/CCA-Remediation-final.pdf. Accessed 20 June 2016.
Dehejia, R. H., & Wahba, S. (1999). Propensity score matching methods for non-experimental causal studies. Columbia University Department of Economics Discussion Paper No. 102-114.
ECS. (2012). Choosing who delivers: The impact of placing limits on the delivery of remedial education at four-year institutions. http://www.ecs.org/clearinghouse/01/02/19/10219.pdf. Accessed 15 June 2016.
Grodsky, E. (2007). Compensatory sponsorship in higher education. American Journal of Sociology, 112(6), 1662–1712.
Guardabascio, B., & Ventura, M. (2014). Estimating the dose-response function through a generalized linear model approach. The Stata Journal, 14(1), 141–158.
Hirano, K., & Imbens, G. W. (2004). The propensity score with continuous treatments. In A. Gelman & X.-L. Meng (Eds.), Applied Bayesian modeling and causal inference from incomplete-data perspectives (pp. 73–83). Hoboken, NJ: Wiley.
Hodara, M., & Jaggars, S. S. (2014). An examination of the impact of accelerating community college students’ progression through developmental education. The Journal of Higher Education, 85(2), 246–276.
Holland, P. W. (1986). Statistics and causal inference. Journal of the American Statistical Association, 81(396), 945–960.
Imbens, G. W. (2000). The role of the propensity score in estimating dose response functions. Biometrika, 87(3), 706–710.
Lue, A. (2013). States reform college remedial education. http://www.huffingtonpost.com/2013/07/25/college-remedial-ducation_n_3652650.html?. Accessed 20 June 2016.
Moss, B. G., & Yeaton, W. H. (2006). Shaping policies related to developmental education: An evaluation using the regression-discontinuity design. Educational Evaluation and Policy Analysis, 28(3), 215–229.
NCES. (2014). U.S. Department of Education, National Center for Education Statistics, 2003–2004 and 2007–2008 National Postsecondary Student Aid Study (NPSAS:04 and NPSAS:08).
Pearl, J. (2009). Causal inference in statistics: An overview. Statistics Surveys, 3, 96–146.
Ridgeway, G., McCaffrey, D., Morral, A., Burgette, L., & Griffin, B. A. (2017). Toolkit for weighting and analysis of nonequivalent groups: A tutorial for the twang package. The Comprehensive R Archive Network. Retrieved from https://cran.r-project.org/web/packages/twang/vignettes/twang.pdf.
Rosenbaum, P. R., & Rubin, D. B. (1983). The central role of the propensity score in observational studies for causal effects. Biometrika, 70(1), 41–55.
Rubin, P. R. (1974). Estimating causal effects of treatments in randomized and nonrandomized studies. Journal of Educational Psychology, 66(5), 688–701.
Rubin, D. B. (2005). Causal inference using potential outcomes. Journal of the American Statistical Association, 100(469), 322–331.
Scrivener, S., Weiss, M. J., Ratledge, AL., Rudd, T., Sommo, C., & Fresques, H. (2015). Doubling graduation rates: Three-year effects of CUNY’s Accelerated Study in Associate Programs (ASAP) for developmental education students. Retrieved from https://www.mdrc.org/sites/default/files/doubling_graduation_rates_fr.pdf
Shadish, W. R., Cook, T. D., & Campbell, D. T. (2001). Experimental and quasi-experimental designs for generalized causal inference. New York, NY: Houghton Mifflin Company.
WICHE. (2014). Remedial and developmental education. http://higheredpolicies.wiche.edu/content/policy/search?state=All&policyIssues=48&_policyIssues=on. Accessed 20 June 2016.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Turk, J.M. Estimating the Impact of Developmental Education on Associate Degree Completion: A Dose–Response Approach. Res High Educ 60, 1090–1112 (2019). https://doi.org/10.1007/s11162-019-09549-9
Received:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11162-019-09549-9