Abstract
While considerable evidence has accumulated on state-funded merit-based scholarships, research on the effects of specific scholarship design choices has been thin, perhaps in part because cross-state comparisons are difficult. As one of the only states to enact major changes in the design of its merit-based scholarship program, Georgia provides a unique opportunity to explore the effects of these design choices. Using student-level observations for all high school graduates in Georgia over 9 years from 2008 to 2016, the paper uses difference-in-differences analysis and regression-discontinuity design to estimate the effects of a reduction in the level of HOPE scholarship funding, and the start of a new full-tuition scholarship, on student enrollment in Georgia colleges and universities. We find that the highest-achieving students were more likely to attend Georgia public higher-education institutions after the scholarship changes than before. Students who qualified for partial-tuition HOPE scholarships beginning in 2011 were less likely to attend Georgia public 4-year institutions than those who received full-tuition HOPE scholarships before 2011, though their enrollment increased relative to students ineligible for any merit aid. We conclude with discussion of implications for the design of merit-based scholarship programs.
Similar content being viewed by others
Data Availability
The data for this project are confidential and are used by the authors under a signed Confidentiality and Data Use Agreement with the Governor's Office of Student Achievement (GOSA). Release of the data to a third party is prohibited unless permission is specifically granted by GOSA in writing.
Notes
Private college scholarships were originally $1000 but increased to $3000 in 1995.
For example, the Zell Miller scholarship amount for 15 credit hours in Georgia’s research universities (Georgia Institute of Technology, Georgia State University, University of Georgia) was $3641 in 2011–2012, and the HOPE amount was $3181.50. The difference is $459.50, which indicates about a 13 percent gap between tuition and HOPE awards. The 13 percent gap was constant across the University System of Georgia’s institution, according to the Georgia Student Finance Commission’s award information in the 2012 academic year (https://apps.gsfc.org/main/publishing/pdf/common/FY2012_HOPEandZellMillerCombined.pdf.).
At the flagship institutions that most Zell Miller-eligible students attend, Georgia Tech’s fees were $1,185 and UGA’s fees were $1095 for the Fall semester of the academic year 2012 (https://www.usg.edu/fiscal_affairs/tuition_and_fees/v5-index/fiscal_year_2012).
Our baseline models use actual HOPE GPA and students’ highest ACT/SAT scores. Then, we use predicted HOPE GPA rather than actual HOPE GPA, and first ACT/SAT scores rather than highest scores, to adjust for potential scholarship-induced grade inflation and increased test-taking behavior after the 2011 changes. Details are described further below.
Scholarship eligibility is based on students’ highest test score at a single test administration.
As shown in Appendix Table 7, approximately 99 percent and 95 percent of predicted Zell Miller and HOPE scholarship recipients, respectively, actually received scholarships when using actual HOPE GPA and highest test score to measure eligibility. Using predicted HOPE GPA and first ACT/SAT test score to predict eligibility, approximately 96 percent and 80 percent of predicted recipients actually received scholarships. The table uses only students who enrolled at Georgia institutions as we only observe actual scholarship receipt for these students.
We use predicted GPA and first test scores to reduce potential bias from grade inflation or test re-taking.
These estimates come from separate multivariate regression models for each group that exclude the interaction terms from Eq. (1) and include covariates, and school and cohort fixed effects. The standard errors are clustered at the school level.
The scholarship changes were announced in March 2011 and became effective immediately, leaving 2011 high school graduates little time to adjust plans for fall enrollment.
In the pre-change period, this threshold did not exist and students above and below received the same merit-based scholarship.
In response to concerns that the retention criteria could reduce STEM majors, the university system began adding 0.5 points to students’ grades in approved STEM courses, beginning in fall 2017. Students in our sample enrolled in college before this change took effect.
References
Abraham, K. G., & Clark, M. A. (2006). Financial aid and students’ college decisions evidence from the District of Columbia Tuition Assistance Grant Program. Journal of Human Resources, 41(3), 578–610.
Angrist, J., Autor, D., Hudson, S., & Pallais, A. (2017). Evaluating post-secondary aid: Enrollment, persistence, and projected completion effects (No. w23015). National Bureau of Economic Research.
Avery, C., & Hoxby, C. M. (2004). Do and should financial aid packages affect students’ college choices? College choices: The economics of where to go, when to go, and how to pay for it (pp. 239–302). University of Chicago Press.
Becker, G. S. (2009). Human capital: A theoretical and empirical analysis, with special reference to education. University of Chicago Press.
Bettinger, E. (2015). Need-based aid and college persistence: The effects of the Ohio College Opportunity Grant. Educational Evaluation and Policy Analysis, 37(1), 102S-119S.
Borjas, G. J., & Van Ours, J. C. (2010). Labor economics. McGraw-Hill.
Britton, T. (2022). College or bust… or both: The effects of the great recession on college enrollment for black and latinx young adults. Journal of Research on Educational Effectiveness, 2022, 1–27.
Bruce, D. J., & Carruthers, C. K. (2014). Jackpot? The impact of lottery scholarships on enrollment in Tennessee. Journal of Urban Economics, 81, 30–44.
Burland, E., Dynarski, S., Michelmore, K., Owen, S., & Raghuraman, S. (2022). The Power of Certainty: Experimental Evidence on the Effective Design of Free Tuition Programs (No. w29864). National Bureau of Economic Research.
Callaway, B., & Sant’Anna, P. H. (2021). Difference-in-differences with multiple time periods. Journal of Econometrics, 225(2), 200–230.
Castleman, B. L., Long, T., Bridget, A., Chris, M., Richard, G., Josh, C., & Benjamin, L. (2014). The impact of partial and full merit scholarships on college entry and success: Evidence from the Florida Bright Futures Scholarship program. EdPolicyWorks Working Paper Series No. 17.
Center on Budget and Policy Priorities, Chart Book: The Legacy of the Great Recession. Retrieved June 6, 2019, from https://www.cbpp.org/research/economy/the-legacy-of-the-great-recession
Cohen-Vogel, L., Ingle, W. K., Levine, A. A., & Spence, M. (2008). The “spread” of merit-based college aid: Politics, policy consortia, and interstate competition. Educational Policy, 22(3), 339–362.
Conley, T. G., & Taber, C. R. (2011). Inference with "Difference in Differences" with a small number of policy changes. The Review of Economics and Statistics, 93(1), 113–125. https://www.jstor.org/stable/23015923
Cornwell, C., Mustard, D. B., & Sridhar, D. J. (2006). The enrollment effects of merit-based financial aid: Evidence from Georgia’s HOPE Program. Journal of Labor Economics, 24(4), 761–786.
Cornwell, C. M., Lee, K. H., & Mustard, D. B. (2005). Student responses to merit scholarship retention rules. Journal of Human Resources, 40(4), 895–917.
Darolia, R., Roedel, C., Martorell, P., Wilson, K., & Perez-Arce, F. (2015). Do employers prefer workers who attend for-profit colleges? Evidence from a field experiment. Journal of Policy Analysis and Management, 34(4), 881–903.
Dee, T. S., & Jackson, L. A. (1999). Who loses HOPE? Attrition from Georgia’s college scholarship program. Southern Economic Journal, 66, 379–390.
Deming, D. J., Goldin, C., & Katz, L. F. (2012). The for-profit postsecondary school sector: Nimble critters or agile predators? Journal of Economic Perspectives, 26(1), 139–164.
Dynarski, S. (2000). Hope for whom? Financial aid for the middle class and its impact on college attendance. National Tax Journal, 53(3), 629–661.
Dynarski, S. (2002). The behavioral and distributional implications of aid for college. American Economic Review, 92(2), 279–285.
Dynarski, S. (2003). Does aid matter? Measuring the effect of student aid on college attendance and completion. American Economic Review, 93(1), 279–288.
Dynarski, S. (2004). The new merit aid. College choices: The economics of where to go, when to go, and how to pay for it, 63–100.
Dynarski, S. (2008). Building the stock of college-educated labor. Journal of Human Resources, 43(3), 576–610.
Education Commission of the States (2021). 50-State Comparison: Need- and Merit-Based Financial Aid 2021. https://reports.ecs.org/comparisons/need--and-merit-based-financial-aid-2021-01. Accessed December 3, 2022.
Fernandez, F.J. and Hu, X. (2022). Do state merit-based financial aid programs support the American dream? Scholars Strategy Network. https://scholars.org/contribution/do-state-merit-based-financial-aid-programs
Goodman, J. (2008). Who merits financial aid?: Massachusetts’ Adams Scholarship. Journal of Public Economics, 92(10–11), 2121–2131. https://doi.org/10.1016/j.jpubeco.2008.03.009
Goodman-Bacon, A. (2021). Difference-in-differences with variation in treatment timing. Journal of Econometrics, 225(2), 254–277.
Henry, G. T., & Rubenstein, R. (2002). Paying for grades: Impact of merit-based financial aid on educational quality. Journal of Policy Analysis and Management, 21(1), 93–109.
Henry, G. T., Rubenstein, R., & Bugler, D. T. (2004). Is HOPE enough? Impacts of receiving and losing merit-based financial aid. Educational Policy, 18(5), 686–709. https://doi.org/10.1177/0895904804269098
Jaeger, D. A., & Page, M. E. (1996). Degrees matter: New evidence on sheepskin effects in the returns to education. The Review of Economics and Statistics, 78, 733–740.
Jones, T. R., Kreisman, D., Rubenstein, R., Searcy, C., & Bhatt, R. (2022). The effects of financial aid loss on persistence and graduation: A multi-dimensional regression discontinuity approach. Education Finance and Policy, 17(2), 206–231.
Kahneman, D., & Tversky, A. (1979). Prospect theory: An analysis of decision under risk. Econometrica, 47(2), 263–291.
Kahneman, D., & Tversky, A. (1984). Choices, values, and frames. American Psychologist, 39(4), 341–350.
Kane, T. J. (2007). Evaluating the impact of the DC tuition assistance grant program. Journal of Human Resources, 42(3), 555–582.
Long, B. T. (2014). The financial crisis and college enrollment: How have students and their families responded? How the financial crisis and Great Recession affected higher education (pp. 209–233). University of Chicago Press.
Manski, C. F. (1993). Adolescent econometricians: How do youth infer the returns to schooling. Studies of Supply and Demand in Higher Education, 43, 60.
Paul, J. D., Cheng, A., Greene, J. P., & McGee, J. B. (2021). The Value of College Athletics in the Labor Market: Results from a Resume Audit Field Experiment. Education Reform Faculty and Graduate Students Publications. https://scholarworks.uark.edu/edrepub/123
Rauschenberg, S & Chalasani, K. (2017). Georgia dual enrollment and postsecondary outcomes. https://gosa.georgia.gov/georgia-dual-enrollment-and-postsecondary-outcomes
Ribar, D. C., & Rubenstein, R. (2021). Dynamics of Merit-Based Scholarships in Georgia. GPL Reports, 8. https://scholarworks.gsu.edu/gpl_reports/8
Roth, J., Sant'Anna, P. H., Bilinski, A., & Poe, J. (2022). What's trending in difference-in-differences? A synthesis of the recent econometrics literature. arXiv preprint arXiv:2201.01194
Scott-Clayton, J. (2011). On money and motivation a quasi-experimental analysis of financial incentives for college achievement. Journal of Human Resources, 46(3), 614–646.
Sjoquist, D. L., & Winters, J. V. (2013). The effects of HOPE on post-college retention in the Georgia workforce. Regional Science and Urban Economics, 43(3), 479–490. https://doi.org/10.1016/j.regsciurbeco.2013.02.003
Sjoquist, D. L., & Winters, J. V. (2015). State merit aid programs and college major: A focus on STEM. Journal of Labor Economics, 33(4), 973–1006. https://doi.org/10.1086/681108
Spence, M. (1973). Job market signaling. Quarterly Journal of Economics, 87, 355–374.
United States Bureau of Labor Statistics (2023). Local Area Unemployment Statistics. extracted January 2023 at https://data.bls.gov/timeseries/LASST130000000000003?amp%253bdata_tool=XGtable&output_view=data&include_graphs=true
United States Census Bureau (2021). Georgia among top five population gainers last decade. https://www.census.gov/library/stories/state-by-state/georgia-population-change-between-census-decade.html
Zhang, L. A., & Ness, E. C. (2010). Does state merit-based aid stem brain drain? Educational Evaluation and Policy Analysis, 32(2), 143–165. https://doi.org/10.3102/0162373709359683
Acknowledgements
The contents of this report were developed using data provided by Georgia’s Academic and Workforce Analysis and Research Data System (GA·AWARDS). However, those contents do not necessarily represent the policy of GA·AWARDS or any of its participating organizations, and you should not assume endorsement by GA·AWARDS or any of its participating organizations.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of Interest
All authors declare that they have no conflicts of interest in conducting this research.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
The views expressed in this paper are the authors′ and should not be interpreted as those of the New York City Independent Budget Office.
Appendix
Appendix
See Table 7.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Song, Y., Rubenstein, R. How Does Reducing Merit-Aid Generosity and Certainty Affect College Choices? Evidence from Georgia’s HOPE Scholarship. Res High Educ 65, 1–41 (2024). https://doi.org/10.1007/s11162-023-09747-6
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11162-023-09747-6