Abstract
Despite being criticized as unrepresentative and misleading, retention and graduation rates are an important part of college-search web sites and accountability systems, and they frequently have been used as indicators of institutional quality and effectiveness in educational research. Retention and graduation rates are often compared over time and across institutions. However, such comparisons can be confounded by differences in entering student cohorts and differences among the institutions being compared. This research examined the effects of institutional and cohort characteristics on one-year retention rates using random-effect and fixed-effect regression models for panel data. The use of a fixed-effect model allowed the researchers to account for omitted variables (unobserved heterogeneity) in the analyses. Results indicated that unobserved heterogeneity was a significant issue in the study, and that traditional regression methods may overstate the effects of institutional characteristics on retention rates. Results also indicated that the effects of institutional and cohort characteristics were essentially stable over time and across cohorts.

Similar content being viewed by others
Notes
Race/ethnicity was reported using seven categories prior to 2007 (Black, Non-Hispanic, Hispanic, Asian or Pacific Islander, American Indiana or Alaska Native, White, Non-Hispanic, nonresident Alien, and Unknown/Other), and nine categories after 2010 (Black or African American, Hispanic or Latino, Asian, American Indian or Alaska Native, White, Nonresident Alien, Native Hawaiian or Other Pacific Islander, Unknown/Other Ethnicity, or Multi-racial). Institutions submitting data in 2008 and 2009 were encouraged to use old definitions, but were permitted to use new definitions if a decision had been made at their institution to change reporting practices before new definitions became effective in 2010 (Consortium for Student Retention Data Exchange 2014).
References
Adelman, C. (2007). Making graduation rates matter. Inside Higher Education. Retrieved February 3, 2012 from http://www.insidehighered.com/views/2007/03/12/adelman.
Allison, P. D. (2009). Fixed effect regression models (Sage University Paper Series on Quantitative Applications in the Social Sciences, No. 07-160). Los Angeles, CA: Sage.
Allison, P. D. (2010). Survival analysis using SAS: A practical guide (2nd ed.). Cary, NC: SAS Institute.
American College Testing (2008). ACT-SAT concordance. Iowa City, IA: American College Testing. Retrieved from http://www.act.org/aap/concordance/pdf/reference.pdf.
Anderson, N., & Rucker, P. (2013). Obama proposes college-rating system that could increase affordability. Washington Post. Retrieved August 22, 2013 from http://www.washingtonpost.com/politics/obama-to-propose-college-ranking-system-that-could-increase-affordability/2013/08/22/73e674c0-0b17-11e3-b87c-476db8ac34cd_story.html.
Astin, A. W. (1993). What matters in college: Four critical years revisited. San Francisco: Jossey-Bass.
Astin, A. W. (1997). How “good” is your institution’s retention rate? Research in Higher Education, 38, 647–658.
Astin, A. W., & Oseguera, L. (2012). Pre-college and institutional influences on degree attainment. In A. Seidman (Ed.), College student retention: Formula for student success (2nd ed., pp. 119–146). Lanham, MD: Rowan & Littlefield.
Bailey, T., Calcagno, J. C., Jenkins, D., Leinbach, T., & Kienzl, G. (2006). Is student-right-to-know all you should know? An analysis of community college graduation rates. Research in Higher Education, 47, 491–519.
Black, D. A., & Smith, J. A. (2004). How robust is the evidence on the effects of college quality? Evidence from matching. Journal of Econometrics, 121, 99–124.
Black, D. A., & Smith, J. A. (2006). Estimating the returns to college quality with multiple proxies for quality. Journal of Labor Economics, 24, 701–728.
Carey, K., & Aldeman, C. (2008). Ready to assemble: A model state higher education accountability system. Washington DC: Education Sector.
Consortium for Student Retention Data Exchange (2009). About CSRDE. Retrieved from http://csrde.ou.edu/web/consortium.html.
Consortium for Student Retention Data Exchange. (2014). Definitions: 2013-14 CSRDE Retention Study. Normal, OK: Consortium for Student Retention Data Exchange.
DeAngelo, L., Franke, R., Hurtado, S., Pryor, J. H., & Tran, S. (2011). Completing college: Assessing graduation rates at four-year institutions. Los Angeles: Higher Education Research Institute at UCLA.
DesJardins, S. L. (2003). Even history methods: Conceptual issues and an application to student departure from college. In J. C. Smart (Ed.), Higher education: Handbook of theory and research (Vol. 18, pp. 421–471). Dordrecht: Kluwer.
Dey, E. L., & Astin, A. W. (1993). Statistical alternatives for studying college student retention: A comparative analysis of logit, probit, and linear regression. Research in Higher Education, 34, 569–581.
Education Trust (2009). College results online. Retrieved from http://www.collegeresults.org/.
Gansmer-Topf, A. M., & Schuh, J. H. (2006). Institutional selectivity and institutional expenditures: Examining organizational factors that contribute to retention and graduation. Research in Higher Education, 47, 613–642.
Hauptman, A. M. (2011). Increasing higher education attainment in the United States: Challenges and opportunities. Paper Presented at the American Enterprise Conference “Degrees of Difficulty: Can American Higher Education Regain its Edge?” Washington, D.C. Retrieved from http://www.aei.org/event/1003-46.
Hausman, J. A. (1978). Specification tests in econometrics. Econometrica, 46, 1251–1271.
Hosch, B. J. (2008). Institutional and student characteristics that predict graduation and retention rates. Paper presented at the annual meeting of the North East Association for Institutional Research, Providence, RI.
Jaquette, O., & Parra, E. E. (2014). Using IPEDS for panel analyses: Core concepts, data challenges, and empirical applications. In M. B. Paulsen (Ed.), Higher education: Handbook of theory and research (Vol. 29, pp. 467–534). Dordrecht: Springer.
Longden, B. (2006). An institutional response to changing student expectations and their impact on retention rates. Journal of Higher Education Policy and Management, 28, 173–187.
National Center for Education Statistics. (2012). About IPEDS. Retrieved from http://nces.ed.gov/ipeds/about/.
National Center for Education Statistics. (2014). College navigator. Retrieved from http://nces.ed.gov/collegenavigator/.
National Center for Higher Education Management Systems. (2013). Retention rates—first-time college freshmen returning their second year: Four-year total—2010. Retrieved from http://www.higheredinfo.org/dbrowser/index.php?measure=92.
National Center for Public Policy and Higher Education. (2002). The different dimensions of transfer. Retrieved February 3, 2012 from http://www.highereducation.org/reports/transfer/transfer5.shtml.
U. S. News and World Report. (2012). How U. S. News calculates its best college rankings? Retrieved from http://www.usnews.com/education/best-colleges/articles/2012/09/11/how-us-news-calculates-its-best-colleges-rankings.
Pell Institute for the Study of Opportunity in Higher Education. (2013). Actual versus predicted institutional graduation rates 2013. Postsecondary Education Opportunity (No. 257), pp. 1–16.
Pike, G. R. (2013). NSSE benchmarks and institutional outcomes: A note on the importance of considering the intended uses of a measure in validity studies. Research in Higher Education, 54, 149–170.
Pike, G. R., Hansen, M. J., & Childress, J. E. (2014). The influences of students’ pre-college characteristics, high school experiences, college expectations, and initial enrollment characteristics on degree attainment. Journal of College Student Retention, 16, 1–23.
Rosenthal, R., & Rosnow, R. L. (1991). Essentials of behavioral research: Methods and data analysis (2nd ed.). Boston, MA: McGraw-Hill.
Ryan, J. F. (2004). The relationship between institutional expenditures and degree attainment at baccalaureate colleges. Research in Higher Education, 45, 97–113.
Scott, M., Bailey, T., & Kienzl, G. (2006). Relative success? Determinants of college graduation rates in public and private colleges in the U.S. Research in Higher Education, 47, 249–279.
Sheehy, K. (2013). Colleges skeptical of Obama’s proposed ratings. U. S. News and World Report. Retrieved from http://www.usnews.com/education/best-colleges/articles/2013/11/13/colleges-skeptical-of-obamas-proposed-ratings.
Singer, J. D., & Willett, J. B. (2003). Applied longitudinal data analysis: Modeling change and event occurrence. New York: Oxford University Press.
StataCorp, (2013). Longitudinal data/panel data. College Station, TX: StataCorp.
Teachman, J. (2011). Modeling repeatable events using discrete-time data: Predicting marital dissolution. Journal of Marriage and Family, 73, 525–540.
U. S. Department of Education. (2014) College ratings and paying for performance. Washington, D.C.: U. S. Department of Education. Retrieved from http://www.ed.gov/college-affordability/college-ratings-and-paying-performance.
Villella, E. F. (1986). The environmental factors influencing attrition. Journal of General Education, 38, 221–231.
Voluntary System of Accountability. (2011). College portrait of undergraduate education. Retrieved from http://www.collegeportraits.org/.
Webber, D. A., & Ehrenberg, R. G. (2010). Do expenditures other than instruction affect graduation and persistence rates in American higher education? (Working Paper 121). Ithaca, NY: Cornell University Higher Education Research Institute.
White House Office of the Press Secretary. (2013). Fact sheet on the President’s plan to make college more affordable: A better bargain for the middle class. Washington, D.C.: White House Office of the Press Secretary. Retrieved from http://www.whitehouse.gov/the-press-office/2013/08/22/fact-sheet-president-s-plan-make-college-more-affordable-better-bargain-.
Acknowledgments
The authors wish to thank the staff members of the Consortium for Student Retention Data Exchange for providing the data used in this study.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Pike, G.R., Graunke, S.S. Examining the Effects of Institutional and Cohort Characteristics on Retention Rates. Res High Educ 56, 146–165 (2015). https://doi.org/10.1007/s11162-014-9360-9
Received:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11162-014-9360-9

