Abstract
Although numerous studies have examined racial/ethnic inequalities in collegiate student outcomes, serious attention to disparities in post-secondary student learning has emerged only recently. Using a national sample of 35,000 college seniors and 250 diverse institutions from the Collegiate Learning Assessment, this study investigates the role of institutional characteristics in promoting the development of higher-order cognitive skills and the equitable distribution of these skills by student racial/ethnic background. Using three-level hierarchical linear models within an analysis of covariance framework, we find that the initial academic gaps that separate African American students from their white peers widen even further during college. Although substantial academic disparities exist between Hispanic and white students at both college entry and exit, Hispanic and white students gain academic skills at statistically comparable rates. Importantly, racial/ethnic differences in cognitive development vary across institutions partly as a function of institutional characteristics. In particular, even after accounting for a host of student- and institution-level characteristics, African American/white and Hispanic/white inequalities are somewhat smaller at colleges that enroll larger proportions of non-white students. However, these benefits of increased minority enrollments are contingent upon the academic backgrounds of students’ peers, with academically weaker student enrollments in some cases negating the benefits of increased racial/ethnic diversity.
Similar content being viewed by others
Notes
The percentage of institutions in the sample that are baccalaureate, master’s, and doctoral level, are 35, 40, and 24, respectively, which mirrors the corresponding Carnegie Classifications across institutions nationwide, at 30, 41, and 27%, respectively. Thirteen percent of sample institutions are minority-serving institutions, as compared with 12% of institutions in the Carnegie Classification 2006 national dataset. The average percentage of full-time students in our sample is 81 compared to a national average of 86%. Moreover, the geographic distribution of our sample reflects the Nation’s (e.g., 14% of colleges in our sample and 12% of all colleges are located in the far west). Sample institutions are somewhat more likely to be public and not unexpectedly, have larger undergraduate student populations, on average.
The Test Validity Study (2009) provides further evidence of the CLA’s reliability, sensitivity to growth, and construct validity (Klein et al. 2009). The CLA’s psychometric properties have also been examined by a technical panel convened by the Voluntary System of Accountability, which approved the CLA for use as a learning outcomes measure for its College Portrait project. More recently, the CLA was evaluated by reviewers for the Organisation for Economic Co-operation and Development (OECD), which selected the CLA as the generic skills assessment for its Assessment of Higher Education Learning Outcomes project.
Clearly, disparities in cognitive development among Asian and other race/ethnicity students are an equally important concern. However, due to their smaller representation within the sample, our multilevel models could not support slopes-as-outcomes analyses of these racial/ethnic subgroups.
Unfortunately, the longitudinal sample is too small to support a slopes-as-outcomes multilevel approach. The longitudinal sample spans only 37 institutions (as compared to the 245 institutions in this study). Ten of the institutions in this smaller sample have within-school samples of fewer than 25 students and only five institutions have samples of more than ten African American students.
References
Allen, W. R. (1992). The color of success: African-American college student outcomes at predominantly white and historically black public colleges and universities. Harvard Educational Review, 62(1), 26–42.
Allen, W. R., Epps, E. G., & Haniff, N. Z. (Eds.). (1991). College in black and white: African American students in predominantly white and in historically black public universities. Albany: State University of New York Press.
Allison, P. D. (2002). Missing data. Thousand Oaks, CA: Sage.
Arum, R., & Roksa, J. (2008, November). Learning to reason and communicate in college: Lessons from the CLA longitudinal project. Presented at the Social Science Research Council’s conference on learning in higher education, Chicago.
Astin, A. (1993). What matters in college. San Francisco: Jossey-Bass.
Benjamin, R. (2008). The case for comparative institutional assessment of higher-order thinking skills. Change, 40(6), 50–55.
Bowen, W. G., & Bok, D. C. (1998). The shape of the river: Long-term consequences of considering race in college and university admissions. Princeton, NJ: Princeton University Press.
Chang, M., Denson, N., Saenz, V., & Misa, K. (2005). The educational benefits of sustaining cross-racial interaction among undergraduates. The Journal of Higher Education, 77(3), 430–455.
Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Erlbaum.
Dey, E. (1991, March). Community service and critical thinking: An exploratory analysis of collegiate influences. Paper presented at the meeting of the conference “Setting the agenda for an effective research strategy for combining service and learning in the 1990s,” Racine, WI.
Dorans, N. J. (1999). Correspondences between ACT and SAT I scores (College Board Report No. 99-1; ETS RR 99-2). New York: The College Board.
Educational Testing Service. (2008). Factors that can influence performance on the GRE general test 2005–2006. Princeton, NJ: Educational Testing Service.
Ewell, P. (2002). An emerging scholarship: A brief history of assessment. In T. Banta (Ed.), Building a scholarship of assessment. San Francisco, CA: Jossey-Bass.
Ewell, P. (2008a). No correlation: Musings on some myths about quality. Change, 40(6), 8–13.
Ewell, P. (2008b). Stuck on student learning. Inside Higher Ed. Retrieved November 18, 2008, from www.insidehighered.com.
Flowers, L. A., & Pascarella, E. T. (2003). Cognitive effects of college: Differences between African American and Caucasian students. Research in Higher Education, 44(1), 21–49.
Goldin, C., & Katz, L. F. (2008). The race between education and technology. Cambridge, MA: The Belknap Press of Harvard University Press.
Gurin, P., Dey, E. L., Hurtado, S., & Gurin, G. (2002). Diversity and higher education: Theory and impact on educational outcomes. Harvard Educational Review, 72(3), 330–366.
Hagedorn, L., Pascarella, E., Edison, M., Braxton, J., Nora, A., & Terenzini, P. (1999). Institutional context and the development of critical thinking: A research note. Review of Higher Education, 22, 247–263.
Hanushek, E. A., Kain, J. F., Markman, J. M., & Rivkin, S. G. (2003). Does peer ability affect student achievement? Journal of Applied Econometrics, 18, 527–544.
Hanushek, E. A., Kain, J. F., & Rivkin, S. G. (2002). New evidence about Brown v. Board of Education: The complex effects of school racial composition on achievement (Working Paper 8741). Cambridge, MA: National Bureau of Economic Research.
Klein, S. P., Kuh, G. D., Chun, M., Hamilton, L., & Shavelson, R. (2005). An approach to measuring cognitive outcomes across higher education institutions. Research in Higher Education, 46(3), 251–276.
Klein, S., Liu, O. L., Sconing, J., Bolus, R., Bridgeman, B., Kugelmass, H., Nemeth, A., Robbins, S., & Steedle, J. (2009). Test validity study report. Prepared under a grant from the fund for the improvement of postsecondary education. www.voluntarysystem.org/docs/reports/TVSReport_Final.pdf.
Koretz, D. (2008). Measuring up: What educational testing really tells us. Cambridge, MA: Harvard University Press.
Little, R. J. A., & Rubin, D. B. (1987). Statistical analysis with missing data. New York: Wiley.
Nettles, M. T., Millett, C. M., & Ready, D. D. (2003). Attacking the African American-white achievement gap on college admissions tests. In D. Ravitch (Ed.), Brookings papers on education policy (pp. 215–252). Washington, DC: Brookings Institution Press.
Pascarella, E. (1989). The development of critical thinking: Does college make a difference? Journal of College Student Development, 30(1), 19–26.
Pascarella, E. T., & Terenzini, P. T. (2005). How college affects students: A third decade of research. San Francisco: Jossey-Bass.
Planty, M., Hussar, W., Snyder, T., Kena, G., KewalRamani, A., Kemp, J., et al. (2009). The condition of education 2009 (NCES 2009-081). Washington, DC: National Center for Education Statistics, Institute of Education Sciences, U.S. Department of Education.
Raudenbush, S., & Bryk, A. (2002). Hierarchical linear models: Applications and data analysis methods (2nd ed.). Thousand Oaks, CA: Sage Publications.
Ready, D. D., & Silander, M. (2009, April). School racial composition and young children’s cognitive development: Isolating family, neighborhood, and school influences. Presented at the conference looking to the future: Legal and policy options for racially integrated education in the south and the nation, Chapel Hill, NC.
Sander, R. (2004). A systematic analysis of affirmative action in American law schools. Stanford Law Review, 57, 367–461.
Schafer, J. L. (1997). Analysis of incomplete multivariate data. London: Chapman & Hall.
Seltzer, M. (1995). Furthering our understanding of the effects of educational programs via a slopes-as-outcomes framework. Educational Evaluation and Policy Analysis, 17, 295–304.
Shavelson, R. (2007). A brief history of student learning assessment. Washington, DC: Association of American Colleges and Universities.
Shavelson, R., & Huang, L. (2003). Responding favorably to the frenzy to assess learning in higher education. Change, 35(1), 10–19.
Snijders, T. A. B., & Bosker, R. J. (1999). Multilevel analysis: An introduction to basic and advanced multilevel modeling. London: Sage Publications.
Sowell, T. (1989). Choosing a college: A guide for parents and students. New York: Harper Collins.
Stevens, M. L., Armstrong, E. A., & Arum, R. (2008). Sieve, incubator, temple, hub: Empirical and theoretical advances in the sociology of higher education. Annual Review of Sociology, 34, 127–151. doi:10.1146/annurev.soc.34.040507.134737.
Winter, D., McClelland, D., & Stewart, A. (1981). A new case for the liberal arts: Assessing institutional goals and student development. San Francisco: Jossey-Bass.
Zwick, R., & Sklar, J. C. (2005). Predicting college grades and degree completion using high school grades and SAT scores: The role of student ethnicity and first language. American Educational Research Journal, 42(3), 439–464.
Author information
Authors and Affiliations
Corresponding author
Appendix
Appendix
Rights and permissions
About this article
Cite this article
Kugelmass, H., Ready, D.D. Racial/Ethnic Disparities in Collegiate Cognitive Gains: A Multilevel Analysis of Institutional Influences on Learning and its Equitable Distribution. Res High Educ 52, 323–348 (2011). https://doi.org/10.1007/s11162-010-9200-5
Received:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11162-010-9200-5