Abstract
Variables that address student enrollment patterns (e.g., persistence, enrollment inconsistency, completed credit hours, course credit load, course completion rate, procrastination) constitute a longstanding fixture of analytical strategies in educational research, particularly research that focuses on explaining variation in academic outcomes. However, nearly all measures of enrollment patterns are handicapped by untested assumptions about a more fundamental measure, namely students’ rate of progress. In this paper, I first explain how a variety of widely used measures of enrollment patterns are inextricably linked to students’ rate of progress. I then describe a method of modeling mathematically students’ rate of progress that employs hierarchical (multilevel) discrete-time event history analysis of repeated events. I conclude with an empirical example of the application of this method in which I test several hypotheses concerning students’ rate of progress through the remedial math sequence toward the outcome of college-level math competency. In addition to the utility of the method that is proposed here, the issues discussed in this paper have important practical implications for institutional research, particularly with respect to the use of the various measures of enrollment patterns to explain variation in students’ attainment.
Similar content being viewed by others
Notes
The term persistence sometimes is treated as an abbreviation for persistence to degree attainment (e.g., Baker and Velez 1996). Although persistence and attainment are conceptually interrelated (Horn and Berger 2004), they are operationally distinct (American Council on Education 2003). Thus, I differentiate between students’ persistence and the result of persistence, which may or may not include the completion of a credential.
The terms retention, attrition, departure, and dropout can be ambiguous because they often are measured with respect to a single institution (e.g., Murtaugh et al. 1999). Yet, many students persist in their postsecondary pursuits while moving from one college to another (Adelman 1999; Bach et al. 2000; Bahr 2009; Pascarella and Terenzini 2005; Porter 2003; Rab 2004).
Explaining variation in academic attainment is the principal objective underlying research on, and the use of, measures of enrollment patterns, but it is not the only objective. Among the other objectives is managing/predicting institutional enrollment (Cabrera et al. 1993).
Explanatory value refers to the extent to which variation in a given outcome may be “explained” by its covariation with a given predictor.
In terms of the language that typically is used to describe every history analysis, the completion of these hypothetical steps may be conceptualized as a series of nonreversible (one-way) transitions in the direction of some academic outcome of interest to the researcher. For example, the transition from freshman to sophomore is a step toward the outcome of completing a postsecondary degree. Note, however, that the method of modeling rate of progress that is described here does not require that the multiple steps (or transitions) be ordered with respect to one another, so long as these steps are essentially equivalent to one another.
Note that, at the beginning of the observation period defined for this study, there were 107 distinct community colleges in California, of which 104 were semester-based. There are now 109 community colleges, of which 106 are semester-based.
Of the original cohort of 167,982 students, 47.42% did not enroll in any substantive math coursework at any time during the six-year observation period, 1.11% enrolled exclusively in vocational math coursework, and 51.47% enrolled in at least one nonvocational math course.
A “missing” first math grade is one that a college failed to report or reported as “in progress”.
References
Adelman, C. (1999). Answers in the tool box: Academic intensity, attendance patterns, and bachelor’s degree attainment. Washington, DC: Office of Educational Research and Improvement. ERIC ED431363.
Agresti, A., & Finlay, B. (1997). Statistical methods for the social sciences. Upper Saddle River, New Jersey: Prentice Hall.
Allison, P. D. (1982). Discrete-time methods for the analysis of event histories. Sociological Methodology, 13, 61–98.
Allison, P. D. (1984). Event history analysis: Regression for longitudinal event data. Thousand Oaks, California: Sage.
Allison, P. D. (1995). Survival analysis using the SAS system: A practical guide. Cary, North Carolina: SAS Institute Inc.
American Council on Education. (2003). Issue brief: Student success: Understanding graduation and persistence rates. Washington, DC: American Council on Education.
Arulampalam, W., Naylor, R. A., & Smith, J. P. (2004). A hazard model of the probability of medical school dropout in the UK. Journal of the Royal Statistical Society, Series A, 167, 157–178.
Bach, S. K., Banks, M. T., Kinnick, M. K., Ricks, M. F., Stoering, J. M., & Walleri, R. D. (2000). Student attendance patterns and performance in an urban postsecondary environment. Research in Higher Education, 41, 315–330.
Bahr, P. R. (2007). Double jeopardy: Testing the effects of multiple basic skill deficiencies on successful remediation. Research in Higher Education, 48, 695–725.
Bahr, P. R. (2008a). Does mathematics remediation work?: A comparative analysis of academic attainment among community college students. Research in Higher Education, 49, 420–450.
Bahr, P. R. (2008b). Cooling Out in the community college: What is the effect of academic advising on students’ chances of success? Research in Higher Education, 49, 704–732.
Bahr, P. R. (2009). College hopping: Exploring the occurrence, frequency, and consequences of lateral transfer. Community College Review, 36, 271–298.
Bahr, P. R. (forthcoming). Preparing the underprepared: An analysis of racial disparities in postsecondary mathematics remediation. Journal of Higher Education.
Baker, T. L., & Velez, W. (1996). Access to and opportunity in postsecondary education in the United States: A review. Sociology of Education, 69(extra issue), 82–101.
Barber, J. S., Murphy, S. A., Axinn, W. G., & Maples, J. (2000). Discrete-time multilevel hazard analysis. Sociological Methodology, 30, 201–235.
Beekhoven, S., De Jong, U., & Van Hout, H. (2002). Explaining academic progress via combining concepts of integration theory and rational choice theory. Research in Higher Education, 43, 577–600.
Beekhoven, S., De Jong, U., & Van Hout, H. (2003). Different courses, different students, same results?: An examination of differences in study progress of students in different courses. Higher Education, 46, 37–59.
Berger, J. B., & Milem, J. F. (1999). The role of student involvement and perceptions of integration in a causal model of student persistence. Research in Higher Education, 40, 641–664.
Burley, H., Butner, B., & Cejda, B. (2001). Dropout and stopout patterns among developmental education students in Texas community colleges. Community College Journal of Research and Practice, 25, 767–782.
Cabrera, A. F., Burkum, K. R., & La Nasa, S. M. (2003). Pathways to a four-year degree: Determinants of degree completion among socioeconomically disadvantaged students. Paper presented at the annual meeting of the Association for the Study of Higher Education, Portland, Oregon. ERIC ED482160.
Cabrera, A. F., Nora, A., & Castaneda, M. B. (1993). College persistence: Structural equations modeling test of an integrated model of student retention. Journal of Higher Education, 64, 123–139.
Calcagno, J. C., Crosta, P., Bailey, T., & Jenkins, D. (2007). Stepping stones to a degree: The impact of enrollment pathways and milestones on community college students outcomes. Research in Higher Education, 48, 775–801.
Cofer, J., & Somers, P. (2001). What influences student persistence at two-year colleges? Community College Review, 29, 56–76.
DesJardins, S. L., Ahlburg, D. A., & McCall, B. P. (2002). A temporal investigation of factors related to timely degree completion. Journal of Higher Education, 73, 555–581.
Fenske, R. H., Porter, J. D., & DuBrock, C. P. (2000). Tracking financial aid and persistence of women, minority, and needy students in science, engineering, and mathematics. Research in Higher Education, 41, 67–94.
Glynn, J. G., & Miller, T. E. (2002). A simplified approach to monitoring and reporting student transitions with a focus on retention and graduation rates. College & University, 78, 17–23.
Goldstein, H. (2003). Multilevel statistical models. London: Hodder Arnold.
Hagedorn, L. S., & Lester, J. (2006). Hispanic community college students and the transfer game: Strikes, misses, and grand slam experiences. Community College Journal of Research and Practice, 30, 827–853.
Hagedorn, L. S., Maxwell, W. E., Cypers, S., Moon, H. S., & Lester, J. (2007). Course shopping in urban community colleges: An analysis of student drop and add activities. Journal of Higher Education, 78, 464–485.
Horn, L., & Berger, R. (2004). College persistence on the rise?: Changes in 5-year degree completion and postsecondary persistence rates between 1994 and 2000 (NCES 2005-156). Washington, DC: National Center for Education Statistics.
Hoyt, J. E. (1999). Remedial education and student attrition. Community College Review, 27, 51–73.
Hu, S., & St. John, E. P. (2001). Student persistence in a public higher education system: Understanding racial and ethnic differences. Journal of Higher Education, 72, 265–286.
Ishitani, T. T. (2003). A longitudinal approach to assessing attrition behavior among first-generation students: Time-varying effect of pre-college characteristics. Research in Higher Education, 44, 433–449.
Jenkins, S. P. (2005). Survival analysis. Unpublished manuscript, Institute for Social and Economic Research, University of Essex, Colchester, UK. http://www.iser.essex.ac.uk/teaching/degree/stephenj/ec968/pdfs/ec968lnotesv6.pdf
Jensen, E. L. (1981). Student financial aid and persistence in college. Journal of Higher Education, 52, 280–294.
Johnson, I. Y. (2006). Analysis of stopout behavior at a public research university: The multi-spell discrete-time approach. Research in Higher Education, 47, 905–934.
Johnson, M., & Kuennen, E. (2004). Delaying developmental mathematics: The characteristics and costs. Journal of Developmental Education, 28, 24–29.
Kahn, J. H., & Nauta, M. M. (2001). Social-cognitive predictors of first-year college persistence: The importance of proximal assessment”. Research in Higher Education, 42, 633–652.
Kalamatianou, A. G., & McClean, S. (2003). The perpetual student: Modeling duration of undergraduate studies based on lifetime-type educational data. Lifetime Data Analysis, 9, 311–330.
Kreft, I., & De Leeuw, J. (1998). Introducing multilevel modeling. Thousand Oaks, California: Sage.
Leinbach, D. T., & Jenkins, D. (2008). Using longitudinal data to increase community college student success: A guide to measuring milestone and momentum point attainment. New York: Community College Research Center.
Leppel, K. (2002). Similarities and differences between the college persistence of men and women. Review of Higher Education, 25, 433–450.
Lesik, S. A. (2007). Do developmental mathematics programs have a causal impact on student retention?: An application of discrete-time survival and regression discontinuity analysis. Research in Higher Education, 48, 583–608.
Long, J. S. (1997). Regression models for categorical and limited dependent variables. Thousand Oaks, California: Sage.
Maxwell, W., Hagedorn, L. S., Cypers, S., & Moon, H. S. (2003). Course dropping and course completion: A new direction for community college student research. Paper presented at the annual meeting of the American Educational Research Association, Chicago, Illinois.
Milem, J. F., & Berger, J. B. (1997). A modified model of college student persistence: Exploring the relationship between Astin’s theory of involvement and Tinto’s theory of student departure. Journal of College Student Development, 38, 387–400.
Murtaugh, P. A., Burns, L. D., & Schuster, J. (1999). Predicting the retention of university students. Research in Higher Education, 40, 355–371.
Napoli, A. R., & Wortman, P. M. (1998). Psychosocial factors related to retention and early departure of two-year community college students. Research in Higher Education, 39, 419–455.
Okun, M. A., Benin, M., & Brandt-Williams, A. (1996). Staying in college: Moderators of the relation between intention and institutional departure. Journal of Higher Education, 67, 577–596.
O’Toole, D. M., Stratton, L. S., & Wetzel, J. N. (2003). A longitudinal analysis of the frequency of part-time enrollment and the persistence of students who enroll part-time. Research in Higher Education, 44, 519–537.
Pascarella, E. T., & Terenzini, P. T. (2005). How college affects students, volume 2: A third decade of research. San Francisco, California: Jossey-Bass.
Paulsen, M. B., & St. John, E. P. (2002). Social class and college costs: Examining the financial nexus between college choice and persistence. Journal of Higher Education, 73, 189–236.
Porter, S. R. (2003). Understanding retention outcomes: Using multiple data sources to distinguish between dropouts, stopouts, and transfer-outs. Journal of College Student Retention, 5, 53–70.
Powers, D. A., & Xie, Y. (2000). Statistical methods for categorical data analysis. San Diego, California: Academic Press.
Rab, S. Y. (2004). Swirling students: Putting a new spin on college attrition. Doctoral dissertation manuscript, University of Pennsylvania. UMI # 3125888.
Raudenbush, S. W., & Bryk, A. S. (2002). Hierarchical linear models: Applications and data analysis and methods. Thousand Oaks, California: Sage.
Robinson, R. (2004). Pathways to completion: Patterns of progression through a university degree. Higher Education, 47, 1–20.
Sandler, M. E. (2000). Career decision-making self-efficacy, perceived stress, and an integrated model of student persistence: A structural model of finances, attitudes, behavior, and career development. Research in Higher Education, 41, 537–580.
Scott, M. A., & Kennedy, B. B. (2005). Pitfalls in pathways: Some perspectives on competing risks event history analysis in education research. Journal of Educational and Behavioral Statistics, 30, 413–442.
Singer, J. D., & Willett, J. B. (1993). It’s about time: Using discrete-time survival analysis to study duration and timing of events. Journal of Educational Statistics, 18, 155–195.
Smith, D. B., & Tonidandel, S. (2003). Taking account of time: The application of event history analysis to leadership research. The Leadership Quarterly, 14, 241–256.
Stratton, L. S., O’Toole, D. M., & Wetzel, J. N. (2007). Are the factors affecting dropout behavior related to initial enrollment intensity for college undergraduates? Research in Higher Education, 48, 453–485.
Summers, M. D. (2003). ERIC review: Attrition research at community colleges. Community College Review, 30, 64–84.
Szafran, R. F. (2001). The effect of academic load on success for new college students: Is lighter better? Research in Higher Education, 42, 27–50.
Taniguchi, H., & Kaufman, G. (2005). Degree completion among nontraditional college students. Social Science Quarterly, 86, 912–927.
Titus, M. A. (2004). An examination of the influence of institutional context on student persistence at 4-year colleges and universities: A multilevel approach. Research in Higher Education, 45, 673–699.
Van Der Hulst, M., & Jansen, E. (2002). Effects of curriculum organisation on study progress in engineering studies. Higher Education, 43, 489–506.
Wang, W. (2001). Succeeding in transferable level math: The effects of procrastination and other variables. Paper presented at the annual meeting of the California Association for Institutional Research, Sacramento, California.
Willett, J. B., & Singer, J. D. (1991). From whether to when: New methods for studying student dropout and teacher attrition. Review of Educational Research, 61, 407–450.
World Almanac and Book of Facts. (2007). New York, NY: Primedia Reference, Inc.
Yamaguchi, K. (1991). Event history analysis. Thousand Oaks, California: Sage.
Acknowledgments
I am indebted to Tim Brown, Willard Hom, Myrna Huffman, Tom Nobert, Mary Kay Patton, and Patrick Perry of the California Community College Chancellor’s Office for their assistance with the data employed in this study. I thank Elisabeth Bahr for her assistance with the editing of this manuscript. Finally, I am grateful to John C. Smart and the anonymous referees of Research in Higher Education for their respective recommendations concerning improving this work. An earlier version of this paper was presented at the 2008 Forum of the Association for Institutional Research.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Bahr, P.R. Educational Attainment as Process: Using Hierarchical Discrete-Time Event History Analysis to Model Rate of Progress. Res High Educ 50, 691–714 (2009). https://doi.org/10.1007/s11162-009-9135-x
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11162-009-9135-x