Research in Higher Education

, Volume 56, Issue 5, pp 442–470 | Cite as

Using Multiple Measures to Make Math Placement Decisions: Implications for Access and Success in Community Colleges

Article

Abstract

Community college students are often placed in developmental math courses based on the results of a single placement test. However, concerns about accurate placement have recently led states and colleges across the country to consider using other measures to inform placement decisions. While the relationships between college outcomes and such measures as high school GPA, prior math achievement, and noncognitive measures are well-known, there is little research that examines whether using these measures for course placement improves placement decisions. We provide evidence from California, where community colleges are required to use multiple measures, and examine whether this practice increases access and success in college-level courses. Using data from the Los Angeles Community College District, we find that students who were placed into higher-level math due to multiple measures (e.g., GPA and prior math background) performed no differently from their higher scoring peers in terms of passing rates and long-term credit completion. The findings suggest that community colleges can improve placement accuracy in developmental math and increase access to higher-level courses by considering multiple measures of student preparedness in their placement rules.

Keywords

Community colleges Assessment and placement Developmental math Multiple measures Validation 

References

  1. ACT Inc. (2012). ENGAGE. College user’s guide. Iowa City: ACT, Inc.Google Scholar
  2. Adelman, C. (2006). The toolbox revisited: Paths to degree completion from high school through college. Washington, D.C.: Office of Vocational and Adult Education, U.S. Department of Education.Google Scholar
  3. Allen, J., Robbins, S. B., Casillas, A., & Oh, I. S. (2008). Third-year college retention and transfer: Effects of academic performance, motivation, and social connectedness. Research in Higher Education, 49(7), 647–664.CrossRefGoogle Scholar
  4. American Educational Research Association, American Psychological Association, & National Council on Measurement in Education. (1999). Standards for educational and psychological testing. Washington, DC: AERA, APA, & NCME.Google Scholar
  5. Armstrong, W. B. (2000). The association among student success in courses, placement test scores, student background data, and instructor grading practices. Community College Journal of Research and Practice, 24(8), 681–695.CrossRefGoogle Scholar
  6. Bailey, T. (2009). Challenge and opportunity: Rethinking the role and function of developmental education in community college. New Directions for Community Colleges, 145, 11–30.CrossRefGoogle Scholar
  7. Bailey, T., Jeong, D. W., & Cho, S. W. (2010). Referral, enrollment, and completion in developmental education sequences in community colleges. Economics of Education Review, 29(2), 255–270.CrossRefGoogle Scholar
  8. Belfield, C. R., & Crosta, P. M. (2012). Predicting success in college: The importance of placement tests and high school transcripts (CCRC Working Paper No. 42). New York: Community College Research Center.Google Scholar
  9. Boylan, H. (2009). Targeted intervention for developmental education students (TIDES). Journal of Developmental Education, 32(3), 14–23.Google Scholar
  10. Burdman, P. (2012). Where to begin? The evolving role of placement exams for students starting college. Boston: Jobs for the Future.Google Scholar
  11. Cage, M. C. (1991). Cal. Community Colleges System Agrees to Change Role of Testing. The Chronicle of Higher Education, p. A21.Google Scholar
  12. California Community Colleges Chancellor’s Office. (1998). Multiple measures and other sorrows: A guide for using student assessment information with or instead of test scores. Sacramento: Author. Retrieved April 1, 2012 from http://extranet.cccco.edu/Portals/1/SSSP/Matriculation/Assessment/MultipleMeasuresAndOtherSorrowsMarch1998.pdf.
  13. California Community Colleges Chancellor’s Office. (2011). California community colleges matriculation program handbook. Sacramento: Author. Retrieved April 1, 2012 from http://extranet.cccco.edu/Portals/1/SSSP/Matriculation/MatriculationHandbookRevSeptember2011.pdf.
  14. Collins, M. L. (2008). It’s not just about the cut score: Redesigning placement assessment policies to improve student success. Boston: Jobs for the Future.Google Scholar
  15. Conley, D. T. (2007). Toward a more comprehensive conception of college readiness. Eugene: Educational Policy Improvement Center.Google Scholar
  16. DesJardins, S. L., & Lindsay, N. K. (2007). Adding a statistical wrench to the “toolbox”. Research in Higher Education, 49(2), 172–179.CrossRefGoogle Scholar
  17. Duckworth, A. L., Peterson, C., Matthews, M. D., & Kelly, D. R. (2007). Grit: Perseverance and passion for long-term goals. Journal of Personality and Social Psychology, 92(6), 1087–1101.CrossRefGoogle Scholar
  18. Duckworth, A. L., Quinn, P. D., & Tsukayama, E. (2012). What No Child Left Behind leaves behind: The roles of IQ and self-control in predicting standardized achievement test scores and report card grades. Journal of Educational Psychology, 104(2), 439–451.CrossRefGoogle Scholar
  19. Educational Testing Service (ETS). (2013). ETS Personal Potential Index: Evaluator user’s guide. Princeton: Author.Google Scholar
  20. Fain, P. (2013). Redefining college-ready. Inside HigherEd. Retrieved May 21, 2013 from http://www.insidehighered.com/news/2013/02/19/two-community-colleges-get-serious-about-working-k12.
  21. Fong, K., Melguizo, T., Bos, H., & Prather, G. (2013). A different view on how we understand progression through the developmental math trajectory. Los Angeles: Rossier School of Education, University of Southern California. Retrieved June 6, 2013 from http://www.uscrossier.org/pullias/wp-content/uploads/2013/10/Different_View_Progression_Brief.pdf.
  22. Fulton, M. (2012). Using state policies to ensure effective assessment and placement in remedial education. Denver: Education Commission of the States.Google Scholar
  23. Geiser, S., & Santelices, M. (2007). Validity of high-school grades in predicting student success beyond the freshman year: High-school record vs. standardized tests as indicators of 4-year college outcomes. Berkeley: Center for Studies in Higher Education.Google Scholar
  24. Geiser, S., & Studley, R. (2003). UC and the SAT: Predictive validity and differential impact of the SAT I and SAT II at the University of California. Educational Assessment, 8(1), 1–26.CrossRefGoogle Scholar
  25. Gerlaugh, K., Thompson, L., Boylan, H., & Davis, H. (2007). National study of developmental education II: Baseline data for community colleges. Research in Developmental Education, 20(4), 1–4.Google Scholar
  26. Hodara, M., Jaggars, S. S., & Karp, M. M. (2012). Improving developmental education assessment and placement: Lessons from community colleges across the country (CCRC Working Paper No. 51). New York: Community College Research Center.Google Scholar
  27. Hughes, K. L., & Scott-Clayton, J. (2011). Assessing developmental assessment in community colleges. Community College Review, 39(4), 327–351.Google Scholar
  28. Jaffe, L. (2012). Mathematics from high school to community college: Preparation, articulation, and college un-readiness. Paper presented at the 2012 Annual Conference of the Research and Planning Group for California Community Colleges. Retrieved October 7, 2014 from http://www.rpgroup.org/sites/default/files/Mathematics%20from%20HS%20to%20CC.pdf.
  29. Jaggars, S. S., & Hodara, M. (2013). The opposing forces that shape developmental education. Community College Journal of Research and Practice, 37(7), 575–579.CrossRefGoogle Scholar
  30. Jenkins, D., Jaggars, S. S., & Roksa, J. (2009). Promoting gatekeeper course success among community college students needing remediation: Findings and recommendations from a Virginia Study. New York: Community College Research Center. Retrieved October 7, 2014  from http://eric.ed.gov/?id=ED507824.
  31. Kane, M. T. (2006). Validation. In R. L. Brennan (Ed.), Educational measurement (4th ed., pp. 17–64). Westport: ACE/Praeger Publishers.Google Scholar
  32. Karp, M. M., & Bork, R. H. (2012). They never told me what to expect, so I didn’t know what to do: Defining and clarifying the role of a community college student (CCRC Working Paper No, 47). New York: Community College Research Center.Google Scholar
  33. Lagunoff, R., Michaels, H., Morris, P., & Yeagley, P. (2012). A framework for evaluating the technical quality of multiple measures used in California community college placement. San Francisco: WestED.Google Scholar
  34. Lewallen, W. C. (1994). Multiple measures in placement recommendations: An examination of variables related to course success. Lancaster: Antelope Valley College. (ERIC Document No. 381 186).Google Scholar
  35. Long Beach College Promise. (2013). 5-Year Progress Report (20082013): A breakthrough in student achievement. Long Beach: Author. Retrieved March 18, 2014 from http://www.longbeachcollegepromise.org/wp-content/uploads/2013/03/LBCP-5-Year-ProgressReport.pdf.
  36. Maruyama, G. (2012). Assessing college readiness: Should we be satisfied with ACT or other threshold scores? Educational Researcher, 41(7), 252–261.CrossRefGoogle Scholar
  37. Marwick, J. D. (2004). Charting a path to success: The association between institutional placement policies and the academic success of Latino students. Community College Journal of Research and Practice, 28(3), 263–280.CrossRefGoogle Scholar
  38. Mattern, K. D., & Packman, S. (2009). Predictive validity of ACCUPLACER scores for course placement: A meta-analysis (Research Report No. 2009-2). New York: College Board.Google Scholar
  39. Medhanie, A. G., Dupuis, D. N., LeBeau, B., Harwell, M. R., & Post, T. R. (2012). The role of the ACCUPLACER mathematics placement test on a student’s first college mathematics course. Educational and Psychological Measurement, 72(2), 332–351.CrossRefGoogle Scholar
  40. Melguizo, T., Bos, H., & Prather, G. (2013). Using a regression discontinuity design to estimate the impact of placement decisions in developmental math in Los Angeles Community College District (LACCD). Los Angeles: University of Southern California. Retrieved June 6, 2013 from http://www.uscrossier.org/pullias/wp-content/uploads/2013/10/Good_Placement_Decisions_Brief.pdf.
  41. Melguizo, T., Hagedorn, L. S., & Cypers, S. (2008). Remedial/developmental education and the cost of community college transfer: A Los Angeles County sample. The Review of Higher Education, 31(4), 401–431.CrossRefGoogle Scholar
  42. Melguizo, T., Kosiewicz, H., Prather, G., & Bos, H. (2014). How are community college students assessed and placed in developmental math? Grounding our understanding in reality. Journal of Higher Education, 85(5), 691–722.CrossRefGoogle Scholar
  43. Merisotis, J. P., & Phipps, R. A. (2000). Remedial education in colleges and universities: What’s really going on? The Review of Higher Education, 24(1), 67–85.CrossRefGoogle Scholar
  44. National Center for Public Policy and Higher Education & Southern Regional Education Board (NCPPHE & SREB). (2010). Beyond the rhetoric: Improving college readiness through coherent state policy. Atlanta, GA: NCPPHE. Retrieved January 6, 2013 from http://publications.sreb.org/2010/Beyond%20the%20Rhetoric.pdf.
  45. Noble, J. P., & Sawyer, R. L. (2004). Is high school GPA better than admission test scores for predicting academic success in college? College and University Journal, 79(4), 17–22.Google Scholar
  46. Perin, D. (2006). Can community colleges protect both access and standards? The problem of remediation. Teachers College Record, 108(3), 339–373.CrossRefGoogle Scholar
  47. Perry, M., Bahr, P. M., Rosin, M., & Woodward, K. M. (2010). Course-taking patterns, policies, and practices in developmental education in the California Community Colleges. Mountain View: EdSource. Retrieved October 7, 2014 from http://files.eric.ed.gov/fulltext/ED512364.pdf.
  48. Porchea, S. F., Allen, J., Robbins, S., & Phelps, R. P. (2010). Predictors of long-term enrollment and degree outcomes for community college students: Integrating academic, psychosocial, sociodemographic, and situational factors. The Journal of Higher Education, 81(6), 750–778.Google Scholar
  49. Porter, A., & Polikoff, M. (2012). Measuring academic readiness for college. Educational Policy, 26(3), 394–417.CrossRefGoogle Scholar
  50. Robbins, S. B., Allen, J., Casillas, A., Peterson, C. H., & Le, H. (2006). Unraveling the differential effects of motivational and skills, social, and self-management measures from traditional predictors of college outcomes. Journal of Educational Psychology, 98(3), 598–616.CrossRefGoogle Scholar
  51. Sawyer, R. (1996). Decision theory models for validating course placement tests. Journal of Educational Measurement, 33(3), 271–290.CrossRefGoogle Scholar
  52. Sawyer, R. (2007). Indicators of usefulness of test scores. Applied Measurement in Education, 20(3), 255–271.CrossRefGoogle Scholar
  53. Sawyer, R. (2013). Beyond correlations: Usefulness of high school GPA and test scores in making college admissions decisions. Applied Measurement in Education, 26(2), 89–112.CrossRefGoogle Scholar
  54. Scott-Clayton, J. (2012). Do high-stakes placement exams predict college success? (CCRC Working Paper No. 41). New York: Community College Research Center.Google Scholar
  55. Scott-Clayton, J., Crosta, P., & Belfield, C. (2014). Improving the targeting of treatment: Evidence from college remediation. Educational Evaluation and Policy Analysis, 36(3), 371–393.CrossRefGoogle Scholar
  56. Sedlacek, W. E. (2004). Beyond the Big Test: Noncognitive assessment in higher education. San Francisco: Jossey-Bass.Google Scholar
  57. Sommerville, J., & Yi, Y. (2002). Aligning K-12 and postsecondary expectations: State policy in transition. Washington, D.C.: National Association of System Heads.Google Scholar
  58. Texas Higher Education Coordinating Board. (2012). 2012–2017 Statewide Developmental Education Plan. Retrieved October 7, 2014 from http://www.thecb.state.tx.us/index.cfm?objectid=233A17D9-F3D3-BFAD-D5A76CDD8AADD1E3.
  59. van der Linden, W. J. (1998). A decision theory model for course placement. Journal of Educational and Behavioral Statistics, 23(1), 18–34.CrossRefGoogle Scholar
  60. Venezia, A., Bracco, K., & Nodine, T. (2010). One-shot deal? Students’ perceptions of assessment and course placement in California’s community colleges. San Francisco: WestEd.Google Scholar

Copyright information

© Springer Science+Business Media New York 2014

Authors and Affiliations

  1. 1.Rossier School of EducationUniversity of Southern CaliforniaLos AngelesUSA

Personalised recommendations