Abstract
Although reading is an essential skill for college success, little is known about how college students with and without disabilities read within their actual college curriculum. In the present article, we report on two studies addressing this issue. Within study 1, we developed and validated curriculum-based oral reading fluency measures using a sample of college students without disabilities (N = 125). In study 2, we administered the curriculum-based measures to four groups (each with n = 25): college students without disabilities, college students with dyslexia, college students with ADHD, and a clinical control group. Study 1 results indicated that the curriculum-based measures demonstrated good reliability and criterion validity. Results from study 2 indicated that college students with dyslexia were substantially slower readers than all groups without dyslexia (ds > 1.8). The curriculum-based measures demonstrated high accuracy in classifying participants with dyslexia and with impaired oral reading fluency (area under the curve > .94). Implications for incorporating curriculum-based measures in postsecondary settings are discussed.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Baer, J. D., Cook, A. L., & Baldi, S. (2006). The literacy of America’s college students. Washington, DC: American Institues for Research.
Barkley, R. A. (2015). Attention-deficit hyperactivity disorder: A handbook for diagnosis and treatment (4th ed.). New York: Guilford.
Bray, G. B., Pascarella, E. T., & Pierson, C. T. (2004). Postsecondary education and some dimensions of literacy development: An exploration of longitudinal evidence. Reading Research Quarterly, 39(3), 306–330. https://doi.org/10.1595/RRQ.39.3.3.
Brown, J. I., Fishco, V. V., & Hanna, G. (1993). Nelson-Denny Reading Test and technical report forms G & H. Chicago, IL: Riverside.
Brueggemann, A. E., Kamphaus, R., & Dombrowski, S. C. (2008). An impairment model of learning disability diagnosis. Professional Psychology: Research and Practice, 39(4), 424–430. https://doi.org/10.1037/0735-7028.39.4.424.
Cohen, J. (1960). A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20(1), 37–46.
Cohen, J. (1992). A power primer. Psychological Bulletin, 112(1), 155–159. https://doi.org/10.1037/0033-2909.112.1.155.
Cortiella, C., & Horowitz, S. H. (2014). The state of learning disabilities: Facts, trends, and emerging issues (3rd ed.). New York, NY: National Center for Learning Disabilities.
Deno, S. L. (1985). Curriculum-based measurement: The emerging alternative. Exceptional Children, 52(3), 219–232. https://doi.org/10.1177/001440298505200303.
Dombrowski, S. C., Kamphaus, R. W., & Reynolds, C. R. (2004). After the demise of the discrepancy: Proposed learning disabilities diagnostic criteria. Professional Psychology: Research and Practice, 35(4), 364–372. https://doi.org/10.1037/0735-7028.35.4.364.
Flippo, R. F., & Schumm, J. S. (2009). Reading tests. In R. F. Flippo & D. C. Caverly (Eds.), Handbook of college reading and study strategy research (2nd ed., pp. 408–432). New York, NY: Routledge.
Frazier, T. W., Youngstrom, E. A., Glutting, J. J., & Watkins, M. W. (2007). ADHD and achievement: Meta-analysis of the child, adolescent, and adult literatures and a concomitant study with college students. Journal of Learning Disabilities, 40(1), 49–65. https://doi.org/10.1177/00222194070400010401.
Frazier, T. W., Frazier, A. R., Busch, R. M., Kerwood, M. A., & Demaree, H. A. (2008). Detection of simulated ADHD and reading disorder using symptom validity measures. Archives of Clinical Neuropsychology, 23, 501–509. https://doi.org/10.1016/j.acn.2008.04.001.
Fuchs, L. S., Fuchs, D., Hosp, M. K., & Jenkins, J. R. (2001). Oral reading fluency as an indicator of reading competence: A theoretical, empirical, and historical analysis. Scientific Studies of Reading, 5(3), 239–256. https://doi.org/10.1207/S1532799XSSR0503_3.
Gickling, E. E., & Armstrong, D. L. (1978). Levels of instructional difficulty as related to on-task behavior, task completion, and comprehension. Journal of Learning Disabilities, 11, 559–566. https://doi.org/10.1177/002221947801100905.
Guilford, J. P., & Fruchter, B. (1978). Fundamental statistics in psychology and education (6th ed.). New York: McGraw-Hill.
Hanley, J. A., & McNeil, B. J. (1983). A method of comparing the areas under receiver operating characteristic curves derived from the same cases. Radiology, 148, 839–843. https://doi.org/10.1148/radiology.148.3.6878708.
Harrison, A. G., & Armstrong, I. (2014). WISC-IV unusual digit span performance in a sample of adolescents with learning disabilities. Applied Neuropsychology, Child, 3(2), 152–160. https://doi.org/10.1080/21622965.2012.753570.
Hasbrouck, J., & Tindal, G. (2017). An update to compiled ORF norms (technical report no. 1702). Eugene, OR, Behavioral Research and Teaching, University of Oregon.
Hintze, J. M., Christ, T. J., & Methe, S. A. (2006). Curriculum-based assessment. Psychology in the Schools, 43(1), 45–56. https://doi.org/10.1002/pits.20128.
January, S. A., Ardoin, S. P., Christ, T. J., Eckert, T. L., & White, M. J. (2016). Evaluating the interpretations and use of curriculum-based measurement in reading and word lists for universal screening in first and second grade. School Psychology Review, 45(3), 310–326. https://doi.org/10.17105/SPR45-3.310-326.
Jasinski, L. J., Berry, D. T. R., Shandera, A. L., & Clark, J. A. (2011). Use of the Wechsler Adult Intelligence Scale Digit Span subtest for malingering detection: A meta-analytic review. Journal of Clinical and Experimental Neuropsychology, 33(3), 300–314. https://doi.org/10.1080/13803395.2010.516743.
Just, M. A., & Carpenter, P. A. (1980). A theory of reading: From eye fixations to comprehension. Psychological Review, 87(4), 329–354. https://doi.org/10.1037/0033-295X.87.4.329.
LaBerge, D., & Samuels, S. (1974). Toward a theory of automatic information processing in reading. Cognitive Psychology, 6, 293–323. https://doi.org/10.1016/0010-0285(74)90015-2.
Landis, J. R., & Koch, G. G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33, 159–174. https://doi.org/10.2307/2529310.
Lefly, D. L., & Pennington, B. F. (1991). Spelling errors and reading fluency in compensated adult dyslexics. Annals of Dyslexia, 41(1), 141–162. https://doi.org/10.1007/BF02648083.
Lefly, D. L., & Pennington, B. F. (2000). Reliability and validity of the Adult Reading History Questionnaire. Journal of Learning Disabilities, 33, 286–296. https://doi.org/10.1177/002221940003300306.
Lewandowski, L., Gathje, R. A., Lovett, B. J., & Gordon, M. (2013). Test-taking skills in college students with and without ADHD. Journal of Psychoeducational Assessment, 31(1), 41–52. https://doi.org/10.1177/0734282912446304.
Lewandowski, L. J., Codding, R. S., Kleinmann, A. E., & Tucker, K. L. (2003). Assessment of reading rate in postsecondary students. Journal of Psychoeducational Assessment, 21, 134–144. https://doi.org/10.1177/073428290302100202.
Linn, R. L., Harnisch, D. L., & Dunbar, S. B. (1981). Corrections for range restriction: An empirical investigation of conditions resulting in conservative corrections. Journal of Applied Psychology, 66(6), 655–663.
Lyon, G. R., Shaywitz, S. E., & Shaywitz, B. A. (2003). A definition of dyslexia. Annals of Dyslexia, 53, 1–14. https://doi.org/10.1007/s11881-003-0001-9.
McGrew, K. S., Shrank, F. A., & Woodcock, R. W. (2007). Woodcock-Johnson III Normative Update technical manual. Rolling Meadows, IL: Riverside.
Miller, C. J., Miller, S. R., Bloom, J. S., Jones, L., Lindstrom, W., et al. (2006). Testing the double-deficit hypothesis in an adult sample. Annals of Dyslexia, 56(1), 83–102.
Miller, L. A., Lewandowski, L. J., & Antshel, K. M. (2015). Effects of extended time for college students with and without ADHD. Journal of Attention Disorders, 19(8). 678–686. https://doi.org/10.1177/1087054713483308.
Newman, L., Wagner, M., Knokey, A. M., Marder, C., Nagle, K., Shaver, D., … Schwarting, M. (2011). The post-high school outcomes of young adults with disabilities up to 8 years after high school. A report from the National Longitudinal Transition Study-2 (NLTS2). Retrieved from http://ies.ed.gov/ncser/pubs/20113005/pdf/20113005.pdf
Obuchowski, N. A. (2005). ROC analysis. American Journal of Roentgenology, 184(2), 364–372. https://doi.org/10.2214/ajr.184.2.01840364.
Pennington, B. F., McGrath, L. M., & Peterson, R. L. (2019). Diagnosing learning disorders: From science to practice (3rd ed.). New York: Guilford.
Reschly, A. L., Busch, T. W., Betts, J., Deno, S. L., & Long, J. D. (2009). Curriculum-based measurement oral reading as an indicator of reading achievement: A meta-analysis of the correlational evidence. Journal of School Psychology, 47, 427–469. https://doi.org/10.1016/j.jsp.2009.07.001.
Sackett, P. R., & Yang, H. (2000). Correction for range restriction: An expanded typology. Journal of Applied Psychology, 85(1), 112–118. https://doi.org/10.1037//0021-9010.85.1.112.
Sattler, J. M., & Ryan, J. J. (2009). Assessment with the WAIS-IV. San Diego: Jerome M. Sattler, Publisher, Inc..
Schroeder, R. W., Twumasi-Ankrah, P., Baade, L. E., & Marshall, P. S. (2012). Reliable digit span: A systematic review and cross-validation study. Assessment, 19(1), 21–30. https://doi.org/10.1177/1073191111428764.
Shapiro, E. S. (2004). Academic skills problems: Direct assessment and intervention (3rd ed.). New York: Guilford.
Shaywitz, S. E., & Shaywitz, B. A. (2005). Dyslexia (specific reading disability). Biological Psychiatry, 57, 1301–1309. https://doi.org/10.1016/j.biopsych.2005.01.043.
Stanovich, K. E. (1999). The sociopsychometrics of learning disabilities. Journal of Learning Disabilities, 32(4), 350–361. https://doi.org/10.1177/002221949903200408.
Swets, J. A. (1996). Signal detection theory and ROC analysis in psychology and diagnosis: Collected papers. Mahwah, NJ: Erlbaum.
Torgesen, J. K., Wagner, R. K., & Rashotte, C. A. (2012). Test of Word Reading Efficiency, Second Edition and examiner’s manual. Austin, TX: PRO-ED, Inc..
U.S. Government Accountability Office. (2009). Higher education and disability: Education needs a coordinated approach to improve its assistance to schools in supporting students. Retrieved from http://www.gao.gov/assets/300/297433.pdf.
U.S. Department of Education. (2014). Profile of undergraduate students: 2011–12. Retrieved May 30, 2018, from https://nces.ed.gov/pubs2015/2015167.pdf.
U.S. Department of Education. (2015). The nation’s report card. Retrieved May 30, 2018, from https://www.nationsreportcard.gov/reading_math_g12_2015
U.S. Department of Education. (2016). Digest of education statistics: 2016. Retrieved May 30. 2018, from https://nces.ed.gov/programs/digest/d16/tables/dt16_311.50.asp
Valentine, J. C., Konstantopoulos, S., & Goldrick-Rab, S. (2017). What happens to students placed in developmental education? A meta-analysis of regression discontinuity studies. Review of Educational Research, 87(4), 806–833. https://doi.org/10.3102/0034654317709237.
Webb, N. M., Shavelson, R. J., & Haertel, E. H. (2006). Reliability coefficients and generalizability theory. In C. R. Rao & S. Sinharay (Eds.), Handbook of statistics (Vol. 26, pp. 81–124). Amsterdam: Elsevier.
Wechsler, D. (2008). Wechsler Adult Intelligence Scale—Fourth Edition. San Antonio, TX: Pearson.
Willcutt, E. G., Pennington, B. F., Olson, R. K., & DeFries, J. C. (2007). Understanding comorbidity: A twin study of reading disability and attention-deficit/hyperactivity disorder. American Journal of Medical Genetics, 144, 709–714. https://doi.org/10.1002/ajmg.b.30310.
Woodcock, R. W. (2011). Woodcock Reading Mastery Tests Third Edition and examiner’s manual. Bloomington, MN: Pearson.
Woodcock, R. W., McGrew, K. S., Shrank, F. A., & Mather, N. (2007). Woodcock-Johnson III Tests of Achievement Normative Update. Rolling Meadows, IL: Riverside.
Youngstrom, E. A. (2014). A primer on receiver operating characteristic analysis and diagnostic efficiency statistics for pediatric psychology: We are ready to ROC. Journal of Pediatric Psychology, 39(2), 204–221. https://doi.org/10.1093/jpepsy/jst062.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
The study was authorized by the Institutional Review Board of the researchers’ university. All participants provided written informed consent.
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Nelson, J.M., Lindstrom, W., Foels, P.A. et al. Validation of curriculum-based reading passages and comparison of college students with and without dyslexia or ADHD. Ann. of Dyslexia 69, 297–317 (2019). https://doi.org/10.1007/s11881-019-00183-9
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11881-019-00183-9