Abstract
As states adapt new content standards that support college and career readiness, there is a need to develop assessments that produce valid and reliable measures for all students. This chapter describes the overall processes and individual tasks that the Smarter Balanced Assessment Consortium (Smarter Balanced) implemented to produce one of the most accessible mathematics and English language arts/literacy assessment systems. The assessments are aligned with the Common Core State Standards (CCSS) and are geared to students in grades 3–8 and 11. This chapter explains the ways in which the consortium operationalized and implemented universal design principles throughout the entire assessment design and development process, including creation of the test administration platform, item writing, piloting, field testing, and scoring. In addition, the authors share how Smarter Balanced emphasized utilizing a multidisciplinary approach and evidence-based decisions-making processes. The chapter shows how these approaches resulted in a suite of embedded and non-embedded accessibility resources that can help meet individual student needs. The ability to customize individual test instances reinforces a paradigm shift away from considering the needs of student groups (e.g., English learners, students with disabilities) to focusing on each individual student’s specific need(s). The chapter closes with a call for future work and research that includes identifying how technology can meet the needs of individual students, in particular low-instance populations.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsNotes
- 1.
We use the term accessibility resources as a broad categorical term referring to any support offered to students as part of the test materials or the test administration procedures.
- 2.
A Smarter-administered survey showed that, across its membership, dual language immersion programs offered to ELs included instruction in Spanish-English.
- 3.
In the 2015–2016 school year, Smarter supported English Braille, American Edition (EBAE) literary code, and Nemeth math code, with formal plans to support EBAE literary, Nemeth math, and Unified English Braille (UEB) math and literary codes.
References
Abedi, J., & Ewers, N. (2013). Accommodations for English language learners and students with disabilities: A research based algorithm. Retrieved from http://www.smarterbalanced.org/wordpress/wp-content/uploads/2012/08/Accomodations-for-under-represented-students.pdf
Abedi, J., Hofstetter, C., & Lord, C. (2004). Assessment accommodations for English language learners: Implications for policy-based empirical research. Review of Educational Research, 74(1), 1–28.
Alliance for Excellence. (2015). Every student succeeds act: Accountability provisions. Retrieved from: https://www.sifassociation.org/NewsRoom/Documents/ESSA_accountability_chart.pdf
Common Core State Standards Initiative (CCSS). (2016a). About the standards. Retrieved from http://www.corestandards.org/about-the-standards/
Common Core State Standards Initiative (CCSS). (2016b). Public license. Retrieved from http://www.corestandards.org/public-license/
Department of Education. (2014). Setting the pace: Expanding opportunity for America’s Students Under Race to the Top. Retrieved from https://www.whitehouse.gov/sites/default/files/docs/settingthepacerttreport_3-2414_b.pdf
Duran, R. (2008). Assessing English-language learners’ achievement. Review of Research in Education, 32, 292–327.
Ericsson, K. A., & Simon, H. A. (1993). Protocol analysis: Verbal reports as data. Cambridge, MA: MITE Press.
Higgins, J., Famularo, L., Bowman, T., & Hall, R. (2015). Research and development of audio and American Sign Language guidelines for creating accessible computer-based assessments. Retrieved from http://gaap.measuredprogress.org/gaap/docs/GAAP_Research_White_Paper _Final.pdf
Kopriva, R. (2001, June). ELL validity research designs for state academic assessments: An outline of five research designs evaluation the validity of large-scale assessments for English language learners and other test takers. Paper presented at the Council of State School Officers Meeting, Houston, TX.
Partnership for Assessment of Readiness for College and Careers (PARCC). (2016). The PARCC tests: Modern, high-quality assessments. Retrieved from http://www.parcconline.org/about/the-parcc-tests
Smarter Balanced Assessment Consortium (Smarter). (n.d.-a). The individual student assessment accessibility profiles (ISAAP) process. Retrieved from http://www.smarterbalanced.org/assessments/accessibility-and-accommodations/
Smarter Balanced Assessment Consortium (Smarter). (n.d.-b). Interim assessment statement of purpose. Retrieved from www.smarterbalanced.org/wp-content/uploads/2015/09/Interim-Assessment-Statement-Purpose-FINALmerged.pdf
Smarter Balanced Assessment Consortium (Smarter). (2014). Smarter balanced assessment consortium: Accessibility and accommodations framework. Retrieved from https://www.smarterbalanced.org/wp-content/uploads/2015/09/Accessibility-and-Accommodations-Framework.pdf
Smarter Balanced Assessment Consortium (Smarter). (2015a). Smarter balanced assistive technology typology. Retrieved from http://www.smarterbalanced.org/assessments/accessibility-and-accommodations/
Smarter Balanced Assessment Consortium (Smarter). (2015b). Content specifications for the summative assessment of the Common Core State Standards for Mathematics. Retrieved from http://www.smarterbalanced.org/wp-content/uploads/2015/08/Mathematics-Content-Specifications.pdf
Smarter Balanced Assessment Consortium (Smarter). (2015c). Content specifications for the summative assessment of the Common Core State Standards for English language arts and literacy in history/social studies, science, and technical subjects. Retrieved from www.smarterbalanced.org/wp-content/uploads/2015/08/ELA_Content_Specs.pdf
Smarter Balanced Assessment Consortium (Smarter). (2016a). Projected and actual student counts. Unpublished internal document.
Smarter Balanced Assessment Consortium (Smarter). (2016b). Smarter balanced assessment consortium usability, accessibility, and accommodations guidelines (UAAG). Retrieved from http://www.smarterbalanced.org/wp-content/uploads/2015/09/Usability-Accessibility-Accomodations-Guidelines.pdf
Smarter Balanced Assessment Consortium (Smarter). (2016c). Smarter balanced assessment consortium: 2013–14 technical report. Retrieved from www.smarterbalanced.org/wp-content/uploads/2015/08/2013-14_Technical_Report.pdf
Smarter Balanced Assessment Consortium (Smarter). (2016d). Smarter balanced assessment consortium advisory committees. Retrieved from http://www.smarterbalanced.org/about/advisory-committees/
Smarter Balanced Assessment Consortium (Smarter). (2016e). Accessibility and accommodations. Retrieved from http://www.smarterbalanced.org/assessments/accessibility-and-accommodations/
Solano-Flores, G. (2012). Smarter balanced assessment consortium: Translation accommodations framework for testing English language learners in mathematics. Retrieved from http://www.smarterbalanced.org/wp-content/uploads/2015/08/Translation-Accommodations-Framework-for-Testing-ELL-Math.pdf
United States Department of Education (2015). Every Student Succeeds Act. Retrieved from https://www.ed.gov/essa?src=rn
Solano-Flores, G., Backhoff, E., & Contreras-Niño, L. A. (2009). Theory of test translation error. International Journal of Testing, 9(2), 78–91.
Yell, M. L., & Katsiyannas, A. (2006). Adequate yearly progress, and students with disabilities. Retrieved from http://www.redorbit.com/news/education/424129/the_no_child_left_behind_act_adequate_yearly_progress_and/
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Appendices
Appendix A
Members for of the Three Smarter Balanced Assessment Consortium in 2016
Technical Advisory Committee Members
-
Randy Bennett, Ph.D.
-
Derek Briggs, Ph.D.
-
Gregory J. Cizek, Ph.D.
-
David Conley, Ph.D.
-
Brian Gong, Ph.D.
-
Edward Haertel, Ph.D.
-
Gerunda Hughes, Ph.D.
-
G. Gage Kingsbury, Ph.D.
-
Joseph Martineau, Ph.D.
-
William McCallum, Ph.D.
-
James W. Pellegrino, Ph.D.
-
Jim Popham, Ph.D.
-
Joseph Ryan, Ph.D.
-
Guillermo Solano-Flores, Ph.D.
-
Martha Thurlow, Ph.D.
-
Sheila Valencia, Ph.D.
-
Joe Willhoft, Ph.D.
English Language Learners Advisory Committee Members
-
Stephanie Cawthon, Ph.D.
-
Magda Chia, Ph.D.
-
Donna Christian, Ph.D.
-
Gary Cook, Ph.D.
-
Kathy Escamilla, Ph.D.
-
James Green, Ph.D.
-
Kenji Hakuta, Ph.D.
-
Robert Linquanti
-
Guillermo Solano-Flores, Ph.D.
-
Guadalupe Valdés, Ph.D.
Students with Disabilities Advisory Committee Members
-
Magda Chia, Ph.D.
-
Donald D. Deshler, Ph.D.
-
Barbara Ehren, Ed.D.
-
Cheryl Kamei-Hannan, Ph.D.
-
Jacqueline F. Kearns, Ed.D.
-
Susan Rose, Ph.D.
-
Jim Sandstrum
-
Ann C. Schulte, Ph.D.
-
Richard Simpson, Ed.D.
-
Stephen W. Smith, Ph.D.
-
Martha L. Thurlow, Ph.D.
Appendix B
Advocacy Groups with which the Smarter Balanced Assessment Consortium Collaborates
-
American Federation of Teachers
-
California School for the Blind
-
California School for the Deaf
-
Californians Together
-
California State Teach
-
Center for Applied Special Technology
-
Center for Law and Education
-
Conference of Educational Administrators of Schools and Programs for the Deaf
-
Council for Exceptional Children
-
Council of the Great City Schools
-
Council of Parent Attorneys and Advocates
-
Learning Disabilities Association of Maryland
-
Mexican American Legal Defense and Education Fund
-
Missouri School Boards’ Association
-
Missouri Council of Administrators of Special Education
-
National Center for Learning Disabilities
-
National Association of Latino Elected and Appointed Officials
-
The Advocacy Institute
-
The National Hispanic University
Rights and permissions
Copyright information
© 2018 Springer International Publishing AG
About this chapter
Cite this chapter
Chia, M., Kachchaf, R. (2018). Designing, Developing, and Implementing an Accessible Computer-Based National Assessment System. In: Elliott, S., Kettler, R., Beddow, P., Kurz, A. (eds) Handbook of Accessible Instruction and Testing Practices. Springer, Cham. https://doi.org/10.1007/978-3-319-71126-3_5
Download citation
DOI: https://doi.org/10.1007/978-3-319-71126-3_5
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-71125-6
Online ISBN: 978-3-319-71126-3
eBook Packages: Behavioral Science and PsychologyBehavioral Science and Psychology (R0)