Advertisement

Journal of Educational Change

, Volume 16, Issue 3, pp 281–304 | Cite as

Student-involved data use: Establishing the evidence base

  • Jo Beth Jimerson
  • Ellen Reames
Article

Abstract

In this conceptual paper, we map the research terrain on what we term “student-involved data use” (SIDU)—that is, the practice of having students track, chart, and analyze their own data in formal and structured ways. Drawing on peer-reviewed research as well as practitioner-oriented literature, social media, and district websites, we leverage a lens informed by goal achievement theory to highlight the potential benefits of SIDU as well as the possible dangers of implementing SIDU in haphazard ways. We begin by tracing the rise of the modern iteration of this data-driven practice, rooted in the application of principles associated with the Malcolm Baldrige National Quality Award criteria to the classroom level and to the teacher–student dyad. We then describe common components of the practice, including the use of student “data folders” or “data binders,” semi-public classroom “data walls,” and “quality tools” (such as the Plan-Do-Study-Act cycle) that aim at building reflective practice among students. Beyond describing the increasingly popular practice, we note that the empirical base for SIDU is quite shallow at present: implementation is far outpacing the evidence on the processes involved in and outcomes of SIDU. Currently, practitioners and policymakers have little in the way of empirical evidence to guide efforts, potentially to the detriment of long-term educational outcomes. To this end, we posit a range of ways in which the research community can join in comprehensive inquiry efforts aimed at learning more about the conditions under which SIDU may be a positive and productive process for students.

Keywords

Data-driven decision making (DDDM) Continuous improvement Educational data use Student-involved data use (SIDU) School reform School improvement Student data folders Data walls 

References

  1. Baldrige Performance Excellence Program. (2015). 20152016 Baldrige excellence framework: A systems approach to improving your organization’s performance (education). Gaithersburg, MD: US Department of Commerce, National Institute of Standards and Technology. http://www.nist.gov/baldrige
  2. Banister, S. I. (2002). A question of quality: The Malcolm Baldrige criteria as applied to education. Journal of Research for Educational Leaders, 1(2), 44–65.Google Scholar
  3. Benjamin, S. (2000). The quality rubric: A systematic approach for implementing quality principles and tools in classrooms and schools. Milwaukee, WI: ASQ Quality Press.Google Scholar
  4. Black, P., & Wiliam, D. (1998). Assessment and classroom learning. Assessment in Education, 5(1), 7–74.CrossRefGoogle Scholar
  5. Blackwell, L. D., Trzesniewski, K. H., & Dweck, C. S. (2007). Implicit theories of intelligence predict achievement across an adolescent transition: A longitudinal study and an intervention. Child Development, 78(1), 246–263.CrossRefGoogle Scholar
  6. Booher-Jennings, J. (2005). Below the bubble: “Educational triage” and the Texas accountability system. American Educational Research Journal, 42(2), 231–268.CrossRefGoogle Scholar
  7. Burgard, J. J. (2009). Continuous improvement in the science classroom (2nd ed.). Milwaukee, WI: ASQ Quality Press.Google Scholar
  8. Byrnes, M. A., & Baxter, J. C. (2012). There is another way! Launch a Baldrige-based quality classroom (2nd ed.). Milwaukee, WI: ASQ Quality Press.Google Scholar
  9. Cauley, K. M., & McMillan, J. H. (2010). Formative assessment techniques to support student motivation and achievement. The Clearing House, 83(1), 1–6.CrossRefGoogle Scholar
  10. Chappuis, J. (2009). Seven strategies of assessment for learning (2nd ed.). Boston: Pearson.Google Scholar
  11. Chappuis, J., Stiggins, R. J., Chappuis, S., & Arter, J. A. (2012). Classroom assessment for student learning doing it right—Using it well (2nd ed.). Boston: Pearson.Google Scholar
  12. Clymer, J. B., & Wiliam, D. (2007). Improv-ing the way we grade science. Educational Leadership, 64, 36–42.Google Scholar
  13. Coburn, C. E., Honig, M. I., & Stein, M. K. (2009). What’s the evidence on districts’ use of evidence? In J. D. Bransford, D. J. Stipek, N. J. Vye, L. M. Gomez, & D. Lam (Eds.), The role of research in educational improvement (pp. 67–87). Cambridge: Harvard Education Press.Google Scholar
  14. Copland, M., Knapp, M., & Swinnerton, J. (2009). Data informed leadership and school improvement. In T. J. Kowalski & T. J. Lasley (Eds.), Handbook on data-based decision making in education (pp. 153–172). New York: Routledge.Google Scholar
  15. Courtney, L. (2014). In Pinterest [“Data Binders” board]. Retrieved December 21, 2014 from http://pinterest.com/lianec/data-binders/
  16. Daly, A. (2009). Rigid response in an age of accountability: The potential of leadership and trust. Educational Administration Quarterly, 45(2), 168–216.CrossRefGoogle Scholar
  17. Datnow, A., Park, V., & Wohlstetter, P. (2007). Achieving with data: How high-performing school systems use data to improve instruction for elementary students. Retrieved August 13, 2010 from New Schools Venture Fund website: http://www.newschools.org/files/AchievingWithData.pdf
  18. Dunlap Community Unit Schools #323 (DCUS). (2013). Continuous improvement. Retrieved September 19, 2013 from http://www.dunlapcusd.net/CI/Pages/StudentDataFolders.aspx
  19. Dweck, C. S. (2006). Mindset: The new psychology of success. New York: Ballantine.Google Scholar
  20. Farley-Ripple, E. N., & Cho, V. (2014). Depth of use: How district decision-makers did and did not engage with evidence. In A. Bowers, A. R. Shoho, & B. G. Barnett (Eds.), Using data in schools to inform leadership and decision-making—international research on school leadership (Vol. 5, pp. 229–252). Charlotte, NC: Information Age Publishing Inc.Google Scholar
  21. Flynn, B. B., & Saladin, B. (2001). Further evidence on the validity of the theoretical models underlying the Baldrige criteria. Journal of Operations Management, 19, 617–652.CrossRefGoogle Scholar
  22. Hackman, J. R., & Wageman, R. (1995). Total quality management: Empirical, conceptual, and practical issues. Administrative Science Quarterly, 40(2), 309–342.CrossRefGoogle Scholar
  23. Halverson, R. (2010). School formative feedback systems. Peabody Journal of Education, 85, 130–146.CrossRefGoogle Scholar
  24. Hamilton, L. S., Halverson, R., Jackson, S. S., Mandinach, E., Supovitz, J. A., & Wayman, J. C. (2009). Using student achievement data to support instructional decision making. Washington, DC: Institute of Education Sciences and the National Center for Education Evaluation.Google Scholar
  25. Hattie, J. (2011). Visible learning for teachers: Maximizing impact on learning. New York: Routledge.Google Scholar
  26. Hattie, J., & Timperley, H. (2007). The power of feedback. Review of Educational Research, 77(1), 81–112.CrossRefGoogle Scholar
  27. Heritage, M. (2007). Formative assessment: What do teachers need to know and do? Phi Delta Kappan, 89, 140–145.CrossRefGoogle Scholar
  28. Heritage, M. (2010). Formative assessment and next-generation assessment systems: Are we losing an opportunity? Washington, DC: Council of Chief State School Officers.Google Scholar
  29. Hurst-Euless-Bedford Independent School District (HEBISD). (2011). Continuous improvement. Retrieved September 19, 2013 from http://www.hebisd.edu/CI/ci-default.asp
  30. Ikemoto, G. S., & Marsh, J. A. (2007). Cutting through the “data-driven” mantra: Different conceptions of data-driven decision making. In P. A. Moss (Ed.), Evidence and decision making (pp. 105–131). Malden, MA: Blackwell.Google Scholar
  31. Jimerson, J. B. & McGhee, M. (2013). Leading inquiry in schools: Examining mental models of datainformed practice. Current Issues in Education, 16(1), 1–20.Google Scholar
  32. Jim Shipley & Associates. (2012a). Continuous classroom improvement: First steps in using a systems approach to improve learning results (3rd ed.). North Redington Beach, Florida: Jim Shipley & Associates.Google Scholar
  33. Jim Shipley & Associates. (2012b). Doing it right! A guide to student data folders and student-led conferences. North Redington Beach, Florida: Jim Shipley & Associates.Google Scholar
  34. Jim Shipley & Associates. (2013). Retrieved October 13, 2013 from www.jimshipley.net
  35. Kennedy, B. L., & Datnow, A. (2011). Student involvement and data-driven decision making: Developing a new typology. Youth & Society, 43(4), 1246–1271.CrossRefGoogle Scholar
  36. Kerr, K. I., Marsh, J. A., Ikemoto, G. S., Darilek, H., & Barney, H. (2006). Strategies to promote data use for instructional improvement: Actions, outcomes, and lessons from three urban districts. American Journal of Education, 112, 496–520.CrossRefGoogle Scholar
  37. Loeb, H., Knapp, M. S., & Elfers, A. M. (2008). Teachers’ response to standards-based reform: Probing reform assumptions in Washington State. Education Policy Analysis Archives, 16(8), 1–32.Google Scholar
  38. Louis, K. S., Leithwood, K., Wahlstrom, K. L., Anderson, S. E., Michlin, M., Mascall, B., et al. (2010). Learning from leadership: Investigating the links to improved student learning (final report of research findings). New York, NY: The Wallace Foundation.Google Scholar
  39. Maggin, D. M., Chafouleas, S. M., Goddard, K. M., & Johnson, A. H. (2011). A systematic evaluation of token economies as a classroom management tool for students with challenging behavior. Journal of School Psychology, 49, 529–554.CrossRefGoogle Scholar
  40. Mandinach, E. B. (2012). A perfect time for data use: Using data-driven decision making to inform practice. Educational Psychologist, 47(2), 71–85.CrossRefGoogle Scholar
  41. Mandinach, E. B., & Jackson, S. S. (2012). Transforming teaching and learning through data-driven decision making. Thousand Oaks, CA: SAGE Publications.Google Scholar
  42. Marsh, J. A. (2012). Interventions promoting educators’ use of data: Research insights and gaps. Teachers College Record, 114(11), 1–48.Google Scholar
  43. Marsh, J. A., Farrell, C. C., & Bertrand, M. (2014). Trickle-down accountability: How middle school teachers engage students in data use. Educational Policy. doi: 10.1177/0895904814531653 Google Scholar
  44. Marsh, J. A., McCombs, J. S., & Martorell, F. (2010). How instructional coaches support data-driven decision making: Policy implementation and effects in Florida middle schools. Educational Policy, 24(6), 872–907.CrossRefGoogle Scholar
  45. Marsh, J. A., Pane, J. F., & Hamilton, L. S. (2006). Making sense of data-driven decision making in education. RAND. Retrieved December 17, 2012 from http://www.rand.org/content/dam/rand/pubs/occasional_papers/2006/RAND_OP170.pdf
  46. Martin, B. (2011.) Tutorials-student data folders. Cedar Rapids Community School District (CRCSD). Retrieved September 19, 2013 from http://quality.cr.k12.ia.us/index_search.asp
  47. Means, B., Chen, E., DeBarger, A., & Padilla, C. (2011). Teachers’ ability to use data to inform instruction: Challenges and supports. Washington, DC: U.S. Department of Education, Office of Planning, Evaluation, and Policy Development.Google Scholar
  48. Meece, J. L., Anderman, E. M., & Anderman, L. H. (2006). Classroom goal structure, student motivation, and academic achievement. Annual Review of Psychology, 57, 487–503.CrossRefGoogle Scholar
  49. Miller, M. N., Bell, E. V., & Holland, D. F. (2009). Slow turn ahead: 5 principles guide district through a changing demographic landscape. Journal of Staff Development, 30(4), 46–50.Google Scholar
  50. Montgomery County Public Schools (MCPS). (2010). Data notebooks/folders. Retrieved September 20, 2013 from http://montgomeryschoolsmd.org/info/baldrige/staff/datanotebooks.shtm
  51. Neves, J. S., & Nakhai, B. (1993). The Baldrige award framework for teaching total quality management. Journal of Education for Business, 69(2), 121–125.CrossRefGoogle Scholar
  52. Park, V., & Datnow, A. (2009). Co-constructing distributed leadership: District and school connections in data-driven decision-making. School Leadership and Management, 29(5), 477–494.CrossRefGoogle Scholar
  53. Park, S., Hironaka, S., Carver, P., & Nordstrum, L. (2013). Continuous improvement in education. Stanford, CA: Carnegie Foundation for the Advancement of Teaching.Google Scholar
  54. Pintrich, P. R. (2003). A motivational science perspective on the role of student motivation in learning and teaching contexts. Journal of Educational Psychology, 95(4), 667–686.CrossRefGoogle Scholar
  55. Plank, S. B., & Condliffe, B. F. (2013). Pressures of the season: An examination of classroom quality and high-stakes accountability. American Educational Research Journal, 50(5), 1152–1182.CrossRefGoogle Scholar
  56. Pollock, M. (2013). It takes a network to raise a child—Improving the communication infrastructure of public education. Teachers College Record, 115(7), 1–28.Google Scholar
  57. Quebodeaux, P. S. (2010). Quality in education in the Calcasieu Parish school system: Experiences of administrators. Dissertation, University of New Orleans.Google Scholar
  58. Reeves, D. B., & Flach, T. (2011). Data: Meaningful analysis can rescue schools from drowning in data. Journal of Staff Development, 32(4), 34–40.Google Scholar
  59. Rhim, L. M. (2011). Learning how to dance in the Queen City: Cincinnati Public Schools’ turnaround initiative. Darden/Curry Partnership for Leaders in Education, University of Virginia, Charlottesville, VA. Retrieved August 19, 2013 from http://www.darden.virginia.edu/web/uploadedFiles/Darden/Darden_Curry_PLE/UVA_School_Turnaround/DanceInTheQueenCity_Sept2011.pdf
  60. Senge, P. (2006). The fifth discipline: The art & practice of the learning organization (Rev). New York: Currency Doubleday.Google Scholar
  61. Senge, P., Cambron-McCabe, N., Lucas, T., Smith, B., & Dutton, J. (2012). Schools that learn (updated and revised): A fifth discipline fieldbook for educators, parents, and everyone who cares about education. New York: Crown Publishing.Google Scholar
  62. Shute, V. J. (2008). Focus on formative feedback. Review of Educational Research, 78(1), 153–189.CrossRefGoogle Scholar
  63. Simonsen, B., Fairbanks, S., Briesch, A., Myers, D., & Sugai, G. (2008). Evidence-based practices in classroom management: Considerations for research to practice. Education and Treatment of Children, 31, 351–380.CrossRefGoogle Scholar
  64. Stiggins, R. (2005). From formative assessment to assessment for learning: A path to success in standards-based schools. Phi Delta Kappan, 87(4), 324–328.CrossRefGoogle Scholar
  65. Stuart, S. K., & Rinaldi, C. (2011). Response to intervention for English learners. The Journal of Multiculturalism in Education, 7(3), 1–16.Google Scholar
  66. Sugai, G., Horner, R. H., Dunlap, G., Hieneman, M., Lewis, T. J., Nelson, C. M., et al. (2000). Applying positive behavior support and functional behavioral assessment in schools. Journal of Positive Behavior Interventions, 2(3), 131–143.CrossRefGoogle Scholar
  67. Valli, L., & Buese, D. (2007). The changing roles of teachers in an era of high-stakes accountability. American Educational Research Journal, 44(3), 519–558.CrossRefGoogle Scholar
  68. Wahlstrom, K. L., Louis, K. S., Leithwood, K., & Anderson, S. E. (2010). Investigating the links to improved student learning. Executive summary of research findings. New York: The Wallace Foundation.Google Scholar
  69. Wayman, J. C., & Jimerson, J. B. (2014). Teacher needs for data-related professional learning. Studies in Educational Evaluation, 42, 25–34.Google Scholar
  70. Wayman, J. C., Spring, S. D., & Lemke, M. A., Lehr, M. D. (2012). Using data to inform practice: Effective principal leadership strategies. Paper presented at the 2012 Annual Meeting of the American Educational Research Association, Vancouver, Canada.Google Scholar
  71. Wayman, J. C., & Stringfield, S. (2006). Technology-supported involvement of entire faculties in examination of student data for instructional improvement. American Journal of Education, 112(August), 549–571.CrossRefGoogle Scholar
  72. Weaver, T. (1992). Total quality management. ERIC Digest No. 73. Retrieved from ERIC database (ED347670).Google Scholar
  73. Wiliam, D. (2011). What is assessment for learning? Studies in Educational Evaluation, 37(1), 3–14.CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media Dordrecht 2015

Authors and Affiliations

  1. 1.Texas Christian UniversityFort WorthUSA
  2. 2.Auburn UniversityAuburnUSA

Personalised recommendations