Advertisement

Adopting and adapting: school leaders in the age of data-informed decision making

  • Cornelius Young
  • Gerry McNamara
  • Martin Brown
  • Joe O’Hara
Article

Abstract

The concept of data-informed decision making (DIDM), a term used interchangeably with data-driven decision making (DDDM) and data-based decision making (DBDM), is relatively new to Irish education and the school planning process. This research sought to clarify what data principals use and how they use that information for school improvement considering new school self-evaluation requirements. The paper begins by charting the rise internationally of data use in school planning, decision making and accountability. It proceeds to describe the policy context in this area in Ireland and then reports recent research with school leaders around how data is collected and used in their work. Although the paper focusses on Ireland, it is tentatively suggested that school leaders, teachers and policymakers in other countries, and there are many, which have come late to the expectation that school improvement and accountability should be heavily data-informed may find the efforts of Irish principals in this regard of interest.

Keywords

Assessment Evaluation Data-informed decision making Leadership School inspection School self-evaluation 

References

  1. Anderson, S., Leithwood, K., & Strauss, T. (2010). Leading data use in schools: organizational conditions and practices at the school and district levels. Leadership and Policy in Schools, 9, 292–327.CrossRefGoogle Scholar
  2. Bernhardt, V. (2013). Data analysis for continuous school improvement. New York: Routledge.Google Scholar
  3. Brown, M., McNamara, G., & O’Hara, J. (2016). Quality and the rise of value-added in education: the case of Ireland. Policy Futures in Education, 14, 810–829.CrossRefGoogle Scholar
  4. Bush, G. W. (2001). No child left behind act. Washington, DC: United States Department of Education Available from: http://www2.ed.gov/admins/lead/account/nclbreference/index.html. Accessed 02 Aug 2016.Google Scholar
  5. Celio, M. B., & Harvey, J. (2005). Buried treasure: developing a management guide from mountains of school data. Bothell: Center on Reinventing Public Education.Google Scholar
  6. Coburn, C. E., & Talbert, J. E. (2006). Conceptions of evidence use in school districts: mapping the terrain. American Journal of Education, 112, 469–495.CrossRefGoogle Scholar
  7. Coburn, C. E., & Turner, E. O. (2011). Research on data use: a framework and analysis. Measurement: Interdisciplinary Research & Perspective, 9, 173–206.Google Scholar
  8. Cohen, L., Manion, L., & Morrison, K. (2013). Research methods in education. New York: Routledge.Google Scholar
  9. Copland, M. A. (2003). Leadership of inquiry: building and sustaining capacity for school improvement. Educational Evaluation and Policy Analysis, 25, 375–395.CrossRefGoogle Scholar
  10. Creswell, J. W. (2012). Educational research: planning, conducting, and evaluating quantitative. Harlow: Pearson Education.Google Scholar
  11. Darling-Hammond, L. (2007). Race, inequality and educational accountability: the irony of ‘No Child Left Behind’. Race Ethnicity and Education, 10, 245–260.CrossRefGoogle Scholar
  12. Datnow, A., & Hubbard, L. (2016). Teacher capacity for and beliefs about data-driven decision making: a literature review of international research. Journal of Educational Change, 17, 7–28.CrossRefGoogle Scholar
  13. Datnow, A., & Park, V. (2009). School system strategies for supporting data use. In T. Kowalski & T. J. Lasley (Eds.), Handbook of data-based decision making in education. New York: Routledge.Google Scholar
  14. Datnow, A., Park, V., & Wohlstetter, P. (2007). Achieving with data: how high-performing school systems use data to improve instruction for elementary students. Los Angeles: University of Southern California.Google Scholar
  15. Datnow, A., Park, V., & Kennedy-Lewis, B. (2013). Affordances and constraints in the context of teacher collaboration for the purpose of data use. Journal of Educational Administration, 51, 341–362.CrossRefGoogle Scholar
  16. DES. (2005). DEIS (delivering equality of opportunity in schools): an action plan for educational inclusion. Dublin: DES.Google Scholar
  17. DES. (2011). School Self-Evaluation, Guidelines for Post-Primary Schools. Dublin: DES.Google Scholar
  18. DES. (2012). Circular 0040/2012: implementation of school self-evaluation. Dublin: DES.Google Scholar
  19. DES. (2014). Circular 70/2014: guidance for post-primary schools on the provision of resource teaching and learning support. Dublin: Government Publications.Google Scholar
  20. DES. (2016a). Looking at our School 2016. A quality framework for post-primary schools. Dublin: Government Publications.Google Scholar
  21. DES. (2016b). Circular 34/2016: information in relation to standardised testing and other matters. Dublin: Government Publications.Google Scholar
  22. DES. (2016c). Circular 40/2016: continuing implementation of school self-evaluation 2016–2020. Dublin: Government Publications.Google Scholar
  23. Earl, L., & Katz, S. (2006). Leading in a data rich world: harnessing data for school improvement. Thousand Oaks: Corwin.Google Scholar
  24. Fabry, D. L., & Higgs, J. R. (1997). Barriers to the effective use of technology in education: current status. Journal of Educational Computing Research, 17, 385–395.CrossRefGoogle Scholar
  25. Gelderblom, G., Schildkamp, K., Pieters, J., & Ehren, M. (2016). Data-based decision making for instructional improvement in primary education. International Journal of Educational Research, 80, 1–14.CrossRefGoogle Scholar
  26. Gill, B., Borden, B. C. & Hallgren, K. (2014). A conceptual framework for data-driven decision making. Final report of research conducted by Mathematica Policy Research, Princeton, submitted to Bill & Melinda Gates Foundation, Seattle, WA.Google Scholar
  27. Gilleece, L. (2014). Understanding achievement differences between schools in Ireland—can existing data-sets help? Irish Educational Studies, 33, 75–98.CrossRefGoogle Scholar
  28. Greller, W., & Drachsler, H. (2012). Translating learning into numbers: a generic framework for learning analytics. Journal of Educational Technology & Society, 15, 42–57.Google Scholar
  29. Hallinger, P. (2010). A review of three decades of doctoral studies using the principal instructional management rating scale: a lens on methodological progress in educational leadership. Educational Administration Quarterly, 47, 271–306.CrossRefGoogle Scholar
  30. Hislop, H. (2013). Applying an evaluation and assessment framework: an Irish perspective. In Irish presidency of the Council of the European Union, presidency conference: Better assessment and evaluation to improve teaching and learning. Dublin: DES.Google Scholar
  31. Hoogland, I., Schildkamp, K., Van Der Kleij, F., Heitink, M., Kippers, W., Veldkamp, B. & Dijkstra, A. M. (2016). Prerequisites for data-based decision making in the classroom: Research evidence and practical illustrations. Teaching and Teacher Education. 60, 3770386Google Scholar
  32. Honig, M. I., & Coburn, C. (2007). Evidence-based decision making in school district central offices: toward a policy and research agenda. Educational Policy, 22, 578–608.CrossRefGoogle Scholar
  33. Hout, M., & Elliott, S. W. (2011). Incentives and test-based accountability in education. Washington, DC: National Academies Press.Google Scholar
  34. Ikemoto, G. S., & Marsh, J. A. (2007). Cutting through the “data-driven” mantra: different conceptions of data-driven decision making. Reprints. Santa Monica: RAND Corporation.Google Scholar
  35. Ingram, D., Seashore Louis, K., & Schroeder, R. (2004). Accountability policies and teacher decision making: barriers to the use of data to improve practice. The Teachers College Record, 106, 1258–1287.CrossRefGoogle Scholar
  36. Johnson Jr., B. L., & Kruse, S. D. (2012). Decision making for educational leaders: underexamined dimensions and issues. Albany: SUNY Press.Google Scholar
  37. Kerr, K. A., Marsh, J. A., Ikemoto, G. S., Darilek, H., & Barney, H. (2006). Strategies to promote data use for instructional improvement: actions, outcomes, and lessons from three urban districts. American Journal of Education, 112, 496–520.CrossRefGoogle Scholar
  38. Killion, J., & Bellamy, G. T. (2000). On the job. Journal of Staff Development, 21, 27–31.Google Scholar
  39. Knapp, M. S., Swinnerton, J. A., Copland, M. A., & Monpas-Huber, J. (2006). Data-informed leadership in education. Seattle: Center for the Study of Teaching and Policy.Google Scholar
  40. Koretz, D. (2003). Using multiple measures to address perverse incentives and score inflation. Educational Measurement: Issues and Practice, 22, 18–26.CrossRefGoogle Scholar
  41. Kowalski, T., & Lasley, T. J. (2009). Handbook of data-based decision making in education. New York: Routledge.Google Scholar
  42. Kowalski, T. J., Lasley, T. J. & Mahoney, J. W. (2008). Data-driven decisions and school leadership: Best practices for school improvement, Pearson education. Boston: MA.Google Scholar
  43. Lachat, M. A., & Smith, S. (2005). Practices that support data use in urban high schools. Journal of Education for Students Placed at Risk, 10, 333–349.CrossRefGoogle Scholar
  44. Lai, M. K., & Schildkamp, K. (2013). Data-based decision making: an overview. Data-based decision making in education. Dordtrecht: Springer.Google Scholar
  45. Leithwood, K., Seashore Louis, K., Anderson, S., & Wahlstrom, K. (2004). Review of research: how leadership influences student learning. Minneapolis: University of Minnesota.Google Scholar
  46. Louis, K. S., Leithwood, K., Wahlstrom, K. L., Anderson, S. E., Michlin, M., Mascall, B., Gordon, M., Thomas, E., Tiiu, S., & Moore, S. (2010). Learning from leadership: investigating the links to improved student learning. Toronto: Center for Applied Research and Educational Improvement/University of Minnesota and Ontario Institute for Studies in Education/University of Toronto.Google Scholar
  47. Love, N. (2009). Using data to improve learning for all: a collaborative inquiry approach. Thousand Oaks: Corwin Press.Google Scholar
  48. Love, N., Stiles, K. E., Mundry, S., & Diranna, K. (2008). The data coach’s guide to improving learning for all students: unleashing the power of collaborative inquiry. Thousand Oaks: Corwin Press.Google Scholar
  49. MacBeath, J. (1999). Schools must speak for themselves: the case for school self-evaluation. London: Routledge.Google Scholar
  50. MacBeath, J. (2009). Self-evaluation for school improvement. Second international handbook of educational change. Dordrecht: Springer.Google Scholar
  51. MacBeath, J. (2013). Learning in and out of school: the selected works of John MacBeath. London: Routledge.Google Scholar
  52. Mandinach, E. B., & Gummer, E. S. (2016). Data literacy for educators: making it count in teacher preparation and practice. New York: Teachers College Press.Google Scholar
  53. Mandinach, E. B., & Jackson, S. S. (2012). Transforming teaching and learning through data-driven decision making. Thousand Oaks: Corwin Press.CrossRefGoogle Scholar
  54. Mandinach, E. B., Honey, M., & Light, D. (2006). A theoretical framework for data-driven decision making. In Annual meeting of the American Educational Research Association. San Francisco: AERA.Google Scholar
  55. Marsh, J. A. (2012). Interventions to promote data use: an introduction. Teachers College Record. New York: Columbia University.Google Scholar
  56. Marsh, J. A., & Farrell, C. C. (2014). How leaders can support teachers with data-driven decision making: a framework for understanding capacity building. Educational Management Administration & Leadership, 43, 269–289.CrossRefGoogle Scholar
  57. Marsh, J. A., Pane, J. F. & Hamilton, L. S. (2006). Making sense of data-driven decision making in education: Evidence from Recent RAND Research. Santa Monica, CA: RAND Corporation.Google Scholar
  58. Matthews, P., & Lewis, P. (2009). How do school leaders successfully lead learning? Nottingham: National College for School Leadership.Google Scholar
  59. McNamara, G., & O’Hara, J. (2008). Trusting schools and teachers: developing educational professionalism through self-evaluation. New York: Peter Lang.Google Scholar
  60. Morris, A. (2011). Student standardised testing: current practices in OECD countries and a literature review. OECD Education Working Papers No. 65. Paris: OECD Publishing.Google Scholar
  61. Nayir, K. F., & McNamara, G. (2014). The increasingly central role of school self-evaluation in inspection systems across Europe: the case of Ireland. Turkish Journal of Education, 3, 48–59.CrossRefGoogle Scholar
  62. Nelson, R., Ehren, M., & Godfrey, D. (2015). Literature review on internal evaluation. London: UCL Institute of Education. Available.Google Scholar
  63. O’Brien, S., McNamara, G., & O’Hara, J. (2015). Supporting the consistent implementation of self-evaluation in Irish post-primary schools. Educational Assessment, Evaluation and Accountability, 27, 377–393.CrossRefGoogle Scholar
  64. O'Day, J. (2002). Complexity, accountability, and school improvement. Harvard Educational Review, 72, 293–329.CrossRefGoogle Scholar
  65. Park, V., & Datnow, A. (2008). Collaborative assistance in a highly prescribed school reform model: the case of success for all. Peabody Journal of Education, 83, 400–422.CrossRefGoogle Scholar
  66. Park, V., & Datnow, A. (2009). Co-constructing distributed leadership: district and school connections in data-driven decision-making. School leadership and Management, 29, 477–494.CrossRefGoogle Scholar
  67. Parylo, O., & Zepeda, S. J. (2014). Describing an ‘effective’ principal: perceptions of the central office leaders. School Leadership & Management, 34, 518–537.CrossRefGoogle Scholar
  68. Patton, M. Q. (2015). Qualitative research & evaluation methods: integrating theory and practice. Thousand Oaks: SAGE.Google Scholar
  69. PDST. (2016). Senior Cycle Subject Analysis Spreadsheets [Online]. Dublin: PDST Available: http://PDST.ie/postprimary. Accessed Web Page 2016.Google Scholar
  70. Picciano, A. G. (2006). Data-driven decision making for effective school leadership. Englewood Cliffs: Prentice-Hall.Google Scholar
  71. Prøitz, T. S., Mausethagen, S., & Skedsmo, G. (2017). Investigative modes in research on data use in education. Nordic Journal of Studies in Educational Policy, 3(1), 42–55.CrossRefGoogle Scholar
  72. Romero, C., & Ventura, S. (2007). Educational data mining: a survey from 1995 to 2005. Expert Systems with Applications, 33, 135–146.CrossRefGoogle Scholar
  73. Rosenkvist, M. A. (2010). Using student test results for accountability and improvement. Paris: OECD.CrossRefGoogle Scholar
  74. Schildkamp, K. (2007). The utilisation of a self-evaluation instrument for primary education Accessed on-line http://doc.utwente.nl/57803/1/thesis_Schildkamp.pdf on 24/07/2015. Enshede: University of Twente.Google Scholar
  75. Schildkamp, K., & Kuiper, W. (2010). Data-informed curriculum reform: which data, what purposes, and promoting and hindering factors. Teaching and Teacher Education, 26, 482–496.CrossRefGoogle Scholar
  76. Schildkamp, K., & Tiddly, C. (2008). School performance feedback systems in the USA and in The Netherlands: a comparison. Educational Research and Evaluation, 14, 255–282.CrossRefGoogle Scholar
  77. Schildkamp, K., & Visscher, A. (2014). Data-centered school self-evaluation in the Netherlands: Characteristics and prerequisites. In M. Lai & S. Kushner (Eds.), A Developmental and Negotiated Approach to School Self-Evaluation (Advances in Program Evaluation) (Vol. 14, pp. 233–252). Bingley: Emerald Group Publishing, Limited.CrossRefGoogle Scholar
  78. Schildkamp, K., Rekers-Mombarg, L. T. M., & Harms, T. J. (2012). Student group differences in examination results and utilization for policy and school development. School Effectiveness and School Improvement, 23, 229–255.CrossRefGoogle Scholar
  79. Schildkamp, K., Karbautzki, L., & Vanhoof, J. (2013a). Exploring data use practices around Europe: identifying enablers and barriers. Studies in Educational Evaluation, 42, 15–24.CrossRefGoogle Scholar
  80. Schildkamp, K., Lai, M. K., & Earl, L. (2013b). Data-based decision making in education: challenges and opportunities. Dordrecht: Springer.CrossRefGoogle Scholar
  81. Schildkamp, K., Poortman, C. L., & Handelzalts, A. (2015). Data teams for school improvement. School Effectiveness and School Improvement, 27, 228–254.CrossRefGoogle Scholar
  82. Senge, P. M., Cambron-Mccabe, N., Lucas, T., Smith, B., & Dutton, J. (2012). Schools that learn: a fifth discipline fieldbook for educators, parents, and everyone who cares about education. Boston: Nicholas Brealey Publishing.Google Scholar
  83. Shah, M. (2014). Impact of management information systems (MIS) on school administration: what the literature says. Procedia-Social and Behavioral Sciences, 116, 2799–2804.CrossRefGoogle Scholar
  84. Shen, J., & Cooley, V. E. (2008). Critical issues in using data for decision-making. International Journal of Leadership in Education, 11, 319–329.CrossRefGoogle Scholar
  85. Smith, M. (2005). Data for schools in NSW: what is provided and can it help? Using data to support learning. Melbourne: Council for Educational Research.Google Scholar
  86. Smyth, E. (1999). Do schools differ? Dublin: Economic and Social Research Institute.Google Scholar
  87. Smyth, E., McCoy, S., & Kingston, G. (2015). Learning from the evaluation of DEIS. Dublin: ESRI.Google Scholar
  88. Spillane, J. P. (2012). Data in practice: conceptualizing the data-based decision-making phenomena. American Journal of Education, 118, 113–141.CrossRefGoogle Scholar
  89. Spillane, J. P., Halverson, R., & Diamond, J. B. (2004). Towards a theory of leadership practice: a distributed perspective. Journal of Curriculum Studies, 36, 3–34.CrossRefGoogle Scholar
  90. Sun, J., Przybylski, R., & Johnson, B. J. (2016). A review of research on teachers’ use of student data: from the perspective of school leadership. Educational Assessment, Evaluation and Accountability, 28:5.CrossRefGoogle Scholar
  91. Tan, H. C., Anumba, C. J., Carrillo, P. M., Bouchlaghem, D., Kamara, J., & Udeaja, C. (2009). Capture and reuse of project knowledge in construction. Chichester: Wiley.Google Scholar
  92. The Inspectorate (2013). Promoting the quality of learning, Chief Inspector’s Report 2010–2011. Dublin: DES.Google Scholar
  93. The Inspectorate. (2016). Inspectorate publications [Online]. Dublin: DES Available: http://www.education.ie/en/Publications/Inspection-Reports-Publications/Evaluation-Reports-Guidelines/. Accessed 01/10/2016.Google Scholar
  94. Tusla. (2016). Research and Statistics [Online]. Dublin: TUSLA Available: http://www.tusla.ie/services/educational-welfare-services/publications/research-and-statistics. Accessed 01/10/2016.Google Scholar
  95. Valli, L., Croninger, R. G., & Walters, K. (2007). Who (else) is the teacher? Cautionary notes on teacher accountability systems. American Journal of Education, 113, 635–662.CrossRefGoogle Scholar
  96. Visscher, A. J., & Coe, R. (2013). School improvement through performance feedback. London: Routledge.Google Scholar
  97. Wayman, J. C., & Stringfield, S. (2006). Data use for school improvement: school practices and research perspectives. American Journal of Education, 112, 463–468.CrossRefGoogle Scholar
  98. Wayman, J. C., Midgley, S., & Stringfield, S. (2006). Leadership for data-based decision-making: Collaborative educator teams. In A. B. Danzig (Ed.), Learner Centered leadership: Research, policy, and practice (pp. 189–206). Mahwah: Lawrence Erlbaum Associates.Google Scholar
  99. Wayman, J. C., Jimerson, J. B., & Cho, V. (2012b). Organizational considerations in establishing the data-informed district. School Effectiveness and School Improvement, 23, 159–178.CrossRefGoogle Scholar
  100. Wayman, J. C., Spring, S. D., Lemke, M. A., & Lehr, M. D. (2012c). Using data to inform practice: effective principal leadership strategies. Annual Meeting of the American Educational Research Association. Vancouver: AERA.Google Scholar
  101. Wohlstetter, P., Datnow, A., & Park, V. (2008). Creating a system for data-driven decision-making: applying the principal-agent framework. School Effectiveness and School Improvement, 19, 239–259.CrossRefGoogle Scholar
  102. Wrigley, T. (2013). Rethinking school effectiveness and improvement: a question of paradigms. Discourse: Studies in the Cultural Politics of Education, 34, 31–47.Google Scholar
  103. Yoon, S. Y. (2016). Principals’ data-driven practice and its influences on teacher buy-in and student achievement in comprehensive school reform models. Leadership and Policy in Schools, 15, 500–523.CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2018

Authors and Affiliations

  • Cornelius Young
    • 1
  • Gerry McNamara
    • 1
  • Martin Brown
    • 1
  • Joe O’Hara
    • 1
  1. 1.EQI – The centre for Evaluation, Quality and Inspection and DCU Institute of EducationDublin 9Ireland

Personalised recommendations