Skip to main content
SpringerLink
Log in

Taking Stock of Complementary Methods: The Perpetual Quest for Good Research Methods for Educational Leadership and Policy

  • Chapter
  • First Online:
Complementary Research Methods for Educational Leadership and Policy Studies

  • 1649 Accesses

Abstract

This chapter synthesizes the presentations of complementary methods by authors in this volume by discussing how their work helps answer three questions: (1) What methods can answer causal questions of what works, why, and under what conditions?; (2) How can methods accommodate the epistemological foundations of realist, interpretive, and critical knowledge paradigms?; and (3) How can research methods be used to generate knowledge that might address underlying patterns of privilege and power in education, rather than implicitly or explicitly supporting the status quo? The chapter concludes with comments about using methodological tools from the academic disciplines, structured causal analysis with qualitative data, critical quantitative analysis, and methods such as design research and improvement science that explore not only the present but also the future.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 149.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 199.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 199.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Angrist, J. D., & Pischke, J.-S. (2009). Mostly harmless econometrics: An empiricist’s companion. Princeton: Princeton University Press.

    Google Scholar 

  • Baker, R. S., & Corbett, A. T. (2014). Assessment of robust learning with educational data mining. Research & Practice in Assessment, 9, 38–50.

    Google Scholar 

  • Beadie, N. (2016). The federal role in education and the rise of social science research: Historical and comparative perspectives. Review of Research in Education, 40(1), 1–37.

    Article  Google Scholar 

  • Blaisdell, B. (2016). Exorcising the racism phantasm: Racial realism in educational research. Urban Review, 48, 285–310.

    Article  Google Scholar 

  • Borman, G. D. (2009). The use of randomized trials to inform education policy. In G. Sykes, B. Schneider, D. N. Plank, with T. G. Ford (Eds). Handbook of education policy research (pp. 129–138). New York: Routledge.

    Google Scholar 

  • Bowers, A. J. (2010). Grades and graduation: A longitudinal risk perspective to identify student dropouts. The Journal of Educational Research, 103(3), 191–207.

    Article  Google Scholar 

  • Boyce, A. (1915). Present methods of measuring teacher efficiency. Teachers College Record, 16(7), 11–28.

    Google Scholar 

  • Boyce, J., & Bowers, A. J. (2016). Principal turnover: Are there different types of principals who move from or leave their schools? A latent class analysis of the 2007–2008 schools and staffing survey and the 2008–2009 principal follow-up survey. Leadership and Policy in Schools, 15(3), 237–272.

    Article  Google Scholar 

  • Brady, H. E., & Collier, D. (2010). Rethinking social inquiry: Diverse tools, shared standards (2nd ed.). Lanham: Rowman & Littlefield Publishers.

    Google Scholar 

  • Brown, A. L., & De Lissovoy, N. (2011). Economies of racism: Grounding education policy research in the complex dialectic of race, class, and capital. Journal of Education Policy, 26(5), 595–619.

    Article  Google Scholar 

  • Bryk, A. S. (2009). Support a science of performance improvement. Phi Delta Kappan, 90(8), 597–600.

    Article  Google Scholar 

  • Bryk, A. S. (2015). 2014 AERA distinguished lecture: Accelerating how we learn to improve. Educational Researcher, 44(9), 467–477.

    Article  Google Scholar 

  • Bryk, A. S., Gomez, L. M., Grunow, A., & LeMahieu, P. G. (2015). Learning to improve: How America’s schools can get better at getting better. Cambridge, MA: Harvard Education Press.

    Google Scholar 

  • Callahan, R. E. (1962). Education and the cult of efficiency. Chicago: The University of Chicago Press.

    Google Scholar 

  • Campbell, D. T., & Stanley, J. C. (1963). Experimental and quasi-experimental designs for research. Chicago: Rand McNally & Company

    Google Scholar 

  • Carnoy, M. (2009). Policy research ineducation: The economic view. In G. Sykes, B. Schneider, D. N. Plank, with T. G. Ford (Eds). Handbook of education policy research (pgs. 27–38). New York: Routledge.

    Google Scholar 

  • Carter, D. F., & Hurtado, S. (2007). Bridging key research dilemmas: Quantitative research using a critical eye. New Directions for Institutional Research, 133, 25–35.

    Article  Google Scholar 

  • Cartwright, N. (2007). Hunting causes and using them: Approaches in philosophy and economics. Cambridge, UK: Cambridge University Press.

    Book  Google Scholar 

  • Caves, K. M., Meuer, J., & Rupietta, C. (2016). Advancing educational leadership research using qualitative comparative analysis (QCA). In B. G. Barnett, A. R. Shoho, & A. J. Bowers (Eds.), Challenges and opportunities of educational leadership research and practice: The state of the field and its multiple futures (pp. 147–170). Charlotte, NC: Information Age Publishing Inc.

    Google Scholar 

  • Coburn, C. E., Stein, M. K., & ProQuest (Firm). (2010). Research and practice in education: Building alliances, bridging the divide. Lanham: Rowman & Littlefield.

    Google Scholar 

  • Cook, T. D., & Campbell, D. T. (1979). Quasi-experimentation: Design and analysis issues for field settings. Boston: Houghton Mifflin Co.

    Google Scholar 

  • Desimone, L. M. (2009). Complementary methods for policy research. In G. Sykes, B. Schneider, D. N. Plank, with T. G. Ford (Eds). Handbook of education policy research (pp. 163–175). New York: Routledge.

    Google Scholar 

  • Dixson, A. D., & Rousseau, C. K. (2005). And we are still not saved: Critical race theory in education ten years later. Race, Ethnicity, and Education, 8(1), 7–27.

    Article  Google Scholar 

  • Donmoyer, R. (1999). The continuing quest for a knowledge base: 1976–1998. In J. Murphy & K. S. Louis (Eds.), Handbook of research on educational administration (2nd ed., pp. 23–44). San Francisco: Jossey-Bass.

    Google Scholar 

  • Easton, John Q. (2010). Out of the tower, into the schools: How new IES goals will reshape researcher roles. Presidential Talk, Annual Meeting of the American Educational Research Association, Denver, May 2.

    Google Scholar 

  • Figlio, D., Karbownik, K., & Salvanes, K. (2017). The promise of administrative data in education research. Education Finance and Policy, 12(2), 129–136.

    Article  Google Scholar 

  • Firestone, W., & Riehl, C. (Eds.) (2005). A new agenda for research in educational leadership. New York: Teachers College Press

    Google Scholar 

  • Fisher, R. A. (1935). The design of experiments. Edinburgh: Oliver and Boyde.

    Google Scholar 

  • Foster, W. (1989). The administrator as a transformative intellectual. Peabody Journal of Education, 66(3), 5–18.

    Google Scholar 

  • Gamoran, A. (2009). Commentary: The disciplinary foundations of education policy research. In G. Sykes, B. Schneider, D. N. Plank, with T. G. Ford (Eds). Handbook of education policy research (pp. 106–110). New York: Routledge.

    Google Scholar 

  • Gobo, G. (2008). Re-conceptualizing generalization: Old issues in a new frame. In P. Alasuutari, L. Bickman, & J. Brannen. (Eds.), The SAGE handbook of social research methods (pp. 193–213). Los Angeles: Sage.

    Google Scholar 

  • Greenfield, T. B., & Ribbins, P. (1993). Greenfield on educational administration: Towards a humane science. New York: Routledge.

    Google Scholar 

  • Gronn, P. C. (1983). Talk as the work: The accomplishment of school administration. Administrative Science Quarterly, 28(1), 1–21.

    Article  Google Scholar 

  • Hallinger, P., & Heck, R. H. (2011). Conceptual and methodological issues in studying school leadership effects as a reciprocal process. School Effectiveness and School Improvement, 22(2), 149–173.

    Article  Google Scholar 

  • Hedges, L. V., Pigott, T. D., Polanin, J. R., Ryan, A. M., Tocci, C., & Williams, R. T. (2016). The question of school resources and student achievement: A history and reconsideration. Review of Research in Education, 40(1), 143–168.

    Article  Google Scholar 

  • Hutt, E. L. (2016). Surveying the nation: Longitudinal surveys and the construction of national solutions to educational inequity. Ethics and Education, 11(2), 240–258.

    Article  Google Scholar 

  • Kaplan, D. (2009). Causal inference in non-experimental educational policy research. In G. Sykes, B. Schneider, D. N. Plank, with T. G. Ford (Eds). Handbook of education policy research (pgs. 139–153). New York: Routledge.

    Google Scholar 

  • King, G., Keohane, R. O., & Verba, S. (1994). Designing social inquiry: Scientific inference in qualitative research. Princeton: Princeton University Press.

    Google Scholar 

  • Labaree, D. F. (2011). The lure of statistics for educational researchers. Educational Theory, 61(6), 621–632.

    Article  Google Scholar 

  • Levin, H.M. (1983). Cost-effectiveness: A primer. Beverly Hills, CA: SAGE Publications.

    Google Scholar 

  • Lincoln, Y. S., & Guba, E. G. (1985). Naturalistic inquiry. Beverly Hills: Sage Publications.

    Google Scholar 

  • Loeb, S., & Strunk, K. (2003). The contribution of administrative and experimental data to education policy research. National Tax Journal, 56(2), 415–438.

    Article  Google Scholar 

  • Mertens, D. M., Bazeley, P., Bowleg, L., Fielding, N., Maxwell, J., Molina-Azorin6, J. F., & Niglas, K. (2016). Expanding thinking through a kaleidoscopic look into the future: Implications of the mixed methods international research association’s task force report on the future of mixed methods. Journal of mixed methods research, 10(3), 221–227.

    Google Scholar 

  • Miles, M. B., & Huberman, A. M. (1994). Qualitative data analysis: An expanded sourcebook (2nd ed.). Thousand Oaks: Sage Publications.

    Google Scholar 

  • Morgan, S. L., & Winship, C. (2007). Counterfactuals and causal inference: Methods and principles for social research. New York: Cambridge University Press.

    Google Scholar 

  • Murnane, R. J., & Willett, J. B. (2011). Methods matter: Improving causal inference in educational and social science research. Oxford: Oxford University Press.

    Google Scholar 

  • Orland, M. (2009). Separate orbits: The distinctive worlds of educational research and policymaking. In G. Sykes, B. Schneider, D. N. Plank, with T. G. Ford (Eds). Handbook of education policy research (pp. 113–128). New York: Routledge.

    Google Scholar 

  • Patton, M. Q. (2011). Developmental evaluation: Applying complexity concepts to enhance innovation and use. New York: Guilford Press.

    Google Scholar 

  • Penuel, W. R., Fishman, B. J., Cheng, B. H., & Sabelli, N. (2011). Organizing research and development at the intersection of learning, implementation, and design. Educational Researcher, 40(7), 331–337.

    Article  Google Scholar 

  • Ragin, C. C. (2013). New directions in the logic of social inquiry. Political Research Quarterly, 66(1), 171–174.

    Google Scholar 

  • Ragin, C. C. (2014). The comparative method: Moving beyond qualitative and quantitative strategies. Oakland: University of California Press.

    Google Scholar 

  • Rebell, M. (2007). Professional rigor, public engagement and judicial review: A proposal for enhancing the validity of education adequacy studies. Teachers College Record, 109(6), 1303–1373.

    Google Scholar 

  • Rebell, M. A. (2008). Equal opportunity and the courts. Phi Delta Kappan, 89(6), 432.

    Article  Google Scholar 

  • Riehl, C. (2006a). Feeling better: A comparison of medical research and education research. Educational Researcher, 35(5), 24–29.

    Article  Google Scholar 

  • Riehl, C. (2006b). Research on educational leadership: Knowledge we need for the world we live in. In F. W. English & G. C. Furman (Eds.), Research and educational leadership: Navigating the new National Research Council guidelines. Lanham: Rowman and Littlefield Publishers.

    Google Scholar 

  • Riehl, C., & Firestone, W. (2005). What research methods should be used to study educational leadership? In W. Firestone and C. Riehl (Eds.), A new agenda for research in educational leadership (pgs. 156–170). New York: Teachers College Press.

    Google Scholar 

  • Riehl, C., & Lyon, M. A. (2017). Counting on context: Cross-sector collaborations for education and the legacy of James Coleman’s sociological vision. The Annals of the American Academy of Political and Social Science, 674(1), 262–280.

    Article  Google Scholar 

  • Robinson, V. M. J. (1995). The identification and evaluation of power in discourse. In D. Corson (Ed.), Discourse and power in educational organizations (pp. 111–130). Cresskill: Hampton Press, Inc.

    Google Scholar 

  • Spillane, J. P., Pareja, A. S., Dorner, L., Barnes, C., May, H., Huff, J., & Camburn, E. (2010). Mixing methods in randomized controlled trials (RCTs): Validation, contextualization, triangulation, and control. Educational Assessment, Evaluation and Accountability, 22(1), 5–28.

    Article  Google Scholar 

  • Stage, F. K. (2007). Answering critical questions using quantitative data. New Directions for Institutional Research, 133, 5–16.

    Article  Google Scholar 

  • Stage, F. K., & Wells, R. S. (2014). Critical quantitative inquiry in context. New Directions for Institutional Research, 158, 1–6.

    Article  Google Scholar 

  • Strayer, G. D. (1915). The methods of a school survey. Teachers College Record, 16(1), 40–44.

    Google Scholar 

  • Timar, T. B. (1997). The institutional role of state education departments: A historical perspective. American Journal of Education, 105(3), 231–260.

    Article  Google Scholar 

  • Weimer, D. L. (2009). Making education research more policy-analytic. In G. Sykes, B. Schneider, D. N. Plank, with T. G. Ford (Eds). Handbook of education policy research (pp. 93–100). New York: Routledge.

    Google Scholar 

  • Weiss, C. H. (1980). Knowledge creep and decision accretion. Knowledge: Creation, Diffusion, Utilization, 1(3), 381–404.

    Article  Google Scholar 

  • Willower, D. J., & Forsyth, P. B. (1999). A brief history of scholarship on educational administration. In J. Murphy & K. S. Louis (Eds.), Handbook of research on educational administration (2nd ed., pp. 1–23). San Francisco: Jossey-Bass.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Education Policy and Social Analysis, Teachers College, Columbia University, New York, NY, USA

    Carolyn J. Riehl

Authors
  1. Carolyn J. Riehl
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Carolyn J. Riehl .

Editor information

Editors and Affiliations

  1. School of Education, Indiana University, Bloomington, IN, USA

    Chad R. Lochmiller

Rights and permissions

Reprints and permissions

Copyright information

© 2018 The Author(s)

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Riehl, C.J. (2018). Taking Stock of Complementary Methods: The Perpetual Quest for Good Research Methods for Educational Leadership and Policy. In: Lochmiller, C. (eds) Complementary Research Methods for Educational Leadership and Policy Studies. Palgrave Macmillan, Cham. https://doi.org/10.1007/978-3-319-93539-3_18

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-93539-3_18

  • Published:

  • Publisher Name: Palgrave Macmillan, Cham

  • Print ISBN: 978-3-319-93538-6

  • Online ISBN: 978-3-319-93539-3

  • eBook Packages: EducationEducation (R0)

Publish with us

Policies and ethics

Search

Navigation