Skip to main content

Quality Criteria in Educational Research: Is Beauty More Important Than Popularity?

  • Chapter
  • First Online:
A Companion to Research in Education
  • 4177 Accesses

Abstract

As noted by Scott, during the past decade, following the lead of moves in the USA and UK, national governments have scrutinised more closely the cost effectiveness and impact of research funding within higher education. Direct criticism of the overall quality of educational research has emerged, particularly in terms of its scientific rigour, its utility for practitioners, and the manner in which it is assessed. This contribution to the Companion explores the reasons why the quality of educational research has come to be so questioned, and examines a key discussion framework for assessing quality that has emerged from this debate. It then considers the merits of possible internal and external criteria for the worth of educational research, and the links between these criterial sets and the function and purpose of qualitative and quantitative approaches to educational research. Finally, the question of whether educational research is an art or a science is addressed.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 149.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 199.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 199.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Bassey M (1992) Creating education through research. Br Educ Res J 18(1):3–16

    Article  Google Scholar 

  • Bassey M (1993) Educational research in the universities and colleges of the United Kingdom: significant insights or trivial pursuits. Paper presented at the Social Sciences and Humanities Research Council of Canada Conference on Evaluation, Social Science and Public Policy, Ottawa, 11 June 1993

    Google Scholar 

  • Bassey M (2001) A solution to the problem of generalisation in educational research: fuzzy prediction. Oxf Rev Educ 27(1):5–22

    Article  Google Scholar 

  • Berliner DC (2002) Educational research: the hardest science of all. Educ Res 31(8):18–20

    Google Scholar 

  • Berridge MJ, Irvine RF (1984) Inositol trisphosphate: a novel second messenger in cellular signal transduction. Nature 312:315–321

    Article  Google Scholar 

  • Blunkett D (2000) Influence or irrelevance: can social science improve government? Speech made by David Blunkett, Secretary of State for Education and Employment, to a meeting convened by the Economic and Social Research Council on 2 February 2000. Research Intelligence, pp 12–21

    Google Scholar 

  • Bridges D, Smeyers P, Smith R (2008) Educational research and the practical judgement of policy makers. J Philos Educ 42(S1):7–14

    Google Scholar 

  • Carlyle T (1849) Occasional Discourse on the Negro Question. Fraser’s Magazine for Town and Country, XL [reprinted in The commercial review of the South and West (later De Bow’s Review), June, 1850, Vol. VIII (Old Series), Vol. II, No.4, pp. 527–538]

    Google Scholar 

  • Carr D (2003) Making sense of education. Routledge-Falmer, London/New York

    Google Scholar 

  • Dewey J (1902) Academic freedom. Educ Rev 21(813):1–14

    Google Scholar 

  • Edwards T (2000) ‘All the evidence shows …’: reasonable expectations of educational research. Oxf Rev Educ 26(3):299–311

    Article  Google Scholar 

  • Evans J, Benefield P (2001) Systematic reviews of educational research: does the medical model fit? Br Educ Res J 27(5):527–541

    Article  Google Scholar 

  • Feuer M, Towne L, Shavelson R (2002) Scientific culture and educational research. Educ Res 31(8):4–14

    Google Scholar 

  • Furlong J, Oancea A (2005) Assessing quality in applied and practice-based educational research: a framework for discussion. Department of Educational Studies, Oxford University, Oxford

    Google Scholar 

  • Gouldner A (1957) Theoretical requirements of the applied social sciences. Am Sociol Rev 22(10):92–102

    Article  Google Scholar 

  • Hammersley M (1997) Educational research and teaching: a response to David Hargreaves’ TTA Lecture. Br Educ Res J 23(2):141–161

    Article  Google Scholar 

  • Hammersley M (2000) Varieties of social research: a typology. Int J Soc Res Methodol 3(3):221–229

    Article  Google Scholar 

  • Hammersley M (2005) Assessing quality in qualitative research. Paper for a TLRP seminar on assessing quality in case study and qualitative research, TLRP seminar series on quality in educational research, July, Birmingham

    Google Scholar 

  • Hammersley M (2008) Troubling criteria: a critical commentary on Furlong and Oancea’s framework for assessing educational research. Br Educ Res J 34(6):747–762

    Article  Google Scholar 

  • Harden A, Thomas J (2005) Methodological issues in combining diverse study types in systematic reviews. Int J Soc Res Methodol 8(3):257–271

    Article  Google Scholar 

  • Hargreaves D (1996) Teaching as a research based profession: possibilities and prospects. TTA Annual Lecture 1996. Reprinted in Moon B, Butcher J, Bird E (eds) (2001) Leading professional development in education. Routledge, London, pp 200–210

    Google Scholar 

  • Hargreaves D (1997) In defence of research for evidence-based teaching: a rejoinder to Martyn Hammersley. Br Educ Res J 23(4):405–419

    Article  Google Scholar 

  • HEFCE (Higher Education Funding Council for England) (2007) Research assessment exercise education panel assessment criteria. HEFCE, Swindon

    Google Scholar 

  • HEFCE (2009) Research excellence framework: second consultation on the assessment and funding of research. HEFCE, Swindon

    Google Scholar 

  • Hillage J, Pearson R, Anderson A, Tamkin P (1998) Excellence in research in schools. Department for Education & Employment/Institute of Employment Studies, London

    Google Scholar 

  • Hodkinson P (2004) Research as a form of work: expertise, community and methodological objectivity. Br Educ Res J 30(1):9–26

    Article  Google Scholar 

  • Kaestle CF (1993) The awful reputation of educational research. Educ Res 22(1):26–31

    Google Scholar 

  • Karran T (2009) Academic freedom: in justification of a universal ideal. Stud High Educ 34(3):263–283

    Article  Google Scholar 

  • Keynes JM (1934) Introduction to the Cambridge handbook of economic series. Cambridge University Press, Cambridge/New York

    Google Scholar 

  • Lawrence P (2003) The politics of publication. Nature 422:259–261

    Article  Google Scholar 

  • MacLure M (2005) ‘Clarity bordering on stupidity’: where’s the quality in systematic review? J Educ Policy 20(4):393–416

    Article  Google Scholar 

  • Mankiw NG, Taylor MP (2006) Macroeconomics. Worth Publishers, New York

    Google Scholar 

  • McGaw B, Boud D, Poole M, Warry S, McKechnie P (1992) Educational research in Australia: report of the review panel of research in education. Australian Government Publishing Service, Canberra

    Google Scholar 

  • McIntyre D (1997) The profession of educational research. Br Educ Res J 23(2):127–140

    Article  Google Scholar 

  • Neumann R (2005) Doctoral differences: professional doctorates and PhDs compared. J High Educ Policy Manage 27(2):173–188

    Article  Google Scholar 

  • Newby H (2003) Verbal Evidence to the House of Commons Education and Skills Committee. 5 Mar 2003, London

    Google Scholar 

  • Oancea A (2005) Criticisms of educational research: key topics and levels of analysis. Br Educ Res J 31(2):157–183

    Article  Google Scholar 

  • Oancea A (2007) From Procrustes to Proteus: trends and practices in the assessment of education research. Int J Res Method Educ 30(3):243–269

    Article  Google Scholar 

  • Oancea A, Furlong J (2007) Expressions of excellence and the assessment of applied and practice-based research. Res Pap Educ 22(2):119–137

    Article  Google Scholar 

  • Oancea A, Pring R (2008) The importance of being thorough: on systematic accumulations of ‘what works’ in education research. J Philos Educ 42(S1):15–39

    Article  Google Scholar 

  • OECD (1994) Main definitions and conventions for the measurement of research and experimental development: a summary of the Frascati manual, OCDE/GD(94)84. OECD, Paris

    Google Scholar 

  • Phillips DC (2005) The contested nature of empirical educational research (and why philosophy of education offers little help). J Philos Educ 39(4):577–597

    Article  Google Scholar 

  • Pring R (2000a) Editorial conclusion: a philosophical perspective. Oxf Rev Educ 26(3):495–501

    Article  Google Scholar 

  • Pring R (2000b) The ‘false dualism’ of educational research. J Philos Educ 34(2):247–260

    Article  Google Scholar 

  • Prost A (2001) Pour un Programme Stratégique de Recherche en Education. Ministère de l’Education Nationale, Paris

    Google Scholar 

  • Shavelson RJ, Towne L (eds) (2002) National Research Council Committee on Scientific Principles for Educational Research. Scientific Research in Education. National Academy Press, Washington, DC

    Google Scholar 

  • Spencer L, Ritchie J, Lewis J, Dillon L (2003) Quality in qualitative evaluation: a framework for assessing research evidence. Cabinet Office, Government Chief Social Researcher’s Office, London

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Terence Karran .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer Science+Business Media Dordrecht

About this chapter

Cite this chapter

Karran, T. (2014). Quality Criteria in Educational Research: Is Beauty More Important Than Popularity?. In: Reid, A., Hart, E., Peters, M. (eds) A Companion to Research in Education. Springer, Dordrecht. https://doi.org/10.1007/978-94-007-6809-3_58

Download citation

Publish with us

Policies and ethics