Quality & Quantity

, Volume 51, Issue 5, pp 2319–2335 | Cite as

Confirmation bias: methodological causes and a palliative response

  • Adam FfordeEmail author


The paper advocates for changes to normative aspects of belief management in applied research. The central push is to argue for methodologically-required choice to include the possibility of adopting the view that a given dataset contains insufficient regularities for predictive theorising. This is argued to be related to how we should understand differences between predictive and non-predictive knowledges, contrasting Crombie and Nisbet. The proposed direction may also support management practices under conditions of uncertainty.


Confirmation bias Research methodology Agnotology Unknowability 


  1. ASA (American Statistical Association).: American Statistical Association Releases Statement on Statistical Significance and P-values (2016)
  2. Caballero, R.J.: Macroeconomics after the crisis: time to deal with the pretence-of-knowledge syndrome. J. Econ. Perspect. 24(4), 85–102 (2010)CrossRefGoogle Scholar
  3. Cohen, J.: The earth is round (p < 0.5). Am. Psychol. 49(12), 997–1003 (1994)CrossRefGoogle Scholar
  4. Converse, P.E.: The nature of belief systems in mass publics. In: David, E.D., Apter, E. (eds.) Ideology and its discontents, vol. 18(1-3), pp. 1–74. The Free Press of Glencoe, reprinted in Critical Review, New York (2006)Google Scholar
  5. Crombie, A.C.: Robert Grosseteste and the Origins of Experimental Science 1100-1700. Clarendon Press, Oxford (1953)Google Scholar
  6. Dunn, John: The Cunning of Unreason: Making Sense of Politics. Basic Books, New York NY (2000)Google Scholar
  7. Ferguson, J.: The Anti-Politics Machine: “Development,” Depoliticization and Bureaucratic Power in Lesotho. Cambridge University Press, Cambridge (1990)Google Scholar
  8. Ferguson, J.: Development and Bureaucratic Power in Lesotho. In: Majid, Ed (ed.) Rahnema and Victoria Bawtree, The Post-Development Reader. Zed Books, London (1997)Google Scholar
  9. Fforde, A.: Persuasion: reflections on economics, data and the ‘homogeneity assumption. J Econ Methodol 12(1), 63–91 (2005)CrossRefGoogle Scholar
  10. Fforde, A.: Coping with facts: a skeptic’s guide to the problem of development. Kumarian Press, Bloomfield (2009)Google Scholar
  11. Fforde, A.: Responses to the policy science problem: reflections on the politics of development. Dev Pract 20(2), 188–204 (2010)CrossRefGoogle Scholar
  12. Fforde, A.: ‘Policy recommendations as spurious predictions: toward a theory of economists’ ignorance’. Crit Rev 23(1–2), 105–115 (2011)CrossRefGoogle Scholar
  13. Fforde, A.: Understanding development economics: its challenge to development studies. Routledge, London (2013)Google Scholar
  14. Fforde, A.: What might international development assistance be able to tell us about contemporary ‘policy government’ in developed countries? Adm. Soc. (2015)Google Scholar
  15. Fforde, A.: Reinventing Development: The Sceptical Change Agent. Palgrave, London (2016)Google Scholar
  16. Fforde, A., Parker, S.: Towards a Metric of Ignorance: The Paine Index. Mimeo, New York (2012)Google Scholar
  17. Fforde, A., Seidel, K.: Cambodia: donor playground? Defeat and doctrinal dysfunction in a hoped-for client state. South East Asian Res 23, 79–99 (2015)CrossRefGoogle Scholar
  18. Fourcade, M., et al.: The Superiority of Economists. J. Econ. Perspect. 29(1), 89–114 (2015)CrossRefGoogle Scholar
  19. Friedman, J.: Public competence in normative and positive theory: neglected implications of “The nature of belief systems in mass publics”. Crit. Rev. 18(1–3), i–xliii (2006)Google Scholar
  20. Gillespie, M.A.: The Theological Origins of Modernity. University of Chicago Press, Chicago (2008)CrossRefGoogle Scholar
  21. Granger, C.W.J., Newbold, P.: Spurious regressions in econometrics. J. Econom. 2(2), 111–120 (1974)CrossRefGoogle Scholar
  22. Granger, C.W.J.: Spurious regression. In: Eatwell, J., Milgate, M., Newman, P. (eds.) Econometrics. WW Norton & Company, London (1990)Google Scholar
  23. Hoffman, K.: Auftragstaktik: mission-based leadership. Engineer 24(4), 50–55 (1994)Google Scholar
  24. Held, David, et al.: Global Transformations, 1st edn. Polity Press, Cambridge (1999)Google Scholar
  25. Kenny, Charles, Williams, David: What do we know about economic growth? Or, why don’t we know very much? World Dev. 29(1), 2001 (2001)CrossRefGoogle Scholar
  26. Levine, R., Zervos, S.J.: What have we learnt about policy and growth from cross-country regressions? Am. Econ. Rev. 82(2), 426–430 (1993)Google Scholar
  27. McCloskey, D.M.: The Rhetoric of Economics. University of Wisconsin Press, Madison (1985)Google Scholar
  28. Mynatt, Clifford R., Doherty, Michael E., Tweney, Ryan D.: Confirmation bias in a simulated research environment: an experimental study of scientific inference. Q J Exp Psychol 29(1), 85–95 (1977)CrossRefGoogle Scholar
  29. Nickerson, R.S.: Confirmation bias: a ubiquitous phenomenon in many guises. Rev Gen Psychol 2(2), 175–220 (1998)CrossRefGoogle Scholar
  30. Nisbet, R.A.: Social Change and History: Aspects of the Western Theory of Development. Oxford University Press, Oxford (1969)Google Scholar
  31. NDT Resource Center.: Fatigue Crack Growth Rate Properties. (2013). Accessed 20 May 2013
  32. Shore, C., Wright, S.: Policy: a new field of anthropology. In: Chris, Ed (ed.) Anthropology of Policy: Critical Perspectives on Governance and Power. Routledge, London (1997)Google Scholar
  33. Solow, R.M.: A contribution to the theory of economic growth. Quart. J. Econ. 70(1), 65–94 (1956)CrossRefGoogle Scholar
  34. Solow, R.M.: What have we learned from a decade of empirical research on growth? Applying growth theory across countries. World Bank Econ. Rev. 15(2), 283–288 (2001)CrossRefGoogle Scholar
  35. Sullivan, H.: ’Truth’ junkies: using evaluation in UK public policy. Policy Politics 39(4), 499–512 (2012)CrossRefGoogle Scholar
  36. Weiss, K.M.: Agnotology: how can we handle what we don’t know in a knowing way? Evol. Anthropol. 21, 96–100 (2012)CrossRefGoogle Scholar
  37. White, L.: Technology and invention in the Middle Ages. Speculum 15(2), 141–159 (1940)CrossRefGoogle Scholar
  38. Wood, A.: Comment. In: Pasinetti L., Solow RM. (eds) Economic growth and the structure of long-term development, Proceedings of the IEA Conference, Varenna, Italy, (IEA Conference Volume, No. 1), London, Macmillan (1994)Google Scholar
  39. Yonay, Y., Breslau, D.: Marketing models: the culture of mathematical economics. Sociol. Forum 21, 345–386 (2006)CrossRefGoogle Scholar
  40. Yonay, Yuval P.: The Struggle Over the Soul of Economics. Princeton University Press, Princeton (1998)CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media Dordrecht 2016

Authors and Affiliations

  1. 1.Victoria UniversityMelbourneAustralia

Personalised recommendations