Philosophical Studies

, Volume 172, Issue 7, pp 1929–1952 | Cite as

Reliability for degrees of belief

  • Jeff DunnEmail author


We often evaluate belief-forming processes, agents, or entire belief states for reliability. This is normally done with the assumption that beliefs are all-or-nothing. How does such evaluation go when we’re considering beliefs that come in degrees? I consider a natural answer to this question that focuses on the degree of truth-possession had by a set of beliefs. I argue that this natural proposal is inadequate, but for an interesting reason. When we are dealing with all-or-nothing belief, high reliability leads to high levels of truth-possession. However, when it comes to degrees of belief, reliability and truth-possession part ways. The natural answer thus fails to be a good way to evaluate degrees of belief for reliability. I propose and develop an alternative method based on the notion of calibration, suggested by Frank Ramsey, which does not have this problem and consider why we should care about such assessments of reliability even if they are not tied directly to truth-possession.


Goldman Reliabilism Reliability Scoring rules Credences Degrees of belief Bayesian Calibration Refinement Power 



Earlier versions of this paper were given at the Fall 2011 Meeting of the Indiana Philosophical Association, the 2012 Central APA, and at Western Michigan University. Thanks to all participants there. Thanks especially to Erik Wielenberg, Jennifer Lackey, Lara Buchak, Chris Meacham, James Joyce, Ethan Brauer, and anonymous reviewers for Philosophical Studies for very helpful comments.


  1. Armstrong, D. (1973). Belief, truth and knowledge. Cambridge: Cambridge University Press.CrossRefGoogle Scholar
  2. Baumann, P. (2009). Reliabilism—modal, probabilistic, or contextualist. Grazer Philosophische Studien, 79, 77–89.Google Scholar
  3. Bird, A. (2004). Is evidence non-inferential? The Philosophical Quarterly, 54, 252–265.CrossRefGoogle Scholar
  4. Blattenberger, G., & Lad, F. (1985). Separating the Brier score into calibration and refinement components: A graphical exposition. American Statistician, 39, 26–32.Google Scholar
  5. Brier, G. (1950). Verification of forecasts expressed in terms of probability. Monthly Weather Review, 78(1), 1–3.CrossRefGoogle Scholar
  6. Cohen, S. (1984). Justification and truth. Philosophical Studies, 46, 279–295.CrossRefGoogle Scholar
  7. De Finetti, B. (1972). Probability, induction and statistics: The art of guessing. New York: Wiley.Google Scholar
  8. DeGroot, M., & Fienberg, S. (1983). The comparison and evaluation of forecasters. Journal of the Royal Statistical Society D (The Statistician), 32(1/2), 12–22.Google Scholar
  9. DePaul, M. (2004). Truth consequentialism: Withholding and proportioning belief to the evidence. Philosophical Issues, 14(1), 91–112.CrossRefGoogle Scholar
  10. Dunn, J. (2012). Evidential externalism. Philosophical Studies, 158(3), 435–455.CrossRefGoogle Scholar
  11. Gibbard, A. (2008). Rational credence and the value of truth. In T. Gendler & J. Hawthorne (Eds.), Oxford studies in epistemology (Vol. 2). Oxford: Oxford University Press.Google Scholar
  12. Goldman, A. (1979). What is justified belief? In G. Pappas (Ed.), Justification and knowledge (pp. 1–23). Dordrecht: D Reidel.CrossRefGoogle Scholar
  13. Goldman, A. (1986). Epistemology and cognition. Cambridge, MA: Harvard University Press.Google Scholar
  14. Goldman, A. (1988). Strong and weak justification. Philosophical Perspectives, 2, 51–69.CrossRefGoogle Scholar
  15. Goldman, A. (1999). Knowledge in a social world. Oxford: Oxford University Press.CrossRefGoogle Scholar
  16. Goldman, A. (2010). Epistemic relativism and reasonable disagreement. In R. Feldman & T. Warfield (Eds.), Disagreement (pp. 187–215). Oxford: Oxford University Press.CrossRefGoogle Scholar
  17. Goldman, A. (2012). Reliabilism and contemporary epistemology. Oxford: Oxford University Press.CrossRefGoogle Scholar
  18. Goldman, A., & Shaked, M. (1991). An economic model of scientific activity and truth acquisition. Philosophical Studies, 63(1), 31–55.CrossRefGoogle Scholar
  19. Greaves, H., & Wallace, D. (2006). Justifying conditionalization: Conditionalization maximizes expected epistemic utility. Mind, 115(459), 607–632.CrossRefGoogle Scholar
  20. Greco, J. (1999). Agent reliabilism. Noûs, 33, 273–296.CrossRefGoogle Scholar
  21. Hájek, A. (unpublished). A puzzle about degree of belief. Retrieved from
  22. Jeffrey, R. (1965). The logic of decision. Chicago: University of Chicago Press.Google Scholar
  23. Joyce, J. (1998). A nonpragmatic vindication of probabilism. Philosophy of Science, 65(4), 575–603.CrossRefGoogle Scholar
  24. Joyce, J. (2009). Accuracy and coherence: Prospects for an alethic epistemology of partial belief. In F. Huber & C. Schmidt-Petri (Eds.), Degrees of belief (pp. 263–297). New York: Springer.CrossRefGoogle Scholar
  25. Lange, M. (1999). Calibration and the epistemological role of Bayesian conditionalization. The Philosophical Review, 96(6), 292–324.Google Scholar
  26. Leitgeb, H., & Pettigrew, R. (2010a). An objective justification of Bayesianism I: Measuring inaccuracy. Philosophy of Science, 77(2), 201–235.CrossRefGoogle Scholar
  27. Leitgeb, H., & Pettigrew, R. (2010b). An objective justification of Bayesianism II: The consequences of minimizing inaccuracy. Philosophy of Science, 77(2), 236–272.CrossRefGoogle Scholar
  28. Maher, P. (1996). Subjective and objective confirmation. Philosophy of Science, 63, 149–174.CrossRefGoogle Scholar
  29. Murphy, A. (1972). Scalar and vector partitions of the probability score: Part I. Two-state situation. Journal of Applied Meteorology, 11, 273–282.CrossRefGoogle Scholar
  30. Murphy, A. (1973). A new vector partition of the probability score. Journal of Applied Meteorology, 12, 595–600.CrossRefGoogle Scholar
  31. Neta, R. (2008). What evidence do you have? British Journal for the Philosophy of Science, 59, 89–119.CrossRefGoogle Scholar
  32. Pritchard, D., Millar, A., & Haddock, A. (2010). The nature and value of knowledge: Three investigations. Oxford: Oxford University Press.CrossRefGoogle Scholar
  33. Ramsey, F. P. (1931). Truth and probability. In R. B. Braithwaite (Ed.), The foundations of mathematics and other logical essays (pp. 156–198). London: Routledge.Google Scholar
  34. Sanders, F. (1963). On subjective probability forecasting. Journal of Applied Meteorology, 2(2), 191–201.CrossRefGoogle Scholar
  35. Savage, L. (1971). Elicitation of personal probabilities and expectations. Journal of the American Statistical Association, 66(336), 783–801.CrossRefGoogle Scholar
  36. Schmitt, F. F. (2000). Veritistic value. Social Epistemology, 14(4), 259–280.CrossRefGoogle Scholar
  37. Seidenfeld, T. (1985). Calibration, coherence, and scoring rules. Philosophy of Science, 52, 274–294.CrossRefGoogle Scholar
  38. Silins, N. (2005). Deception and evidence. Philosophical Perspectives, 19, 375–404.CrossRefGoogle Scholar
  39. van Fraassen, B. (1983). Calibration: A frequency justification for personal probability. Boston Studies in the Philosophy of Science, 76, 295–319.Google Scholar
  40. Weisberg, J. (2009). Commutativity or holism? A dilemma for conditionalizers. The British Journal for the Philosophy of Science, 60(4), 793.CrossRefGoogle Scholar
  41. Weisberg, J. (2011). Varieties of Bayesianism. In D. Gabbay, S. Hartmann, & J. Woods (Eds.), Handbook of the history of logic (Vol. 10). New York: Elsevier.Google Scholar
  42. Williamson, T. (2000). Knowledge and Its limits. Oxford: Oxford University Press.Google Scholar

Copyright information

© Springer Science+Business Media Dordrecht 2014

Authors and Affiliations

  1. 1.Department of PhilosophyDePauw UniversityGreencastleUSA

Personalised recommendations