Skip to main content
Log in

Evaluating Formal Models of Science

  • Article
  • Published:
Journal for General Philosophy of Science Aims and scope Submit manuscript

Abstract

This paper presents an account of how to evaluate formal models of science: models and simulations in social epistemology designed to draw normative conclusions about the social structure of scientific research. I argue that such models should be evaluated according to their representational and predictive accuracy. Using these criteria and comparisons with familiar models from science, I argue that most formal models of science are incapable of supporting normative conclusions.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

Notes

  1. Unlike the other papers discussed here, Hong and Page (2004) do not discuss science specifically, but rather problem solving generally. However, due to the similarity of their approach to that employed by philosophers of science, I treat this paper as part of the formal models of science literature.

  2. Philosophers often distinguish between Aristoltean idealization, which ignores irrelevant features of a system, and Galilean idealization, which deliberately distorts the system. According to this taxonomy, Cartwright’s “Non-Galilean” idealizations would actually be a subset of Galilean idealization. For simplicity I maintain Cartwright’s terminology.

  3. This is not to say that Schelling’s model involves no non-Galilean idealizations. For instance, it assumes that moving is costless and that individuals of either colour are equally free to move to any vacant location.

  4. As a reviewer observed, this is a weak, qualitative prediction. Schelling’s model, like some formal models of science, relies on the robustness of this behaviour for its explanatory appeal. As discussed below, what distinguishes Schelling’s model from most formal models of science is not its predictive accuracy, but that this behaviour is generated by Galilean (stripping away) idealizations.

References

  • Abiodun, B., et al. (2014). Evaluation of climate models. In T. F. Stocker, et al. (Eds.), Climate change 2013: The physical science basis. Contribution of working group I to the fifth assessment report of the Intergovernmental Panel on Climate Change (pp. 741–866). New York: Cambridge University Press.

    Google Scholar 

  • Alexander, J. M. (2017). Malcom’s maxim and formal models of scientific inquiry. In Formal models of scientific inquiry (conference). http://homepage.ruhr-uni-bochum.de/defeasible-reasoning/Conference-Formal-Models.html. Accessed December 2018.

  • Alexander, J. M., Himmelreich, J., & Thompson, C. (2015). Epistemic landscapes, optimal search, and the division of cognitive labor. Philosophy of Science,82(3), 424–453.

    Article  Google Scholar 

  • Angrist, J., et al. (2017). Economic research evolves: Fields and styles. The American Economic Review,107(5), 293–297.

    Article  Google Scholar 

  • Arrow, K., & Debreu, G. (1954). Existence of an equilibrium for a competitive economy. Econometrica: Journal of the Econometric Society,22(3), 265–290.

    Article  Google Scholar 

  • Cartwright, N. (2005). The vanity of rigour in economics: Theoretical models and Galilean experiments. In P. Fontaine, & R. Leonard (Eds.), The experiment in the history of economics (pp. 118–134). London: Routledge.

    Google Scholar 

  • Edwards, P. N. (2010). A vast machine: Computer models, climate data, and the politics of global warming. Cambridge: MIT Press.

    Google Scholar 

  • Friedman, M. (2008). The methodology of positive economics. In D. M. Hausman (Ed.), The philosophy of economics: An anthology (3rd ed., pp. 145–178). Cambridge: Cambridge University Press.

    Google Scholar 

  • Frigg, R., & Hartmann, S. (2012). Models in science. In E. N. Zalta (Ed.), The stanford encyclopedia of philosophy (Summer 2018 Edition) (pp. 1–24).

  • Geanakoplos, J. (1998). Arrow–Debreu model of general equilibrium. In J. Eatwell, M. Milgate & P. Newman (Eds.), The new Palgrave: A dictionary of economics (Vol. 1, pp. 116–124). London: Macmillan.

    Google Scholar 

  • Goldman, A. I. (2011). A guide to social epistemology. In A. I. Goldman, & D. Whitcomb (Eds.), Social epistemology: Essential readings (pp. 11–37). Oxford: Oxford University Press.

    Google Scholar 

  • Grossman, S. J., & Stiglitz, J. E. (1980). On the impossibility of informationally efficient markets. The American Economic Review,70(3), 393–408.

    Google Scholar 

  • Grüne-Yanoff, T. (2009). Learning from minimal economic models. Erkenntnis,70(1), 81–99.

    Article  Google Scholar 

  • Hands, D. W. (1997). Caveat emptor: Economics and contemporary philosophy of science. Philosophy of Science,64(Supplement), S107–S116.

    Article  Google Scholar 

  • Hausman, D. M. (1992). The inexact and separate science of economics. New York: Cambridge University Press.

    Book  Google Scholar 

  • Hausman, D. M. (2008). Why look under the hood? In D. M. Hausman (Ed.), The philosophy of economics: An anthology (3rd ed., pp. 183–187). Cambridge: Cambridge University Press.

    Google Scholar 

  • Hausman, D. M., & McPherson, M. S. (2008). The philosophical foundations of mainstream normative economics. In D. M. Hausman (Ed.), The philosophy of economics: An anthology (3rd ed., pp. 226–250). Cambridge: Cambridge University Press.

    Google Scholar 

  • Hicks, D. J. (2016). Bibliometrics for social validation. PLoS ONE,11(12), e0168597–15.

    Article  Google Scholar 

  • Hong, L., & Page, S. E. (2004). Groups of diverse problem solvers can outperform groups of high-ability problem solvers. Proceedings of the National Academy of Sciences of the United States of America,101(46), 16385–16389.

    Article  Google Scholar 

  • Katzav, J. (2014). The epistemology of climate models and some of its implications for climate science and the philosophy of science. Studies in History and Philosophy of Science Part B: Studies in History and Philosophy of Modern Physics,46(2), 228–238.

    Article  Google Scholar 

  • Kitcher, P. (1990). The division of cognitive labor. The Journal of Philosophy,87(1), 5–22.

    Article  Google Scholar 

  • Kuhn, T. S. (1985). The Copernican revolution. Planetary astronomy in the development of western thought. Cambridge: Harvard University Press.

    Google Scholar 

  • Lloyd, E. A. (2009). Varieties of support and confirmation of climate models. Aristotelian Society Supplementary Volume, 83(1), 213–232. https://www.jstor.org/stable/20619136. Accessed 21 Jan 2019.

    Article  Google Scholar 

  • Martini, C., & Pinto, M. F. (2017). Modeling the social organization of science. European Journal for Philosophy of Science,7(2), 221–238.

    Article  Google Scholar 

  • Massey, D. S., & Denton, N. A. (1993). American apartheid. Segregation and the making of the underclass. Cambridge: Harvard University Press.

    Google Scholar 

  • Merton, R. K. (1957). Priorities in scientific discovery: A chapter in the sociology of science. American Sociological Review,22(6), 635–659.

    Article  Google Scholar 

  • Mirowski, P. (2004). On playing the economics cards in the philosophy of science: Why it didn’t work for Michael Polanyi. In The effortless economy of science? (pp. 53–71). Durham, NC: Duke University Press.

  • Morrison, M. (2015). Reconstructing reality: Models, mathematics, and simulations. Oxford: Oxford University Press.

    Book  Google Scholar 

  • Muldoon, R., & Weisberg, M. (2010). Robustness and idealization in models of cognitive labor. Synthese,183(2), 161–174.

    Article  Google Scholar 

  • Orzack, S. H., & Sober, E. (1993). A critical assessment of Levins’s The strategy of model building in population biology (1966). The Quarterly Review of Biology,68(4), 533–546.

    Article  Google Scholar 

  • Perović, S., et al. (2016). Optimal research team composition: Data envelopment analysis of Fermilab experiments. Scientometrics,108(1), 1–29.

    Article  Google Scholar 

  • Reijula, H. S., & Kuorikoski, J. E. (forthcoming). Modeling epistemic communities. In M. Fricker, P. J Graham, D. Henderson, N. Pedersen, & J. W. Routledge (Eds.), The Routledge handbook of social epistemology.

  • Romero, F. (2016). Can the behavioral sciences self-correct? A social epistemic study. Studies in History and Philosophy of Science Part A,60, 55–69.

    Article  Google Scholar 

  • Rosenstock, S., Bruner, J., & O’Connor, C. (2017). In epistemic networks, is less really more? Philosophy of Science,84(2), 234–252.

    Article  Google Scholar 

  • Schelling, T. C. (1969). Models of segregation. The American Economic Review,59(2), 488–493.

    Google Scholar 

  • Simon, H. (2008). Testability and approximation. In D. M. Hausman (Ed.), The philosophy of economics: An anthology (3rd ed., pp. 179–182). Cambridge: Cambridge University Press.

    Google Scholar 

  • Solomon, M. (2001). Social empiricism. Cambridge, MA: The MIT Press.

    Book  Google Scholar 

  • Strevens, M. (2003). The role of the priority rule in science. The Journal of Philosophy,100(2), 55–79.

    Article  Google Scholar 

  • Sugden, R. (2008). Credible worlds: The stats of theoretical models in economics. In D. M. Hausman (Ed.), The philosophy of economics: An anthology (3rd ed., pp. 476–509). Cambridge: Cambridge University Press.

    Google Scholar 

  • Thoma, J. (2015). The epistemic division of labor revisited. Philosophy of Science,82(3), 454–472.

    Article  Google Scholar 

  • Thompson, A. (2014). Does diversity trump ability? Notices of the American Mathematical Society,61(9), 1024–1027.

    Article  Google Scholar 

  • Weisberg, M. (2006). Robustness analysis. Philosophy of Science,73(5), 730–742.

    Article  Google Scholar 

  • Weisberg, M. (2013). Simulation and similarity. Oxford: Oxford University Press.

    Book  Google Scholar 

  • Weisberg, M., & Muldoon, R. (2009). Epistemic landscapes and the division of cognitive labor. Philosophy of Science,76(2), 225–252.

    Article  Google Scholar 

  • Winsberg, E. (2006). Models of success versus the success of models: Reliability without truth. Synthese,152(1), 1–19.

    Article  Google Scholar 

  • Zollman, K. J. S. (2007). The communication structure of epistemic communities. Philosophy of Science,74(5), 574–587.

    Article  Google Scholar 

  • Zollman, K. J. S. (2012). Social network structure and the achievement of consensus. Politics, Philosophy and Economics, 11(1), 26–44. https://doi.org/10.1177/1470594X11416766. Accessed 21 January 2019.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Michael Thicke.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Thicke, M. Evaluating Formal Models of Science. J Gen Philos Sci 51, 315–335 (2020). https://doi.org/10.1007/s10838-018-9440-1

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10838-018-9440-1

Keywords

Navigation