Abstract
This paper presents an account of how to evaluate formal models of science: models and simulations in social epistemology designed to draw normative conclusions about the social structure of scientific research. I argue that such models should be evaluated according to their representational and predictive accuracy. Using these criteria and comparisons with familiar models from science, I argue that most formal models of science are incapable of supporting normative conclusions.
Similar content being viewed by others
Notes
Unlike the other papers discussed here, Hong and Page (2004) do not discuss science specifically, but rather problem solving generally. However, due to the similarity of their approach to that employed by philosophers of science, I treat this paper as part of the formal models of science literature.
Philosophers often distinguish between Aristoltean idealization, which ignores irrelevant features of a system, and Galilean idealization, which deliberately distorts the system. According to this taxonomy, Cartwright’s “Non-Galilean” idealizations would actually be a subset of Galilean idealization. For simplicity I maintain Cartwright’s terminology.
This is not to say that Schelling’s model involves no non-Galilean idealizations. For instance, it assumes that moving is costless and that individuals of either colour are equally free to move to any vacant location.
As a reviewer observed, this is a weak, qualitative prediction. Schelling’s model, like some formal models of science, relies on the robustness of this behaviour for its explanatory appeal. As discussed below, what distinguishes Schelling’s model from most formal models of science is not its predictive accuracy, but that this behaviour is generated by Galilean (stripping away) idealizations.
References
Abiodun, B., et al. (2014). Evaluation of climate models. In T. F. Stocker, et al. (Eds.), Climate change 2013: The physical science basis. Contribution of working group I to the fifth assessment report of the Intergovernmental Panel on Climate Change (pp. 741–866). New York: Cambridge University Press.
Alexander, J. M. (2017). Malcom’s maxim and formal models of scientific inquiry. In Formal models of scientific inquiry (conference). http://homepage.ruhr-uni-bochum.de/defeasible-reasoning/Conference-Formal-Models.html. Accessed December 2018.
Alexander, J. M., Himmelreich, J., & Thompson, C. (2015). Epistemic landscapes, optimal search, and the division of cognitive labor. Philosophy of Science,82(3), 424–453.
Angrist, J., et al. (2017). Economic research evolves: Fields and styles. The American Economic Review,107(5), 293–297.
Arrow, K., & Debreu, G. (1954). Existence of an equilibrium for a competitive economy. Econometrica: Journal of the Econometric Society,22(3), 265–290.
Cartwright, N. (2005). The vanity of rigour in economics: Theoretical models and Galilean experiments. In P. Fontaine, & R. Leonard (Eds.), The experiment in the history of economics (pp. 118–134). London: Routledge.
Edwards, P. N. (2010). A vast machine: Computer models, climate data, and the politics of global warming. Cambridge: MIT Press.
Friedman, M. (2008). The methodology of positive economics. In D. M. Hausman (Ed.), The philosophy of economics: An anthology (3rd ed., pp. 145–178). Cambridge: Cambridge University Press.
Frigg, R., & Hartmann, S. (2012). Models in science. In E. N. Zalta (Ed.), The stanford encyclopedia of philosophy (Summer 2018 Edition) (pp. 1–24).
Geanakoplos, J. (1998). Arrow–Debreu model of general equilibrium. In J. Eatwell, M. Milgate & P. Newman (Eds.), The new Palgrave: A dictionary of economics (Vol. 1, pp. 116–124). London: Macmillan.
Goldman, A. I. (2011). A guide to social epistemology. In A. I. Goldman, & D. Whitcomb (Eds.), Social epistemology: Essential readings (pp. 11–37). Oxford: Oxford University Press.
Grossman, S. J., & Stiglitz, J. E. (1980). On the impossibility of informationally efficient markets. The American Economic Review,70(3), 393–408.
Grüne-Yanoff, T. (2009). Learning from minimal economic models. Erkenntnis,70(1), 81–99.
Hands, D. W. (1997). Caveat emptor: Economics and contemporary philosophy of science. Philosophy of Science,64(Supplement), S107–S116.
Hausman, D. M. (1992). The inexact and separate science of economics. New York: Cambridge University Press.
Hausman, D. M. (2008). Why look under the hood? In D. M. Hausman (Ed.), The philosophy of economics: An anthology (3rd ed., pp. 183–187). Cambridge: Cambridge University Press.
Hausman, D. M., & McPherson, M. S. (2008). The philosophical foundations of mainstream normative economics. In D. M. Hausman (Ed.), The philosophy of economics: An anthology (3rd ed., pp. 226–250). Cambridge: Cambridge University Press.
Hicks, D. J. (2016). Bibliometrics for social validation. PLoS ONE,11(12), e0168597–15.
Hong, L., & Page, S. E. (2004). Groups of diverse problem solvers can outperform groups of high-ability problem solvers. Proceedings of the National Academy of Sciences of the United States of America,101(46), 16385–16389.
Katzav, J. (2014). The epistemology of climate models and some of its implications for climate science and the philosophy of science. Studies in History and Philosophy of Science Part B: Studies in History and Philosophy of Modern Physics,46(2), 228–238.
Kitcher, P. (1990). The division of cognitive labor. The Journal of Philosophy,87(1), 5–22.
Kuhn, T. S. (1985). The Copernican revolution. Planetary astronomy in the development of western thought. Cambridge: Harvard University Press.
Lloyd, E. A. (2009). Varieties of support and confirmation of climate models. Aristotelian Society Supplementary Volume, 83(1), 213–232. https://www.jstor.org/stable/20619136. Accessed 21 Jan 2019.
Martini, C., & Pinto, M. F. (2017). Modeling the social organization of science. European Journal for Philosophy of Science,7(2), 221–238.
Massey, D. S., & Denton, N. A. (1993). American apartheid. Segregation and the making of the underclass. Cambridge: Harvard University Press.
Merton, R. K. (1957). Priorities in scientific discovery: A chapter in the sociology of science. American Sociological Review,22(6), 635–659.
Mirowski, P. (2004). On playing the economics cards in the philosophy of science: Why it didn’t work for Michael Polanyi. In The effortless economy of science? (pp. 53–71). Durham, NC: Duke University Press.
Morrison, M. (2015). Reconstructing reality: Models, mathematics, and simulations. Oxford: Oxford University Press.
Muldoon, R., & Weisberg, M. (2010). Robustness and idealization in models of cognitive labor. Synthese,183(2), 161–174.
Orzack, S. H., & Sober, E. (1993). A critical assessment of Levins’s The strategy of model building in population biology (1966). The Quarterly Review of Biology,68(4), 533–546.
Perović, S., et al. (2016). Optimal research team composition: Data envelopment analysis of Fermilab experiments. Scientometrics,108(1), 1–29.
Reijula, H. S., & Kuorikoski, J. E. (forthcoming). Modeling epistemic communities. In M. Fricker, P. J Graham, D. Henderson, N. Pedersen, & J. W. Routledge (Eds.), The Routledge handbook of social epistemology.
Romero, F. (2016). Can the behavioral sciences self-correct? A social epistemic study. Studies in History and Philosophy of Science Part A,60, 55–69.
Rosenstock, S., Bruner, J., & O’Connor, C. (2017). In epistemic networks, is less really more? Philosophy of Science,84(2), 234–252.
Schelling, T. C. (1969). Models of segregation. The American Economic Review,59(2), 488–493.
Simon, H. (2008). Testability and approximation. In D. M. Hausman (Ed.), The philosophy of economics: An anthology (3rd ed., pp. 179–182). Cambridge: Cambridge University Press.
Solomon, M. (2001). Social empiricism. Cambridge, MA: The MIT Press.
Strevens, M. (2003). The role of the priority rule in science. The Journal of Philosophy,100(2), 55–79.
Sugden, R. (2008). Credible worlds: The stats of theoretical models in economics. In D. M. Hausman (Ed.), The philosophy of economics: An anthology (3rd ed., pp. 476–509). Cambridge: Cambridge University Press.
Thoma, J. (2015). The epistemic division of labor revisited. Philosophy of Science,82(3), 454–472.
Thompson, A. (2014). Does diversity trump ability? Notices of the American Mathematical Society,61(9), 1024–1027.
Weisberg, M. (2006). Robustness analysis. Philosophy of Science,73(5), 730–742.
Weisberg, M. (2013). Simulation and similarity. Oxford: Oxford University Press.
Weisberg, M., & Muldoon, R. (2009). Epistemic landscapes and the division of cognitive labor. Philosophy of Science,76(2), 225–252.
Winsberg, E. (2006). Models of success versus the success of models: Reliability without truth. Synthese,152(1), 1–19.
Zollman, K. J. S. (2007). The communication structure of epistemic communities. Philosophy of Science,74(5), 574–587.
Zollman, K. J. S. (2012). Social network structure and the achievement of consensus. Politics, Philosophy and Economics, 11(1), 26–44. https://doi.org/10.1177/1470594X11416766. Accessed 21 January 2019.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Thicke, M. Evaluating Formal Models of Science. J Gen Philos Sci 51, 315–335 (2020). https://doi.org/10.1007/s10838-018-9440-1
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10838-018-9440-1