Content and misrepresentation in hierarchical generative models
In this paper, we consider how certain longstanding philosophical questions about mental representation may be answered on the assumption that cognitive and perceptual systems implement hierarchical generative models, such as those discussed within the prediction error minimization (PEM) framework. We build on existing treatments of representation via structural resemblance, such as those in Gładziejewski (Synthese 193(2):559–582, 2016) and Gładziejewski and Miłkowski (Biol Philos, 2017), to argue for a representationalist interpretation of the PEM framework. We further motivate the proposed approach to content by arguing that it is consistent with approaches implicit in theories of unsupervised learning in neural networks. In the course of this discussion, we argue that the structural representation proposal, properly understood, has more in common with functional-role than with causal/informational or teleosemantic theories. In the remainder of the paper, we describe the PEM framework for approximate Bayesian inference in some detail, and discuss how structural representations might arise within the proposed Bayesian hierarchies. After explicating the notion of variational inference, we define a subjectively accessible measure of misrepresentation for hierarchical Bayesian networks by appeal to the Kullbach–Leibler divergence between posterior generative and approximate recognition densities, and discuss a related measure of objective misrepresentation in terms of correspondence with the facts.
KeywordsProblem of content Misrepresentation Functional role semantics Structural resemblance Prediction error minimization Generative model Recognition model Kullbach–Leibler divergence Variational Bayesian inference Unsupervised learning
- Adams, R. A., Huys, Q. J. M., & Roiser, J. P. (2015). Computational psychiatry: Towards a mathematically informed understanding of mental illness. Journal of Neurology, Neurosurgery & Psychiatry, 87(1), 53–63.Google Scholar
- Allen, M., & Friston, K.J. (2016). From cognitivism to autopoiesis: towards a computational framework for the embodied mind. Synthese. doi:10.1007/s11229-016-1288-5.
- Barrett, L. F. (2016). The theory of constructed emotion: An active inference account of interoception and categorization. Social Cognitive and Affective Neuroscience, 12, 1.Google Scholar
- Bishop, C. M. (2007). Pattern recognition and machine learning. Cordrecht: Springer.Google Scholar
- Block, N. (1994). Advertisement for a semantics for psychology. In S. P. Stich & T. Warfield (Eds.), Mental representation: A reader. Oxford: Blackwell.Google Scholar
- Brandom, R. (1994). Making it explicit. Cambridge: Harvard University Press.Google Scholar
- Bruineberg, J. (2016). The anticipating brain is not a scientist: The free-energy principle from an ecological-enactive perspective. Synthese. doi:10.1007/s11229-016-1239-1.
- Carreira-Perpiñán, M. A., & Hinton, G. E. (2005). On contrastive divergence learning. In Proceedings of the tenth international workshop on artificial intelligence and statistics.Google Scholar
- Cummins, R. (1994). Interpretational semantics. In S. Stich & T. Warfield (Eds.), Mental representation: A reader. Oxford: Blackwell.Google Scholar
- Dayan, P., & Abbott, L. F. (2001). Theoretical neuroscience. Cambridge, Mass: MIT Press.Google Scholar
- Dretske, F. (1981). Knowledge and the flow of information. Cambridge, MA: MIT Press.Google Scholar
- Eliasmith, C. (2000). How neurons mean: A neurocomputational theory of representational content. Ph.D., Washington University in St.Louis.Google Scholar
- Farennikova, A. (2014). Perception of absence and penetration from expectation. Review of Philosophy and Psychology, 6, 1–20.Google Scholar
- Field, H. (1977). Logic, meaning and conceptual role. Journal of Philosophy, 74(69), 379–409.Google Scholar
- Fodor, J. A. (1975). The language of thought. Cambridge: Harvard University Press.Google Scholar
- Fodor, J. A. (1990). A theory of content and other essays. Cambridge, Mass: MIT Press.Google Scholar
- Gallagher, B. (2006). Matching structure and semantics: A survey on graph-based pattern matching. In AAAI fall symposium on capturing and using patterns for evidence detection (pp. 45–53). American Association for Artificial Intelligence.Google Scholar
- Gallagher, S., & Allen, M. (2016). Active inference, enactivism and the hermeneutics of social cognition. Synthese. doi:10.1007/s11229-016-1269-8.
- Gładziejewski, P., & Miłkowski, M. (2017). Structural representations: Causally relevant and different from detectors. Biology and Philosophy. doi:10.1007/s10539-017-9562-6.
- Goodfellow, I., Bengio, Y., & Courville, A. (2016). Deep learning. Cambridge, MA: MIT Press.Google Scholar
- Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., et al. (2014). Generative adversarial nets. In Z. Ghahramani, M. Welling, C. Cortes, N. D. Lawrence & K. Q. Weinberger (Eds.), Advances in neural information processing systems (Vol. 27, pp. 2672–2680).Google Scholar
- Grush, R. (2004). The emulation theory of representation: Motor control, imagery, and perception. Behavioral and Brain Sciences, 27, 377–442.Google Scholar
- Harman, G. (1973). Thought. Princeton: Princeton University Press.Google Scholar
- Hinton, G. E. (2005). What kind of graphical model is the brain? In International joint conference on artificial intelligence 2005, Edinburgh.Google Scholar
- Hinton, G. E., & Sejnowski, T. J. (1983). Optimal perceptual inference. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.Google Scholar
- Hinton, G. E., & Sejnowski, T. J. (1999). Unsupervised learning: Foundations of neural computation. In G. E. Hinton & T. J. Sejnowski (Eds.), Unsupervised learning: Foundations of neural computation. Cambridge, MA: MIT Press.Google Scholar
- Hohwy, J. (2015a). The neural organ explains the mind. In T. Metzinger & J. M. Windt (eds.) Open MIND (pp. 1–23). Frankfurt am Main: MIND Group.Google Scholar
- Hohwy, J. (2016a). Prediction, agency, and body ownership. In A. Engel, K. Friston, & D. Kragic (Eds.), Where is the action? The pragmatic turn in cognitive science. Cambridge, MA: MIT Press.Google Scholar
- Hohwy, J., & Michael, J. (2017). Why would any body have a self. In F. Vignemont & A. Alsmith (Eds.), The body and the self. Cambridge, MA: MIT Press.Google Scholar
- Hutto, D. (2017). Getting into the great guessing game: Bootstrap heaven or hell? Synthese. doi:10.1007/s11229-017-1385-0.
- Hutto, D., & Myin, E. (2013). Radicalizing enactivism: Basic minds without content. Cambridge, MA: MIT Press.Google Scholar
- Kirchhoff, M. (2016). Autopoiesis, free energy, and the life–mind continuity thesis. Synthese. doi:10.1007/s11229-016-1100-6.
- Klein, C. (2016). What do predictive coders want? Synthese. doi:10.1007/s11229-016-1250-6.
- Le, Q. V., Ranzato, M., Monga, R., Devin, M., Chen, K., Corrado, G. S., et al. (2012). Building high-level features using large scale unsupervised learning. In Proceedings of the 29th international conference on machine learning, Edinburgh.Google Scholar
- Loughlin, V. (2016). Jakob hohwy: The predictive mind. Phenomenology and the Cognitive Sciences. doi:10.1007/s11097-016-9479-6.
- Metzinger, T., & Wiese, W. (Eds.). (2017). Philosophy and predictive processing. MIND Group: Frankfurt am Main.Google Scholar
- Millikan, R. (1984). Language, thought, and other biological categories. Cambridge, MA: MIT Press.Google Scholar
- Neal, R. M., & Hinton, G. E. (1998). A view of the EM algorithm that justifies incremental, sparse, and other variants. NATO ASI Series D Behavioural and Social Sciences, 89, 355–370.Google Scholar
- O’Brien, G., & Opie, J. (2004). Notes toward a structuralist theory of mental representation. In H. Clapin, P. Staines, & P. Slezak (Eds.), Represenation in mind: New approaches to mental representation. Oxford: Clarendon Press.Google Scholar
- Sellars, W. (2007). In the space of reasons. Cambridge: Harvard University Press.Google Scholar
- Trappenberg, T. (2010). Fundamentals of computational neuroscience. Oxford: Oxford University Press.Google Scholar