Epistemic Constraints on Autonomous Symbolic Representation in Natural and Artificial Agents

  • David Windridge
  • Josef Kittler
Part of the Studies in Computational Intelligence book series (SCI, volume 122)


We set out to address, in the form of a survey, the fundamental constraints upon self-updating representation in cognitive agents of natural and artificial origin. The foundational epistemic problem encountered by such agents is that of distinguishing errors of representation from inappropriateness of the representational framework. Resolving this conceptual difficulty involves ensuring the empirical falsifiability of both the representational hypotheses and the entities so represented, while at the same time retaining their epistemic distinguishability.

We shall thus argue that perception-action frameworks provide an appropriate basis for the development of an empirically meaningful criterion for validating perceptual categories. In this scenario, hypotheses about the agent’s world are defined in terms of environmental affordances (characterised in terms of the agent’s active capabilities). Agents with the capability to hierarchically-abstract this framework to a level consonant with performing syntactic manipulations and making deductive conjectures are consequently able to form an implicitly symbolic representation of the environment within which new, higher-level, modes of environment manipulation are implied (e.g. tool-use). This abstraction process is inherently open-ended, admitting a wide-range of possible representational hypotheses — only the form of the lowest-level of the hierarchy need be constrained a priori (being the minimally sufficient condition necessary for retention of the ability to falsify high-level hypotheses).

In biological agents capable of autonomous cognitive-updating, we argue that the grounding of such a priori ‘bootstrap’ representational hypotheses is ensured via the process of natural selection.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Hume D (1999) An Enquiry concerning Human Understanding. Oxford University Press, Oxford/New YorkGoogle Scholar
  2. 2.
    Kant I (1999) Critique of Pure Reason. Cambridge University PressGoogle Scholar
  3. 3.
    Heidegger M (1996) Being and Time. BlackwellGoogle Scholar
  4. 4.
    Dreyfus H (1972) What Computers Can't Do. New York: Harper and RowGoogle Scholar
  5. 5.
    Suber P. Mind and baud rate. E-print of the Phil. Dept., Earlham College, Retr. 13/6/2005 http://www.earlham.edu/_peters/writing/baudrate.htm
  6. 6.
    Winograd T (1980) What does it mean to understand language?, Cognitive Science 4(3):209–242. Reprinted in D. Norman (ed.), Perspectives on Cognitive Science, Ablex and Erlbaum Associates, 1981, 231-264Google Scholar
  7. 7.
    Gödel K (1931) Über formal unentscheidbare stäze der principia math. & verwandter systeme, I Monatshefte für Mathematik und Physik (38):173–198CrossRefGoogle Scholar
  8. 8.
    Breuer T (2000) In: M Carrier GM L Ruetsche (ed.) Science at Century's End: Philosophical Questions on the Progress and Limits of Science. Pittsburgh & Konstanz, University of Pittsburgh Press & Universitätsverlag KonstanzGoogle Scholar
  9. 9.
    Breuer T (1995) The impossibility of exact state self-measurements, Philosophy of Science 62:197–214CrossRefMathSciNetGoogle Scholar
  10. 10.
    Winograd T, Flores F (1986) Understanding Computers and Cognition. Addison-Wesley, Reading, MAMATHGoogle Scholar
  11. 11.
    McCarthy J, Hayes P (1969) Some philosophical problems from the standpoint of artificial intelligence, Machine Intelligence (4):463–502MATHGoogle Scholar
  12. 12.
    Quine WVO (1960) Word and Object. NY: John Wiley and Sons, MITMATHGoogle Scholar
  13. 13.
    Wittgenstein L (2001) Philosophical investigations : the German text with a revised English translation by Ludwig Wittgenstein. Oxford : BlackwellGoogle Scholar
  14. 14.
    Millikan RG (1987) Language, Thought, and Other Biological Categories: New Foundations for Realism. The MIT Press; Reprint editionGoogle Scholar
  15. 15.
    Sipper M (1995) An introduction to artificial life., Explorations in Artificial Life (special issue of AI Expert) 4–8Google Scholar
  16. 16.
    Marr D (1982) Vision: A Computational Approach. Freeman & Co., San Fr.Google Scholar
  17. 17.
    Gärdenfors P (1994) How logic emerges from the dynamics of information, Logic and Information Flow 49–77Google Scholar
  18. 18.
    Granlund G (2003) Organization of Architectures for Cognitive Vision Systems, In: Proceedings of Workshop on Cognitive Vision. Schloss Dagstuhl, GermanyGoogle Scholar
  19. 19.
    Magee D, Needham CJ, Santos P, Cohn AG, Hogg DC (2004) Autonomous learning for a cognitive agent using continuous models and inductive logic programming from audio-visual input, In: Proc. of the AAAI Workshop on Anchoring Symbols to Sensor DataGoogle Scholar
  20. 20.
    Brooks RA (1991) Intelligence without representation, Artificial Intelligence 47:139–159CrossRefGoogle Scholar
  21. 21.
    Newell A, Simon H (1976) The Theory of Human Problem Solving; reprinted in Collins & Smith (eds.), In: Readings in Cognitive Science, section 1.3.Google Scholar
  22. 22.
    Pinker S, Bloom P (1990) Natural language and natural selection, Behavioural and Brain Sciences 13(4):707–784Google Scholar
  23. 23.
    Marshall J, Blank D, Meeden L (2004) An emergent framework for selfmotivation in developmental robotics, In: Proc. of the Third International Conference on Development and Learning (ICDL '04). Salk Inst.Google Scholar
  24. 24.
    Franklin S, Garzon M (1991) Neural Computability, In: Omidvar O (ed.) Progress in Neural Networks, vol. 1. AblexGoogle Scholar
  25. 25.
    Wolff JG (1987) Cognitive development as optimisation, In: Bolc L (ed.) Computational Models of Learning, 161–205. Springer-Verlag, HeidelbergGoogle Scholar
  26. 26.
    Dewey J (1896) The reex arc concept in psychology, The Psychological Review (3):356–370Google Scholar
  27. 27.
    Gibson JJ (1979) The ecological approach to visual perception. Houghton-Mifflin, BostonGoogle Scholar
  28. 28.
    McGrenere J, Ho W (2000) Affordances: Clarifying and Evolving a Concept, In: Proceedings of Graphics Interface 2000, 179{186. Montreal, CanadaGoogle Scholar
  29. 29.
    Lakoff G, Johnson M (1999) Philosophy in the Flesh : The Embodied Mind and Its Challenge to Western Thought. Harper Collins PublishersGoogle Scholar
  30. 30.
    Glenberg A (1997) What memory is for, Behavioral and Brain Sciences 20(1):1–55Google Scholar
  31. 31.
    Berlucchi F, Aglioti S (1997) The body in the brain: neural bases of corporeal awareness, Trends in Neuroscience 20(5):60–564Google Scholar
  32. 32.
    Piaget J (1970) Genetic Epistemology. Columbia University Press, New YorkGoogle Scholar
  33. 33.
    Rohrer T (2001) Pragmatism, Ideology and Embodiment: William James and the Philosophical Foundations of Cognitive Linguistics, In: Sandriklogou, Dirven (eds.) Language and Ideology: Cognitive Theoretical Approaches, 49-82. Amsterdam: John BenjaminsGoogle Scholar
  34. 34.
    Perry J (1997) Myself and I, In: Stamm M (ed.) Philosophie in Sythetisher Absicht, 83–103. Stuttgart:Klett-CottaGoogle Scholar
  35. 35.
    Bermudez JL (2001) Non-conceptual self-consciousness and cognitive science, Synthese (129):129–149CrossRefGoogle Scholar
  36. 36.
    Metzinger T (2003) Phenomenal transparency and cognitive self-reference, Phenomenology and the Cognitive Sciences (2):353–393CrossRefGoogle Scholar
  37. 37.
    Viezzer M (2001) Dynamic Ontologies or How to Build Agents That Can Change Their Mind. Ph.D. Thesis, University of Birmingham, UKGoogle Scholar
  38. 38.
    Pinker S (1995) The Language Instinct: The New Science of Language and Mind. Penguin Books Ltd. ISBN: 0140175296Google Scholar
  39. 39.
    Harnad S (1990) The symbol grounding problem, Physica D (42):335–346CrossRefGoogle Scholar
  40. 40.
    Steels L (1997) The origins of syntax in visually grounded robotic agents, In: Pollack M (ed.) Proceedings of the 10th IJCAI, Nagoya, 1632{1641. AAAI Press, Menlo-Park Ca.Google Scholar
  41. 41.
    Harrison JE, Baron-Cohen S (1996) Synaesthesia: Classic and Contemporary Readings. Blackwell PublishersGoogle Scholar
  42. 42.
    Saunders J, Knill DC (2004) Visual feedback control of hand movements, J of Neuroscience 24(13):3223–3234CrossRefGoogle Scholar
  43. 43.
    Schlicht EJ, Schrater PR (2003) Bayesian model for reaching and grasping peripheral and occluded targets, Journal of Vision 3(9):261Google Scholar
  44. 44.
    Brooks RA (1986) A robust layered control system for a mobile robot, IEEE Journal of Robotics and Automation 14(23)Google Scholar
  45. 45.
    Modayil J. Bootstrap learning a perceptually grounded object ontology. Retr. 9/5/2005 http://www.cs.utexas.edu/users/modayil/modayil-proposal.pdf
  46. 46.
    Nehaniv CL, Polani D, Dautenhahn K, te Boekhorst R, Canamero L (2002) In: Standish B Abbass (ed.) Artificial Life VIII, 345–349. MIT PressGoogle Scholar
  47. 47.
    Sun R (2004) Desiderata for cog. architectures, Philosophical Psychology 17(3)Google Scholar
  48. 48.
    Stein LA (1991) Imagination and situated cognition. Tech. Rep. A.I. Memo No. 27, MIT AI LaboratoryGoogle Scholar
  49. 49.
    Windridge D, Kittler J (2007) Open-Ended Inference of Relational Representations in the COSPAL Perception-Action Architecture, In: Proc. of International Conf. on Machine Vision Applications (ICVS 2007). GermanyGoogle Scholar
  50. 50.
    Quine WVO (1977) Ontological Relativity. ColumbiaGoogle Scholar
  51. 51.
    Popper K (1959) The Logic of Scientific Discovery. (translation of Logik der Forschung). Hutchinson, LondonGoogle Scholar
  52. 52.
    Dawkins R (1989) The Sel_sh Gene (2nd ed.). OUPGoogle Scholar
  53. 53.
    Hobson J (1988) The Dreaming Brain. Basic Books, New YorkGoogle Scholar
  54. 54.
    Gallese V, Goldman A (1998) Mirror neurons and the simulation theory of mind-reading, Trends in Cognitive Sciences 2(2)Google Scholar
  55. 55.
    Windridge D (2005) Cognitive bootstrapping: A survey of bootstrap mechanisms for emergent cognition. Tech. Rep. VSSP-TR-2/2005, CVSSP, The University of Surrey, Guildford, Surrey, GU2 7XH, UKGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2008

Authors and Affiliations

  • David Windridge
    • 1
  • Josef Kittler
    • 1
  1. 1.School of Electronics and Physical SciencesUniversity of SurreyGuildfordUK

Personalised recommendations