Skip to main content

Modelling Interaction in Multi-modal Affordance Processing with Neural Dynamics

  • Conference paper

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 7426))

Abstract

Behavioral studies on the activation of affordances by understanding observation and action sentences on graspable objects show a direct relationship between the canonical orientation of graspable objects, their dimension and the kind of grip required by those objects to be grasped. The present work introduces the concepts of Dynamic Field Theory for modeling the results observed in the behavioral studies previously mentioned. The model was not only able to replicate qualitatively similar results regarding reaction times, but also the identification of same versus different object and the distinction between observable versus action sentences. The model shows the potential of dynamic field theory for the design and implementation of brain inspired cognitive systems.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Chrisley, R., Ziemke, T.: Embodiment. In: Encyclopedia of Cognitive Science, pp. 1102–1108. Macmillan Publishers (2003)

    Google Scholar 

  2. Chersi, F., Thill, S., Ziemke, T., Borghi, A.M.: Sentence processing: linking language to motor chains. Frontiers in Neurorobotics 4(4) (2010)

    Google Scholar 

  3. Buccino, G., Riggio, L., Melli, G., Binkofski, F., Gallese, V., Rizzolatti, G.: Listening to action related sentences modulates the activity of the motor system: a combined tms and behavioral study. Cognitive Brain Research 24, 355–363 (2005)

    Article  Google Scholar 

  4. Scorolli, C., Borghi, A.M.: Sentence comprehension and action: effector specific modulation of the motor system. Brain Research 1130, 119–124 (2007)

    Article  Google Scholar 

  5. Borghi, A.M., Scorolli, C.: Language comprehension and hand motion simulation. Human Movement Science 28, 12–27 (2009)

    Article  Google Scholar 

  6. Tucker, M., Ellis, R.: On the relations between seen objects and components of potential actions. Journal of Experimental Psychology: Human Perception and Performance 24(3), 830–846 (1998)

    Article  Google Scholar 

  7. Thill, S., Caligiore, D., Borghi, A.M., Ziemke, T., Baldassare, G.: Integrating theories and computational models of affordance control and mirror neurons: A review and a model design (submitted)

    Google Scholar 

  8. Borghi, A.M., Riggio, L.: Sentence comprehension and simulation of object temporary, canonical and stable affordances. Brain Research 1253, 117–128 (2009)

    Article  Google Scholar 

  9. Şahin, E., Çakmak, M., Doǧar, M.R., Uǧur, E., Üçoluk, G.: To afford or not to afford: A new formalization of affordances toward affordance-based robot control. Adaptive Behavior 15(4), 447–472 (2007)

    Article  Google Scholar 

  10. Fitzpatrick, P., Metta, G.: Grounding vision through experimental manipulation. Philosophical Transactions of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences 361(1811), 2165–2185 (2003)

    Article  MathSciNet  Google Scholar 

  11. Fagg, A.H., Arbib, M.A.: Modeling parietal-premotor interaction in primate control of grasping. Neural Networks 11, 1277–1303 (1998)

    Article  Google Scholar 

  12. Caligiore, D., Borghi, A.M., Parisi, D., Baldassarre, G.: TRoPICALS: A computational embodied neuroscience model of compatibility effects. Psychological Review 117, 1188–1228 (2010)

    Article  Google Scholar 

  13. Schöner, G.: Development as Change of System Dynamics: Stability, Instability, and Emergence. In: Toward a New Grand Theory of Development? Connectionism and Dynamic Systems Theory Re-Considered, pp. 25–49. Oxford University Press, New York (2009)

    Chapter  Google Scholar 

  14. Amari, S.I.: Dynamics of pattern formation in lateral-inhibition type neural fields. Biological Cybernetics 27, 77–87 (1977)

    Article  MathSciNet  MATH  Google Scholar 

  15. Cisek, P.: Cortical mechanisms of action selection: the affordance competition hypothesis. Philosophical Transactions of The Royal Society B - Biological Sciences 362, 1585–1599 (2007)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2012 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Durán, B., Thill, S. (2012). Modelling Interaction in Multi-modal Affordance Processing with Neural Dynamics. In: Ziemke, T., Balkenius, C., Hallam, J. (eds) From Animals to Animats 12. SAB 2012. Lecture Notes in Computer Science(), vol 7426. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-33093-3_8

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-33093-3_8

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-33092-6

  • Online ISBN: 978-3-642-33093-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics