From Language to Action: Extraction and Disambiguation of Affordances in ModelAct

Conference paper
Part of the Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering book series (LNICST, volume 150)

Abstract

In this paper we focus on how information about concrete actions performed on food should be provided to IoT devices in terms of affordances extracted from corpora. Natural language processing has a role in defining which kind of knowledge devices interacting with machines and appliances should handle when humans send requests through natural language interfaces.

We propose a model for the extraction of affordances of food from corpora and their role in sequences of procedural (sub)actions. The food processor of the future can find helpful this knowledge to interact with users suggesting alternatives in food processing in recipes steps and basic reasoning about preconditions and consequences in making meals.

Keywords

Affordances Natural language processing Verbs’ disambiguation 

References

  1. 1.
    Beetz, M., Klank, U., Kresse, I., Maldonado, A., Msenlechner, L., Pangercic, D., Rhr, T., Tenorth, M.: Robotic roommates making pancakes. In: 2011 11th IEEE-RAS International Conference on Humanoid Robots (2011)Google Scholar
  2. 2.
    Fellbaum, C. (ed.): WordNet: An Electronic Lexical Database. MIT Press, Cambridge (1998)Google Scholar
  3. 3.
    Gibson, J.J.: The Ecological Approach to Visual Perception. Houghton Mifflin, Boston (1979)Google Scholar
  4. 4.
    Horton, T.E., Chakraborty, A., St. Amant R.: Affordances for robots: a brief survey. Avant 3(2), 70–84 (2012)Google Scholar
  5. 5.
    Manning, C.D., Surdeanu, M., Bauer, J., Finkel, J., Bethard, S.J., McClosky, D.: The Stanford CoreNLP natural language processing toolkit. In: Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics: System Demonstrations, pp. 55–60 (2014)Google Scholar
  6. 6.
    Russo, I., De Felice, I., Frontini, F., Khan, F., Monachini, M.: (Fore)seeing actions in objects. Acquiring distinctive affordances from language. In: Proceedings of the 10th International Workshop on Natural Language Processing and Cognitive Science - NLPCS 2013, pp. 151–161 (2013)Google Scholar

Copyright information

© Institute for Computer Sciences, Social Informatics and Telecommunications Engineering 2015

Authors and Affiliations

  1. 1.ILC CNR PisaPisaItaly
  2. 2.Dipartimento di InformaticaUniversita’ di TorinoTorinoItaly

Personalised recommendations