Skip to main content
SpringerLink
Log in

Object Recognition for Service Robots through Verbal Interaction Based on Ontology

  • Conference paper
Advances in Visual Computing (ISVC 2013)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 8033))

Included in the following conference series:

Abstract

We are developing a helper robot able to fetch objects requested by users. This robot tries to recognize objects through verbal interaction with the user concerning objects that it cannot detect autonomously. Since the robot recognizes objects based on verbal interaction with the user, such a robot must by necessity understand human descriptions of said objects. However, humans describe objects in various ways: they may describe attributes of whole objects, those of parts, or those viewable from a certain direction. Moreover, they may use the same descriptions to describe a range of different objects. In this paper, we propose an ontological framework for interactive object recognition to deal with such varied human descriptions. In particular, we consider human descriptions about object attributes, and develop an interactive object recognition system based on this ontology.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. Fukuda, H., Mori, S., Sakata, K., Kobayashi, Y., Kuno, Y.: Object recognition for service robots based on human description of object attributes. IEEJ Transactions on Electronics, Information and Systems 133-C(1), 18–27 (2013)

    Article  Google Scholar 

  2. Winograd, T.: Understanding Natural Language. Academic press (1972)

    Google Scholar 

  3. McGuire, P., Fritsch, J., Steil, J.J., Roothling, F., Fink, G.A., Wachsmuth, S., Sagerer, G., Ritter, H.: Multi-modal human machine communication for instruction robot grasping tasks. In: IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 1082–1089 (2002)

    Google Scholar 

  4. Takizawa, M., Makihara, Y., Shimada, N., Miura, J., Shirai, Y.: A service robot with interactive vision - object recognition using dialog with user. In: Int. Workshop Language Understanding and Agents for Real World Interaction, pp. 16–23 (2003)

    Google Scholar 

  5. Kobayashi, S., Tamagawa, S., Morita, T., Yamaguchi, T.: Intelligent humanoid robot with Japanese wikipedia ontology and robot action ontology. In: The 6th ACM/IEEE Int. Conf. on Human Robot Intetaction, pp. 417–424 (2011)

    Google Scholar 

  6. Maillot, N.E., Thonnat, M.: Ontology based complex object recognition. Image and Vision Computing 26(1), 102–113 (2008)

    Article  Google Scholar 

  7. Dasiopoulou, S., Mezaris, V., Kompatsiaris, I., Papastathis, V.K., Strintzis, M.G.: Knowledge-assisted semantic video object detection. IEEE Trans. Circuits Systems Video Tech. 15(10), 1210–1224 (2005)

    Article  Google Scholar 

  8. Holzapfel, H., Neubig, D., Waibel, A.: A dialogue approach to learning object descriptions and semantic categories. Robotics and Autonomous Systems 56(11) (2008)

    Google Scholar 

  9. Kozaki, K., Kitamura, Y., Ikeda, M., Mizoguchi, R.: Hozo: An Environment for Building/Using Ontologies Based on a Fundamental Consideration of “Roleh” and “Relationship”. In: Proc. of the 13th International Conference Knowledge Engineering and Knowledge Management (EKAW 2002), pp. 213–218 (2002)

    Google Scholar 

  10. Gibson, J.J.: The Ecological Approach to Visual Perception. Routledge (1986)

    Google Scholar 

  11. Cao, L., Kobayashi, Y., Kuno, Y.: Spatial-Based Feature for Locating Objects. In: Huang, D.-S., Ma, J., Jo, K.-H., Gromiha, M.M. (eds.) ICIC 2012. LNCS, vol. 7390, pp. 128–137. Springer, Heidelberg (2012)

    Chapter  Google Scholar 

  12. Gouaillier, D., Hugel, V., Blazevic, P., Kilner, C., Monceaux, J., Lafourcade, P., Marnier, B., et al.: Mechatronic design of nao humanoid. In: IEEE Int. Conf. on Robotics and Autonation, pp. 769–774 (2009)

    Google Scholar 

  13. Kinect for Windows, http://kinectforwindows.org/

  14. Open-Source Large Vocabulary CSR Engine Julius, http://julius.sourceforge.jp/index-en.html

Download references

Author information

Authors and Affiliations

  1. Department of Information and Computer Science, Saitama University, 255 Shimo-okubo, Sakura-ku, Saitama, 338-8570, Japan

    Hisato Fukuda, Satoshi Mori, Yoshinori Kobayashi & Yoshinori Kuno

  2. PRESTO, Japan Science and Technology Agency (JST), 4-1-8 Honcho, Kawaguchi, Saitama, 332-0012, Japan

    Yoshinori Kobayashi

  3. Faculty of Liberal Arts, Saitama University, 255 Shimo-okubo, Sakura-ku, Saitama, 338-8570, Japan

    Daisuke Kachi

Authors
  1. Hisato Fukuda
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Satoshi Mori
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yoshinori Kobayashi
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Yoshinori Kuno
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Daisuke Kachi
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. University of Nevada, Reno, NV, USA

    George Bebis

  2. NASA Ames Research Center, Moffett Field, CA, USA

    Richard Boyle

  3. Lawrence Berkeley National Laboratory, Berkeley, CA, USA

    Bahram Parvin

  4. Desert Research Institute, Reno, NV, USA

    Darko Koracin

  5. Arizona State University, Tempe, AZ, USA

    Baoxin Li

  6. Mitsubishi Electric Research Laboratories, Cambridge, MA, USA

    Fatih Porikli

  7. University of California, Riverside, CA, USA

    Victor Zordan

  8. AT&T Research Labs, Florham Park, NJ, USA

    James Klosowski

  9. ZIRST, Saint-Ismier Cedex, France

    Sabine Coquillart

  10. Qualcomm Research, San Diego, CA, USA

    Xun Luo

  11. Oxford e-Research Centre, University of Oxford, Oxford, UK

    Min Chen

  12. IBM, Hawthorne, NY, USA

    David Gotz

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Fukuda, H., Mori, S., Kobayashi, Y., Kuno, Y., Kachi, D. (2013). Object Recognition for Service Robots through Verbal Interaction Based on Ontology. In: Bebis, G., et al. Advances in Visual Computing. ISVC 2013. Lecture Notes in Computer Science, vol 8033. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-41914-0_39

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-41914-0_39

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-41913-3

  • Online ISBN: 978-3-642-41914-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation