Skip to main content

An Extensible Language Interfacefor Robot Manipulation

  • Conference paper
Artificial General Intelligence (AGI 2012)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 7716))

Included in the following conference series:

Abstract

This paper describes our Extensible Language Interface (ELI) for robots. The system is intended to interpret far-field speech commands in order to perform fetch-and-carry tasks, potentially for use in an eldercare context. By “extensible” we mean that the robot is able to learn new nouns and verbs by simple interaction with its user. An associated video [1] illustrates the range of phenomena handled by our implemented real-time system.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Connell, J.: Eli Arm Demos (video) (2012), http://www.johuco.com/eli_arm_demos.wmv

  2. Connell, J.: Fusing Animals and Humans. In: Proc. AGI 2008, pp. 389–393 (2008)

    Google Scholar 

  3. Chitta, S., Jones, E., Ciocarlie, M., Hsiao, K.: Perception, Planning, and Execution for Mobile Manipulation in Unstructured Environments. IEEE Robotics and Automation Magazine 19(2), 58–71 (2012)

    Article  Google Scholar 

  4. Srinivasa, S., et al.: HERB: A Home Exploring Robotic Butler. Autonomous Robots 28(1), 5–20 (2010)

    Article  Google Scholar 

  5. Choi, Y., et al.: Hand It Over or Set It Down: A User Study of Object Delivery with an Assistive Mobile Manipulator. In: IEEE Int. Symp. on Robot and Human Interactive Communication (RO-MAN), pp. 736–743 (2009)

    Google Scholar 

  6. Seabra Lopes, L., Teixeira, A.: Human-Robot Interaction through Spoken Language Dialogue. In: IEEE Int. Conf. on Intelligent Robots and Systems (IROS), pp. 528–534 (2000)

    Google Scholar 

  7. Stuckler, J., Holz, D., Behnke, S.: Demonstrating Everyday Manipulation Skills in RoboCup@Home. IEEE Robotics and Automation Magazine, 34–42 (June 2012)

    Google Scholar 

  8. Steels, L.: The origins of syntax in visually grounded robotic agents. Artificial Intelligence 103, 133–156 (1998)

    Article  MATH  Google Scholar 

  9. Roy, D.: Grounded Spoken Language Acquisition: Experiments in Word Learning. IEEE Trans. on Multimedia 5(2), 197–209 (2003)

    Article  Google Scholar 

  10. Peltason, J., et al.: Mixed-Initiative in Human Augmented Mapping. In: IEEE Int. Conf. on Robotics and Automation (ICRA), pp. 2146–2153 (2009)

    Google Scholar 

  11. Siskind, J.: Grounding the Lexical Semantics of Verbs in Visual Perception using Force Dynamics and Event Logic. J. of Artificial Intelligence Research 15, 31–90 (2001)

    MATH  Google Scholar 

  12. Breazeal, C., et al.: Using perspective taking to learn from ambiguous demonstrations. Robotics and Autonomous Systems 54, 385–393 (2006)

    Article  Google Scholar 

  13. Connell, J.: Beer on the Brain. In: Proc. of AAAI Spring Symposium – My Dinner with R2D2: Natural Dialogues with Practical Robotics Devices, pp. 25–26 (March 2000)

    Google Scholar 

  14. Soltau, H., Saon, G., Kingsbury, B.: The IBM Attila Speech Recognition Toolkit. In: IEEE Spoken Language Technology Workshop (SLT), pp. 97–102 (2010)

    Google Scholar 

  15. Murdock, J., et al.: Typing candidate answers using type coercion. IBM J. of Res. and Dev. 56(3/4), 7:1–7:13 (2012)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2012 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Connell, J., Marcheret, E., Pankanti, S., Kudoh, M., Nishiyama, R. (2012). An Extensible Language Interfacefor Robot Manipulation. In: Bach, J., Goertzel, B., Iklé, M. (eds) Artificial General Intelligence. AGI 2012. Lecture Notes in Computer Science(), vol 7716. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-35506-6_3

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-35506-6_3

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-35505-9

  • Online ISBN: 978-3-642-35506-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics