A Multimodal Human-Robot-Interaction Scenario: Working Together with an Industrial Robot

  • Alexander Bannat
  • Jürgen Gast
  • Tobias Rehrl
  • Wolfgang Rösel
  • Gerhard Rigoll
  • Frank Wallhoff
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5611)

Abstract

In this paper, we present a novel approach for multimodal interactions between humans and industrial robots.

The application scenario is situated in a factory, where a human worker is supported by a robot to accomplish a given hybrid assembly scenario, that covers manual and automated assembly steps. The robot is acting as an assistant as well as a fully autonomous assembly unit.

For interacting with the presented system, the human is able to give his commands via three different input modalities (speech, gaze and the so-called soft-buttons).

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Zäh, M.F., Lau, C., Wiesbeck, M., Ostgathe, M., Vogl, W.: Towards the Cognitive Factory. In: Proceedings of the 2nd International Conference on Changeable, Agile, Reconfigurable and Virtual Production (CARV), Toronto, Canada (July 2007)Google Scholar
  2. 2.
    Goebl, M., Färber, G.: A real-time-capable hard- and software architecture for joint image and knowledge processing in cognitive automobiles. In: Intelligent Vehicles Symposium, pp. 737–740 (June 2007)Google Scholar
  3. 3.
    Stiller, C., Färber, G., Kammel, S.: Cooperative cognitive automobiles. In: Intelligent Vehicles Symposium, pp. 215–220. IEEE, Los Alamitos (2007)Google Scholar
  4. 4.
    Thuy, M., Göbl, M., Rattei, F., Althoff, M., Obermeier, F., Hawe, S., Nagel, R., Kraus, S., Wang, C., Hecker, F., Russ, M., Schweitzer, M., León, F.P., Diepold, K., Eberspächer, J., Heißing, B., Wünsche, H.J.: Kognitive automobile - neue konzepte und ideen des sonderforschungsbereiches/tr-28. In: Aktive Sicherheit durch Fahrerassistenz, Garching bei München, Garching bei München, April 7-8 (2008)Google Scholar
  5. 5.
    Bardins, S., Poitschke, T., Kohlbecher, S.: Gaze-based Interaction in various Environments. In: Proceedings of 1st ACM International Workshop on Vision Networks for Behaviour Analysis VNBA 2008, Vancouver, Canada (2008)Google Scholar
  6. 6.
    Bannat, A., Gast, J., Rigoll, G., Wallhoff, F.: Event Analysis and Interpretation of Human Activity for Augmented Reality-based Assistant Systems. In: IEEE Proceeding ICCP 2008, Cluj-Napoca, Romania, August 28-30 (2008)Google Scholar
  7. 7.
    Naur, P.: Revised Report on the Algorithmic Language ALGOL 60. Communications of the ACM 3(5), 299–314 (1960)MathSciNetCrossRefGoogle Scholar
  8. 8.
    Soriano, M., Huovinen, S., Martinkauppi, B., Laaksonen, M.: Skin Detection in Video under Changing Illumination Conditions. In: Proc. 15th International Conference on Pattern Recognition, Barcelona, Spain, pp. 839–842 (2000)Google Scholar
  9. 9.
    Lenz, C., Nair, S., Rickert, M., Knoll, A., Rösel, W., Bannat, A., Gast, J., Wallhoff, F.: Joint Actions for Humans and Industrial Robots: A Hybrid Assembly Concept. In: Proc. 17th IEEE International Symposium on Robot and Human Interactive Communication, Munich, Germany (2008)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Alexander Bannat
    • 1
  • Jürgen Gast
    • 1
  • Tobias Rehrl
    • 1
  • Wolfgang Rösel
    • 2
  • Gerhard Rigoll
    • 1
  • Frank Wallhoff
    • 1
  1. 1.Department of Electrical Engineering and Information TechnologyInstitute for Human-Machine CommunicationGermany
  2. 2.Faculty of Mechanical Engineering, Institute for Machine Tools and Industrial ManagementTechnische Universität MünchenMunichGermany

Personalised recommendations