Investigation of an Augmented Reality-Based Machine Operator Assistance-System

  • Frerk Saxen
  • Anne Köpsel
  • Simon Adler
  • Rüdiger Mecke
  • Ayoub Al-Hamadi
  • Johannes Tümler
  • Anke Huckauf
Chapter
Part of the Cognitive Technologies book series (COGTECH)

Abstract

In this work we propose three applications towards an augmented reality-based machine operator assistance system. The application context is worker training in motor vehicle production. The assistance system visualizes information relevant to any particular procedure directly at the workplace. Mobile display devices in combination with augmented reality (AR) technologies present situational information. Head-mounted displays (HMD) can be used in industrial environments when workers need to have both hands free. Such systems augment the user’s field of view with visual information relevant to a particular job. The potentials of HMDs are well known and their capabilities have been demonstrated in different application scenarios. Nonetheless, many systems are not user-friendly and may lead to rejection or prejudice among users. The need for research on user-related aspects as well as methods of intuitive user interaction arose early but has not been met until now. Therefore, a robust prototypical system was developed, modified and validated. We present image-based methods for robust recognition of static and dynamic hand gestures in real time. These methods are used for intuitive interaction with the mobile assistance system. The selection of gestures (e.g., static vs. dynamic) and devices is based on psychological findings and ensured by experimental studies.

Notes

Acknowledgements

This work was done within the Transregional Collaborative Research Centre SFB/TRR 62 “Companion-Technology for Cognitive Technical Systems” funded by the German Research Foundation (DFG).

References

  1. 1.
    Ierusalimschy, R., Celes, W., de Figueiredo, L.H.: Lua (1993). http://www.lua.org/
  2. 2.
    Kalal, Z., Mikolajczyk, K., Matas, J.: Tracking-learning-detection. IEEE Trans. Pattern Anal. Mach. Intell. 6(1), 1409–1422 (2010)Google Scholar
  3. 3.
    Khan, R., Hanbury, A., Stöttinger, J., Bais, A.: Color based skin classification. Pattern Recogn. Lett. 33, 157–163 (2012). doi:10.1016/j.patrec.2011.09.032CrossRefGoogle Scholar
  4. 4.
    Köpsel, A., Huckauf, A.: Evaluation of static and dynamic freehand gestures in device control. In: Proceedings of the Tilburg Gesture Research Meeting (2013)Google Scholar
  5. 5.
    Phung, S.L., Bouzerdoum, A., Chai, D.: Skin segmentation using color pixel classification: analysis and comparison. IEEE Trans. Pattern Anal. Mach. Intell. 27(1), 148–154 (2005)CrossRefGoogle Scholar
  6. 6.
    Wobbrock, J.O., Myers, B.A.: Edgewrite: a new text entry technique designed for stability. Technical report, Institute for Software Research, Carnegie Mellon University (2005)Google Scholar

Copyright information

© Springer International Publishing AG 2017

Authors and Affiliations

  • Frerk Saxen
    • 1
  • Anne Köpsel
    • 2
  • Simon Adler
    • 3
  • Rüdiger Mecke
    • 3
  • Ayoub Al-Hamadi
    • 1
  • Johannes Tümler
    • 4
  • Anke Huckauf
    • 2
  1. 1.IIKTOtto von Guericke University MagdeburgMagdeburgGermany
  2. 2.General PsychologyUlm UniversityUlmGermany
  3. 3.Fraunhofer IFFMagdeburgGermany
  4. 4.Volkswagen AGWolfsburgGermany

Personalised recommendations