Investigation of an Augmented Reality-Based Machine Operator Assistance-System
In this work we propose three applications towards an augmented reality-based machine operator assistance system. The application context is worker training in motor vehicle production. The assistance system visualizes information relevant to any particular procedure directly at the workplace. Mobile display devices in combination with augmented reality (AR) technologies present situational information. Head-mounted displays (HMD) can be used in industrial environments when workers need to have both hands free. Such systems augment the user’s field of view with visual information relevant to a particular job. The potentials of HMDs are well known and their capabilities have been demonstrated in different application scenarios. Nonetheless, many systems are not user-friendly and may lead to rejection or prejudice among users. The need for research on user-related aspects as well as methods of intuitive user interaction arose early but has not been met until now. Therefore, a robust prototypical system was developed, modified and validated. We present image-based methods for robust recognition of static and dynamic hand gestures in real time. These methods are used for intuitive interaction with the mobile assistance system. The selection of gestures (e.g., static vs. dynamic) and devices is based on psychological findings and ensured by experimental studies.
This work was done within the Transregional Collaborative Research Centre SFB/TRR 62 “Companion-Technology for Cognitive Technical Systems” funded by the German Research Foundation (DFG).
- 1.Ierusalimschy, R., Celes, W., de Figueiredo, L.H.: Lua (1993). http://www.lua.org/
- 2.Kalal, Z., Mikolajczyk, K., Matas, J.: Tracking-learning-detection. IEEE Trans. Pattern Anal. Mach. Intell. 6(1), 1409–1422 (2010)Google Scholar
- 4.Köpsel, A., Huckauf, A.: Evaluation of static and dynamic freehand gestures in device control. In: Proceedings of the Tilburg Gesture Research Meeting (2013)Google Scholar
- 6.Wobbrock, J.O., Myers, B.A.: Edgewrite: a new text entry technique designed for stability. Technical report, Institute for Software Research, Carnegie Mellon University (2005)Google Scholar