Bare Hand Interface for Interaction in the Video See-Through HMD Based Wearable AR Environment
In this paper, we propose a natural and intuitive bare hand interface for wearable augmented reality environment using the video see-through HMD. The proposed methodology automatically learned color distribution of the hand object through the template matching and tracking the hand objects by using the Meanshift algorithm under the dynamic background and moving camera. Furthermore, even though users are not wearing gloves, extracting of the hand object from arm is enabled by applying distance transform and using radius of palm. The fingertip points are extracted by convex hull processing and assigning constraint to the radius of palm area. Thus, users don’t need attaching fiducial markers on fingertips. Moreover, we implemented several applications to demonstrate the usefulness of proposed algorithm. For example, “AR-Memo" can help user to memo in the real environment by using a virtual pen which is augmented on the user’s finger, and user can also see the saved memo on his/her palm by augmenting it while moving around anywhere. Finally, we experimented performance and did usability studies.
KeywordsSearch Window Fiducial Marker Color Distribution Dynamic Background Bare Hand
Unable to display preview. Download preview PDF.
- 1.ARToolKit, http://www.hitl.washington.edu/artoolkit/
- 3.Shapiro, L., Stockman, G.: Computer Vision, pp. 196–197. Prentice-Hall, Englewood Cliffs (2001)Google Scholar
- 4.Bradski, G.R.: Computer Vision Face Tracking For Use in a Perceptual User Interface, Microcomputer Research Lab. Santa Clara, Intel CorporationGoogle Scholar
- 6.Daeyang i-visor DH-4400VP, http://www.mpcclub.ru/index.php?action=product&id=3340
- 7.Open Source Computer Vision Library, http://www.intel.com/research/mrl/research/opencv
- 8.Smith, R., Piekarski, W., Wigley, G.: Hand Tracking For Low Powered Mobile AR User Interfaces. In: 6th Australasian User Interface Conference, Newcastle, NSW (January 2005)Google Scholar
- 9.Manresa, C., et al.: Hand Tracking and Gesture Recognition for Human-Computer Interaction. Electronic Letters on Computer Vision and Image Analysis 5(3), 96–104 (2005)Google Scholar