Abstract
Mobile user interfaces is an increasingly important topic because of the rapid growth of smart phones and tablet PCs. Thus, we propose a new type of mobile user interface, focusing on mobile devices equipped with a rear-facing camera. In the proposed system, users can interact with mobile software applications using finger gestures with the hand which holds a mobile device, which are detected by a rear-facing camera. Skin-color segmentation, morphological operation, blob detection and skeletonization are used in finger pointer tracking and finger gesture estimation. Mouse events, directional commands and mobile applications can be controlled by the proposed finger gesture-based mobile user interface.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Koh, E., Won, J., Bae, C.: On-premesie skin color modeling method for vision-based hand tracking. In: IEEE 13th International Symposium Consumer Electronics, ISCE 2009, May 25-28 (1981)
Wu, Y., Huang, T.S.: Vision-based gesture recognition: A review. In: Braffort, A., Gibet, S., Teil, D., Gherbi, R., Richardson, J. (eds.) GW 1999. LNCS (LNAI), vol. 1739, p. 103. Springer, Heidelberg (2000)
Sasaki, H., Kuroda, T., Manabe, Y., Chihara, K.: Augmented reality based input interface for wearable computers. In: Heudin, J.-C. (ed.) VW 2000. LNCS (LNAI), vol. 1834, pp. 294–302. Springer, Heidelberg (2000)
Wu, Y.-W., Ai, X.-Y.: Face Detection in Color Images Using AdaBoost Algorithm Based on Skin color Information. In: Knowledge Discovery and Data Mining 2008, pp. 339–342 (2008)
Vezhnevets, V., Sazonov, V., Andreeva, A.: A survey on pixel based skin color detection techniques. In: GraphiCon, Moscow, Russia (September 2003)
Shapiro, L., Stockman, G.: Computer Vision, pp. 63–73. Prentice Hall, Englewood Cliffs (2002)
Dillecourt, M.B., Samet, H., Tamminen, M.: A general approach to connected-component labeling for arbitrary image representations. Journal of the ACM 39(2), 253–280 (1992)
Umbaugh, S.E.: Computer Imaging: Digital Image Analysis and Processing (2005)
Abeysinghe, S., Baker, M., Chiu, W., Ju, T.: Segmentation-free skeletonization of grayscale volumes for shape understanding. In: SMI, pp. 63–71 (June 2008)
Android NDK | Android Developers, http://developer.android.com/sdk/ndk/index.html
Java Native Interface, Wikipedia, http://en.wikipedia.org/Java_Native_Interface
Hirobe, Y., Niikura, T., Watanabe, Y., Komuro, T., Ishikawa, M.: Vision-based Input Interface for Mobile Devices with High speed Fingertip Tracking. In: 22nd ACM Symposium on UIST, pp. 7–8 (2009)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
An, JH., Min, JH., Hong, KS. (2011). Finger Gesture Estimation for Mobile Device User Interface Using a Rear-Facing Camera. In: Park, J.J., Yang, L.T., Lee, C. (eds) Future Information Technology. Communications in Computer and Information Science, vol 185. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-22309-9_28
Download citation
DOI: https://doi.org/10.1007/978-3-642-22309-9_28
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-22308-2
Online ISBN: 978-3-642-22309-9
eBook Packages: Computer ScienceComputer Science (R0)