Abstract
Designing a user friendly Chinese input system is a challenging task due to the logographic nature of Chinese characters. Using fingertips and cameras to replace pens and touch panels as input devices could reduce the cost and improve ease-of-use and comfort of the computer-human interface. In this work, Chinese character entry is achieved using Mandarin Phonetic Symbol (MPS) recognition via on-line fingertip tracking. In the proposed system, particle filters are applied for robust fingertip tracking. Afterwards, MPS recognition is performed on the tracked fingertip trajectories using Hidden Markov Models. In the proposed system, the challenges of entering, leaving, and virtual strokes caused by video-based fingertip input can be overcome. We conduct experiments to validate that the MPS symbols written by fingertips are successfully and efficiently recognized using the proposed framework.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Lai, J.T.C., Li, Y., Anderson, R.: Donuts: Chinese Input with Pressure-Sensitive Marking Menu. In: ACM Symposium on User Interface Software and Technology (October 2005)
Han, C.-C., Cheng, H.-L., Lin, C.-L., Fan, K.-C.: Personal Authentication Using Palmprint Features. Pattern Recognition 36(2), 371–381 (2003)
Isard, M., Blake, A.: Condensation – Conditional density propagation for visual tracking. International Journal on Computer Vision 1(29), 5–28 (1998)
Arulampalam, M.S., Maskell, S., Gordon, N., Clapp, T.: A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking. IEEE Transactions on Signal Processing 50(2), 174–188 (2002)
Zheng, W., Bhandarkar, S.M.: Face detection and tracking using a Boosted Adaptive Particle Filter. Journal of Visual Communication and Image Representation 20(1), 9–27 (2009)
Gustafsson, F., et al.: Particle filters for positioning, navigation and tracking. IEEE Transactions on Signal Processing 50(2), 425–437 (2002)
Rabiner, L.R.: A tutorial on hidden Markov models and selected applications in speech recognition. Proceedings of the IEEE 77(2), 257–286 (1989)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Yu, CC., Cheng, HY., Jeng, BS., Lee, CC., Hong, WT. (2011). Human-Centered Fingertip Mandarin Input System Using Single Camera. In: Lee, KT., Tsai, WH., Liao, HY.M., Chen, T., Hsieh, JW., Tseng, CC. (eds) Advances in Multimedia Modeling. MMM 2011. Lecture Notes in Computer Science, vol 6524. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-17829-0_18
Download citation
DOI: https://doi.org/10.1007/978-3-642-17829-0_18
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-17828-3
Online ISBN: 978-3-642-17829-0
eBook Packages: Computer ScienceComputer Science (R0)