Skip to main content
SpringerLink
Log in

Image-Based Wearable Tangible Interface

  • Conference paper
Advances in Intelligent Systems and Applications - Volume 2

Part of the book series: Smart Innovation, Systems and Technologies ((SIST,volume 21))

Abstract

This paper presents a novel technique for the mobile TUI system which consists of a pico projector and a camera only. The proposed system can transform an arbitrary flat surface into a touch panel. It allows user to interact with a computer by hand gestures on any flat surface in anytime and anyplace. The contributions of the proposed system include the extraction of display screen from the live captured image by a RGB-based camera, shadow-based fingertips detection approach and a fast yet reliable FSM grammar to determine user’s finger gesture. At the end, a prototype system is built to validate the proposed techniques and an experiment is shown in the last.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 259.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 329.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 329.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Jeffries, R., Miller, J.R., Wharton, C., Uyeda, K.: User interface evaluation in the real world: a comparison of four techniques. In: SIGCHI 1991, pp. 4–11 (1991)

    Google Scholar 

  2. Kay, A.: User Interface: a personal view, pp. 121–131 (1990)

    Google Scholar 

  3. TUI –Wikipedia, http://en.wikipedia.org/wiki/Tangible_user_interface

  4. Ishii, H.: The tangible user interface and its evolution. Communications of the ACM - Organic User Interfaces 51(6), 32–36 (2008)

    Google Scholar 

  5. Licsar, A., Sziranyi, T.: Hand Gesture Recognition in Camera-Projector System. In: International Workshop on Human-Computer Interaction, pp. 83–93 (2004)

    Google Scholar 

  6. Mistry, P., Maes, P., Chang, L.: WUW - Wear Ur World - A Wearable Gestural Interface. In: ACM CHI, pp. 4111–4116 (2009)

    Google Scholar 

  7. Wilson, A.D.: PlayAnywhere: a compact interactive tabletop projection-vision system. In: ACM UIST, pp. 83–92 (2005)

    Google Scholar 

  8. Yoshida, T., Hirobe, Y., Nii, H., Kawakami, N., Tachi, S.: Twinkle: Interacting with Physical Surfaces Using Handheld Projector. In: IEEE VR, pp. 87–90 (2010)

    Google Scholar 

  9. Gonzalez, R.C., Woods, R.E.: Digital Image Processing, 2nd edn. (2002)

    Google Scholar 

  10. Harrison, C., Benko, H., Wilson, A.D.: OmniTouch: Wearable Multitouch Interaction Everywhere. In: ACM UIST, pp. 441–450 (2011)

    Google Scholar 

  11. Zhang, Z.: A Flexible New Technique for Camera Calibration. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1330–1334 (2000)

    Google Scholar 

  12. Falcao, G., Hurtos, N., Massich, J., Fofi, D.: Projector-Camera Calibration Toolbox (2009), http://code.google.com/p/procamcalib

  13. Mitra, S., Acharya, T.: Gesture Recognition: A Survey. IEEE Transactions on Systems, Man, and Cybernetics, 311–324 (2007)

    Google Scholar 

  14. OS X Lion, OS X Lion: About Multi-Touch gestures, http://support.apple.com/kb/HT4721

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science and Information Engineering, NTPU, Taipei, Taiwan

    Jiung-Yao Huang & Yong-Zeng Yeo

  2. Department of Computer Science and Information Engineering, TKU, Taipei, Taiwan

    Lin Huei

  3. Department of Computer Science & Information Engineering, NDU, Hsinchu, Taiwan

    Chung-Hsien Tsai

Authors
  1. Jiung-Yao Huang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yong-Zeng Yeo
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Lin Huei
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Chung-Hsien Tsai
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jiung-Yao Huang .

Editor information

Editors and Affiliations

  1. of Applied Sciences, Department of Electronic Engineering, National Kaohsiung University, Jiàngōng Road, Kaohsiung, 807, Taiwan R.O.C.

    Jeng-Shyang Pan

  2. , Department of Computer Science and, National Dong Hwa University, #1, Sec. 2, Da Hsueh Rd., Hualien, Taiwan R.O.C.

    Ching-Nung Yang

  3. , Department of Computer Science and, Providence University, #200, Chung-shi Rd., Taichung, Taiwan R.O.C.

    Chia-Chen Lin

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Huang, JY., Yeo, YZ., Huei, L., Tsai, CH. (2013). Image-Based Wearable Tangible Interface. In: Pan, JS., Yang, CN., Lin, CC. (eds) Advances in Intelligent Systems and Applications - Volume 2. Smart Innovation, Systems and Technologies, vol 21. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-35473-1_46

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-35473-1_46

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-35472-4

  • Online ISBN: 978-3-642-35473-1

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation