Table-Top Interface Using Fingernail Images and Real Object Recognition

  • Kenta Hara
  • Noriko Takemura
  • Yoshio Iwai
  • Kosuke Sato
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7040)


Many researchers have proposed the development of table-top interfaces in the last decade. In a table-top system, for user satisfaction, they must be able to operate digital and analog media seamlessly. In this paper, we propose a table-top interface system that allows users to intuitively operate digital media by gesture recognition. The proposed system can capture the image of an object placed on the table by recognizing pressing gestures from fingernail images, and can transfer digital content by recognizing user’s shaking gestures. The evaluation experiments show that users can intuitively operate the proposed system without being aware of the data transmission.


table-top interface object recognition gesture recognition fingernail image 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Sugita, N., Iwai, D., Sato, K.: Touch Sensing by Image Analysis of Fingernail. In: SICE Annual Conference, pp. 1520–1525 (2008)Google Scholar
  2. 2.
    Koike, H., Sato, Y., Kobayashi, Y.: Integrating Paper and Digital Information on EnhancedDesk: A Method for Realtime Finger Tracking on a Augmented Desk System. ACM Transactions on Computer-Human Interaction 8(4) (December 2001)Google Scholar
  3. 3.
    Han, J.Y.: Low-cost Multi-touch Sensing through Frustrated Total Internal Reflection. In: Symposium on User Interface Software and Technology, pp. 115-118 (2005)Google Scholar
  4. 4.
    Kane, S.K., Avrahami, D., Wobbrock, J.O., Harrison, B., Rea, A., Philipose, M., LaMarca, A.: Bonfire: A Nomadic System for Hybrid Laptop-Tabletop Interaction. In: Symposium on User Interface Software and Technology, pp. 129–138 (2009)Google Scholar
  5. 5.
    Iwai, D., Sato, K.: Limpid Desk: See-Through Access to Disorderly Desktop in Projection-Based Mixed Reality. In: Symposium on Virtual Reality Software and Technology, pp. 112–115 (2006)Google Scholar
  6. 6.
    Hartmann, B., Moriss, M.R., Benko, H., Wilson, A.D.: Pictionaire: Supporting Collaborative Design Work by Integrating Physical and Digital Artifacts. In: Conference on Computer Supported Cooperative Work, pp. 421–424 (2010)Google Scholar
  7. 7.
    Koshimizu, M., Hayashi, N., Hirose, Y.: SnapTable: Physical Handling for Digital Documents for Electronic Paper. In: The Third Nordic Conference on Human Computer, pp. 401–404 (2004)Google Scholar
  8. 8.
    Viola, P., Jones, M.: Rapid object detection using a boosted cascade of simple features. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 511–518 (2001)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Kenta Hara
    • 1
  • Noriko Takemura
    • 1
  • Yoshio Iwai
    • 2
  • Kosuke Sato
    • 1
  1. 1.Graduate School of Engineering ScienceOsaka UniversityToyonakaJapan
  2. 2.Graduate School of EngineeringTottori UniversityTottori-shiJapan

Personalised recommendations