Interacting with Digital Signage Using Hand Gestures

Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5627)


Digital signage is a very attractive medium for advertisement and general communications in public open spaces. In order to add interaction capabilities to digital signage displays, special considerations must be taken. For example, the signs’ environment and placement might prevent direct access to conventional means of interaction, such as using a keyboard or a touch-sensitive screen. This paper describes a vision-based gesture recognition approach to interact with digital signage systems and discusses the issues faced by such systems. Using Haar-like features and the AdaBoosting algorithm, a set of hand gestures can be recognized in real-time and converted to gesture commands to control and manipulate the digital signage display. A demonstrative application using this gesture recognition interface is also depicted.


Digital Signage Gesture Recognition Hand Gesture Weak Classifier Hand Shape 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Harrison, J.V., Andrusiewicz, A.: An emerging marketplace for digital advertising based on amalgamated digital signage networks. In: Proc. IEEE International Conference on E-Commerce, pp. 149–156 (2003)Google Scholar
  2. 2.
    Wang, P.: Digital signage 101: a quick introduction to those who are new to digital signage,
  3. 3.
    The DSE19M Economy Serie 19-Inch LCD Advertising Machine,
  4. 4.
    GestPoint® Gesture Recognition for Presentation Systems,
  5. 5.
    Wu, Y., Huang, T.S.: Non-stationary color tracking for vision-based human computer interaction. IEEE Trans. on Neural Networks, 948–960 (2002)Google Scholar
  6. 6.
    Mckenna, S., Morrison, K.: A comparison of skin history and trajectory-based representation schemes for the recognition of user- specific gestures. Pattern Recognition 37, 999–1009 (2004)CrossRefGoogle Scholar
  7. 7.
    Bretzner, L., Laptev, I., Lindeberg, T.: Hand gesture recognition using multiscale colour features, hierarchical models and particle filtering. In: Proc. 5th IEEE International Conference on Automatic Face and Gesture Recognition, pp. 405–410 (2002)Google Scholar
  8. 8.
    Imagawa, K., Matsuo, H., Taniguchi, R., Arita, D., Lu, S., Igi, S.: Recognition of local features for camera-based sign language recognition system. In: Proc. International Conference on Pattern Recognition, vol. 4, pp. 849–853 (2000)Google Scholar
  9. 9.
    Cui, Y., Weng, J.: Appearance-based hand sign recognition from intensity image sequences. Computer Vision Image Understanding 78(2), 157–176 (2000)CrossRefGoogle Scholar
  10. 10.
    Ramamoorthy, A., Vaswani, N., Chaudhury, S., Banerjee, S.: Recognition of dynamic hand gestures. Pattern Recognition 36, 2069–2081 (2003)CrossRefzbMATHGoogle Scholar
  11. 11.
    Ong, E., Bowden, R.: Detection and segmentation of hand shapes using boosted classifiers. In: Proc. IEEE 6th International Conference on Automatic Face and Gesture Recognition, pp. 889–894 (2004)Google Scholar
  12. 12.
    Ng, C.W., Ranganath, S.: Gesture recognition via pose classification. In: Proc. 15th International Conference on Pattern Recognition, vol. 3, pp. 699–704 (2000)Google Scholar
  13. 13.
    Viola, P., Jones, M.: Rapid object detection using a boosted cascade of simple features. In: Proc. IEEE Conference on Computer Vision and Pattern Recognition, pp. 511–518 (2001)Google Scholar
  14. 14.
    Freund, Y., Schapire, R.E.: A short introduction to boosting. Journal of Japanese Society for Artificial Intelligence 14(5), 771–780 (1999)Google Scholar
  15. 15.
    Freund, Y., Schapire, R.E.: A decision-theoretic generalization of on-line learning and an application to boosting. Journal of Computer and System Sciences 55(1), 119–139 (1997)MathSciNetCrossRefzbMATHGoogle Scholar
  16. 16.
    Chen, Q., Georganas, N.D., Petriu, E.M.: Hand gesture recognition using Haar-like features and a stochastic context-free grammar. IEEE Transactions on Instrumentation and Measurement 57(8), 1562–1571 (2008)CrossRefGoogle Scholar
  17. 17.
    Gesture-based interactive digital signage demo, DiscoverLab, University of Ottawa,

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  1. 1.DISCOVER LabUniversity of OttawaOttawaCanada
  2. 2.Institute of Computer Graphics and Image ProcessingTianjin UniversityTianjinChina

Personalised recommendations