Effective Palm Tracking with Integrated Tracker and Offline Detector

  • Zhibo Yang
  • Yanmin Zhu
  • Bo Yuan
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8589)


In this paper, we propose a vision based palm tracking method with three inherently connected components: i) an offline palm detector that locates all possible palm-like objects; ii) a SURF-based tracking module that identifies the tracked palm’s location using historical information; iii) an adaptive skin color model and a patch similarity calculation module. The outputs from the last component can effectively eliminate false detections and decide which palm is under tracking and also provide updated information to the first two modules. In summary, our work makes the following contributions: i) an effective offline palm detector; ii) a benchmark dataset for training and testing palm detectors; iii) an effective solution to tackling the challenges of palm tracking in adverse environments including occlusions, changing illumination and lack of context. Experiment results show that our method compare favorably with other popular tracking techniques such as Camshift and TLD in terms of precision and recall.


Palm Tracking Detection SURF Skin Color Model Integrator 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Zhu, Y.M., Yang, Z.B., Yuan, B.: Vision Based Hand Gesture Recognition. In: 2013 International Conference on Service Science, pp. 260–265 (2013)Google Scholar
  2. 2.
    Li, C., Kitani, M.K.: Pixel-Level Hand Detection in Ego-Centric Videos. In: 2013 IEEE Conference on Computer Vision and Pattern Recognition, pp. 3570–3577 (2013)Google Scholar
  3. 3.
    Chen, Q., Georganas, N.D., Petriu, E.M.: Real-Time Vision-Based Hand Gesture Recognition Using Haar-like Features. In: 2007 IEEE Instrumentation and Measurement Technology Conference, pp. 1–6 (2007)Google Scholar
  4. 4.
    Wu, Y., Huang, T.S.: View-Independent Recognition of Hand Postures. In: 2000 IEEE Conference on Computer Vision and Pattern Recognition, vol. 2, pp. 88–94 (2000)Google Scholar
  5. 5.
    Wu, Y., Liu, Q., Huang, T.S.: An Adaptive Self-Organizing Color Segmentation Algorithm with Application to Robust Real-Time Human Hand Localization. In: 2000 Asian Conference on Computer Vision, pp. 1106–1110 (2000)Google Scholar
  6. 6.
    Dadgostar, F., Sarrafzadeh, A.: An Adaptive Real-Time Skin Detector Based on Hue Thresholding: A Comparison on Two Motion Tracking Methods. Pattern Recognition Letters 27(12), 1342–1352 (2006)CrossRefGoogle Scholar
  7. 7.
    Viola, P., Jones, M.: Rapid Object Detection Using a Boosted Cascade of Simple Features. In: 2001 IEEE Conference on Computer Vision and Pattern Recognition, vol. 1, pp. 511–518 (2001)Google Scholar
  8. 8.
    Ong, E.J., Bowden, R.: A Boosted Classifier Tree for Hand Shape Detection. In: 6th Automatic Face and Gesture Recognition, pp. 889–894 (2004)Google Scholar
  9. 9.
    Karlinsky, L., Dinerstein, M., Harari, D.: The Chains Model for Detecting Parts by Their Context. In: 2010 IEEE Conference on Computer Vision and Pattern Recognition, pp. 25–32 (2010)Google Scholar
  10. 10.
    Kumar, M.P., Zisserman, A., Torr, P.H.: Efficient Discriminative Learning of Parts-Based Models. In: 12th International Conference on Computer Vision, pp. 552–559 (2009)Google Scholar
  11. 11.
    Arbelaez, P., Maire, M., Fowlkes, C., Malik, J.: From Contours to Regions: An Empirical Evaluation. In: 2009 IEEE Conference on Computer Vision and Pattern Recognition, pp. 2294–2301 (2009)Google Scholar
  12. 12.
    Mittal, A., Zisserman, A., Torr, P.H.: Hand Detection Using Multiple Proposals. In: 22nd British Machine Vision Conference, 75.1-75.11 (2011)Google Scholar
  13. 13.
    Kolsch, M., Turk, M.: Fast 2D Hand Tracking with Flocks of Features and Multi-Cue Integration. In: IEEE Workshop on Real-Time Vision for Human-Computer Interaction, pp. 158–165 (2004)Google Scholar
  14. 14.
    Bretzner, L., Laptev, I., Lindeberg, T.: Hand Gesture Recognition Using Multi-Scale Color Features, Hierarchical Models and Particle Filtering. In: 5th IEEE International Conference on Automatic Face and Gesture Recognition, pp. 423–428 (2002)Google Scholar
  15. 15.
    Kalal, Z., Krystian, M.K., Matas, J.: Tracking-Learning-Detection. IEEE Transactions on Pattern Analysis and Machine Intelligence 34(7), 1409–1422 (2012)CrossRefGoogle Scholar
  16. 16.
    Rittscher, J., Tu, P.H., Krahnstoever, N.: Simultaneous Estimation of Segmentation and Shape. In: 2005 IEEE Conference on Computer Vision and Pattern Recognition, vol. 2, pp. 486–493 (2005)Google Scholar
  17. 17.
  18. 18.
  19. 19.
    Lucas, B.D., Kanade, T.: An Iterative Image Registration Technique with an Application to Stereo Vision. In: 7th International Joint Conference on Artificial Intelligence, pp. 674–679 (1981)Google Scholar
  20. 20.
    Bay, H., Tuytelaars, T., Van Gool, L.: SURF: Speeded up robust features. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006, Part I. LNCS, vol. 3951, pp. 404–417. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  21. 21.
    Kalal, Z., Mikolajczyk, K., Matas, J.: Forward-Backward Error: Automatic Detection of Tracking Failures. In: 20th International Conference on Pattern Recognition, pp. 2756–2759 (2010)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  • Zhibo Yang
    • 1
  • Yanmin Zhu
    • 1
  • Bo Yuan
    • 1
  1. 1.Intelligent Computing Lab, Division of Informatics, Graduate School at ShenzhenTsinghua UniversityShenzhenP.R. China

Personalised recommendations