Computer Vision

Living Edition

Hand Pose Estimation

  • Liuhao Ge
  • Junsong YuanEmail author
Living reference work entry
DOI: https://doi.org/10.1007/978-3-030-03243-2_875-1
  • 12 Downloads

Synonyms

Related Concepts

Definition

Hand pose estimation is the process of estimating the 2D/3D positions of hand keypoints from a visual input, typically a single depth image or a single monocular RGB image.

Background

Vision-based hand pose estimation is a very important problem in computer vision and has been studied for over 20 years since it is one of the core technologies for human computer interaction, especially in virtual reality and augmented reality applications [11, 16, 17]. For example, articulated 3D hand pose estimation provides a natural way for users to interact with virtual environments and virtual objects [3]. The estimated hand pose can also be used for hand gesture recognition.

Although hand pose estimation has aroused a lot of research attention in recent years, it is still challenging to achieve efficient and robust performance. First, estimating 3D hand pose from depth images is a...

This is a preview of subscription content, log in to check access.

References

  1. 1.
    Cai Y, Ge L, Cai J, Yuan J (2018) Weakly-supervised 3D hand pose estimation from monocular RGB images. In: Proceedings of the European conference on computer vision (ECCV)Google Scholar
  2. 2.
    Erol A, Bebis G, Nicolescu M, Boyle RD, Twombly X (2005) A review on vision-based full DOF hand motion estimation. In: IEEE conference on computer vision and pattern recognition workshops, pp 75–82Google Scholar
  3. 3.
    Ge L, Liang H, Yuan J, Thalmann D (2019) Real-time 3D hand pose estimation with 3D convolutional neural networks. IEEE Trans Pattern Anal Mach Intell 41(4):956–970CrossRefGoogle Scholar
  4. 4.
    Ge L, Ren Z, Li Y, Xue Z, Wang Y, Cai J, Yuan J (2019) 3D hand shape and pose estimation from a single RGB image. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR)Google Scholar
  5. 5.
    Ge L, Ren Z, Yuan J (2018) Point-to-point regression pointnet for 3D hand pose estimation. In: Proceedings of the European conference on computer vision (ECCV)Google Scholar
  6. 6.
    Joo H, Simon T, Sheikh Y (2018) Total capture: a 3D deformation model for tracking faces, hands, and bodies. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), pp 8320–8329Google Scholar
  7. 7.
    Liang H, Yuan J, Lee J, Ge J, Thalmann D (2019) Hough forest with optimized leaves for global hand pose estimation with arbitrary postures. IEEE Trans Cybern 49(2):527–541CrossRefGoogle Scholar
  8. 8.
    Melax S, Keselman L, Orsten S (2013) Dynamics based 3D skeletal hand tracking. In: Proceedings of the graphics interface, pp 63–70Google Scholar
  9. 9.
    Oikonomidis I, Kyriazis N, Argyros AA (2010) Markerless and efficient 26-DOF hand pose recovery. In: Proceedings of the Asian conference on computer vision. Springer, pp 744–757Google Scholar
  10. 10.
    Qian C, Sun X, Wei Y, Tang X, Sun J (2014) Realtime and robust hand tracking from depth. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), pp 1106–1113Google Scholar
  11. 11.
    Rehg JM, Kanade T (1994) Visual tracking of high DOF articulated structures: an application to human hand tracking. In: Proceedings of the European conference on computer vision (ECCV)Google Scholar
  12. 12.
    Sharp T, Keskin C, Robertson D, Taylor J, Shotton J, Kim D, Rhemann C, Leichter I, Vinnikov A, Wei Y, Freedman D, Kohli P, Krupka E, Fitzgibbon A, Izadi S (2015) Accurate, robust, and flexible real-time hand tracking. In: Proceedings of the 33rd annual ACM conference on human factors in computing systems, pp 3633–3642Google Scholar
  13. 13.
    Taylor J, Bordeaux L, Cashman T, Corish B, Keskin C, Sharp T, Soto E, Sweeney D, Valentin J, Luff B, Topalian A, Wood E, Khamis S, Kohli P, Izadi S, Banks R, Fitzgibbon A, Shotton J (2016) Efficient and precise interactive hand tracking through joint, continuous optimization of pose and correspondences. ACM Trans Graph 35(4):143:1–143:12Google Scholar
  14. 14.
    Tkach A, Pauly M, Tagliasacchi A (2016) Sphere-meshes for real-time hand modeling and tracking. ACM Trans Graph 35(6):222:1–222:11Google Scholar
  15. 15.
    Tompson J, Stein M, Lecun Y, Perlin K (2014) Real-time continuous pose recovery of human hands using convolutional networks. ACM Trans Graph 33(5):169:1–169:10Google Scholar
  16. 16.
    Wu Y, Huang TS (2001) Hand modeling, analysis and recognition. IEEE Signal Process Mag 18(3):51–60CrossRefGoogle Scholar
  17. 17.
    Wu Y, Lin J, Huang TS (2005) Analyzing and capturing articulated hand motion in image sequences. IEEE Trans Pattern Anal Mach Intell 27(12):1910–1922CrossRefGoogle Scholar
  18. 18.
    Xu C, Cheng L (2013) Efficient hand pose estimation from a single depth image. In: Proceedings of the IEEE international conference on computer vision (ICCV), pp 3456–3462Google Scholar
  19. 19.
    Yuan S, Ye Q, Stenger B, Jain S, Kim T-K (2017) Bighand2. 2m benchmark: hand pose dataset and state of the art analysis. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), pp 2605–2613Google Scholar
  20. 20.
    Zimmermann C, Brox T (2017) Learning to estimate 3D hand pose from single RGB images. In: Proceedings of the IEEE international conference on computer vision (ICCV)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2020

Authors and Affiliations

  1. 1.Institute for Media InnovationNanyang Technological UniversitySingaporeSingapore
  2. 2.Department of Computer Science and EngineeringState University of New York at BuffaloBuffaloUSA

Section editors and affiliations

  • Wenjun Zeng
    • 1
  • Sing Bing Kang
    • 2
  1. 1.Microsoft ResearchBeijingChina
  2. 2.Microsoft ResearchRedmondUSA