We propose a three-dimensional hand posture estimation system that can retrieve a hand posture image most similar to the input data from a non-multilayer database. Our system uses, at the first stage, coarse screening by the proportional information on the hand images, which roughly correspond to forearm rotation or bending of the thumb or four fingers; then, at the second stage, performs a detailed search for similarity for selected candidates. To describe forearm rotation, and wrist’s internal and external rotations, bending and stretching, no separate processes were used for estimating the corresponding joint angles. By estimating the sequential images of the finger shape using this method, we successfully realized a process involving a joint angle estimation error within two or three degrees, a processing time of approximately 80 fps or more, using only one Note PC and high-speed camera, even when the wrist was freely rotating. Since the image information and the joint angle information are paired in the database, as well as the wrist joint, the system can generate the imitative motions as those of the fingers and wrist of a human being with no time delay by means of a robot, by outputting the estimation results to the robot hand.
This is a preview of subscription content, log in to check access.
Buy single article
Instant access to the full article PDF.
Price includes VAT for USA
Subscribe to journal
Immediate online access to all issues from 2019. Subscription will auto renew annually.
This is the net price. Taxes to be calculated in checkout.
Rehg JM, Kanade T (1994) Visual tracking of high DOF articulated structures: an application to human hand tracking. In: European conference on computer vision, pp 35–46
Kameda Y, Minoh M (1996) A human motion estimation method using 3-successive video frames. In: Proceedings of the virtual systems and multimedia, pp 135–140
Lu S, Metaxas D, Samaras D, Oliensis J (2003) Using multiple cues for hand tracking and model refinement. In: Proceedings of the CVPR2003, vol 2, pp 443–450
Gumpp T, Azad P, Welke K, Oztop E, Dillmann R, Cheng G (2006) Unconstrained real-time markerless hand tracking for humanoid interaction. In: Proceedings of the IEEE-RAS international conference on humanoid robots (Humanoids 2006), CD-ROM
Athitos V, Scarloff S (2002) An appearance-based framework for 3D hand shape classification and camera viewpoint estimation. In: Proceedings of the automatic face and gesture recognition, pp 40–45
Hoshino K, Tanimoto T (2005) Real time search for similar hand images from database for robotic hand control. In: IEICE transactions on fundamentals of electronics. Communications and computer sciences, E88-A, vol 10, pp 2514–2520
Wu Y, Lin J, Huang TS (2005) Analyzing and capturing articulated hand motion in image sequences. IEEE Trans Pattern Anal Mach Intell 27(12): 1910–1922
Hoshino K, Tamaki E, Tanimoto T (2007) Copycat hand—robot hand imitating human motions at high speed and with high accuracy. Adv Robotics 21(15): 1743–1761
Tamaki E, Hoshino K (2007) 3D estimation of human hand posture with wrist motions, IEICE technical report. Welfare information technology vol 107, 179, pp 59–62 (in Japanese)
Otsu N, Kurita T (1998) A new scheme for practical, flexible and intelligent vision systems. In: Proceedings of the IAPR workshop on computer vision, pp 431–435
Hoshino K, Kawabuchi I (2005) Pinching at finger tips for humanoid robot hand. J Robotics Mechatronics 17(6): 655–663
Hoshino K, Tanimoto T (2006) Realtime hand posture estimation with Self-Organizing Map for stable robot control. In: IEICE transactions on information and systems, E89-D, vol 6, pp 1813–1819
Hoshino Lab. http://www.kz.tsukuba.ac.jp/~hoshino/
About this article
Cite this article
Hoshino, K., Tomida, M. Quick and accurate estimation of human 3D hand posture. Intel Serv Robotics 3, 11 (2010). https://doi.org/10.1007/s11370-009-0052-9
- Hand posture estimation
- 2D-appearance-based approach
- 3D changes in the appearance of hands
- Proportional information on the hand images
- Imitative motions