Abstract
In order to improve the accuracy of hand pose estimation from a depth image, a method based on convolutional neural network (CNN) is proposed in this paper. First of all, we modify the structure of traditional CNN to recognize the 3D joint locations from a depth image. By appending some shortcuts between layers, the proposed network increases the correlation between the front and back layers. This structure can avoid the information loss caused by the simple layer-by-layer transmission, and can improve the estimation accuracy effectively. Afterwards, the estimated joint locations continue to be inputted into a support vector regression (SVR) phase. The use of SVR can introduce the constraint of local joint information, which can get rid of those abnormal estimations further. Extensive experiments show that our method enables significant performance improvement over the-state-of-arts in the accuracy of hand pose estimation.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Ueda, E., Matsumoto, Y., Imai, M., Ogasawara, T.: A hand-pose estimation for vision-based human interfaces. IEEE Trans. Industr. Electron. 50, 676–684 (2003)
Yin, X., Xie, M.: Estimation of the fundamental matrix from uncalibrated stereo hand images for 3D hand gesture recognition. Pattern Recogn. 36, 567–584 (2003)
Tagliasacchi, A., Schr, M., der Tkach, A., Bouaziz, S., Botsch, M., Pauly, M.: Robust articulated-ICP for real-time hand tracking. In: Proceedings of the Eurographics Symposium on Geometry Processing, pp. 101–114. Eurographics Association (2015)
Taylor, J., et al.: Efficient and precise interactive hand tracking through joint, continuous optimization of pose and correspondences. ACM Trans. Graph. 35, 1–12 (2016)
Li, P., Ling, H., Li, X., Liao, C.: 3D hand pose estimation using randomized decision forest with segmentation index points. In: 2015 IEEE International Conference on Computer Vision (ICCV), pp. 819–827 (2015)
Tang, D., Chang, H.J., Tejani, A., Kim, T.-K.: Latent regression forest: structured estimation of 3D articulated hand posture. In: 2014 IEEE Conference on Computer Vision and Pattern Recognition, pp. 3786–3793. IEEE Computer Society (2014)
Oberweger, M., Wohlhart, P., Lepetit, V.: Training a Feedback loop for hand pose estimation. In: 2015 IEEE International Conference on Computer Vision (ICCV), pp. 3316–3324 (2015)
Oberweger, M., Wohlhart, P., Lepetit, V.: Hands deep in deep learning for hand pose estimation. Computer Science (2015)
Ge, L., Liang, H., Yuan, J., Thalmann, D.: Robust 3D hand pose estimation in single depth images: from single-view CNN to multi-view CNNs. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3593–3601 (2016)
Zhou, X., Wan, Q., Zhang, W., Xue, X., Wei, Y.: Model-based deep hand pose estimation. In: Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence, pp. 2421–2427. AAAI Press (2016)
Madadi, M., Escalera, S., Baro, X., Gonzalez, J.: End-to-end global to local CNN learning for hand pose recovery in depth data. arXiv e-prints, pp. 1–11 (2017)
Yang, H., Zhang, J.: Hand pose regression via a classification-guided approach. In: Lai, S.-H., Lepetit, V., Nishino, K., Sato, Y. (eds.) ACCV 2016. LNCS, vol. 10113, pp. 452–466. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-54187-7_30
Iandola, F.N., Han, S., Moskewicz, M.W., Ashraf, K., Dally, W.J., Keutzer, K.: SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5 MB model size. arXiv e-prints, vol. 1602, pp. 1–13 (2016)
Smola, A.J., Schölkopf, B.: A tutorial on support vector regression. Stat. Comput. 14, 199–222 (2004)
Tompson, J., Stein, M., Lecun, Y., Perlin, K.: Real-time continuous pose recovery of human hands using convolutional networks. ACM Trans. Graph. 33, 169 (2014)
Jia, Y., et al.: Caffe: convolutional architecture for fast feature embedding. In: Proceedings of the ACM International Conference on Multimedia - MM 2014, pp. 675–678. ACM (2014)
Pedregosa, F., et al.: Scikit-learn: machine learning in python. J. Mach. Learn. Res. 12, 2825–2830 (2011)
Acknowledgments
This work is supported by the Liaoning Provincial Natural Science Foundation of China (20170540039).
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Dong, Y., Lu, J., Zhang, Q. (2019). Hand Pose Estimation Using Convolutional Neural Networks and Support Vector Regression. In: El Rhalibi, A., Pan, Z., Jin, H., Ding, D., Navarro-Newball, A., Wang, Y. (eds) E-Learning and Games. Edutainment 2018. Lecture Notes in Computer Science(), vol 11462. Springer, Cham. https://doi.org/10.1007/978-3-030-23712-7_56
Download citation
DOI: https://doi.org/10.1007/978-3-030-23712-7_56
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-23711-0
Online ISBN: 978-3-030-23712-7
eBook Packages: Computer ScienceComputer Science (R0)