Abstract
This paper proposes a method for estimating the 3D pose of a person using multiple asynchronous cameras. In the proposed method, a 2D pose of a person is estimated from each captured image using OpenPose. To solve the asynchrony problem, we virtually generate the synchronous pose data by interpolating the temporally neighboring poses that are from actually captured images. Then, the 3D pose is reconstructed by triangulation from the virtually synchronized 2D poses from multiple cameras. In the experiment, the effectiveness of the proposed method was confirmed by capturing a moving person using eight cameras. We also investigated the effect of frame rate changes on pose estimation accuracy.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Cao, Z., Hidalgo, G., Simon, T., Wei, S.-E., Sheikh, Y.: OpenPose: realtime multi-person 2D pose estimation using part affinity fields. arXiv:1812.08008 (2018)
Cao, Z., Simon, T., Wei, S., Sheikh, Y.: Realtime multi-Person 2D pose estimation using part affinity fields. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 7291–7299 (2017)
Simon, T., Joo, H., Matthews, I., Sheikh, Y.: Hand Keypoint Detection in Single Images using Multiview Bootstrapping. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, vol. 2 (2017)
Wei, S., Ramakrishna, V., Kanade, T., Sheikh, Y.: Convolutional pose machines,” arXiv preprint arXiv:1602.00134 (2016)
Nakazawa, M., Mitsugami, I., Habe, H., Yamazoe, H., Yagi, Y.: Calibration of multiple Kinects with little overlap regions. Proc. IEEJ Trans. Electri. Electron. Eng. 10(S1), S108–S115 (2015)
Murakami, J., Morimoto, T., Mitsugami, I.: Gaze and body capture system under VR experiences. In: Proceedings of the ACM Symposium on Virtual Reality Software and Technology, vol. 91 (2018)
Shotten, J., Fitzgibbon, A., Cook, M., Sharp, T., Finocchio, M., Moore, R., Kipman, A., Blake, A.: Real-time human pose recognition in parts from single depth images. In: Proceedings of the IEEE Computer Vision and Pattern Recognition (2011)
Girshick, R., Shotton, J., Kohli, P., Criminisi, A., Fitzgibbon, A.: Efficient regression of general-activity human poses from depth images. In: Proceedings of the IEEE International Conference on Computer Vision (2011)
Martinez, J., Hossain, R., Romero, J., Little, J.: A simple yet effective baseline for 3d human pose estimation. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 2640–2649 (2017)
Li, S., Zhang, W., Chan, A.B.: Maximum-margin structured learning with deep networks for 3d human pose estimation. In: Proceeding of IEEE International Conference on Computer Vision, pp. 2848–2856 (2015)
Nie, B.X., Wei, P., Zhu, S.C.: Monocular 3d human pose estimation by predicting depth on joints. In: Proceeding of IEEE International Conference on Computer Vision (2017)
Hossain, M.R.I., Little, J.J.: Exploiting temporal information for 3d human pose estimation. In: Proceedings of the European Conference on Computer Vision, pp. 68–84 (2018)
Wandt, B., Rosenhahn, B.: RepNet: Weakly supervised training of an adversarial reprojection network for 3D human pose estimation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 7782–7791 (2019)
Habibie, I., Xu, W., Mehta, D., Pons-Moll, G., Theobalt, C.: In the wild human pose estimation using explicit 2D features and intermediate 3D representations. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 10905–10914 (2019)
Chen, C., Tyagi, A., Agrawal, A., Drover, D., MV, R., Stojanov, S., Rehg, J.M.: Unsupervised 3D pose estimation with geometric self-supervision. In: Proceeding of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 5714–5724 (2019)
Rhodin, H., Sprri, J., Katircioglu, I., Constantin, V., Meyer, F., Muller, E., Salzmann, M., Fua, P.: Learning monocular 3D human pose estimation from multi-view images. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 8437–8446 (2018)
Chen, X., Lin, K., Liu, W., Qian, C., Wang, X., Lin, L.: Weakly-supervised discovery of geometry-aware representation for 3D human pose estimation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 10895–10904 (2019)
Kocabas, M., Karagoz, S., Akbas, E.: Self-supervised learning of 3d human pose using multi-view geometry. arXiv preprint arXiv:1903.02330 (2019)
Zhang, Z.: A flexible new technique for camera calibration. Proc. IEEE Trans. Pattern Anal. Mach. Intell. 22(11), 1330–1334 (2000)
Acknowledgements
This work was supported by JSPS KAKENHI Grant Number JP18H03312.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this chapter
Cite this chapter
Morimoto, T., Mitsugami, I. (2021). 3D Pose Estimation Using Multiple Asynchronous Cameras. In: Ahad, M.A.R., Inoue, S., Roggen, D., Fujinami, K. (eds) Activity and Behavior Computing. Smart Innovation, Systems and Technologies, vol 204. Springer, Singapore. https://doi.org/10.1007/978-981-15-8944-7_3
Download citation
DOI: https://doi.org/10.1007/978-981-15-8944-7_3
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-15-8943-0
Online ISBN: 978-981-15-8944-7
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)