This paper presents a novel dynamic projection mapping which tracks a skeleton of a user and projects a sequence of images on the body of the user based on robust camera-project calibration without depending on accurate camera calibration using RGB-D image of the Kinect. As the first step of the proposed method, the camera-projector calibration using RGB-D images of the Kinect is performed without the printed calibration board. In the second step, the planes for the torso and palms are defined in 3D world coordinates based on the 2D skeleton information and RGB-D image. In the last step, the projection screen coordinates for the planes of the torso and palms are computed based on the homography between the camera image and the screen image for the projection with considering depth values of the planes of torso and palms. We proved the accuracy and convenience of the proposed method through the projection mapping experiments on a user in various poses.
- Dynamic projection mapping
- Camera-projector calibration
- Kinect projection mapping
This is a preview of subscription content, access via your institution.
Tax calculation will be finalised at checkout
Purchases are for personal use onlyLearn about institutional subscriptions
Azuma, R.T.: A survey of augmented reality. Presence Teleoperators Virtual Environ. 6(4), 355–385 (1997)
Bimber, O., Raska, R.: Spatial Augmented Reality: Merging Real and Virtual Worlds. A.K. Peters, Natick (2005)
Narita, G., Watanabe, Y., Ishikawa, M.: Dynamic projection mapping onto deforming non-rigid surface using deformable dot cluster marker. IEEE Trans. Vis. Comput. Graph. 23(3), 1235–1248 (2017)
Lee, J., Kim, Y., Kim, D.: Real-time projection mapping on flexible dynamic objects. In: HCI Korea Conference, pp. 187–190 (2014)
Interactive Body Projection Mapping for Hypermetrop. https://vimeo.com/34609484
Bot&Dolly, Box. http://bit.ly/19SZdTl
Moreno, D., Taubin, G.: Simple, accurate, and robust projector-camera calibration. In: IEEE International Conference on 3D Imaging, Modeling, Processing, Visualization and Transmission (3DIMPVT), pp. 464–471 (2012)
This work was supported by Basic Science Research Program through the National Research Foundation of Korea (NRF-2017R1D1A1B03035718) funded by the Ministry of Education. The human images of this paper were used under publishing consent.
Editors and Affiliations
© 2020 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Kim, SJ., Choi, YJ. (2020). Dynamic Projection Mapping Using Kinect-Based Skeleton Tracking. In: Park, J., Park, DS., Jeong, YS., Pan, Y. (eds) Advances in Computer Science and Ubiquitous Computing. CUTE CSA 2018 2018. Lecture Notes in Electrical Engineering, vol 536. Springer, Singapore. https://doi.org/10.1007/978-981-13-9341-9_11
Publisher Name: Springer, Singapore
Print ISBN: 978-981-13-9340-2
Online ISBN: 978-981-13-9341-9