Skip to main content

Dynamic Projection Mapping Using Kinect-Based Skeleton Tracking

Part of the Lecture Notes in Electrical Engineering book series (LNEE,volume 536)


This paper presents a novel dynamic projection mapping which tracks a skeleton of a user and projects a sequence of images on the body of the user based on robust camera-project calibration without depending on accurate camera calibration using RGB-D image of the Kinect. As the first step of the proposed method, the camera-projector calibration using RGB-D images of the Kinect is performed without the printed calibration board. In the second step, the planes for the torso and palms are defined in 3D world coordinates based on the 2D skeleton information and RGB-D image. In the last step, the projection screen coordinates for the planes of the torso and palms are computed based on the homography between the camera image and the screen image for the projection with considering depth values of the planes of torso and palms. We proved the accuracy and convenience of the proposed method through the projection mapping experiments on a user in various poses.


  • Dynamic projection mapping
  • Camera-projector calibration
  • Kinect projection mapping

This is a preview of subscription content, access via your institution.

Buying options

USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
USD   169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions


  1. Azuma, R.T.: A survey of augmented reality. Presence Teleoperators Virtual Environ. 6(4), 355–385 (1997)

    CrossRef  Google Scholar 

  2. Bimber, O., Raska, R.: Spatial Augmented Reality: Merging Real and Virtual Worlds. A.K. Peters, Natick (2005)

    CrossRef  Google Scholar 

  3. Narita, G., Watanabe, Y., Ishikawa, M.: Dynamic projection mapping onto deforming non-rigid surface using deformable dot cluster marker. IEEE Trans. Vis. Comput. Graph. 23(3), 1235–1248 (2017)

    CrossRef  Google Scholar 

  4. Lee, J., Kim, Y., Kim, D.: Real-time projection mapping on flexible dynamic objects. In: HCI Korea Conference, pp. 187–190 (2014)

    Google Scholar 

  5. Interactive Body Projection Mapping for Hypermetrop.

  6. Bot&Dolly, Box.

  7. Moreno, D., Taubin, G.: Simple, accurate, and robust projector-camera calibration. In: IEEE International Conference on 3D Imaging, Modeling, Processing, Visualization and Transmission (3DIMPVT), pp. 464–471 (2012)

    Google Scholar 

Download references


This work was supported by Basic Science Research Program through the National Research Foundation of Korea (NRF-2017R1D1A1B03035718) funded by the Ministry of Education. The human images of this paper were used under publishing consent.

Author information

Authors and Affiliations


Corresponding author

Correspondence to Yoo-Joo Choi .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and Permissions

Copyright information

© 2020 Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Kim, SJ., Choi, YJ. (2020). Dynamic Projection Mapping Using Kinect-Based Skeleton Tracking. In: Park, J., Park, DS., Jeong, YS., Pan, Y. (eds) Advances in Computer Science and Ubiquitous Computing. CUTE CSA 2018 2018. Lecture Notes in Electrical Engineering, vol 536. Springer, Singapore.

Download citation

  • DOI:

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-13-9340-2

  • Online ISBN: 978-981-13-9341-9

  • eBook Packages: EngineeringEngineering (R0)