Machine Vision and Applications

, Volume 20, Issue 2, pp 85–92

Augmented reality on cloth with realistic illumination

Original Paper

DOI: 10.1007/s00138-007-0108-9

Cite this article as:
Bradley, D., Roth, G. & Bose, P. Machine Vision and Applications (2009) 20: 85. doi:10.1007/s00138-007-0108-9


Augmented reality (AR) is the concept of inserting virtual objects into real scenes. Often, augmentations are aligned with rigid planar objects in the scene. However, a more difficult task is to align non-rigid augmentations with flexible objects like cloth. To address this problem, we present a method to perform real-time flexible augmentations on cloth. Our method involves sparse cloth-tracking in video images using a new vision-based marker system with temporal coherence. We include an image-based method to automatically acquire real world illumination and shadows from the input frame. Non-rigid augmentations are achieved by rendering a textured 2D mesh aligned with the cloth surface, and combining the illumination result. The ability to perform realistic augmentations on cloth leads to applications in fashion, advertising, home decor and entertainment. We demonstrate our cloth augmentations with an application to interactively design T-shirts by demonstrating different virtual logos on a physical shirt in real-time.


Augmented reality Non-rigid object tracking Common illumination Marker systems 

Copyright information

© Springer-Verlag 2007

Authors and Affiliations

  1. 1.Department of Computer ScienceCarleton UniversityOttawaCanada
  2. 2.University of British ColumbiaVancouverCanada
  3. 3.Institute for Information TechnologyNational Research Council of CanadaOttawaCanada

Personalised recommendations