Advertisement

Multimedia Tools and Applications

, Volume 59, Issue 1, pp 129–148 | Cite as

A low-cost projector-based hand-held flexible display system

  • Zhaorong Li
  • Kin-Hong Wong
  • Yibo Gong
  • Michael Ming-Yuen Chang
Article
  • 219 Downloads

Abstract

In this paper, we propose a low-cost hand-held flexible display system which uses a projector to project display content onto an ordinary white paper that can be twisted freely. The ultimate goal is to develop an interactive viewing tool for displaying content on flexible surface that can be deformed by the user, i.e., when the user twists the paper, the display content on the paper deforms simultaneously. This system has a lot of potential in the entertainment and education industries. A pair of cameras is employed to track the pattern printed on the back of paper. The cameras and the projector are calibrated off-line via a simple and convenient method. A real-time algorithm is proposed to recover the 3D surface of the paper. The display content is then pre-warped according to the recovered surface and projected onto the front of the paper. Two demonstrative applications are elaborated to illustrate the potential of the proposed system. Our system is easy to set up and runs in real-time. Experimental results show that the flexible display is created with satisfactory accuracy and robustness.

Keywords

Flexible display Interactive display system Multi-view reconstruction 3D non-rigid surface tracking 

Supplementary material

Supplementary video

(AVI 13.8 mb)

References

  1. 1.
    Bouguet JY. Pyramidal implementation of the lucas kanade feature trackerGoogle Scholar
  2. 2.
    Bregler C, Hertzmann A, Biermann H (200) Recovering non-rigid 3d shape from image streams. In Proceedings of intl. Conf. on Computer Vision and Pattern RecognitionGoogle Scholar
  3. 3.
    Cassinelli A, Ishikawa M (2009) Volume slicing display. In ACM SIGGRAPH ASIA 2009 Art Gallery & Emerging Technologies: Adaptation (Yokohama, Japan, December 16–19, 2009). SIGGRAPH ASIA '09. ACM, New York, NY, 88–88Google Scholar
  4. 4.
    Ilic S, Fua P (2006) Implicit meshes for surface reconstruction. IEEE Trans Pattern Anal Mach Intell 28(2):328–333CrossRefGoogle Scholar
  5. 5.
  6. 6.
    Konieczny J, Shimizu C, Meyer G, Colucci D (2005) A hand-held flexible display system. IEEE Visualization Conference, pp 591–597Google Scholar
  7. 7.
    Lee JC, Hudson SE, Tse E (2008) Foldable interactive displays. In Proceedings of the 21st annual ACM symposium on User Interface Software and Technology, pp 287–290Google Scholar
  8. 8.
    Leung MC, Lee KK, Wong KH, Chang MY (2009) A projector based movable hand-held display system. in Proceedings of intl. Conf. on Computer Vision and Pattern RecognitionGoogle Scholar
  9. 9.
    Levmar. “levmar: levenberg-marquardt non-linear least squares algorithms in c/c++”, http://www.ics.forth.gr/lourakis/levmar/
  10. 10.
    Raskar R. Jeroen van B (2005) Low-cost multi-projector curved screen displays. In International Symposium Society for Information Display (SID)Google Scholar
  11. 11.
    Raskar R, Welch G, Low KL, Bandyopadhyay D (2001) Shader lamps: Animating real objects with image-based illumination. In Proceedings of the 12th Eurographics Workshop on Rendering techniques, pp 89–102Google Scholar
  12. 12.
    Salzmann M, Hartley R, Fua P (2007) Convex optimization for deformable surface 3d tracking. in Proceedings of Intl. Conf. on Computer VisionGoogle Scholar
  13. 13.
    Salzmann M, Pilet J, Ilic S, Fua P (2007) Suface deformation models for non-rigid 3d shape recovery. IEEE Trans Pattern Anal Mach Intell 29(8):1481–1487CrossRefGoogle Scholar
  14. 14.
    Sukthankar R, Stockton RG, Mullin MD (2001) Smarter presentations: Exploiting homography in camera-projector systems. In Proceedings of Intl. Conf. on Computer VisionGoogle Scholar
  15. 15.
    Summet J, Sukthankar R (2005) Tracking locations of moving hand-held displays using projected light. In Proceedings of Pervasive, pp 37–46Google Scholar
  16. 16.
    Xiao J, Baker S, Matthews I, Kanade T (2004) Real-time combined 2d + 3d active appearance models. In Proceedings of intl. Conf. on Computer Vision and Pattern RecognitionGoogle Scholar
  17. 17.
    Zhang Z (2000) A flexible new technique for camera calibration. IEEE Trans Pattern Anal Mach Intell 22(11):1330–1334CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC 2011

Authors and Affiliations

  • Zhaorong Li
    • 1
  • Kin-Hong Wong
    • 1
  • Yibo Gong
    • 1
  • Michael Ming-Yuen Chang
    • 2
  1. 1.Department of Computer Science and EngineeringThe Chinese University of Hong KongHong Kong SARPeople’s Republic of China
  2. 2.Department of Information EngineeringThe Chinese University of Hong KongHong Kong SARPeople’s Republic of China

Personalised recommendations