IMPROVE: An innovative application for collaborative mobile mixed reality design review

  • Pedro Santos
  • André Stork
  • Thomas Gierlinger
  • Alain Pagani
  • Céline Paloc
  • Iñigo Barandarian
  • Giuseppe Conti
  • Raffaele de Amicis
  • Martin Witzel
  • Oliver Machui
  • José M. Jiménez
  • Bruno Araujo
  • Joaquim Jorge
  • Georg Bodammer
Technical Paper

Abstract

In this paper we introduce an innovative application aiming at combining large, tablet-based and headmounted displays for collaborative mobile mixed reality design reviews. Our research and development is motivated by two use scenarios: automotive and architectural design review involving real users from Page/Park architects and Elasis FIAT. Our activities are supported by the EU IST project IMPROVE. It covers activities in the areas of: HMD development using unique OLED technology, markerless tracking, augmented reality rendering, image calibration for large tiled displays, collaborative tablet-based and projection wall oriented interaction and stereoscopic video streaming for mobile users. The paper gives an overview of the hardware and software developments within IMPROVE and concludes with results from first user test.

Keywords

Mixed reality applications Collaborative Design Review 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Klüger, K., Fröhlich, B., Hoffmann, J., Hochstrate, J.: Implementing multi-viewer time-sequential stereo displays based on shuttered lcd projectors. In: 4th Immersive Projection Technology Workshop, Ames, Iowa (2004)Google Scholar
  2. 2.
    Monno, G., Fiorentino, M., de Amicis, R., Stork, A.: Spacedesign: A mixed reality workspace for aesthetic industrial design. In: Symposium on Augmented and Mixed Reality, Darmstadt, ISMAR (2002)Google Scholar
  3. 3.
    Klinker, G., Dutoit, A.H., Bauer, M., Bayer, J., Novak, V., Matzke, D.: Fata Morgana—a presentation system for product design. In: International Symposium on Augmented and Mixed Reality, Darmstadt, ISMAR (2002)Google Scholar
  4. 4.
    Majumder A. and Stevens R. (2004). Color nonuniformity in projection-based displays: analysis and solutions. IEEE Trans. Vis. Comput. Graph. 10(2): 177–188 CrossRefGoogle Scholar
  5. 5.
    Beardsley, P., Willwacher, T., Rao, S., Raskar, R., van Baar, J., Forlines, C.: Ilamps: geometrically aware and selfconfiguring projectors. In: Proceedings of ACM SIGGRAPH (2003)Google Scholar
  6. 6.
    Majumder, A., Towles, H., Raji, A., Gill, G., Fuchs, H.: Pixelflex2: a comprehensive, automatic, casually-aligned multi-projector display. In: IEEE Workshop on Projector-Camera Systems (PROCAMS) (2003)Google Scholar
  7. 7.
    Majumder, A., Brown, M., Yang, R.: Camera-Based Calibration Techniques for Seamless Multi-Projector Displays, vol. 11 (2005)Google Scholar
  8. 8.
    Stone, M.C.: Color balancing experimental projection displays. In: Color Imaging Conference, pp. 342–347 (2001)Google Scholar
  9. 9.
    Stone and M.C. (2001). Color and brightness appearance issues in tiled displays. IEEE Comput. Graph. Appl. 21(5): 58–66 CrossRefGoogle Scholar
  10. 10.
    Chen, H., Wallace, G., Li, K.: Color gamut matching for tiled display walls. In: EGVE ’03: Proceedings of the Workshop on Virtual Environments, pp. 193–302 (2003)Google Scholar
  11. 11.
    Reiners, D., Kresse, W., Knoepfle, C.: Color consistency for digital multi-projector stereo display systems: the heyewall and the digital cave. In: EGVE’03: Proceedings of the Workshop on Virtual Environments 2003, pp. 271–279. ACM Press, Zurich, Switzerland (2003)Google Scholar
  12. 12.
    McCrory, M., Papka, M.E., Majumder, A., Jones, D., Stevens, R.: Using a camera to capture and correct spatial photometric variation in multi-projector displays.In: IEEE Workshop on Projector-Camera Systems (PROCAMS) (2003)Google Scholar
  13. 13.
    Majumder A. and Stevens R. (2005). Perceptual photometric seamlessness in projection-based tiled displays. ACM Trans. Graph. 24(1): 118–139 CrossRefGoogle Scholar
  14. 14.
    Towles, H., Majumder, A., He, Z., Welch, G.: Achieving color uniformity across multi-projector displays. In : IEEE Computer Society Press (ed.) VIS ’00 Proceedings of the Conference on Visualization ’00, pp. 117–124. Salt Lake City, Utah, United States (2000)Google Scholar
  15. 15.
    Debevec P.E. and Malik J. (1997). Recovering high dynamic range radiance maps from photographs. Comput. Graph. 31: 369–378 Google Scholar
  16. 16.
    Bern, M., Eppstein, D.: Optimized color gamuts for tiled displays. In: SCG ’03: Proceedings of the Nineteenth Annual Symposium on Computational Geometry, pp. 274–281. ACM Press, San Diego, California, USA (2003)Google Scholar
  17. 17.
    Debevec, P.: Rendering synthetic objects into real scenes: bridging traditional and image-based graphics with global illumination and high dynamic range photography. SIGGRAPH 98 (1998)Google Scholar
  18. 18.
    Kautz, J., Sloan, P.-P., Snyder, J.: Precomputed radiance transfer for real-time rendering in dynamic low-frequency lighting environments. SIGGRAPH (2002)Google Scholar
  19. 19.
    Lepetit, V., Fua, P.: Monocular Model-Based 3D Tracking of Rigid Objects: A survey (2005)Google Scholar
  20. 20.
    Poupyrev, I., Ikamoto, I., Kato, H., Billinghurst, M., Tachibana, K.: Virtual object manipulation on tabletop ar environment. In: International Symposium on Augmented Reality, pp. 111–119 (2000)Google Scholar
  21. 21.
    Drummond T. and Cipolla R. (2002). Real-time visual tracking of complex structures. IEEE Trans. Pattern Anal. Mach. Intell. 27: 932–946 CrossRefGoogle Scholar
  22. 22.
    Fitzgibbon, A., Simon, G., Zisserman, A.: Markerless tracking using planar structures in the scene. In: International Symposium on Mixed and Augmented Reality, pp. 120–128 (2000)Google Scholar
  23. 23.
    Zhang Z. (2000). A flexible new technique for camera calibration. IEEE Trans. Pattern Anal. Mach. Intell. 22: 1330–1334 CrossRefGoogle Scholar
  24. 24.
    Stewart, C.V.: Robust parameter estimation. Soc. Ind. Appl. Math. 41(3), 513–537 (1999)Google Scholar
  25. 25.
    Schmalstieg, D.: Designing immersive virtual reality for geometry education. IEEE Virtual Real. Alexandria, VA, USA (2006)Google Scholar
  26. 26.
    Regenbrecht, H., Wagner, M.: Interaction in a collaborative augmented reality enviromnment. In: Proceeding of Chi 2002, pp. 504–505. ACM Press, Minneapolis, Minnesota, USA (2002)Google Scholar
  27. 27.
    Shi, J., Thomasi, C.: Good features to track. In: Conference on Computer Vision and Pattern Recognition (Seattle) (1994)Google Scholar
  28. 28.
    Lowe D. (2001) Distincitve image features from scale-invariant keypoints. Int J Comput Vis. 20(2): 91–110Google Scholar

Copyright information

© Springer Verlag France 2007

Authors and Affiliations

  • Pedro Santos
    • 1
  • André Stork
    • 1
  • Thomas Gierlinger
    • 2
  • Alain Pagani
    • 2
  • Céline Paloc
    • 3
  • Iñigo Barandarian
    • 3
  • Giuseppe Conti
    • 4
  • Raffaele de Amicis
    • 4
  • Martin Witzel
    • 4
  • Oliver Machui
    • 5
  • José M. Jiménez
    • 6
  • Bruno Araujo
    • 7
  • Joaquim Jorge
    • 7
  • Georg Bodammer
    • 8
  1. 1.Fraunhofer-IGD, A2DarmstadtGermany
  2. 2.Tu-DarmstadtDarmstadtGermany
  3. 3.VicomtechSan SebastianSpain
  4. 4.GraphitechTrentoItaly
  5. 5.TrivisioDreieichGermany
  6. 6.STTSan SebastianSpain
  7. 7.INESC-IDLisbonPortugal
  8. 8.MicroemissiveEdinburghUK

Personalised recommendations