Solving Rendering Issues in Realistic 3D Immersion for Visual Rehabilitation

  • Tristan Carrier-Baudouin
  • Claude Chapdelaine
  • Marc Lalonde
  • Philippe Quinn
  • Samuel FoucherEmail author
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9914)


When a person becomes visually impaired, intensive rehabilitation is required to learn the skills necessary to accurately interpret the sensory cues. 3D virtual immersion (3D VI) can provide a safe and rich world for rehabilitation by rendering a complex environment. 3D VI can stage challenges that can be faced with less stress than the real outdoor world. In order for 3D VI to be used efficiently, the visual rendering for people with low vision and the audio for both the blind and people with low vision must be as realistic as possible. Building a 3D environment at low cost imposes constraints both on the installation and the technical aspects. This paper describes our current work to solve projections issues for a realistic rendering when images are not aligned and deformed.


Visual rehabilitation aid 3D immersion Multi-projector calibration 



We thank the O&M specialists of INLB for their feedback. Our gratitude to Dr. Tony Leroux (audiologist), Pr. Agathe Ratelle (O&M specialist trainer) and Dany Vaillancourt for their creative and helpful skills. This work is supported by CRIM, ISED (Innovation, Science and Economic Development Canada), and le MESI (Ministère de l’Économie, de la Science et de l’Innovation du Québec).


  1. 1.
    Merabet, L., Sánchez, J.: Audio-based navigation using virtual environments: combining technology and neuroscience. AER J. Res. Pract. Vis. Impairment Blindness 2(3), 128–137 (2009)Google Scholar
  2. 2.
    Sánchez, J., Saenz, M., Garrido, J.M.: Usability of a multimodal video game to improve the navigational skills for blind children. ACM Trans. Accessible Comput. 3(2), 7 (2010)CrossRefGoogle Scholar
  3. 3.
    LaGrow, S.J.: Improving perception for orientation and mobility. In: Wiener, W.R., Welsh, R.L., Blasch, B.B. (eds.) Foundations of Orientation and Mobility, vol. 2, 3rd edn, pp. 3–26. AFB Press, New York (2010)Google Scholar
  4. 4.
    Couturier, J., Ratelle, A.: Manuel d’Intervention en Orientation et Mobilité. Université de Montréal and INLB, Québec, Canada. Course Notes (2012)Google Scholar
  5. 5.
    Garcia-Dorado, I., Cooperstock, J.R.: Fully automatic multi-projector calibration with an uncalibrated camera. In: Proceedings of the Computer Vision and Pattern Recognition Workshops, Colorado Springs, pp. 29–36. IEEE, June 2011Google Scholar
  6. 6.
    Baar, J.V., Willwacher, T., Rao, S., Raskar, R.: Seamless multi-projector display on curved screens. In: Proceedings of the Workshop on Virtual Environments, Zurich, pp. 281–286. ACM (2003)Google Scholar
  7. 7.
    Brown, M., Majumder, A., Yang, R.: Camera-based calibration techniques for seamless multiprojector displays. IEEE Trans. Visual Comput. Graphics 11(2), 193–206 (2005)CrossRefGoogle Scholar
  8. 8.
    Stillwell, J.: Mathematics and its History. Springer, New York (2010)CrossRefzbMATHGoogle Scholar
  9. 9.
    May, B.B., Cahill, N.D., Rosen, M.R.: Calibration of a multi-projector system for display on a cylindrical surface. In: Proceedings of the Image Processing Workshop, Rochester, New York, pp. 6–9. IEEE (2010)Google Scholar
  10. 10.
    Sajadi, B., Majumder, A.: Auto-calibration of multi-projector cave-like immersive environments. IEEE Trans. Visual Comput. Graphics 18(3), 381–393 (2011)CrossRefGoogle Scholar
  11. 11.
    Bradski, G.: The opencv library. Dr. Dobb’s Journal of Software Tools (2000)Google Scholar
  12. 12.
    Olszta, P.W., Umbach, A., Baker, S., Fay, J.: The freeglut library (version 3.0.0). (2015).

Copyright information

© Springer International Publishing Switzerland 2016

Authors and Affiliations

  • Tristan Carrier-Baudouin
    • 1
  • Claude Chapdelaine
    • 1
  • Marc Lalonde
    • 1
  • Philippe Quinn
    • 1
  • Samuel Foucher
    • 1
    Email author
  1. 1.Computer Research Institute of Montréal (CRIM)MontréalCanada

Personalised recommendations