Skip to main content
SpringerLink
Log in

Single Camera Stereo System Using Prism and Mirrors

  • Conference paper
Advances in Visual Computing (ISVC 2010)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 6454))

Included in the following conference series:

Abstract

Stereo and 3D reconstruction are used by many applications such as object modeling, facial expression studies and human motion analysis. But synchronizing multiple high frame rate cameras require special hardware or sophisticated software solutions. In this paper, we propose a single camera stereo system by using a setup made of prism and mirrors. Our setup is cost effective, portable and can be calibrated similar to two camera stereo to obtain high quality 3D reconstruction. We demonstrate the application of the proposed system in dynamic 3D face expression capture, depth super-resolution in stereo video and general depth estimation.

This work was made possible by NSF Office of Polar Program grants, ANT0636726 and ARC0612105.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Heseltine, T., Pears, N., Austin, J.: Three-dimensional face recognition using combinations of surface feature map subspace components. Image Vision Comput. 26, 382–396 (2008)

    Article  Google Scholar 

  2. Wang, J., Yin, L., Wei, X., Sun, Y.: 3d facial expression recognition based on primitive surface feature distribution. In: Proc. Conf. Computer Vision and Pattern Recognition, pp. 1399–1406 (2006)

    Google Scholar 

  3. Pellegrini, S., Iocchi, L.: Human posture tracking and classification through stereo vision and 3d model matching. J. Image Video Process. 2008, 1–12 (2008)

    Article  Google Scholar 

  4. Sogo, T., Ishiguro, H., Trivedi, M.M.: Real-time target localization and tracking by n-ocular stereo. In: OMNIVIS 2000: Proceedings of the IEEE Workshop on Omnidirectional Vision, p. 153 (2000)

    Google Scholar 

  5. Somanath, G., Rohith, M.V., Metaxas, D., Kambhamettu, C.: D - clutter: Building object model library from unsupervised segmentation of cluttered scenes. In: IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2009 (2009)

    Google Scholar 

  6. Gluckman, J., Nayar, S.K.: Planar catadioptric stereo: Geometry and calibration. Computer Vision and Pattern Recognition. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 1, p. 1022 (1999)

    Google Scholar 

  7. Gluckman, J., Nayar, S.K.: Catadioptric stereo using planar mirrors. Int. J. Comput. Vision 44, 65–79 (2001)

    Article  MATH  Google Scholar 

  8. Chaen, A., Yamazawa, K., Yokoya, N., Takemura, H.: Omnidirectional stereo vision using hyperomni vision. In: Technical Report 96-122, IEICE (1997) (in Japanese)

    Google Scholar 

  9. Gluckman, J., Nayar, S.K., Thoresz, K.J.: Real-time omnidirectional and panoramic stereo. In: Proceedings of the 1998 DARPA Image Understanding Workshop, pp. 299–303. Morgan Kaufmann, San Francisco (1998)

    Google Scholar 

  10. Nene, S.A., Nayar, S.K.: Stereo with mirrors. In: ICCV 1998: Proceedings of the Sixth International Conference on Computer Vision, Washington, DC, USA, p. 1087. IEEE Computer Society, Los Alamitos (1998)

    Google Scholar 

  11. Mitsumoto, H., Tamura, S., Okazaki, K., Kajimi, N., Fukui, Y.: 3-d reconstruction using mirror images based on a plane symmetry recovering method. IEEE Transactions on Pattern Analysis and Machine Intelligence 14, 941–946 (1992)

    Article  Google Scholar 

  12. Zhang, Z.Y., Tsui, H.T.: 3d reconstruction from a single view of an object and its image in a plane mirror. In: International Conference on Pattern Recognition, vol. 2, p. 1174 (1998)

    Google Scholar 

  13. Kawanishi, T., Yamazawa, K., Iwasa, H., Takemura, H., Yokoya, N.: Generation of high-resolution stereo panoramic images by omnidirectional imaging sensor using hexagonal pyramidal mirrors. International Conference on Pattern Recognition 1, 485 (1998)

    Google Scholar 

  14. Gluckman, J., Nayar, S.K.: Rectified catadioptric stereo sensors. Computer Vision and Pattern Recognition. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 2, p. 2380 (2000)

    Google Scholar 

  15. Gluckman, J., Nayar, S.K.: Rectified catadioptric stereo sensors. IEEE Transactions on Pattern Analysis and Machine Intelligence 24, 224–236 (2002)

    Article  Google Scholar 

  16. Gao, C., Ahuja, N.: Single camera stereo using planar parallel plate. In: 17th International Conference on Pattern Recognition, ICPR 2004, vol. 4, pp. 108–111 (2004)

    Google Scholar 

  17. Nishimoto, Y., Shirai, Y.: A feature-based stereo model using small disparties. In: Proc. Computer Vision and Pattern Recognition, pp. 192–196 (1987)

    Google Scholar 

  18. Lee, D.H., Kweon, I.S., Cipolla, R.: A biprism-stereo camera system. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 1, p. 1082 (1999)

    Google Scholar 

  19. Xiao, Y., Lim, K.B.: A prism-based single-lens stereovision system: From trinocular to multi-ocular. Image Vision Computing 25, 1725–1736 (2007)

    Article  Google Scholar 

  20. Duvieubourg, L., Ambellouis, S., Cabestaing, F.: Single-camera stereovision setup with orientable optical axes. In: International Conference Computer Vision and Graphics (ICCVG), 173–178 (2004)

    Google Scholar 

  21. Lu, T., Chao, T.H.: A single-camera system captures high-resolution 3d images in one shot. SPIE Newsroom (2006), doi: 10.1117/2.1200611.0303

    Google Scholar 

  22. Kuhnert, K.D., Stommel, M.: Fusion of stereo-camera and pmd-camera data for real-time suited precise 3d environment reconstruction. In: IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 4780–4785 (2006)

    Google Scholar 

  23. Yang, Q., Yang, R., Davis, J., Nister, D.: Spatial-depth super resolution for range images. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 1–8 (2007)

    Google Scholar 

  24. Zhu, J., Wang, L., Yang, R., Davis, J.: Fusion of time-of-flight depth and stereo for high accuracy depth maps. In: IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2008, pp. 1–8 (2008)

    Google Scholar 

  25. Schuon, S., Theobalt, C., Davis, J., Thrun, S.: Lidarboost: Depth superresolution for tof 3d shape scanning. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 343–350 (2009)

    Google Scholar 

  26. Zhu, J., Wang, L., Gao, J., Yang, R.: Spatial-temporal fusion for high accuracy depth maps using dynamic mrfs. IEEE Transactions on Pattern Analysis and Machine Intelligence 32, 899–909 (2010)

    Article  Google Scholar 

  27. Sawhney, H.S., Guo, Y., Hanna, K., Kumar, R., Adkins, S., Zhou, S.: Hybrid stereo camera: an ibr approach for synthesis of very high resolution stereoscopic image sequences. In: SIGGRAPH 2001: Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques (2001)

    Google Scholar 

  28. Kopf, J., Cohen, M.F., Lischinski, D., Uyttendaele, M.: Joint bilateral upsampling. In: SIGGRAPH 2007: ACM SIGGRAPH 2007 Papers, p. 96 (2007)

    Google Scholar 

  29. Li, F., Yu, J., Chai, J.: A hybrid camera for motion deblurring and depth map super-resolution. In: IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2008, pp. 1–8 (2008)

    Google Scholar 

  30. Fusiello, A., Irsara, L.: Quasi-euclidean uncalibrated epipolar rectification. In: International Conference on Pattern Recognition, ICPR (2008)

    Google Scholar 

  31. Čech, J., Šára, R.: Efficient sampling of disparity space for fast and accurate matching. In: BenCOS 2007: CVPR Workshop Towards Benchmarking Automated Calibration, Orientation and Surface Reconstruction from Images, IEEE, Los Alamitos (2007)

    Google Scholar 

  32. Towles, H., Chen, W.C., Yang, R., Kum, S.U., Fuchs, H., Kelshikar, N., Mulligan, J., Daniilidis, K., Holden, L., Seleznik, B., Sadagic, A., Lanier, J.: 3d tele-collaboration over internet2. In: International Workshop on Immersive Telepresence, ITP (2002)

    Google Scholar 

  33. Roh, M.C., Shin, H.K., Lee, S.W.: View-independent human action recognition with volume motion template on single stereo camera. Pattern Recognition Letters 31, 639–647 (2010)

    Article  Google Scholar 

  34. Bitelli, G., Girelli, V.A., Remondino, F., Vittuari, L.: The potential of 3d techniques for cultural heritage object documentation. Videometrics IX 6491 (2007)

    Google Scholar 

  35. Strobl, K.H., Sepp, W., Fuchs, S., Paredes, C., Arbter, K.: DLR CalDe and DLR CalLab

    Google Scholar 

  36. Murray, D., Little, J.J.: Using real-time stereo vision for mobile robot navigation. Autonomous Robots 8, 161–171 (2000)

    Article  Google Scholar 

  37. Agarwal, A., Izadi, S., Chandraker, M., Blake, A.: High precision multi-touch sensing on surfaces using overhead cameras. In: International Workshop on Horizontal Interactive Human-Computer Systems, pp. 197–200 (2007)

    Google Scholar 

  38. Shimizu, M., Yoshizuka, T., Miyamoto, H.: A gesture recognition system using stereo vision and arm model fitting. International Congress Series, vol. 1301, pp. 89–92 (2007)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Video/Image Modeling and Synthesis (VIMS) Lab, Department of Computer and Information Sciences, University of Delaware, Newark, DE, USA

    Gowri Somanath, M V Rohith & Chandra Kambhamettu

Authors
  1. Gowri Somanath
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. M V Rohith
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Chandra Kambhamettu
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Department of Computer Science and Engineering, University of Nevada, 89557, Reno, NV, USA

    George Bebis

  2. Moffett Field, NASA Ames Research Center, 94035, CA, USA

    Richard Boyle

  3. Lawrence Berkeley National Laboratory, Berkeley, CA, USA

    Bahram Parvin

  4. Desert Research Institute, Reno, NV, USA

    Darko Koracin

  5. The Chinese University of Hong Kong, Shatin, Hong Kong, China

    Ronald Chung

  6. Dyna Vox Systems, Pittsburgh, PA, USA

    Riad Hammound

  7. King Saud University, Riyadh, Saudi Arabia

    Muhammad Hussain

  8. Hewlett Packard Labs, Paolo Alto, CA, USA

    Tan Kar-Han

  9. The Ohio State University, Columbus, OH, USA

    Roger Crawfis

  10. Virtual Reality Lab, EPFL, Lausanne, Switzerland

    Daniel Thalmann

  11. NASA Ames Research Center, Clifton Park, NY, USA

    David Kao

  12. Kitware, Clifton Park, NY, USA

    Lisa Avila

Rights and permissions

Reprints and permissions

Copyright information

© 2010 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Somanath, G., Rohith, M.V., Kambhamettu, C. (2010). Single Camera Stereo System Using Prism and Mirrors. In: Bebis, G., et al. Advances in Visual Computing. ISVC 2010. Lecture Notes in Computer Science, vol 6454. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-17274-8_17

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-17274-8_17

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-17273-1

  • Online ISBN: 978-3-642-17274-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation