Skip to main content
SpringerLink
Log in

Three-Dimensional Video Contents Exploitation in Depth Camera-Based Hybrid Camera System

  • Chapter
High-Quality Visual Experience

Part of the book series: Signals and Communication Technology ((SCT))

  • 1229 Accesses

Abstract

Video-plus-depth is an image sequence of synchronized color and depth images. As importance of video-plus-depth increases as an essential part of the next-generation multimedia applications, it is crucial to estimate accurate depth information from a real scene and to find a practical framework to use the immersive video in industry. In this chapter, we introduce a hybrid camera system composed of a stereoscopic camera and a time-of-flight depth camera to generate high-quality and high-resolution video-plus-depth. We also handle a hierarchical decomposition method of depth images to render a dynamic 3D scene represented by video-plus-depth rapidly. Finally, we present a method to generate streamable 3D video contents based on video-plus-depth and computer graphic models in the MPEG-4 multimedia framework. The MPEG-4-based 3D video contents can support a variety of user-friendly interactions, such as free viewpoint changing and free composition with computer graphic images.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 179.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 229.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Fehn, C.: A 3D-TV System Based on Video Plus Depth Information. In: Proc. Asilomar Conference on Signals, Systems and Computers, Pacific Grove, CA, USA (2003)

    Google Scholar 

  2. Kauff, P., Atzpadin, N., Fehn, C., Müller, M., Schreer, O., Smolic, A., Tanger, R.: Depth Map Creation and Image-based Rendering for Advanced 3DTV Services Providing Interoperability and Scalability. Signal Processing: Image Communication 22(2), 217–234 (2007)

    Article  Google Scholar 

  3. Scharstein, D., Szeliski, R.: A Taxonomy and Evaluation of Dense Two-frame Stereo Correspondence Algorithms. International Journal of Computer Vision 47(1-3), 7–42 (2002)

    Article  MATH  Google Scholar 

  4. Zitnick, C., Kang, S., Uyttendaele, M., Winder, S., Szeliski, R.: High-quality Video View Interpolation Using a Layered Representation. ACM Trans. on Graphics 23(3), 600–608 (2004)

    Article  Google Scholar 

  5. Kim, S.M., Cha, J., Ryu, J., Lee, K.H.: Depth Video Enhancement of Haptic Interaction Using a Smooth Surface Reconstruction. IEICE Trans. on Information and System E89-D(1), 37–44 (2006)

    Article  Google Scholar 

  6. Waschbüsch, M., Würmlin, S., Cotting, D., Gross, M.: Point-sampled 3D Video of Real-world Scenes. Signal Processing: Image Communication 22(2), 203–216 (2007)

    Article  Google Scholar 

  7. Iddan, G.J., Yahav, G.: 3D Imaging in the Studio and Elsewhere. In: Proc. SPUE Videometrics and Optical Methods for 3D Shape Measurements, San Jose, CA, USA (2001)

    Google Scholar 

  8. Kawakita, M., Kurita, T., Kikuchi, H., Inoue, S.: HDTV Axi-vision Camera. In: Proc. International Broadcasting Conference, Amsterdam, Netherlands (2002)

    Google Scholar 

  9. Redert, A., Beeck, M., Fehn, C., IJsselsteijn, W., Pollefeys, M., Gool, L., Ofek, E., Sexton, I., Surman, P.: ATTEST – Advanced Three-Dimensional Television System Technologies. In: Proc. International Symposium on 3D Data Processing Visualization and Transmission, Padova, Italy (2002)

    Google Scholar 

  10. Cha, J., Kim, S.M., Kim, S.Y., Kim, S., Oakley, I., Ryu, J., Lee, K.H., Woo, W., Ho, Y.S.: Client System for Realistic Broadcasting: a First Prototype. In: Ho, Y.-S., Kim, H.-J. (eds.) PCM 2005. LNCS, vol. 3768, pp. 176–186. Springer, Heidelberg (2005)

    Chapter  Google Scholar 

  11. Ho, Y.S., Kim, S.Y., Lee, E.K.: Three-dimensional Video Generation for Realistic Broadcasting Services. In: Proc. International Technical Conference on Circuits, Systems, Computers and Communications, Shimonoseki, Japan (2008)

    Google Scholar 

  12. Kim, S.Y., Lee, E.K., Ho, Y.S.: Generation of ROI Enhanced Depth Maps Using Stereoscopic Cameras and a Depth Camera. IEEE Trans. on Broadcasting 54(4), 732–740 (2008)

    Article  Google Scholar 

  13. Kim, S.Y., Ho, Y.S.: Hierarchical Decomposition of Depth Map Sequences for Representation of Three-dimensional Dynamic Scenes. IEICE Trans. on Information and Systems E90-D(11), 1813–1820 (2007)

    Article  Google Scholar 

  14. Cho, J.H., Kim, S.Y., Ho, Y.S., Lee, K.H.: Dynamic 3D Human Actor Generation Method Using a Time-of-flight Depth Camera. IEEE Trans. on Consumer Electronics 54(4), 1514–1521 (2008)

    Article  Google Scholar 

  15. Cho, J.H., Chang, I.Y., Kim, S.M., Lee, K.H.: Depth Image Processing Technique for Representing Human Actors in 3DTV Using Single Depth Camera. In: Proc. IEEE 3DTV Conference, pp. 1–4 (2007)

    Google Scholar 

  16. Zhu, J., Wang, L., Yang, R., Davis, J.: Fusion of Time-of-flight Depth and Stereo for High Accuracy Depth Maps. In: Proc. IEEE Conference on Computer Vision and Pattern Recognition, Anchorage, Alaska, USA (2008)

    Google Scholar 

  17. Yoon, S.U., Ho, Y.S.: Multiple Color and Depth Video Coding Using a Hierarchical Representation. IEEE Trans. on Circuits and Systems for Video Technology 17(11), 1450–1460 (2007)

    Article  Google Scholar 

  18. Felzenszwalb, P.F., Huttenlocher, D.P.: Efficient Belief Propagation for Early Vision. International Journal of Computer Vision 70(1), 41–54 (2006)

    Article  Google Scholar 

  19. Farin, D., Peerlings, R., With, P.: Depth-image Representation Employing Meshes for Intermediate-view Rendering and Coding. In: Proc. IEEE 3DTV conference, Kos Island, Greece (2007)

    Google Scholar 

  20. Pereira, F.: MPEG-4: Why, What, How and When. Signal Processing: Image Communication 15(4), 271–279 (2000)

    Article  Google Scholar 

  21. Levkovich-Maslyuk, L., Ignatenko, A., Zhirkov, A., Konushin, A., Park, I., Han, M., Bayakovski, Y.: Depth Image-Based Representation and Compression for Static and Animated 3-D Objects. IEEE Trans. on Circuits and Systems for Video Technology 14(7), 1032–1045 (2004)

    Article  Google Scholar 

  22. Kolmogorov, V., Zabih, R.: Computing Visual Correspondence with Occlusions Using Graph Cuts. In: Proc. International Conference on Computer Vision, Vancouver, Canada (2001)

    Google Scholar 

  23. Bobick, A.F., Intille, S.S.: Large Occlusion Stereo. International Journal of Computer Vision 33(3), 181–200 (1999)

    Article  Google Scholar 

  24. LMS-Z390i, http://www.riegl.com/

  25. Wiegand, T., Lightstone, M., Mukherjee, D., Campbell, T.G., Mitra, S.K.: Rate-distortion Optimized Mode Selection for Very Low Bit Rate Video Coding and the Emerging H.263 Standard. IEEE Trans. on Circuit and System for Video Technology 6(9), 182–190 (1996)

    Article  Google Scholar 

  26. Darwin Streaming Server, http://developer.apple.com/

  27. Cha, J., Kim, S.Y., Ho, Y.S., Ryu, J.: 3D Video Player System with Haptic Interaction Based on Depth Image-Based Representation. IEEE Trans. on Consumer Electronics 52(2), 477–484 (2006)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. The University of Tennessee, Knoxville, Tennessee, USA, 37996

    Sung-Yeol Kim, Andreas Koschan & Mongi A. Abidi

  2. Gwangju Institute of Science and Technology, Gwangju, 500-712, Republic of Korea

    Yo-Sung Ho

Authors
  1. Sung-Yeol Kim
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Andreas Koschan
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Mongi A. Abidi
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Yo-Sung Ho
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. University of Surrey, Guildford, UK

    Marta Mrak

  2. University of Zagreb, Zagreb, Croatia

    Mislav Grgic

  3. Swiss Federal Institute of Technology, Lausanne, Switzerland

    Murat Kunt

Rights and permissions

Reprints and permissions

Copyright information

© 2010 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Kim, SY., Koschan, A., Abidi, M.A., Ho, YS. (2010). Three-Dimensional Video Contents Exploitation in Depth Camera-Based Hybrid Camera System. In: Mrak, M., Grgic, M., Kunt, M. (eds) High-Quality Visual Experience. Signals and Communication Technology. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-12802-8_15

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-12802-8_15

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-12801-1

  • Online ISBN: 978-3-642-12802-8

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation