Skip to main content
SpringerLink
Log in

The separation of reflected and transparent layers from real-world image sequence

  • Original Paper
  • Published:
Machine Vision and Applications Aims and scope Submit manuscript

Abstract

This paper presents an optimal method for the separation of reflected and transparent layers from real-world scene images. Whereas past research has been applied to indoor environments and static cameras, our technique can be used for outdoor scenes and motion cameras. The method is based on spatio-temporal analysis, especially using epipolar plane images (EPI). The edge and color information of EPI has been used to segment the areas on EPIs efficiently and separate the reflected and transparent layers. This method can be used for refining building textures by removing reflections from captured images for the purpose of city modeling.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Bolles R., Baker H., Marimont D. (1987) Epipolar plane image analysis: an approach to determining structure from motion. Int. J. Comput. Vis. 1, 7–55

    Article  Google Scholar 

  2. Bronstein, A.M., Bronstein, M.M., Zibulevsky, M., Zeevi, Y.Y. Blind separation on reflections using sparse ICA. In: 4th International Symposium of Independent Component Analysis and Blind Signal Separation, pp. 227–232 (2003)

  3. Farid H., Adelson E.H. (1999) Separating reflections from images using independent components analysis. J. Opt. Soc. Am. 16, 2136–2145

    Google Scholar 

  4. Hermanto, Barros, A.K., Yamamura, T., Ohnishi, N. Separating virtual and real objects using independent component analysis. IEICE TRANS E84-D (2001)

  5. Irani M., Peleg S. (1993) Motion analysis for image enhancement: resolution, occlusion, and transparency. J. Vis. Commun. Image Rep. 4(4): 324–335

    Article  Google Scholar 

  6. Kawasaki, H., Miyamoto, A., Ohsawa, Y., Ono, S., Ikeuchi, K. Multiple video camera calibration using epi for city modeling. In: ACCV, vol. 2, pp. 569–574 (2004)

  7. Sarel, B., Irani, M. Separating transparent layers through layer information exchange. In: ECCV, vol. 4, pp. 328–341 (2004)

  8. Schechner Y.Y., Kiryati N., Basri R. (2000) Separation of transparent layers using focus. Int. J. Comput. Vis. 39, 25–39

    Article  Google Scholar 

  9. Schechner, Y.Y., Kiryati, N., Shamir, J. Separation of transparent layers by polarization analysis. In: Scandinavian Conference on Image Analysis, vol. 1, pp. 235–242 (1999)

  10. Schechner Y.Y., Kiryati N., Shamir J. (2000) Blind recovery of transparent and semireflected scenes. Comput. Vis. Pattern Recognit. 1, 38–43

    Google Scholar 

  11. Schechner Y.Y., Shamir J. (1999) Vision through semireflecting media: polarization analysis. Opt. Lett. 24, 1088–1090

    Google Scholar 

  12. Schechner, Y.Y., Shamir, J., Kiryati, N. Polarization-based decorrelation of transparent layers: the inclination angle of an invisible surface. In: ICCV, vol. 2, pp. 814–819 (1999)

  13. Swaminathan, R., Kang, S.B., Szeliski, R. On the motion and appearance of specularities in image sequences. In: ECCV, vol. 1, pp. 508–523 (2002)

  14. Szeliski, R., Avidan, S., Anandan, P. Layer extraction from multiple images containing reflections and transparency. In: CVPR, pp. 1246–1253 (2000)

  15. Toro J., Owens J., Medina R. (2003) Using known motion fields for image separation in transparency. Pattern Recognit. Lett. 24, 594–605

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Saitama University, 255 Shimo-Okubo, Sakura-ku, Saitama, 338-8570, Japan

    Thanda Oo, Hiroshi Kawasaki & Yutaka Ohsawa

  2. The University of Tokyo, 6-4-1 Komaba, Meguro-ku, Tokyo, 153-8505, Japan

    Katsushi Ikeuchi

Authors
  1. Thanda Oo
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Hiroshi Kawasaki
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yutaka Ohsawa
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Katsushi Ikeuchi
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Hiroshi Kawasaki.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Oo, T., Kawasaki, H., Ohsawa, Y. et al. The separation of reflected and transparent layers from real-world image sequence. Machine Vision and Applications 18, 17–24 (2007). https://doi.org/10.1007/s00138-006-0043-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00138-006-0043-1

Keywords

Search

Navigation