International Journal of Computer Vision

, Volume 48, Issue 3, pp 233–254 | Cite as

Vision and the Atmosphere

  • Srinivasa G. Narasimhan
  • Shree K. Nayar
Article

Abstract

Current vision systems are designed to perform in clear weather. Needless to say, in any outdoor application, there is no escape from “bad” weather. Ultimately, computer vision systems must include mechanisms that enable them to function (even if somewhat less reliably) in the presence of haze, fog, rain, hail and snow.

We begin by studying the visual manifestations of different weather conditions. For this, we draw on what is already known about atmospheric optics, and identify effects caused by bad weather that can be turned to our advantage. Since the atmosphere modulates the information carried from a scene point to the observer, it can be viewed as a mechanism of visual information coding. We exploit two fundamental scattering models and develop methods for recovering pertinent scene properties, such as three-dimensional structure, from one or two images taken under poor weather conditions.

Next, we model the chromatic effects of the atmospheric scattering and verify it for fog and haze. Based on this chromatic model we derive several geometric constraints on scene color changes caused by varying atmospheric conditions. Finally, using these constraints we develop algorithms for computing fog or haze color, depth segmentation, extracting three-dimensional structure, and recovering “clear day” scene colors, from two or more images taken under different but unknown weather conditions.

physics based vision atmosphere bad weather fog haze visibility scattering attenuation airlight overcast sky scene structure defog dehaze 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Acharya, P.K., Berk, A., Anderson, G.P., Larsen, N.F., Tsay, S.C., and Stamnes, K.H. 1999.Modtran4: MultiplescatteringandBRDF upgrades to modtran. In SPIE Proc. Optical Spectroscopic Techniques and Instrumentation for Atmospheric and Space Research III, p. 3756.Google Scholar
  2. Allard, E. 1876. Memoire sur l'intensite. et la portee des phares. Dunod: Paris.Google Scholar
  3. Bouguer, P. 1729. Traite. d'optique sur la gradation de la lumiere. Chandrasekhar, S. 1960. Radiative Transfer. Dover Publications: New York.Google Scholar
  4. Chu, T.S. and Hogg, D.C. 1968. Effects of precipitation on propagation at 0.63, 3.5 and 10.6 microns. The Bell System Technical Journal.Google Scholar
  5. Cozman, F. and Krotkov, E. 1997. Depth from scattering. In Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition, vol. 31, pp. 801–806.Google Scholar
  6. Gordon, J. and Church, P. 1966. Overcast sky luminances and directional luminous reflectances of objects and backgrounds under overcast skies. Applied Optics, 5:919.Google Scholar
  7. Hardy, A.C. 1967. How large is a point source? Journal of Optical Society of America, 57(1).Google Scholar
  8. Henderson, S.T. 1977. Daylight and its Spectrum. Wiley: New York.Google Scholar
  9. Hidy, G.M. 1972. Aerosols and Atmospheric Chemistry. Academic Press: New York.Google Scholar
  10. Horn, B.K.P. 1986. Robot Vision. The MIT Press: Cambridge, MA.Google Scholar
  11. IRIA. 1978. The Infrared Handbook. Infrared Information and Analysis Center, Environmental Research Institute of Michigan.Google Scholar
  12. Koenderink, J.J. and Richards, W.A. 1992. Why is snow so bright? Journal of Optical Society of America, 9(5):643–648.Google Scholar
  13. Kopeika, N.S. 1998. A System Engineering Approach to Imaging. SPIE Press.Google Scholar
  14. Koschmieder, H. 1924. Theorie der horizontalen sichtweite. Beitr. Phys. Freien Atm., 12:33–53, 171-181.Google Scholar
  15. Langer, M.S. and Zucker, S.W. 1994. Shape from shading on a cloudy day. JOSA-A, 11(2):467–478.Google Scholar
  16. Mason, B.J. 1975. Clouds, Rain, and Rainmaking. Cambridge University Press: Cambridge.Google Scholar
  17. McCartney, E.J. 1975. Optics of the Atmosphere: Scattering by Molecules and Particles. John Wiley and Sons: New York.Google Scholar
  18. Middleton, W.E.K. 1949. The effect of the angular aperture of a telephotometer on the telephotometry of collimated and non-collimated beams. Journal of Optical Society of America, 39:576–581.Google Scholar
  19. Middleton, W.E.K. 1952. Vision Through the Atmosphere. University of Toronto Press.Google Scholar
  20. Mie, G. 1908. A contribution to the optics of turbid media, especially colloidal metallic suspensions. Ann. of Physics, 25(4):377-445.Google Scholar
  21. Minnaert, M. 1954. The Nature of Light and Color in the Open Air. Dover: New York.Google Scholar
  22. Moon, P. and Spencer, D.E. 1942. Illumination from a non-uniform sky. Illum Eng., 37:707–726.Google Scholar
  23. Myers, J.N. 1968. Fog. Scientific American, pp. 75–82.Google Scholar
  24. Narasimhan, S.G. and Nayar, S.K. 2000. Chromatic framework for vision in bad weather. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.Google Scholar
  25. Narasimhan, S.G. and Nayar, S.K. 2001. Vision and the weather. In Proceedings of SPIE Conference on Human Vision and Electronic Imaging VI, p. 4299.Google Scholar
  26. Nayar, S.K. and Narasimhan, S.G. 1999. Vision in bad weather. In Proceedings of the 7th International Conference on Computer Vision.Google Scholar
  27. Nieto-Vesperinas, M. and Dainty, J.C. 1990. Scattering in Volumes and Surfaces. North-Holland: New York.Google Scholar
  28. Oakley, J.P. and Satherley, B.L. 1998. Improving image quality in poor visibility conditions using a physical model for degradation. IEEE Trans. on Image Processing,7.Google Scholar
  29. Ohtake, T. 1970. Factors affecting the size distribution of rain-drops and snowflakes. Journal of Atmospheric Science, 27:804-813.Google Scholar
  30. Porch, W.M. 1975. Visibility of distant mountains as a measure of background aerosol pollution. Applied Optics, 14.Google Scholar
  31. Rensch, D.B. and Long, R.K. 1970. Comparative studies of extinction and backscattering by aerosols, fog, and rain at 10.6 and 0.63 microns. Applied Optics, 9(7).Google Scholar
  32. Shafer, S. 1985. Using color to separate reflection components. Color Research and Applications, pp. 210–218.Google Scholar
  33. Van De Hulst. 1957. Light Scattering by Small Particles. John Wiley and Sons: New York.Google Scholar
  34. Yitzhaky, Y., Dror, I., and Kopeika, N.S. 1998. Restoration of altmospherically blurred images according to weather-predicted atmospheric modulation transfer function. Optical Engineering, 36.Google Scholar

Copyright information

© Kluwer Academic Publishers 2002

Authors and Affiliations

  • Srinivasa G. Narasimhan
    • 1
  • Shree K. Nayar
    • 1
  1. 1.Computer Science DepartmentColumbia UniversityNew YorkUSA

Personalised recommendations