Abstract
Current vision systems are designed to perform in clear weather. Needless to say, in any outdoor application, there is no escape from “bad” weather. Ultimately, computer vision systems must include mechanisms that enable them to function (even if somewhat less reliably) in the presence of haze, fog, rain, hail and snow.
We begin by studying the visual manifestations of different weather conditions. For this, we draw on what is already known about atmospheric optics, and identify effects caused by bad weather that can be turned to our advantage. Since the atmosphere modulates the information carried from a scene point to the observer, it can be viewed as a mechanism of visual information coding. We exploit two fundamental scattering models and develop methods for recovering pertinent scene properties, such as three-dimensional structure, from one or two images taken under poor weather conditions.
Next, we model the chromatic effects of the atmospheric scattering and verify it for fog and haze. Based on this chromatic model we derive several geometric constraints on scene color changes caused by varying atmospheric conditions. Finally, using these constraints we develop algorithms for computing fog or haze color, depth segmentation, extracting three-dimensional structure, and recovering “clear day” scene colors, from two or more images taken under different but unknown weather conditions.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Acharya, P.K., Berk, A., Anderson, G.P., Larsen, N.F., Tsay, S.C., and Stamnes, K.H. 1999.Modtran4: MultiplescatteringandBRDF upgrades to modtran. In SPIE Proc. Optical Spectroscopic Techniques and Instrumentation for Atmospheric and Space Research III, p. 3756.
Allard, E. 1876. Memoire sur l'intensite. et la portee des phares. Dunod: Paris.
Bouguer, P. 1729. Traite. d'optique sur la gradation de la lumiere. Chandrasekhar, S. 1960. Radiative Transfer. Dover Publications: New York.
Chu, T.S. and Hogg, D.C. 1968. Effects of precipitation on propagation at 0.63, 3.5 and 10.6 microns. The Bell System Technical Journal.
Cozman, F. and Krotkov, E. 1997. Depth from scattering. In Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition, vol. 31, pp. 801–806.
Gordon, J. and Church, P. 1966. Overcast sky luminances and directional luminous reflectances of objects and backgrounds under overcast skies. Applied Optics, 5:919.
Hardy, A.C. 1967. How large is a point source? Journal of Optical Society of America, 57(1).
Henderson, S.T. 1977. Daylight and its Spectrum. Wiley: New York.
Hidy, G.M. 1972. Aerosols and Atmospheric Chemistry. Academic Press: New York.
Horn, B.K.P. 1986. Robot Vision. The MIT Press: Cambridge, MA.
IRIA. 1978. The Infrared Handbook. Infrared Information and Analysis Center, Environmental Research Institute of Michigan.
Koenderink, J.J. and Richards, W.A. 1992. Why is snow so bright? Journal of Optical Society of America, 9(5):643–648.
Kopeika, N.S. 1998. A System Engineering Approach to Imaging. SPIE Press.
Koschmieder, H. 1924. Theorie der horizontalen sichtweite. Beitr. Phys. Freien Atm., 12:33–53, 171-181.
Langer, M.S. and Zucker, S.W. 1994. Shape from shading on a cloudy day. JOSA-A, 11(2):467–478.
Mason, B.J. 1975. Clouds, Rain, and Rainmaking. Cambridge University Press: Cambridge.
McCartney, E.J. 1975. Optics of the Atmosphere: Scattering by Molecules and Particles. John Wiley and Sons: New York.
Middleton, W.E.K. 1949. The effect of the angular aperture of a telephotometer on the telephotometry of collimated and non-collimated beams. Journal of Optical Society of America, 39:576–581.
Middleton, W.E.K. 1952. Vision Through the Atmosphere. University of Toronto Press.
Mie, G. 1908. A contribution to the optics of turbid media, especially colloidal metallic suspensions. Ann. of Physics, 25(4):377-445.
Minnaert, M. 1954. The Nature of Light and Color in the Open Air. Dover: New York.
Moon, P. and Spencer, D.E. 1942. Illumination from a non-uniform sky. Illum Eng., 37:707–726.
Myers, J.N. 1968. Fog. Scientific American, pp. 75–82.
Narasimhan, S.G. and Nayar, S.K. 2000. Chromatic framework for vision in bad weather. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.
Narasimhan, S.G. and Nayar, S.K. 2001. Vision and the weather. In Proceedings of SPIE Conference on Human Vision and Electronic Imaging VI, p. 4299.
Nayar, S.K. and Narasimhan, S.G. 1999. Vision in bad weather. In Proceedings of the 7th International Conference on Computer Vision.
Nieto-Vesperinas, M. and Dainty, J.C. 1990. Scattering in Volumes and Surfaces. North-Holland: New York.
Oakley, J.P. and Satherley, B.L. 1998. Improving image quality in poor visibility conditions using a physical model for degradation. IEEE Trans. on Image Processing,7.
Ohtake, T. 1970. Factors affecting the size distribution of rain-drops and snowflakes. Journal of Atmospheric Science, 27:804-813.
Porch, W.M. 1975. Visibility of distant mountains as a measure of background aerosol pollution. Applied Optics, 14.
Rensch, D.B. and Long, R.K. 1970. Comparative studies of extinction and backscattering by aerosols, fog, and rain at 10.6 and 0.63 microns. Applied Optics, 9(7).
Shafer, S. 1985. Using color to separate reflection components. Color Research and Applications, pp. 210–218.
Van De Hulst. 1957. Light Scattering by Small Particles. John Wiley and Sons: New York.
Yitzhaky, Y., Dror, I., and Kopeika, N.S. 1998. Restoration of altmospherically blurred images according to weather-predicted atmospheric modulation transfer function. Optical Engineering, 36.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Narasimhan, S.G., Nayar, S.K. Vision and the Atmosphere. International Journal of Computer Vision 48, 233–254 (2002). https://doi.org/10.1023/A:1016328200723
Issue Date:
DOI: https://doi.org/10.1023/A:1016328200723