Advertisement

International Journal of Computer Vision

, Volume 75, Issue 1, pp 3–27 | Cite as

Vision and Rain

  • Kshitiz GargEmail author
  • Shree K. Nayar
Article

Abstract

The visual effects of rain are complex. Rain produces sharp intensity changes in images and videos that can severely impair the performance of outdoor vision systems. In this paper, we provide a comprehensive analysis of the visual effects of rain and the various factors that affect it. Based on this analysis, we develop efficient algorithms for handling rain in computer vision as well as for photorealistic rendering of rain in computer graphics. We first develop a photometric model that describes the intensities produced by individual rain streaks and a dynamic model that captures the spatio-temporal properties of rain. Together, these models describe the complete visual appearance of rain. Using these models, we develop a simple and effective post-processing algorithm for detection and removal of rain from videos. We show that our algorithm can distinguish rain from complex motion of scene objects and other time-varying textures. We then extend our analysis by studying how various factors such as camera parameters, rain properties and scene brightness affect the appearance of rain. We show that the unique physical properties of rain—its small size, high velocity and spatial distribution—makes its visibility depend strongly on camera parameters. This dependence is used to reduce the visibility of rain during image acquisition by judiciously selecting camera parameters. Conversely, camera parameters can also be chosen to enhance the visibility of rain. This ability can be used to develop an inexpensive and portable camera-based rain gauge that provides instantaneous rain-rate measurements. Finally, we develop a rain streak appearance model that accounts for the rapid shape distortions (i.e. oscillations) that a raindrop undergoes as it falls. We show that modeling these distortions allows us to faithfully render the complex intensity patterns that are visible in the case of raindrops that are close to the camera.

Keywords

physics-based vision outdoor vision and weather atmospheric scattering appearance modeling natural phenomena video analysis video enhancement 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Andsager, K., Beard, K.V., and Laird, N.F. 1999. Laboratory measurements of axis ratios for large raindrops. Journal of the Atmospheric Sciences, 56:2673–2683.CrossRefGoogle Scholar
  2. Beard, K.V. and Chuang, C.H. 1987. A new model for the equilibrium shape of raindrops. Journal of Atmospheric Science, 44(11):1509–1524.CrossRefGoogle Scholar
  3. Birchfield, S. 2005. KLT: An Implementation of the Kanade-Lucas-Tomasi Feature Tracker.Google Scholar
  4. Borovoy, A.G., Kabanov M.V., and Saveliev, B.A. 1975. Intensity fluctuations of optical radiation in scattering media. Applied Optics, 14(11):2731–2739.Google Scholar
  5. Bradley, S.G., Stow C.D., and Lynch-Blosse, C.A. 2000. Measurements of rainfall properties using long optical path imaging. American Meteorological Society, 17:761–772.Google Scholar
  6. Choi, E. 1995. Numerical modelling of gust effect on wind-driven rain. In 9th International Conference on Wind Engineering, vol. 9, no. 13, pp. 214–215.Google Scholar
  7. Chu, T.S. and Hogg, D.C. 1996. Effects of precipitation on propagation at 0.63, 3.5 and 10.6 microns. Bell System Technical Journal.Google Scholar
  8. Cozman, F. and Krotkov, E. 1997. Depth from scattering. CVPR, 31:801–806.Google Scholar
  9. Deepak, A. and Box, M.A. 1978. Forward scattering corrections for optical extinction measurements in aerosol media. 2: Poly-Dispersions. Applied Optics, 17:3169–3176.Google Scholar
  10. Dorsey, J., Pedersen, H., and Hanrahan, P. 1996. Flow and changes in appearance. In Proceedings of Siggraph, vo. 79, no. 30.Google Scholar
  11. Flori, J.P. 1990. Mouillage et Schage D”une Facade Verticale: Analyse Experimentale. Technical Report EN-CLI 90.2 L, Centre Scientifique et Technique du B,timen, 1990.Google Scholar
  12. Garg, K. and Nayar, S.K. 2006. Photorealistic rendering of rain streaks. ACM Trans. on Graphics (also Proc. of ACM SIGGRAPH), 25:996–1002.CrossRefGoogle Scholar
  13. Gunn, R. and Kinzer, G.D. 1949. Terminal velocity for water droplet in stagnant air. Journal of Meterology, 6:243–248.Google Scholar
  14. Habib, E., Krajewski, W.F., and Kruger, A. 2001. Sampling errors of tipping-bucket rain gauge measurements. Journal of Hydrology Engeering, 6:159.CrossRefGoogle Scholar
  15. Horn, B.K.P. 1986. Robot Vision. The MIT Press.Google Scholar
  16. Kubesh, R.J. and Beard, K.V. 1993. Laboratory measurements of spontaneous oscillations of moderate size raindrops. Journal of the Atmospheric Sciences, 50:1089–1098.CrossRefGoogle Scholar
  17. Langer, M.S., Zhang, L., Klein, A.W., Bhatia, A., Pereira, J., and Rekhi, D. 2004. A spectral-particle hybrid method for rendering falling snow. In Rendering Techniques, pp. 217–226.Google Scholar
  18. Loffler-Mang, M. and Joss, J. 2000. An optical disdrometer for measuring size and velocity of hydrometeors. Journal of Atmospheric and Oceanic Technology, 17:130–139.CrossRefGoogle Scholar
  19. Lomas, A. 2005. The Matrix Revolutions. Personal Communication.Google Scholar
  20. Lucas, B.D. and Kanade, T. 1981. An iterative image registration technique with an application to stereo vision. In International Joint Conference on Artificial Intelligence.Google Scholar
  21. Manning, R.M. 1993. Stochastic Electromagnetic Image Propogation. McGraw-Hill, Inc.Google Scholar
  22. Marshall, J.S. and Palmer, W.M.K. 1948. The distribution of raindrops with sizes. Journal of Meterology, 5:165–166.Google Scholar
  23. McCartney, E.J. 1975. Optics of the Atmosphere: Scattering by molecules and particles. John Wiley and Sons.Google Scholar
  24. Middleton, W.E.K. 1952. Vision Through the Atmosphere. University of Toronto Press.Google Scholar
  25. Mulvin, L., and Lewis, J. 1994. Architectural detailing, weathering and stone decay. Building and Environment, 29(1):113–138.CrossRefGoogle Scholar
  26. Narasimhan, S.G. and Nayar, S.K. 2002. Vision and the Atmosphere. IJCV, 48(3):233–254.zbMATHCrossRefGoogle Scholar
  27. Narasimhan, S.G. and Nayar, S.K. 2003. Contrast restoration of weather degraded images. IEEE Trans. on PAMI, 25(6).Google Scholar
  28. Oakley, J.P. and Satherley, B.L. 1998. Improving image quality in poor visibility conditions using a physical model for degradation. IEEE Trans. on Image Processing, 7.Google Scholar
  29. Website: Submitted rain videos. http://www.cs.columbia.edu/CAVE/ project. 2006.
  30. Michael Reed. 2005. Blue sky studios. Personal Communication.Google Scholar
  31. Schechner, Y.Y., Narasimhan, S.G., and Nayar, S.K. 2001. Instant dehazing of images using polarization. CVPR.Google Scholar
  32. Schonhuber, M., Urban, H.E., Baptista, J.P., Randeu, W.L., and Riedl, W. 1994. Measurements of precipitation characteristics of new disdrometer. In Proceedings of Atmospheric Physics and Dynamics in the Analysis and Prognosis of Precipitation Fields.Google Scholar
  33. Starik, K. and Werman, M. 2003. Simulation of rain in videos. Texture Workshop, ICCV.Google Scholar
  34. Tan, K. and Oakley, J.P. 2000. Enhancement of color images in poor visibility conditions. ICIP, 2.Google Scholar
  35. Tokay, A. and Beard, K.V. 1996. A field study of raindrop oscillations. part I. Journal of Applied Meteorology, 35.Google Scholar
  36. Wang, N. and Wade, B. 2004. Rendering falling rain and snow. SIGGRAPH (sketches 0186).Google Scholar
  37. Wang, T. and Clifford, S.F. 1975. Use of rainfall-induced optical scintillations to measure path-averaged rain parameters. Journal of the Optical Society of America, 8:927–937.CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC 2007

Authors and Affiliations

  1. 1.Department of Computer ScienceColumbia UniversityNew YorkUSA

Personalised recommendations