Skip to main content
SpringerLink
Log in

Rainfall Estimation from Traffic Cameras

  • Conference paper
  • First Online:
Database and Expert Systems Applications (DEXA 2019)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 11706))

Included in the following conference series:

Abstract

We propose and evaluate a method for the estimation of rainfall from images from a network of traffic cameras and rain gauges. The method trains a neural network for each camera under the supervision of the rain gauges and interpolates the results to estimate rainfall at any location. We study and evaluate variants of the method that exploit feature extraction and various interpolation methods. We empirically and comparatively demonstrate the superiority of a hybrid approach and of the inverse distance weighting interpolation for an existing comprehensive network of publicly accessible weather stations and traffic cameras.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    For this work, we neither consider the temporal sequences of measurements nor the sequence of images.

  2. 2.

    https://data.gov.sg/dataset/realtime-weather-readings?resource_id=8bd37e06-cdd7-4ca4-9ad8-5754eb70a33d.

References

  1. Abadi, M., et al.: Tensorflow: a system for large-scale machine learning. In: 12th \(\{\)USENIX\(\}\) Symposium on Operating Systems Design and Implementation, \(\{\)OSDI\(\}\) 2016, pp. 265–283 (2016)

    Google Scholar 

  2. Ahrens, B.: Distance in spatial interpolation of daily rain gauge data. Hydrol. Earth Syst. Sci. Discuss. 2(5), 1893–1922 (2005)

    Article  MathSciNet  Google Scholar 

  3. Akbari Asanjan, A., Yang, T., Hsu, K., Sorooshian, S., Lin, J., Peng, Q.: Short-term precipitation forecast based on the PERSIANN system and LSTM recurrent neural networks. J. Geophys. Res. Atmos. 123(22), 12–543 (2018)

    Article  Google Scholar 

  4. Allamano, P., Croci, A., Laio, F.: Toward the camera rain gauge. Water Resour. Res. 51(3), 1744–1757 (2015)

    Article  Google Scholar 

  5. Aswin, S., Geetha, P., Vinayakumar, R.: Deep learning models for the prediction of rainfall. In: 2018 International Conference on Communication and Signal Processing (ICCSP), pp. 0657–0661. IEEE (2018)

    Google Scholar 

  6. Bargaoui, Z.K., Chebbi, A.: Comparison of two kriging interpolation methods applied to spatiotemporal rainfall. J. Hydrol. 365(1–2), 56–73 (2009)

    Article  Google Scholar 

  7. Basistha, A., Arya, D., Goel, N.: Spatial distribution of rainfall in indian himalayas-a case study of Uttarakhand region. Water Res. Manag. 22(10), 1325–1346 (2008)

    Article  Google Scholar 

  8. Cerqueira, R.F., Mantripragada, K.: Estimating rainfall precipitation amounts by applying computer vision in cameras, uS Patent App. 14/748,125, 26 May 2016

    Google Scholar 

  9. Chen, F.W., Liu, C.W.: Estimation of the spatial rainfall distribution using inverse distance weighting (IDW) in the middle of Taiwan. Paddy Water Environ, 10(3), 209–222 (2012)

    Article  Google Scholar 

  10. Chen, Y.C., Wei, C., Yeh, H.C.: Rainfall network design using kriging and entropy. Hydrol. Process. Int. J. 22(3), 340–346 (2008)

    Article  Google Scholar 

  11. Chollet, F., et al.: Keras (2015). https://keras.io

  12. Cramer, S., Kampouridis, M., Freitas, A.A., Alexandridis, A.K.: An extensive evaluation of seven machine learning methods for rainfall prediction in weather derivatives. Expert Syst. Appl. 85, 169–181 (2017)

    Article  Google Scholar 

  13. Garg, K., Nayar, S.K.: Vision and rain. Int. J. Comput. Vis. 75(1), 3–27 (2007)

    Article  Google Scholar 

  14. Haidar, A., Verma, B.: Monthly rainfall forecasting using one-dimensional deep convolutional neural network. IEEE Access 6, 69053–69063 (2018)

    Article  Google Scholar 

  15. Hardwinarto, S., Aipassa, M., et al.: Rainfall monthly prediction based on artificial neural network: a case study in Tenggarong station, East Kalimantan-indonesia. Proc. Comput. Sci. 59, 142–151 (2015)

    Article  Google Scholar 

  16. Hernández, E., Sanchez-Anguix, V., Julian, V., Palanca, J., Duque, N.: Rainfall prediction: a deep learning approach. In: Martínez-Álvarez, F., Troncoso, A., Quintián, H., Corchado, E. (eds.) HAIS 2016. LNCS (LNAI), vol. 9648, pp. 151–162. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-32034-2_13

    Chapter  Google Scholar 

  17. Jiang, T.X., Huang, T.Z., Zhao, X.L., Deng, L.J., Wang, Y.: Fastderain: a novel video rain streak removal method using directional gradient priors. IEEE Transact. Image Process. 28(4), 2089–2102 (2019)

    Article  MathSciNet  Google Scholar 

  18. Kang, L.W., Lin, C.W., Fu, Y.H.: Automatic single-image-based rain streaks removal via image decomposition. IEEE Transact. Image Process. 21(4), 1742–1755 (2012)

    Article  MathSciNet  Google Scholar 

  19. Karney, C.F.: Algorithms for geodesics. J. Geodesy 87(1), 43–55 (2013)

    Article  Google Scholar 

  20. Kashiwao, T., Nakayama, K., Ando, S., Ikeda, K., Lee, M., Bahadori, A.: A neural network-based local rainfall prediction system using meteorological data on the internet: a case study using data from the Japan meteorological agency. Appl. Soft Comput. 56, 317–330 (2017)

    Article  Google Scholar 

  21. Kim, S., Hong, S., Joh, M., Song, S.k.: Deeprain: ConvLSTM network for precipitation prediction using multichannel radar data. arXiv preprint arXiv:1711.02316 (2017)

  22. Kim, S., Kim, H.: A new metric of absolute percentage error for intermittent demand forecasts. Int. J. Forecast. 32(3), 669–679 (2016)

    Article  Google Scholar 

  23. Kingma, D.P., Ba, J.: Adam: a method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014)

  24. Krizhevsky, A., Sutskever, I., Hinton, G.E.: ImageNet classification with deep convolutional neural networks. In: Advances in neural information processing systems, pp. 1097–1105 (2012)

    Google Scholar 

  25. Kurihata, H., et al.: Rainy weather recognition from in-vehicle camera images for driver assistance. In: IEEE Proceedings of Intelligent Vehicles Symposium, 2005, pp. 205–210. IEEE (2005)

    Google Scholar 

  26. Kusiak, A., Wei, X., Verma, A.P., Roz, E.: Modeling and prediction of rainfall using radar reflectivity data: a data-mining approach. IEEE Transact. Geosci. Remote Sens. 51(4), 2337–2342 (2013)

    Article  Google Scholar 

  27. LeCun, Y., Bengio, Y., Hinton, G.: Deep learning. Nature 521(7553), 436 (2015)

    Article  Google Scholar 

  28. Lee, I.J.: Big data processing framework of learning weather information and road traffic collision using distributed CEP from CCTV video: cognitive image processing. In: 2017 IEEE 16th International Conference on Cognitive Informatics and Cognitive Computing (ICCI* CC), pp. 400–406. IEEE (2017)

    Google Scholar 

  29. Lee, J., Hong, B., Shin, Y., Jang, Y.J.: Extraction of weather information on road using CCTV video. In: 2016 International Conference on Big Data and Smart Computing (BigComp), pp. 529–531. IEEE (2016)

    Google Scholar 

  30. Liu, J., Yang, W., Yang, S., Guo, Z.: D3r-Net: dynamic routing residue recurrent network for video rain removal. IEEE Transact. Image Process. 28(2), 699–712 (2019)

    Article  MathSciNet  Google Scholar 

  31. Loucks, D.P., van Beek, E.: Water resources planning and management: an overview. In: Water Resource Systems Planning and Management, pp. 1–49. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-44234-1_1

    Chapter  Google Scholar 

  32. Mair, A., Fares, A.: Comparison of rainfall interpolation methods in a mountainous region of a tropical island. J. Hydrol. Eng. 16(4), 371–383 (2010)

    Article  Google Scholar 

  33. Meyer, H., Kühnlein, M., Appelhans, T., Nauss, T.: Comparison of four machine learning algorithms for their applicability in satellite-based optical rainfall retrievals. Atmos. Res. 169, 424–433 (2016)

    Article  Google Scholar 

  34. Mu, P., Chen, J., Liu, R., Fan, X., Luo, Z.: Learning bilevel layer priors for single image rain streaks removal. IEEE Sig. Process. Lett. 26(2), 307–311 (2019)

    Article  Google Scholar 

  35. Ramana, R.V., Krishna, B., Kumar, S., Pandey, N.: Monthly rainfall prediction using wavelet neural network analysis. Water Resour. Manage 27(10), 3697–3711 (2013)

    Article  Google Scholar 

  36. Rani, B.K., Govardhan, A.: Rainfall prediction using data mining techniques-a survey. Comput. Sci. Inform. Technol. 3, 23–30 (2013)

    Google Scholar 

  37. Roser, M., Moosmann, F.: Classification of weather situations on single color images. In: 2008 IEEE Intelligent Vehicles Symposium, pp. 798–803. IEEE (2008)

    Google Scholar 

  38. Shepard, D.: A two-dimensional interpolation function for irregularly-spaced data. In: Proceedings of the 1968 23rd ACM national conference, pp. 517–524. ACM (1968)

    Google Scholar 

  39. Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 (2014)

  40. Sirirattanapol, C., Nagai, M., Witayangkurn, A., Pravinvongvuth, S., Ekpanyapong, M.: Bangkok CCTV image through a road environment extraction system using multi-label convolutional neural network classification. ISPRS Int. J. Geo-Inf. 8(3), 128 (2019)

    Article  Google Scholar 

  41. Srivastava, N., Hinton, G., Krizhevsky, A., Sutskever, I., Salakhutdinov, R.: Dropout: a simple way to prevent neural networks from overfitting. J. Mach. Learn. Res. 15(1), 1929–1958 (2014)

    MathSciNet  MATH  Google Scholar 

  42. Stein, M.L.: Interpolation of Spatial Data: Some Theory for Kriging. Springer, Heidelberg (2012). https://doi.org/10.1007/978-1-4612-1494-6

    Book  Google Scholar 

  43. Stocker, T.F., et al.: Climate change 2013: The physical science basis (2013)

    Google Scholar 

  44. Toledo-Moreo, R., et al.: Positioning and digital maps. In: Intelligent Vehicles, pp. 141–174. Elsevier (2018)

    Google Scholar 

  45. Tripathi, A.K., Mukhopadhyay, S.: Removal of rain from videos: a review. Sig. Image Video Process. 8(8), 1421–1430 (2014)

    Article  Google Scholar 

  46. Wu, J., Long, J., Liu, M.: Evolving RBF neural networks for rainfall prediction using hybrid particle swarm optimization and genetic algorithm. Neurocomputing 148, 136–142 (2015)

    Article  Google Scholar 

  47. Xingjian, S., Chen, Z., Wang, H., Yeung, D.Y., Wong, W.K., Woo, W.c.: Convolutional LSTM network: a machine learning approach for precipitation nowcasting. In: Advances in neural information processing systems, pp. 802–810 (2015)

    Google Scholar 

  48. Yang, W., Tan, R.T., Feng, J., Liu, J., Yan, S., Guo, Z.: Joint rain detection and removal from a single image with contextualized deep networks. In: IEEE Transactions on Pattern Analysis and Machine Intelligence (2019)

    Google Scholar 

  49. Zhang, H., Patel, V.M.: Density-aware single image de-raining using a multi-stream dense network. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 695–704 (2018)

    Google Scholar 

Download references

Acknowledgment

This work is supported by the National University of Singapore Institute for Data Science project WATCHA: WATer CHallenges Analytics and by Singapore Ministry of Education project Janus.

Author information

Authors and Affiliations

  1. National University of Singapore, Singapore, Singapore

    Remmy Zen, Ruixi Zhang & Stéphane Bressan

  2. Universitas Udayana, Bali, Indonesia

    Dewa Made Sri Arsa & Ngurah Agus Sanjaya ER

Authors
  1. Remmy Zen
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Dewa Made Sri Arsa
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ruixi Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Ngurah Agus Sanjaya ER
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Stéphane Bressan
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Remmy Zen .

Editor information

Editors and Affiliations

  1. Clausthal University of Technology, Clausthal-Zellerfeld, Germany

    Sven Hartmann

  2. Johannes Kepler University of Linz, Linz, Austria

    Josef Küng

  3. The University of Texas at Arlington, Arlington, TX, USA

    Sharma Chakravarthy

  4. Johannes Kepler University of Linz, Linz, Austria

    Gabriele Anderst-Kotsis

  5. Software Competence Center Hagenberg, Hagenberg im Mühlkreis, Austria

    A Min Tjoa

  6. Johannes Kepler University of Linz, Linz, Austria

    Ismail Khalil

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Zen, R., Arsa, D.M.S., Zhang, R., ER, N.A.S., Bressan, S. (2019). Rainfall Estimation from Traffic Cameras. In: Hartmann, S., Küng, J., Chakravarthy, S., Anderst-Kotsis, G., Tjoa, A., Khalil, I. (eds) Database and Expert Systems Applications. DEXA 2019. Lecture Notes in Computer Science(), vol 11706. Springer, Cham. https://doi.org/10.1007/978-3-030-27615-7_2

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-27615-7_2

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-27614-0

  • Online ISBN: 978-3-030-27615-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation