TECA: Petascale Pattern Recognition for Climate Science

  • PrabhatEmail author
  • Surendra Byna
  • Venkatram Vishwanath
  • Eli Dart
  • Michael Wehner
  • William D. Collins
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9257)


Climate Change is one of the most pressing challenges facing humanity in the 21st century. Climate simulations provide us with a unique opportunity to examine effects of anthropogenic emissions. High-resolution climate simulations produce “Big Data”: contemporary climate archives are \(\approx 5PB\) in size and we expect future archives to measure on the order of Exa-Bytes. In this work, we present the successful application of TECA (Toolkit for Extreme Climate Analysis) framework, for extracting extreme weather patterns such as Tropical Cyclones, Atmospheric Rivers and Extra-Tropical Cyclones from TB-sized simulation datasets. TECA has been run at full-scale on Cray XE6 and IBM BG/Q systems, and has reduced the runtime for pattern detection tasks from years to hours. TECA has been utilized to evaluate the performance of various computational models in reproducing the statistics of extreme weather events, and for characterizing the change in frequency of storm systems in the future.


Pattern detection Climate science High performance computing Parallel I/O Data mining Petascale 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Clivar hurricane working group.
  2. 2.
  3. 3.
    Coupled model intercomparison project phase 5.
  4. 4.
    Earth system grid federation.
  5. 5.
    Intergovernmental panel on climate change, fifth assessment report.
  6. 6.
    Noaa ncdc ibtracs dataset.
  7. 7.
    Remote sensing systems special sensor microwave imager instrument.
  8. 8.
    Wcrp coupled model intercomparison project phase 6.
  9. 9.
    Byna, S., Prabhat, Wehner, M.F., Wu, K.J.: Detecting atmospheric rivers in large climate datasets. In: Proceedings of the 2nd International Workshop on Petascal Data Analytics: Challenges and Opportunities, PDAC 2011, pp. 7–14. ACM, New York (2011)Google Scholar
  10. 10.
    Dettinger, M.D., Ralph, F.M., Das, T., Neiman, P.J., Cayan, D.R.: Atmospheric rivers, floods and the water resources of california. Water 3(2), 445–478 (2011)CrossRefGoogle Scholar
  11. 11.
    Knutson, T.R., Sirutis, J.J., Garner, S.T., Held, I.M., Tuleya, R.E.: Simulation of the recent multidecadal increase of atlantic hurricane activity using an 18-km-grid regional model. Bulletin of the American Meteorological Society 88(10), 1549–1565 (2007)CrossRefGoogle Scholar
  12. 12.
    Prabhat, Rbel, O., Byna, S., Wu, K., Li, F., Wehner, M., Bethel, W.: Teca: A parallel toolkit for extreme climate analysis. Procedia Computer Science 9, 866–876 (2012); Proceedings of the International Conference on Computational Science (2012)Google Scholar
  13. 13.
    Ralph, F.M., Neiman, P.J., Rotunno, R.: Dropsonde observations in low-level jets over the northeastern pacific ocean from caljet-1998 and pacjet-2001: Mean vertical-profile and atmospheric-river characteristics. Monthly Weather Review 133(4), 889–910 (2005)CrossRefGoogle Scholar
  14. 14.
    Wang, X.L., Feng, Y.: Inter-comparison of extra-tropical cyclone activity in eight reanalysis datasets. EGU General Assembly Research Abstract (2014)Google Scholar
  15. 15.
    Wehner, M.F., Reed, K.A., Li, F., Prabhat, Bacmeister, J., Chen, C.-T., Paciorek, C., Gleckler, P.J., Sperber, K.R., Collins, W.D., Gettelman, A., Jablonowski, C.: The effect of horizontal resolution on simulation quality in the community atmospheric model, cam5. 1. Journal of Advances in Modeling Earth Systems (2014)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  • Prabhat
    • 1
    Email author
  • Surendra Byna
    • 1
  • Venkatram Vishwanath
    • 2
  • Eli Dart
    • 1
  • Michael Wehner
    • 1
  • William D. Collins
    • 1
  1. 1.Lawrence Berkeley National LaboratoryBerkeleyUSA
  2. 2.Argonne National LaboratoryArgonneUSA

Personalised recommendations