High Level File System and Parallel I/O Optimization of DNS Code

  • Bipin KumarEmail author
  • Nachiket Manapragada
  • Neethi Suresh
Conference paper
Part of the Communications in Computer and Information Science book series (CCIS, volume 964)


The representation of clouds and convection has an enormous impact on simulation of the climate system. Clouds play key role in behavior of weather elements. They have a huge impact on earth radiation budget system, water and energy cycle and hence controlling the climate. There are lot of biases in current atmospheric general circulation models because of inadequate understanding of micro-physical processes and the hydrodynamics in clouds. For improving the models, small scale simulation such as Direct Numerical Simulation (DNS) is required which solves equations without any assumptions. DNS is very complex and requires huge amount of computational resources. These simulations are memory intensive as well as consuming large space for I/O. Writing huge files at run-time is a challenging task and requires optimization in parallel I/O. This study presents different types of optimization for Lustre file system and advanced vector extension 2. The optimization has improved the code by reducing total simulation time significantly.


DNS Parallel I/O optimization Striping NUMA optimization IOBUF optimization 



The HPC facilities at IITM Pune is fully funded by Ministry of Earth Science, Government of India.


  1. 1.
    Götzfried, P., Kumar, B., Shaw, R.A., Schumacher, J.: Droplet dynamics and fine-scale structure in a shearless turbulent mixing layer with phase changes. J. Fluid Mech. 814, 452–483 (2017)MathSciNetCrossRefGoogle Scholar
  2. 2.
    Heimsund, B., Espedal, S.M.: A parallel Eulerian-Lagrangian localised adjoint method. Adv. Water Resour. 23, 950–955 (2005)CrossRefGoogle Scholar
  3. 3.
    Herrman, M.: Parallel Eulerian interface tracking/Lagrangian point particle multi-scale coupling procedure. J. Comput. Phys. 229, 745–759 (2020)CrossRefGoogle Scholar
  4. 4.
    Kumar, B., Bera, S., Parabhakaran, T., Grabowski, W.W.: Cloud edge mixing: direct numerical simulation and observations in Indian monsoon cloud. J. Adv. Model. Earth Syst. 9, 332–353 (2017). Scholar
  5. 5.
    Kumar, B., Schumacher, J., Shaw, R.A.: Cloud microphysical effects of turbulent mixing and entrainment. Theoret. Comput. Fluid Dyn. 27, 361–376 (2013)CrossRefGoogle Scholar
  6. 6.
    Kumar, B., Schumacher, J., Shaw, R.A.: Lagrangian mixing dynamics at the cloudy-clear air interface. J. Atmos. Sci. 71(7), 2564–2580 (2014)CrossRefGoogle Scholar
  7. 7.
    NCAR: NCL (NCAR Command Language). Accessed 12 May 2018
  8. 8.
    Seagate Technology LLC United States: Lustre: the open source parallel file system. Accessed 12 May 2018
  9. 9.
    Stommel, H.: Entrainment of air into a cumulus cloud. J. Meteorol. 4(91), 127–129 (1947)Google Scholar
  10. 10.
    Northwestern University, Argonne National Laboratory: Parallel netCDF: a parallel I-O library for netCDF file access. Accessed 12 May 2018
  11. 11.
    Vaillancourt, P.A., Yau, M.K., Bartello, P., Grabowski, W.W.: Microscopic approach to cloud droplet growth by condensation. Part II: Turbulence, clustering and condensational growth. J. Atmos. Sci. 59, 3421–3435 (2002)CrossRefGoogle Scholar
  12. 12.
    Vaillancourt, P.A., Yau, M.K., Grabowski, W.W.: Microscopic approach to cloud droplet growth by condensation. Part I: Model description and results without turbulence. J. Atmos. Sci. 58, 1945–1964 (2001)CrossRefGoogle Scholar

Copyright information

© Springer Nature Singapore Pte Ltd. 2019

Authors and Affiliations

  1. 1.Indian Institute of Tropical MeteorologyPuneIndia
  2. 2.Cray Supercomputers (India) Pvt Ltd.PuneIndia

Personalised recommendations