High Performance Computational Hydrodynamic Simulations: UPC Parallel Architecture as a Future Alternative

  • Alvin Wei Ze Chew
  • Tung Thanh Vu
  • Adrian Wing-Keung Law
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10860)


Developments in high performance computing (HPC) has today transformed the manner of how computational hydrodynamic (CHD) simulations are performed. Till now, the message passing interface (MPI) remains the common parallelism architecture and has been adopted widely in CHD simulations. However, its bottleneck problem remains for some large-scale simulation cases due to delays during message passing whereby the total communication time may exceed the total simulation runtime with an increasing number of computer processers. In this study, we utilise an alternative parallelism architecture, known as PGAS-UPC, to develop our own UPC-CHD model with a 2-step explicit scheme from the Lax-Wendroff family of predictors-correctors. The model is evaluated on three incompressible, adiabatic viscous 2D flow cases having moderate flow velocities. Model validation is achieved by the reasonably good agreement between the predicted and respective analytical values. We then compare the computational performance between UPC-CHD and that of MPI in its base design in a SGI UV-2000 server till 100 processers maximum in this study. The former achieves a near 1:1 speedup which demonstrates its efficiency potential for very large-scale CHD simulations, while the later experiences slowdown at some point. Extension of UPC-CHD remains our main objective which can be achieved by the following additions: (a) inclusions of other numerical schemes to accommodate for other types of fluid simulations, and (b) coupling UPC-CHD with Amazon Web Service (AWS) to further exploit its parallelism efficiency as a viable alternative.


Parallel computing Viscous incompressible laminar flow MPI UPC Computational hydrodynamic (CHD) simulations 



This research study is funded by the internal core funding from the Nanyang Environment and Water Research Institute (NEWRI), Nanyang Technological University (NTU), Singapore. The first author is grateful to NTU for the 4-year Nanyang President Graduate Scholarship (NPGS) for his PhD study.


  1. Anderson, J.D.: Governing equations of fluid dynamics. In: Wendt, J.F. (ed.) Computational Fluid Dynamics, pp. 15–51. Springer, Heidelberg (2009). Scholar
  2. Balaji, P., Buntinas, D., Goodell, D., Gropp, W., Kumar, S., Lusk, E., Thakur, R., Träff, J.L.: MPI on a million processors. In: Ropo, M., Westerholm, J., Dongarra, J. (eds.) EuroPVM/MPI 2009. LNCS, vol. 5759, pp. 20–30. Springer, Heidelberg (2009). Scholar
  3. Bucs, S.S., Radu, A.I., Lavric, V., Vrouwenvelder, J.S., Picioreanu, C.: Effect of different commercial feed spacers on biofouling of reverse osmosis membrane systems: a numerical study. Desalination 343, 26–37 (2014)CrossRefGoogle Scholar
  4. Chang, C.-W., Liu, P.L.F., Mei, C.C., Maza, M.: Modeling transient long waves propagating through a heterogeneous coastal forest of arbitrary shape. Coast. Eng. 122(Supplement C), 124–140 (2017)CrossRefGoogle Scholar
  5. Chen, W.Y., Bonachea, D., Duell, J., Husbands, P., Iancu, C., Yelick, K.: A Performance Analysis of the Berkeley UPC Compiler. Lawrence Berkeley National Laboratory (2003).
  6. Dalwadi, M.P., Griffiths, I.M., Bruna, M.: Understanding how porosity gradients can make a better filter using homogenization theory. Proc. R. Soc. A: Math. Phys. Eng. Sci. 471(2182), 20150464 (2015)MathSciNetCrossRefGoogle Scholar
  7. Dalwadi, M., Bruna, M., Griffiths, I.: A multiscale method to calculate filter blockage. J. Fluid Mech. 809, 264–289 (2016)MathSciNetCrossRefGoogle Scholar
  8. Gourdain, N., Gicquel, L., Montagnac, M., Vermorel, O., Gazaix, M., Staffelbach, G.: High performance parallel computing of flows in complex geometries: I. methods. Comput. Sci. Discov. 2(1), 015003 (2009)CrossRefGoogle Scholar
  9. Jajcevic, D., Siegmann, E., Radeke, C., Khinast, J.G.: Large-scale CFD–DEM simulations of fluidized granular systems. Chem. Eng. Sci. 98, 298–310 (2013)CrossRefGoogle Scholar
  10. Jamshed, S.: Chapter 3 - The way the HPC works in CFD. In: Using HPC for Computational Fluid Dynamics, pp. 41–79. Academic Press, Oxford (2015)CrossRefGoogle Scholar
  11. Johnson, A.A.: Using unified parallel C to enable new types of CFD applications on the cray X1/E. In: Cray User Group Conference (2006)Google Scholar
  12. Kermani, M., Plett, E.: Roe scheme in generalized coordinates. I – Formulations. In: 39th Aerospace Sciences Meeting and Exhibit. American Institute of Aeronautics and Astronautics (2001a)Google Scholar
  13. Kermani, M., Plett, E.: Roe scheme in generalized coordinates. II - Application to inviscid and viscous flows. In: 39th Aerospace Sciences Meeting and Exhibit. American Institute of Aeronautics and Astronautics (2001b)Google Scholar
  14. Munson, B.R., Young, D.F., Okiishi, T.H.: Fundamentals of Fluid Mechanics. 6th Ed., pp. 263–331. Wiley, Hoboken (2006). (Chapter 6)Google Scholar
  15. Simmendinger, C., Jägersküpper, J., Machado, R., Lojewski, C.: A PGAS-based implementation for the unstructured CFD solver TAU. Partitioned Global Address Space Programming Models, Galveston Island (2011)Google Scholar
  16. Sousa, P., Soares, A., Monteiro, E., Rouboa, A.: A CFD study of the hydrodynamics in a desalination membrane filled with spacers. Desalination 349, 22–30 (2014)CrossRefGoogle Scholar
  17. White, F.M.: Viscous Fluid Flow. 2nd Ed, pp. 457–528. McGraw-Hill (1991). (Chapter 7)Google Scholar

Copyright information

© Springer International Publishing AG, part of Springer Nature 2018

Authors and Affiliations

  1. 1.School of Civil and Environmental EngineeringNanyang Technological UniversitySingaporeSingapore
  2. 2.Environmental Process Modelling Centre (EPMC), Nanyang Environment and Water Research Institute (NEWRI)SingaporeSingapore

Personalised recommendations