Skip to main content
SpringerLink
Log in

Strong scaling of numerical solver for supersonic jet flow configurations

  • Technical Paper
  • Published:
Journal of the Brazilian Society of Mechanical Sciences and Engineering Aims and scope Submit manuscript

Abstract

Acoustics loads are rocket design constraints which push researches and engineers to invest efforts in the aeroacoustics phenomena which is present on launch vehicles. Therefore, an in-house computational fluid dynamics tool is developed in order to reproduce high-fidelity results of supersonic jet flows for aeroacoustic analogy applications. The solver is written using the large eddy simulation formulation that is discretized using a finite-difference approach and an explicit time integration. Numerical simulations of supersonic jet flows are very expensive and demand efficient high-performance computing. Therefore, non-blocking message passage interface protocols and parallel input/output features are implemented into the code in order to perform simulations which demand up to one billion degrees of freedom. The present work evaluates the parallel efficiency of the solver when running on a supercomputer with a maximum theoretical peak of 127.4 TFLOPS. Speedup curves are generated using nine different workloads. Moreover, the validation results of a realistic flow condition are also presented in the current work.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

References

  1. Altair (2019) PBS worksTM, https://www.pbsworks.com/

  2. Amdahl GM (1967) Validity of the single processor approach to achieving large scale computing capabilities. In: AFIPS conference proceedings, vol 30. ACM, Atlantic City, N.J., USA, pp. 483–485

  3. Bodony D, Lele SK (2005) On using large-eddy simulation for the prediction of noise from cold and heated turbulent jets. Phys Fluids 17(8):085103

    Article  Google Scholar 

  4. Bridges J, Wernet MP (2008) Turbulence associated with broadband shock noise in hot jets. In: AIAA Paper No. 2008-2834. In: Proceedings of the 14th AIAA/CEAS aeroacoustics conference (29th AIAA Aeroacoustics Conference), Vancouver, Canada,

  5. Center for Mathematical Sciences Applied to Industry (CEPID-CeMEAI) (2016) (CEPID-CeMEAI) web page, https://www.cemeai.icmc.usp.br/

  6. Cohen E, Gloerfelt X (2018) Influence of pressure gradients on wall pressure beneath a turbulent boundary layer. J Fluid Mech 838:715–758

    Article  MathSciNet  Google Scholar 

  7. Darema F (2001) SPMD model: past, present and future. In: 8th European PVM/MPI users’ group meeting recent advances in parallel virtual machine and message passing interface, Santorini/Thera, Greece, pp. 23–26

  8. Dongarra JJ, Otto SW, Snir M, Walker D (1995) An introduction to the MPI Standard. Technical report, Knoxville, TN, USA

  9. Folk M, Cheng A, Yates K (1999) HDF5: a file format and I/O library for high performance computing applications. Proc Supercomput 99:5–33

    Google Scholar 

  10. Folk M, Heber G, Koziol Q, Pourmal E, Robinson D (2011) An overview of the HDF5 technology suite and its applications. In: Proceedings of the EDBT/ICDT 2011 Workshop on Array Databases. ACM, pp. 36–47

  11. Garnier E, Adams N, Sagaut P (2009) Large eddy simulation for compressible flows. Springer, Berlin

    Book  Google Scholar 

  12. Gloerfelt X, Cinnella P (2019) Large Eddy Simulation Requirements for the Flow over Periodic Hills. Flow Turbul Combust 103(1):55–91. https://doi.org/10.1007/s10494-018-0005-5

    Article  Google Scholar 

  13. Gusev M, Ristov S (2014) A superlinear speedup region for matrix multiplication. Concurr Comput Pract Exp 26(11):1847–1868

    Article  Google Scholar 

  14. Gustafson JL (1988) Reevaluating Amdahl’s law. Commun ACM 31(5):532–533

    Article  Google Scholar 

  15. Jameson A, Mavriplis D (1986) Finite volume solution of the two-dimensional Euler equations on a regular triangular mesh. AIAA J 24(4):611–618

    Article  Google Scholar 

  16. Jameson A, Schmidt W, Turkel E (1981) Numerical solutions of the Euler equations by finite volume methods using Runge-Kutta time-stepping schemes. In: Proceedings of the AIAA 14th fluid and plasma dynamic conference AIAA paper 81–1259, Palo Alto, California, USA

  17. Junqueira-Junior C (2016) Development of a parallel solver for large eddy simulation of supersonic jet flow. PhD thesis, Instituto Tecnológico de Aeronáutica, São José dos Campos, SP, Brazil,

  18. Junqueira-Junior C, Yamouni S, Azevedo JLF, Wolf WR (2018) Influence of different subgrid-scale models in low-order les of supersonic jet flows. J Braz Soc Mech Sci Eng 40(258):1–29

    Google Scholar 

  19. Legensky SM, Edwards DE, Bush RH, Poirier DM (2002) CFD general notation system (CGNS)—status and future directions. In: Proceedings of 40th AIAA aerospace sciences meeting & ExhibitAIAA Paper No. 2002-0752, Reno, NV

  20. Li Y, Wang ZJ (2015) A priori and a posteriori evaluation of subgrid stress models with the burger’s equation. In: Proceedings of 53rd AIAA aerospace sciences meeting AIAA-2015-1283. Kissimmee, Florida, U.S.A, pp. 20

  21. Lo SC, Aikens KM, Blaisdell GA, Lyrintzis AS (2012) Numerical investigation of 3-D supersonic jet flows using large-eddy simulation. Int J Aeroacoust 11(7):783–812

    Article  Google Scholar 

  22. Long LN, Khan M, Sharp HT (1991) A massively parallel three-dimensional Euler/Navier–Stokes method. AIAA J 29(5):657–666

    Article  Google Scholar 

  23. Lustre® (2019) Lustre® filesystem page, https://www.lustre.org/

  24. Mendez S, Shoeybi M, Sharma A, Ham FE, Lele S K, Moin P (2010) Large-eddy simulations of perfectly-expanded supersonic jets: quality assessment and validation. In: 48th AIAA aerospace sciences meeting including the new horizons forum and aerospace exposition AIAA Paper No. 2010–0271, Orlando, USA

  25. Mendez S, Shoeybi M, Sharma A, Ham FE, Leleand SK, Moin P (2012) Large-eddy simulations of perfectly-expanded supersonic jets using an unstructured solver. AIAA J 50(5):1103–1118

    Article  Google Scholar 

  26. Poirier D, Enomoto FY (1998) The CGNS system. In Proceedings of 29th AIAA fluid dynamics conference, AIAA Paper No. 98-3007, Albuquerque, NM

  27. Poirier DMA, Bush RH, Cosner RR, Rumsey CL, McCarthy DR (2000) Advances in the CGNS database standard for aerodynamics and CFD. In: 38th AIAA Aerospace Sciences Meeting & Exhibit AIAA Paper No. 2000-0681, Reno, NV

  28. RedHat (2019) RedHat web page http://www.redhat.com/

  29. Ristov S, Prodan R, Gusev M, Skala K (2016) Superlinear speedup in HPC systems: why and when? In: Proceedings of the 2016 federated conference on computer science and information systems. Gdańsk, Poland, pp. 889–898

  30. Rumsey CL, Wedan B, Hauser T, Poinot M (2012) Recent updates to the CFD general notation system (CGNS). In: Proceedings of 50th AIAA aerospace sciences meeting, AIAA Paper No. 2012-1264, Nashville, TN, USA, pp. 16

  31. Sagaut Pierre (2002) Large eddy simulation for incompressible flows. Springer, Berlin

    Book  Google Scholar 

  32. Sciacovelli L, Cinnella P, Gloerfelt X (2017) Direct numerical simulations of supersonic turbulent channel flows of dense gases. J Fluid Mech 821:153–199

    Article  MathSciNet  Google Scholar 

  33. Sun XH, Chen Y (2010) Reevaluating Amdahl’s law in multicore era. J Parallel Distrib Comput 70(2):183–188

    Article  Google Scholar 

  34. Turkel E, Vatsa VN (1994) Effect of artificial viscosity on three-dimensional flow solutions. AIAA J 32(1):39–45

    Article  Google Scholar 

  35. Vreman AW (1995) Direct and large-eddy simulation of the compressible turbulent mixing layer. PhD thesis, Universiteit Twente

  36. Wolf W, Lele SK (2011) Airfoil Aeroacoustics: LES and acoustic analogy predictions. PhD thesis, Stanford, Stanford, CA, USA

  37. Wolf WR, Azevedo JLF, Lele SK (2012) Convective effects and the role of quadrupole sources for aerofoil aeroacoustics. J Fluid Mech 708:502–538

    Article  MathSciNet  Google Scholar 

Download references

Acknowledgements

The authors gratefully acknowledge the partial support for this research provided by Conselho Nacional de Desenvolvimento Científico e Tecnológico, CNPq, under the Research Grant Nos. 309985/2013-7, 400844/2014-1 and 443839/2014-0. The authors are also indebted to the partial financial support received from Fundação de Amparo à Pesquisa do Estado de São Paulo, FAPESP, under the Research Grant Nos. 2013/07375-0 and 2013/21535-0.

Author information

Authors and Affiliations

  1. DynFluid Laboratory, École Nationale Supérieure d’Arts et Métiers, 75013, Paris, France

    Carlos Junqueira-Junior

  2. Instituto de Aeronáutica e Espaço, DCTA/IAE/ALA, São José dos Campos, SP, 12228-904, Brazil

    João Luiz F. Azevedo

  3. Instituto Tecnológico de Aeronáutica, DCTA/ITA, São José dos Campos, SP, 12228-900, Brazil

    Jairo Panetta

  4. Faculdade de Engenharia Mecânica, Universidade Estadual de Campinas, Rua Mendeleyev, 200, Campinas, SP, 13083-860, Brazil

    William R. Wolf

  5. LatAm Experian DataLab, São Paulo, SP, Brazil

    Sami Yamouni

Authors
  1. Carlos Junqueira-Junior
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. João Luiz F. Azevedo
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jairo Panetta
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. William R. Wolf
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Sami Yamouni
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Carlos Junqueira-Junior.

Ethics declarations

Conflict of Interest

The authors declare that they have no conflict of interest.

Additional information

Technical Editor: André Cavalieri.

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Junqueira-Junior, C., Azevedo, J.L.F., Panetta, J. et al. Strong scaling of numerical solver for supersonic jet flow configurations. J Braz. Soc. Mech. Sci. Eng. 41, 547 (2019). https://doi.org/10.1007/s40430-019-2055-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s40430-019-2055-6

Keywords

Search

Navigation