Parallel data-driven decomposition algorithm for large-scale datasets: with application to transitional boundary layers
- 326 Downloads
Many fluid flows of engineering interest, though very complex in appearance, can be approximated by low-order models governed by a few modes, able to capture the dominant behavior (dynamics) of the system. This feature has fueled the development of various methodologies aimed at extracting dominant coherent structures from the flow. Some of the more general techniques are based on data-driven decompositions, most of which rely on performing a singular value decomposition (SVD) on a formulated snapshot (data) matrix. The amount of experimentally or numerically generated data expands as more detailed experimental measurements and increased computational resources become readily available. Consequently, the data matrix to be processed will consist of far more rows than columns, resulting in a so-called tall-and-skinny (TS) matrix. Ultimately, the SVD of such a TS data matrix can no longer be performed on a single processor, and parallel algorithms are necessary. The present study employs the parallel TSQR algorithm of (Demmel et al. in SIAM J Sci Comput 34(1):206–239, 2012), which is further used as a basis of the underlying parallel SVD. This algorithm is shown to scale well on machines with a large number of processors and, therefore, allows the decomposition of very large datasets. In addition, the simplicity of its implementation and the minimum required communication makes it suitable for integration in existing numerical solvers and data decomposition techniques. Examples that demonstrate the capabilities of highly parallel data decomposition algorithms include transitional processes in compressible boundary layers without and with induced flow separation.
KeywordsParallel algorithms Data decomposition Computational fluid dynamics
Unable to display preview. Download preview PDF.
ESM (MOV 812 kb)
- 1.Benson, A.R., Gleich, D.F., Demmel, J.: Direct QR factorization for tall-and-skinny matrices in MapReduce architectures. In: IEEE International Conference in Big Data (2013)Google Scholar
- 5.Heroux, M., Bartlett, R., Hoekstra, V.H.R., Hu, J., Kolda, T., Lehoucq, R., Long, K., Pawlowski, R., Phipps, E., Salinger, A., Thornquist, H., Tuminaro, R., Willenbring, J., Williams, A.: An overview of trilinos. Technical Report SAND2003-2927, Sandia National Laboratories (2003)Google Scholar
- 7.Luethi, P., Studer, C., Duetsch, S., Zgraggen, E., Kaeslin, H., Felber, N., Fichtner, W.: Gram-Schmidt-based QR decomposition for MIMO detection: VLSI implementation and comparison. In: IEEE Asia Pacific Conference on Circuits and systems, pp 830–833 (2008)Google Scholar
- 19.Statnikov, V., Sayadi, T., Meinke, M., Schmid, P., Schröder, W.: Analysis of pressure perturbation sources on a generic space launcher after-body in supersonic flow using zonal turbulence modeling and dynamic mode decomposition. Phys. Fluids 27(1), 016103(1–21) (2015)Google Scholar
- 21.Ye, J., Li, Q., Xiong, H., Park, H., Janardan, R., Kumar, V.: IDR/QR: an incremental dimension reduction algorithm via QR decomposition. IEEE Trans Knowl Data Eng 17(9):1208–1222 (2005)Google Scholar