Abstract
We consider approximations formed by the sum of a linear combination of given functions enhanced by ridge functions—a Linear/Ridge expansion. For an explicitly or implicitly given objective function, we reformulate finding a best Linear/Ridge expansion in terms of an optimization problem. We introduce a particle grid algorithm for its solution. Several numerical results underline the flexibility, robustness and efficiency of the algorithm. One particular source of motivation is model reduction of parameterized transport or wave equations. We show that the particle grid algorithm is able to find a Linear/Ridge expansion as an efficient nonlinear model reduction.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
Bachmayr, M., Cohen, A.: Kolmogorov widths and low-rank approximations of parametric elliptic PDEs. Math Comput. 86 32(304), 701–724 (2017)
Binev, P., Cohen, A., Dahmen, W., DeVore, R., Petrova, G., Wojtaszczyk, P.: Convergence rates for greedy algorithms in reduced basis methods. SIAM J. Math. Anal. 43(3), 1457–1472 (2011)
Black, F., Schulze, P., Unger, B.: Projection-based model reduction with dynamically transformed modes. ESAIM: Math. Model. Numer. Anal. 54(6), 2011–2043 (Oct 2020)
Bonito, A., Cohen, A., DeVore, R., Guignard, D., Jantsch, P., Petrova, G.: Nonlinear methods for model reduction. ESAIM: M2AN 55(2), 507–531 (2021)
Buffa, A., Maday, Y., Patera, A.T., Prud’homme, C., Turinici, G.: A priori convergence of the greedy algorithm for the parametrized reduced basis method. ESAIM Math. Model. Numer. Anal. 46(3), 595–603 (2012)
Buhmann, M.D., Pinkus, A.: Identifying linear combinations of ridge functions. Adv. Appl. Math. 22(1), 103–118 (1999)
Cea, J.: Approximation variationnelle des problèmes aux limites. Ann. Inst. Fourier 14(2), 345–444 (1964)
Clément, P.: Approximation by finite element functions using local regularization. Rev. Fr. Autom. Inf. Rech. Oper. Anal. Numer. 9(R2), 77–84 (1975)
Constantine, P.G., Eftekhari, A., Hokanson, J., Ward, R.: A near-stationary subspace for ridge approximation. Comput. Methods Appl. Mech. Eng. 326(1), 402–421 (Nov 2017)
Dal Santo, N., Deparis, S., Pegolotti, L.: Data driven approximation of parametrized pdes by reduced basis and neural networks. J. Comput. Phys. 416, 109550 (2020)
Ehrlacher, V., Lombardi, D., Mula, O., Vialard, F.-X.: Nonlinear model reduction on metric spaces. Application to one-dimensional conservative PDEs in Wasserstein spaces. ESAIM. Math. Model. Numer. Anal. arXiv:1909.06626(54) (2021)
Fresca, S., Dede’, L., Manzoni, A.: A comprehensive deep learning-based approach to reduced order modeling of nonlinear time-dependent parametrized pdes. J. Sci. Comput. 87(2), 61 (2021)
Greif, C., Urban, K.: Decay of the kolmogorov n-width for wave problems. Appl. Math. Lett. 96, 216–222 (2019)
Haasdonk, B.: Reduced basis methods for parametrized PDEs—a tutorial. In: Benner, P., Cohen, A., Ohlberger, M., Willcox, K. (eds.) Model Reduction and Approximation, chap 2, pp 65–136. SIAM, Philadelphia (2017)
Hesthaven, J.S., Rozza, G, Stamm, B.: Certified Reduced Basis Methods for Parametrized Partial Differential Equations. Springer (2016)
Ismailov, V.E.: A note on the best l2 approximation by ridge functions. Appl. Math. E-Notes 7, 71–76 (2007)
Kennedy, J., Eberhart, R.: Particle swarm optimization. In: Proceedings of ICNN’95—International Conference on Neural Networks, vol. 4, pp 1942–1948 (1995)
Kolleck, A., Vybíral, J.: On some aspects of approximation of ridge functions. J. Approx. Theory 194, 35–61 (2015)
Kolmogorov, A.: ÜBer Die Beste annäherung Von Funktionen Einer Gegebenen Funktionenklasse. Ann. Math. 37(1), 107–110 (1936)
Kutyniok, G., Petersen, P., Raslan, M, Schneider, R.: A Theoretical Analysis of Deep Neural Networks and Parametric PDEs. Constr. Approx. 5, 73–125 (2022)
Nair, N.J., Balajewicz, M.: Transported snapshot model order reduction approach for parametric, steady-state fluid flows containing parameter-dependent shocks. Int. J. Numer. Meth. Eng. 117(12), 1234–1262 (2019)
Ohlberger, M., Rave, S.: Nonlinear reduced basis approximation of parameterized evolution equations via the method of freezing. C. R. Akad. Sci. Math. 351(23), 901–906 (2013)
Ohlberger, M., Rave, S.: Reduced basis methods: success, limitations and future challenges. In: Proceedings of the Conference Algoritmy, pp 1–12 (2016)
Olsson, A.E.: Particle swarm optimization: theory techniques and applications (2011)
Pinkus, A.: n-widths in approximation theory. Springer, Berlin (1985)
Pinkus, A.: Ridge Functions. Cambridge University Press, Cambridge (2015)
Quarteroni, A., Manzoni, A., Negri, F.: Reduced Basis Methods for Partial Differential Equations: an Introduction. Springer, Cham (2016)
Welper, G.: Transformed snapshot interpolation with high resolution transforms. SIAM J. Sci. Comput. 42(4), A2037–A2061 (2020)
Xu, J., Zikatanov, L.: Some observations on babuška and Brezzi theories. Numer. Math. 94(1), 195–202 (2003)
Acknowledgements
The authors are grateful to the anonymous referees for several valuable comments.
Funding
Open Access funding enabled and organized by Projekt DEAL.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare no conflict of interests.
Additional information
Communicated by: Alex Barnett
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Greif, C., Junk, P. & Urban, K. Linear/Ridge expansions: enhancing linear approximations by ridge functions. Adv Comput Math 48, 15 (2022). https://doi.org/10.1007/s10444-022-09936-4
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s10444-022-09936-4