Abstract
The author considers the robust approach to constructing machine learning algorithms based on minimizing robust finite sums of parameterized functions. This algorithm is based on finite robust differentiable aggregation summation functions, which are stable with respect to outliers.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
G. Beliakov, A. Kelarev, and J. Yearwood, “Robust artificial neural networks and outlier detection,”.
G. Beliakov, H. Sola, and T. Calvo, A Practical Guide to Averaging Functions, Springer-Verlag (2016).
T. Calvo and G. Beliakov, “Aggregation functions based on penalties,” Fuzzy Sets Syst., 161, No. 10, 1420–1436 (2010).
M. Grabich, J.-L. Marichal, and E. Pap, Aggregation Functions, Cambridge Univ. Press, Cambridge (2009).
P. J. Huber, Robust Statistics, Wiley, New York (1981).
D. P. Knigma and J. Ba, “Adam: A Method for Stochastic Optimization,”.
R. Koenker, Quantile Regression, Campridge Univ. Press, New York (2005).
Y. Ma, L. Li, X. Huang, and S. Wang, “Robust support vector machine using least median loss penalty,” IFAC Proc. Vols., 44, No. 1, 11208–11213 (2011).
R. Mesiar, M. Komornikova, A. Kolesarova, and T. Calvo, “Aggregation functions: A revision,” in: Fuzzy Sets and Their Extensions: Representation, Aggregation and Models (H. Bustince, F. Herrera, J. Montero, eds.), Springer-Verlag, Berlin–Heidelberg (2008).
W. Newey and J. Powell, “Asymmetric least squares estimation and testing,” Econometrica., 55, No. 4, 819–847 (1987).
P. J. Rousseeuw, “Least median of squares regression,” J. Am. Stat. Ass., No. 79, 871–880 (1984).
P. J. Rousseeuw and A. M. Leroy, Robust regression and outlier detection, Wiley, New York (1987).
M. Schmidt, N. Le Roux, and F. Bach, “Minimizing finite sums with the stochastic average gradient,” Math. Program., 162, No. 1-2, 83–112 (2017).
Z. M. Shibzukhov, “Correct aggregate operations with algorithms,” Pattern Recogn. Image Anal., 24, No. 3, 377–382 (2014).
Z. M. Shibzukhov, “On the principle of empirical risk minimization based on averaging aggregation functions,” Dokl. Math., 96, No. 2, 494–497 (2017).
V. Vapnik, The Nature of Statistical Learning Theory, Springer-Verlag (2000).
V. J. Yohai, “High breakdown-point and high effciency robust estimates for regression,” Ann. Stat., No. 15, 642–656 (1987).
Author information
Authors and Affiliations
Corresponding author
Additional information
Translated from Itogi Nauki i Tekhniki, Seriya Sovremennaya Matematika i Ee Prilozheniya. Tematicheskie Obzory, Vol. 166, Proceedings of the IV International Scientific Conference “Actual Problems of Applied Mathematics,” Kabardino-Balkar Republic, Nalchik, Elbrus Region, May 22–26, 2018. Part II, 2019.
Rights and permissions
About this article
Cite this article
Shibzukhov, Z.M. Minimizing Robust Estimates of Sums of Parameterized Functions. J Math Sci 260, 249–264 (2022). https://doi.org/10.1007/s10958-022-05689-z
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10958-022-05689-z