Abstract
In this paper, we present a new spectral residual method for solving large-scale positive definite generalized eigenvalue problems. The proposed algorithm is equipped with a dwindling multidimensional nonmonotone filter, in which the envelope dwindles as the step length decreases. We have also employed a relaxed nonmonotone line search technique in the structure of the algorithm which allows it to enjoy the nonmonotonicity from scratch. Under some mild and standard assumptions, the global convergence property of the proposed algorithm is established. An implementation of the new algorithm on some test problems shows the efficiency and effectiveness of the proposed algorithm in practice.
Similar content being viewed by others
References
Ahookhosh M, Amini K, Peyghami MR (2012) A nonmonotone trust-region line search method for large-scale unconstrained optimization. Appl Math Model 36:478–487
Arzani F, Peyghami MR (2016) A new nonmonotone filter Barzilai–Borwein method for solving unconstrained optimization problems. Int J Comput Math 93(3):596–608
Barzilai J, Borwein JM (1988) Two-point step size gradient methods. J Numer Anal 8:141–148
Bello L (2007) Gradiente espectral precondicionado sobre convexos y algunos casos de estudio. Doctoral Thesis, Universidad Central de Venezuela, Caracas, Venezuela
Bello L, Cruz WL, Raydan M (2010) Residual algorithm for large-scale positive definite generalized eigenvalue problems. Comput Optim Appl 46:217–227
Bello L, Raydan M (2005) Preconditioned spectral projected gradient method on convex sets. J Comput Math 22:4–49
Birgin EG, Martínez JM, Raydan M (2000) Nonmonotone spectral projected gradient methods on convex sets. SIAM J Optim 10:1196–1211
Chen Y, Sun W (2010) A dwindling filter line search method for unconstrained optimization. technical report of optimization no. school of mathematical science. Nanjing Normal University, Nanjing
Cheng W, Chen Z (2013) Nonmonotone spectral method for large-scale symmetric nonlinear equations. Numer Algorithm 62:149–162
Cheng W, Li DH (2009) A derivative-free nonmonotone line search and its application to the spectral residual method. IMA J Numer Anal 29:814–825
Cruz WL, Martínez JM, Raydan M (2006) Spectral residual method without gradient information for solving large-scale nonlinear systems of equations. Math Comput 75:1429–1448
Cruz WL, Raydan M (2003) Nonmonotone spectral methods for large-scale nonlinear systems. Optim Methods Softw 18:583–599
Datta BN (1995) Numerical linear algebra and applications. Brooks/Cole, Pacific Grove
Datta BN (2003) Numerical methods for linear control systems design and analysis. Elsevier, Amsterdam
Dolan E, Moré JJ (2002) Benchmarking optimization software with performance profiles. Math Program 91:201–213
Duff I, Grimes R, Lewis J (1989) Sparse matrix test problems. ACM Trans Math Softw 15:1–14
Fatemi M, Mahdavi-Amiri N (2012) A filter trust-region algorithm for unconstrained optimization with strong global convergence properties. Comput Optim Appl 52:239–266
Fatemi M, Mahdavi-Amiri N (2012) A non-monotone trust region algorithm for unconstrained optimization with dynamic reference iteration updates using filter. Optimization 61(6):733–763
Fletcher R, Leyffer S, Toint PL (2006) A brief history of filter methods. SIAG/OPT Views News 18:2–12
Fletcher R, Leyffer S (2002) Nonlinear programming without a penalty function. Math Program 91:239–269
Grippo L, Lampariello F, Lucidi S (1991) A class of nonmonotone stabilization methods in unconstrained optimization. Numer Math 59:779–805
Grippo L, Sciandrone M (2002) Nonmontone globalization techniques for the Barzilai–Borwein gradient method. Comput Optim Appl 23:143–169
Judice JJ, Ribeiro I, Sherali H (2007) The eigenvalue complementarity problem. Comput Optim Appl 37:139–156
Peyghami MR, Tarzanagh DA (2015) A relaxed nonmonotone adaptive trust region method for solving unconstrained optimization problems. Comput Optim Appl 61:321–341
Queiroz MG, Judice JJ, Humes CJ (2004) The symmetric eigenvalue complementarity problem. Math Comput 73:1849–1863
Saad Y (1992) Numerical methods for large eigenvalue problems. Manchester University Press, Manchester
Tarzanagh DA, Saeidian Z, Peyghami MR, Mesgarani H (2015) A new trust region method for solving least-square transformation of system of equalities and inequalities. Optim Lett 9:283–310
Zhang H, Hager WW (2004) A nonmonotone line search technique and its application to unconstrained optimization. SIAM J Optim 14(4):1043–1056
Acknowledgements
The authors would like to thank the Research Council of K.N. Toosi University of Technology and the SCOPE Research Center for supporting this work.
Author information
Authors and Affiliations
Corresponding author
Additional information
Communicated by Antonio José Silva Neto.
Rights and permissions
About this article
Cite this article
Arzani, F., Peyghami, M.R. An approach based on dwindling filter method for positive definite generalized eigenvalue problem. Comp. Appl. Math. 37, 1197–1212 (2018). https://doi.org/10.1007/s40314-016-0391-z
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s40314-016-0391-z
Keywords
- Dwindling filter technique
- Generalized eigenvalue problems
- Spectral methods
- Nonmonotone line search
- Global convergence