Abstract
The paper surveys articles that construct and investigate direct and iterative methods for computing weighted pseudoinverses and weighted normal pseudosolutions with singular weights. The methods considered in the paper are mainly constructed based on the authors’ articles devoted to the development of the theory of weighted pseudoinversion aimed at investigating the characteristics of both weighted pseudoinverses and weighted normal pseudosolutions with singular weights. The paper uses the following results obtained and investigated by the authors: expansions of weighted pseudoinverses into matrix power series and products, limit representations of such matrices, and determination of decompositions of weighted pseudoinverses based on weighted singular value decompositions of matrices with singular weights.
Similar content being viewed by others
References
J. F. Ward, T. L. Boullion, and T. O. Lewis, “Weighted pseudoinverses with singular weights,” SIAM J. Appl. Math., Vol. 21, No. 3, 480–482 (1971).
E. F. Galba, V. S. Deineka, and I. V. Sergienko, “Weighted pseudoinverses and weighted normal pseudosolutions with singular weights,” Comp. Math. Math. Physics, Vol. 49, No. 8, 1281–1297 (2009).
I. V. Sergienko, E. F. Galba, and V. S. Deineka, “Existence and uniqueness of weighted pseudoinverse matrices and weighted normal pseudosolutions with singular weights,” Ukr. Math. J., Vol. 63, No. 1, 85–98 (2011).
I. V. Sergienko, E. F. Galba, and V. S. Deineka, “Existence and uniqueness theorems in the theory of weighted pseudoinverses with singular weights,” Cybern. Syst. Analysis, Vol. 47, No. 1, 11–28 (2011).
E. F. Galba, V. S. Deineka, and I. V. Sergienko, “Weighted singular value decomposition and weighted pseudoinversion of matrices with singular weights,” Zh. Vychisl. Mat. Mat. Fiz., Vol. 52, No. 12, 2115–2132 (2012).
E. F. Galba, V. S. Deineka, and I. V. Sergienko, “Necessary and sufficient conditions of the existence of one of the variants of weighted singular value decomposition of matrices with singular weights,” Doklady RAN, Vol. 455, No. 3, 261–264 (2014).
I. V. Sergienko, E. F. Galba, and V. S. Deineka, “Necessary and sufficient conditions for the existence of weighted singular value decompositions of matrices with singular weights,” Ukr. Math. J., Vol. 67, No. 3, 464–486 (2015).
I. V. Sergienko and E. F. Galba, “Weighted singular value decomposition of matrices with singular weights based on weighted orthogonal transformations,” Cybern. Syst. Analysis, Vol. 51, No. 4, 514–528 (2015).
G. Corach and A. Maestripieri, “Weighted generalized inverses, oblique projections, and least-squares problems,” Numer. Funct. Anal. and Optimization, Vol. 26, No. 6, 659–673 (2005).
S. K. Mitra and C. R. Rao, “Projections under seminorms and generalized Moore–Penrose inverses,” Linear Algebra and Appl., Vol. 9, 155–167 (1974).
L. Elden, “Perturbation theory for the least squares problem with linear equality constraints,” SIAM J. Numer. Anal., Vol. 17, No. 3, 338–350 (1980).
L. Elden, “A weighted pseudoinverse generalized singular values and constrained least squares problems,” BIT, Vol. 22, No. 4, 487–502 (1982).
Y. Censor, D. Gordon, and R. Gordon, “Component averaging: An efficient iterative parallel algorithm for large and sparse unstructured problems,” Parallel Comput., Vol. 27, No. 6, 777–808 (2001).
Y. Censor, D. Gordon, and R. Gordon, “BICAV: An inherently parallel algorithm for sparse systems with pixel-dependent weighting,” IEEE Trans. on Medical Imaging, Vol. 20, 1050–1060 (2001).
Y. Censor and T. Elfving, “Block-iterative algorithms with diagonally scaled oblique projections for the linear feasibility problem,” SIAM J. Matrix. Anal., Vol. 24, No. 1, 40–58 (2002).
Y. Censor and T. Elfving, “Iterative algorithms with seminorm-induced oblique projections,” Abstract Appl. Anal., No. 7, 387–406 (2003).
E. H. Moore, “On the reciprocal of the general algebraic matrix,” Abstract. Bull. Amer. Math. Soc., Vol. 26, 394–395 (1920).
R. Penrose, “A generalized inverse for matrices,” Proc. Cambridge Phil. Soc., Vol. 51, No. 3, 406–413 (1955).
A. Albert, Regression, Pseudoinversion, and Recurrent Estimation [in Russian], Nauka, Moscow (1977).
E. F. Galba, I. N. Molchanov, and V. V. Skopetskii, “Methods of computing weighted pseudoinverse matrices with singular weights,” Cybern. Syst. Analysis, Vol. 35, No. 5, 814–831 (1999).
E. F. Galba, V. S. Deineka, and I. V. Sergienko, “Limit representation of weighted pseudoinverse matrices with singular weights and problem regularization,” Zh. Vychisl. Mat. Mat. Fiz., Vol. 44, No. 11, 1928–1946 (2004).
E. F. Galba, “Iterative methods for calculation of weighted normal pseudosolution with singular weights,” Zh. Vychisl. Mat. Mat. Fiz., Vol. 39, No. 6, 882–896. (1999).
P. Lancaster and P. Rozsa, “Eigenvectors of H-self-adjoint matrices,” Z. Angew. Math. und Mech., Vol. 64, No. 9, 439–441 (1984).
I. Gohberg, P. Lancaster, and L. Rodman, Indefinite Linear Algebra and Applications, Birkhäuser Verlag, Basel–Boston–Berlin (2005).
Kh. D. Ikramov, “About algebraic properties of classes of pseudo-permutation and Í-self-adjoint matrices,” Zh. Vychisl. Mat. Mat. Fiz., Vol. 32, No. 8, 155–169 (1992).
I. V. Sergienko and E. F. Galba, “Weighted pseudoinversion with singular weights,” Cybern. Syst. Analysis, Vol. 52, No. 5, 708–729 (2016).
M. Z. Nashed, Generalized Inverses and Applications, Acad. Press, New York (1976).
O. Vaarmann, Generalized Inverse Mappings [in Russian], Valgus, Tallinn, (1988).
A. Ben-Israel, T. N. E. Greville, Generalized Inverses: Theory and Applications, Springer Verlag, New York (2003).
E. F. Galba, “Representation of weighted pseudoinverse matrix in terms of other pseudoinverse matrices,” Dopovidi Nac. Akad. Ukr., No. 4, 12–17 (1997).
E. F. Galba, “Weighted pseudoinversion of matrices with singular weights,” Ukr. Math. J., Vol. 46, No. 10, 1457–1462 (1994).
H. P. Decell, “An application of the Cayley–Hamilton theorem to generalized matrix inversion,” SIAM Rev., Vol. 7, No. 4, 526–528 (1965).
E. F. Galba, V. S. Deineka, and I. V. Sergienko, “Expansions and polynomial limit representations of weighted pseudoinverses,” Comp. Math. Math. Physics, Vol. 47, No. 5, 713–731 (2007).
G. G. Broeder and A. Charnes, “Contributions to the theory of generalized inverses for matrices,” ONR Res. Memo. Northwestern Univ., No. 39 (1962).
I. V. Sergienko, E. F. Galba, and V. S. Deineka, “Series expansion of weighted pseudoinverse matrices and iterative methods for calculating weighted pseudoinverse matrices and weighted normal pseudosolutions,” Cybern. Syst. Analysis, Vol. 42, No. 1, 28–53 (2006).
I. V. Sergienko, E. F. Galba, and V. S. Deineka, “Expansion of weighted pseudoinverse matrices with singular weights into matrix power products and iteration methods,” Ukr. Math. J., Vol. 59, No. 9, 1417–1440 (2007).
I. V. Sergienko, E. F. Galba, and V. S. Deineka, “Representations and expansions of weighted pseudoinverse matrices, iterative methods, and problem regularization. II. Singular weights,” Cybern. Syst. Analysis, Vol. 44, No. 3, 324–375 (2008).
G. Golub and W. Kahan, “Calculating the singular values and pseudoinverse of matrix,” J. SIAM Numer. Anal., Ser. B2, 205–224 (1965).
G. Golub and W. Kahan, “Least squares, singular values, and matrix approximations,” Aplikace matematiky, Vol. 13, 44–51 (1968).
G. Golub and C. Reinsch, “Singular value decompositions and least squares solutions,” Numer. Math., Vol. 14, 403–420 (1970).
E. F. Galba, “Weighted singular decomposition and weighted pseudoinversion of matrices,” Ukr. Math. J., Vol. 48, No. 10, 1618–1622 (1996).
E. F. Galba, V. S. Deineka, and I. V. Sergienko, “Fast converging iterative methods for calculating weighted pseudoinverses and weighted normal pseudosolutions with singular weights,” Zh. Vychisl. Mat. Mat. Fiz., Vol. 45, No. 10, 1731–1755 (2005).
J. Wilkinson and C. Reinsch, A Reference Book of ALGOL Algorithms. Linear Algebra [Russian translation], Mashinostroenie, Moscow (1976).
C. L. Lawson and R. J. Hanson, Solving Least Squares Problems (Classics in Applied Mathematics), Society for Industrial and Applied Mathematics (1987).
A. N. Khimich and E. A. Nikolaevskaya, “Reliability analysis of computer solutions of systems of linear algebraic equations with approximate intial data,” Cybern. Syst. Analysis, Vol. 44, No. 6, 863–874 (2008).
E. A. Nikolaevskaya and A. N. Khimich, “Error estimation for a weighted minimum-norm least squares solution with positive definite weights,” Comp. Math. Math. Phys., Vol. 49, No. 3, 409–417 (2009).
A. N. Tikhonov and V. Ya. Arsenin, Methods to Solve Ill-Posed Problems [in Russian], Nauka, Moscow (1974).
V. A. Morozov, Regular Methods to Solve Ill-Posed Problems [in Russian], Nauka, Moscow (1987).
A. I. Zhdanov, “The method of augmented regularized normal equations,” Comp. Math. Math. Physics, Vol. 52, No. 2, 194–197 (2012).
G. M. Vainikko and A. Yu. Veretennikov, Iterative Procedures in Ill-Posed Problems [in Russian], Nauka, Moscow (1986).
V. E. Uvarov and R. A. Shafiev, “An iterative regularization method for the 2-constraint pseudoinversion of an operator equation,” Comp. Math. Math. Physics, Vol. 46, No. 10, 1651–1659 (2006).
Author information
Authors and Affiliations
Corresponding author
Additional information
Translated from Kibernetika i Sistemnyi Analiz, No. 3, May–June, 2018, pp. 65–93.
Rights and permissions
About this article
Cite this article
Galba, E.F., Sergienko, I.V. Methods for Computing Weighted Pseudoinverses and Weighted Normal Pseudosolutions with Singular Weights. Cybern Syst Anal 54, 398–422 (2018). https://doi.org/10.1007/s10559-018-0042-z
Received:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10559-018-0042-z