Accelerating the Singular Value Decomposition of Rectangular Matrices with the CSX600 and the Integrable SVD
We propose an approach to speed up the singular value decomposition (SVD) of very large rectangular matrices using the CSX600 floating point coprocessor. The CSX600-based acceleration board we use offers 50GFLOPS of sustained performance, which is many times greater than that provided by standard microprocessors. However, this performance can be achieved only when a vendor-supplied matrix-matrix multiplication routine is used and the matrix size is sufficiently large. In this paper, we optimize two of the major components of rectangular SVD, namely, QR decomposition of the input matrix and back-transformation of the left singular vectors by matrix Q, so that large-size matrix multiplications can be used efficiently. In addition, we use the Integrable SVD algorithm to compute the SVD of an intermediate bidiagonal matrix. This helps to further speed up the computation and reduce the memory requirements. As a result, we achieved up to 3.5 times speedup over the Intel Math Kernel Library running on an 3.2GHz Xeon processor when computing the SVD of a 100,000 × 4000 matrix.
Unable to display preview. Download preview PDF.
- 1.Anderson, E., Bai, Z., Bischof, C., Demmel, J., Dongarra, J., Croz, J.D., Greenbaum, A., Hammarling, S., McKenney, A., Ostrouchov, S., Sorensen, D.: LAPACK User’s Guide. SIAM, Philadelphia (1992)Google Scholar
- 2.ClearSpeed Technology Inc., http://www.clearspeed.com/
- 5.GRAPE-DR Project, http://grape-dr.adm.s.u-tokyo.ac.jp/
- 9.Takata, M., Kimura, K., Iwasaki, M., Nakamura, Y.: Performance of a New Singular Value Decomposition Scheme for Large Scale Matrices. In: Proceedings of The IASTED International Conference on Parallel and Distributed Computing and Networks, pp. 304–309 (2006)Google Scholar