You are here: MIMS > EPrints
MIMS EPrints

2015.106: Computing Fundamental matrix decompositions accurately via the matrix sign function in two iterations: The power of Zolotarev's functions

2015.106: Yuji Nakatsukasa and Roland W. Freund (2015) Computing Fundamental matrix decompositions accurately via the matrix sign function in two iterations: The power of Zolotarev's functions.

Full text available as:

PDF - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
851 Kb

Abstract

The symmetric eigenvalue decomposition and the singular value decomposition (SVD) are fundamental matrix decompositions with many applications. Conventional algorithms for computing these decompositions are suboptimal in view of recent trends in computer architectures, which require minimizing communication together with arithmetic costs. Spectral divide-and-conquer algorithms, which recursively decouple the problem into two smaller subproblems, can achieve both requirements. Such algorithms can be constructed with the polar decomposition playing two key roles: it forms a bridge between the symmetric eigendecomposition and the SVD, and its connection to the matrix sign function naturally leads to spectral-decoupling. For computing the polar decomposition, the scaled Newton and QDWH iterations are two of the most popular algorithms, as they are backward stable and converge in at most nine and six iterations, respectively. Following this framework, we develop a higher-order variant of the QDWH iteration for the polar decomposition. The key idea of this algorithm comes from approximation theory: we use the best rational approximant for the scalar sign function due to Zolotarev in 1877. The algorithm exploits the extraordinary property enjoyed by the sign function that a high-degree Zolotarev function (best rational approximant) can be obtained by appropriately composing low-degree Zolotarev functions. This lets the algorithm converge in just \emph{two} iterations in double-precision arithmetic, with the whopping rate of convergence \emph{seventeen}. The resulting algorithms for the symmetric eigendecompositions and the SVD have higher arithmetic costs than the QDWH-based algorithms, but are better-suited for parallel computing and exhibit excellent numerical backward stability.

Item Type:MIMS Preprint
Additional Information:

To appear in SIAM Review.

Subjects:MSC 2000 > 15 Linear and multilinear algebra; matrix theory
MSC 2000 > 65 Numerical analysis
MIMS number:2015.106
Deposited By:Yuji Nakatsukasa
Deposited On:23 November 2015

Download Statistics: last 4 weeks
Repository Staff Only: edit this item