2009.31: The Complex Step Approximation to the Fréchet Derivative of a Matrix Function
2009.31: Awad H. Al-Mohy and Nicholas J. Higham (2010) The Complex Step Approximation to the Fréchet Derivative of a Matrix Function. Numerical Algorithms, 53 (1). pp. 133-148. ISSN 1017-1398
This is the latest version of this eprint.
Full text available as:
|PDF - Archive staff only - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader|
We show that the Fr\'echet derivative of a matrix function $f$ at $A$ in the direction $E$, where $A$ and $E$ are real matrices, can be approximated by $\Im f(A+ihE)/h$ for some suitably small $h$. This approximation, requiring a single function evaluation at a complex argument, generalizes the complex step approximation known in the scalar case. The approximation is proved to be of second order in $h$ for analytic functions $f$ and also for the matrix sign function. It is shown that it does not suffer the inherent cancellation that limits the accuracy of finite difference approximations in floating point arithmetic. However, cancellation does nevertheless vitiate the approximation when the underlying method for evaluating $f$ employs complex arithmetic. The ease of implementation of the approximation, and its superiority over finite differences, make it attractive when specialized methods for evaluating the Fr\'echet derivative are not available, and in particular for condition number estimation when used in conjunction with a block 1-norm estimation algorithm.
Version of 02 October 2009 below is author's PDF of final paper readable by all.
|Uncontrolled Keywords:||Fr\'echet derivative, matrix function, complex step approximation, complex arithmetic, finite difference, matrix sign function, condition number estimation, block 1-norm estimator|
|Subjects:||MSC 2000 > 15 Linear and multilinear algebra; matrix theory|
MSC 2000 > 65 Numerical analysis
|Deposited By:||Nick Higham|
|Deposited On:||17 November 2009|
Available Versions of this Item
- The Complex Step Approximation to the Fréchet Derivative of a Matrix Function (deposited 17 November 2009) [Currently Displayed]