Optimization by direct search in matrix computations

Higham, Nicholas J. (1993) Optimization by direct search in matrix computations. SIAM Journal On Matrix Analysis And Applications, 14 (2). pp. 317-333. ISSN 1095-7162

 PDF 0614023.pdf Download (2MB)

Abstract

A direct search method attempts to maximize a function $f :{\bf R}^n \to {\bf R}$ using function values only. Many questions about the stability and accuracy of algorithms in matrix computations can be expressed in terms of the maximum value of some easily computable function $f$. For a variety of algorithms it is shown that direct search is capable of revealing instability or poor performance, even when such failure is difficult to discover using theoretical analysis or numerical tests with random or nonrandom data. Informative numerical examples generated by direct search provide the impetus for further analysis and improvement of an algorithm. The direct search methods used are the method of alternating directions and the multi-directional search method of Dennis and Torczon. The problems examined include the reliability of matrix condition number estimators and the stability of Strassen’s fast matrix inversion method.

Item Type: Article optimization, matrix computations, direct search method, numerical stability, Gaussian elimination, matrix condition number estimation, fast matrix multiplication, Vandermonde system, matrix inverse MSC 2010, the AMS's Mathematics Subject Classification > 15 Linear and multilinear algebra; matrix theoryMSC 2010, the AMS's Mathematics Subject Classification > 65 Numerical analysis Ms Lucy van Russelt 03 Jul 2006 20 Oct 2017 14:12 http://eprints.maths.manchester.ac.uk/id/eprint/346

Actions (login required)

 View Item