The space decomposition theory for a class of eigenvalue optimizations

In this paper we study optimization problems involving eigenvalues of symmetric matrices. One of the difficulties with numerical analysis of such problems is that the eigenvalues, considered as functions of a symmetric matrix, are not differentiable at those points where they coalesce. Here we apply the <InlineEquation ID="IEq1"> <EquationSource Format="TEX">$\mathcal{U}$</EquationSource> </InlineEquation>-Lagrangian theory to a class of D.C. functions (the difference of two convex functions): the arbitrary eigenvalue function λ <Subscript> i </Subscript>, with affine matrix-valued mappings, where λ <Subscript> i </Subscript> is a D.C. function. We give the first-and second-order derivatives of <InlineEquation ID="IEq2"> <EquationSource Format="TEX">${\mathcal{U}}$</EquationSource> </InlineEquation>-Lagrangian in the space of decision variables R <Superscript> m </Superscript> when transversality condition holds. Moreover, an algorithm framework with quadratic convergence is presented. Finally, we present an application: low rank matrix optimization; meanwhile, list its <InlineEquation ID="IEq3"> <EquationSource Format="TEX">$\mathcal{VU}$</EquationSource> </InlineEquation> decomposition results. Copyright Springer Science+Business Media New York 2014