Projection-like Retractions on Matrix Manifolds

DOI10.1137/100802529zbMath1248.49055OpenAlexW2098760944MaRDI QIDQ2902874

Publication date: 22 August 2012

Published in: SIAM Journal on Optimization (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1137/100802529

zbMATH Keywords

Stiefel manifold projection retraction matrix manifold spectral manifold equality-constrained optimization feasible optimization method fixed-rank matrices

Mathematics Subject Classification ID

Numerical mathematical programming methods (65K05) Nonlinear programming (90C30) Variational problems in a geometric measure-theoretic setting (49Q20) Local Riemannian geometry (53B20)

Related Items

Introduction to Riemannian Geometry and Geometric Statistics: From Basic Theory to Implementation with Geomstats ⋮ Energy-adaptive Riemannian optimization on the Stiefel manifold ⋮ Constraint optimization and SU(N) quantum control landscapes ⋮ Riemannian Conjugate Gradient Methods: General Framework and Specific Algorithms with Convergence Analyses ⋮ Adaptive Quadratically Regularized Newton Method for Riemannian Optimization ⋮ Sensor Network Localization on the Group of Three-Dimensional Displacements ⋮ A geometric proximal gradient method for sparse least squares regression with probabilistic simplex constraint ⋮ Error bound conditions and convergence of optimization methods on smooth and proximally smooth manifolds ⋮ Adaptive integration of nonlinear evolution equations on tensor manifolds ⋮ A variational approach of the rank function ⋮ Nonmonotone inexact restoration approach for minimization with orthogonality constraints ⋮ Minimum-correction second-moment matching: theory, algorithms and applications ⋮ An efficient damped Newton-type algorithm with globalization strategy on Riemannian manifolds ⋮ Dynamically Orthogonal Numerical Schemes for Efficient Stochastic Advection and Lagrangian Transport ⋮ Low-rank tensor completion by Riemannian optimization ⋮ Dynamically Orthogonal Runge–Kutta Schemes with Perturbative Retractions for the Dynamical Low-Rank Approximation ⋮ Newton acceleration on manifolds identified by proximal gradient methods ⋮ Retraction maps: a seed of geometric integrators ⋮ Approximating the nearest stable discrete-time system ⋮ Cholesky QR-based retraction on the generalized Stiefel manifold ⋮ A semi-analytical approach for the positive semidefinite Procrustes problem ⋮ A trust region method for solving multicriteria optimization problems on Riemannian manifolds ⋮ Convergence Results for Projected Line-Search Methods on Varieties of Low-Rank Matrices Via Łojasiewicz Inequality ⋮ Nonmonotone feasible arc search algorithm for minimization on Stiefel manifold ⋮ A geometric Gauss-Newton method for least squares inverse eigenvalue problems ⋮ A semismooth Newton based augmented Lagrangian method for nonsmooth optimization on matrix manifolds ⋮ Fast gradient method for low-rank matrix estimation ⋮ A Dynamic Smoothing Technique for a Class of Nonsmooth Optimization Problems on Manifolds ⋮ First-order methods almost always avoid strict saddle points ⋮ Riemannian optimization on unit sphere with $p$-norm and its applications ⋮ Riemannian thresholding methods for row-sparse and low-rank matrix recovery ⋮ Data-driven reduced order models using invariant foliations, manifolds and autoencoders ⋮ Riemannian Natural Gradient Methods ⋮ Generalized left-localized Cayley parametrization for optimization with orthogonality constraints ⋮ A difference-of-convex approach for split feasibility with applications to matrix factorizations and outlier detection ⋮ A New First-Order Algorithmic Framework for Optimization Problems with Orthogonality Constraints ⋮ The Condition Number of Join Decompositions ⋮ Primal-dual optimization algorithms over Riemannian manifolds: an iteration complexity analysis ⋮ Gradient projection method on matrix manifolds ⋮ Desingularization of Bounded-Rank Matrix Sets ⋮ A Geometric Approach to Dynamical Model Order Reduction ⋮ Geometric multiscale decompositions of dynamic low-rank matrices ⋮ On the gradient projection method for weakly convex functions on a proximally smooth set ⋮ Ground States of Spin-$F$ Bose--Einstein Condensates ⋮ A brief introduction to manifold optimization ⋮ A non-monotone linear search algorithm with mixed direction on Stiefel manifold ⋮ Cayley-transform-based gradient and conjugate gradient algorithms on Grassmann manifolds ⋮ A feasible filter method for the nearest low-rank correlation matrix problem ⋮ Low-rank retractions: a survey and new results ⋮ High-Order Retractions on Matrix Manifolds Using Projected Polynomials ⋮ Projected nonmonotone search methods for optimization with orthogonality constraints ⋮ Averaging on manifolds by embedding algorithm ⋮ A Riemannian subgradient algorithm for economic dispatch with valve-point effect ⋮ Preconditioned Low-rank Riemannian Optimization for Linear Systems with Tensor Product Structure ⋮ A Riemannian conjugate gradient method for optimization on the Stiefel manifold ⋮ Stochastic approximation on Riemannian manifolds ⋮ Riemannian conjugate gradient methods with inverse retraction ⋮ A framework for generalising the Newton method and other iterative methods from Euclidean space to manifolds ⋮ Adaptive regularization with cubics on manifolds ⋮ Robust principal component pursuit via inexact alternating minimization on matrix manifolds ⋮ Perturbation expansions and error bounds for the truncated singular value decomposition ⋮ Approximate Joint Diagonalization with Riemannian Optimization on the General Linear Group ⋮ The gradient projection algorithm for smooth sets and functions in nonconvex case ⋮ A framework of constraint preserving update schemes for optimization on Stiefel manifold ⋮ The gradient projection method with Armijo's step size on manifolds ⋮ On matrix exponentials and their approximations related to optimization on the Stiefel manifold ⋮ Riemannian Optimization for High-Dimensional Tensor Completion ⋮ The Extrinsic Geometry of Dynamical Systems Tracking Nonlinear Matrix Projections ⋮ Riemannian Newton optimization methods for the symmetric tensor approximation problem ⋮ Riemannian Multigrid Line Search for Low-Rank Problems ⋮ Orthogonal Trace-Sum Maximization: Applications, Local Algorithms, and Global Optimality ⋮ Unnamed Item ⋮ Quadratic optimization with orthogonality constraint: explicit Łojasiewicz exponent and linear convergence of retraction-based line-search and stochastic variance-reduced gradient methods ⋮ A Riemannian gradient ascent algorithm with applications to orthogonal approximation problems of symmetric tensors ⋮ A new, globally convergent Riemannian conjugate gradient method ⋮ Null space gradient flows for constrained optimization with applications to shape optimization ⋮ Riemannian conjugate gradient descent method for fixed multi rank third-order tensor completion ⋮ Computing Eigenspaces With Low Rank Constraints ⋮ A Riemannian Newton Algorithm for Nonlinear Eigenvalue Problems ⋮ Wrapped Statistical Models on Manifolds: Motivations, The Case SE(n), and Generalization to Symmetric Spaces ⋮ Avoiding bad steps in Frank-Wolfe variants

This page was built for publication: Projection-like Retractions on Matrix Manifolds