The Barzilai and Borwein Gradient Method for the Large Scale Unconstrained Minimization Problem

From MaRDI portal
Publication:3124034

DOI10.1137/S1052623494266365zbMath0898.90119MaRDI QIDQ3124034

Marcos Raydan

Publication date: 13 October 1998

Published in: SIAM Journal on Optimization (Search for Journal in Brave)




Related Items

The Hager–Zhang conjugate gradient algorithm for large-scale nonlinear equations, An adaptive nonmonotone global Barzilai–Borwein gradient method for unconstrained optimization, On the complexity of solving feasibility problems with regularized models, A memory gradient method based on the nonmonotone technique, A trust region spectral method for large-scale systems of nonlinear equations, Non Monotone Backtracking Inexact BFGS Method for Regression Analysis, On the Barzilai–Borwein gradient methods with structured secant equation for nonlinear least squares problems, A gradient method for unconstrained optimization in noisy environment, On the rate of convergence of projected Barzilai–Borwein methods, Descent direction method with line search for unconstrained optimization in noisy environment, A Positive Barzilai–Borwein-Like Stepsize and an Extension for Symmetric Linear Systems, Convergence conditions, line search algorithms and trust region implementations for the Polak–Ribière conjugate gradient method, Projected gradient algorithms for optimization over order simplices, A new nonmonotone trust-region method of conic model for solving unconstrained optimization, A Modified Non-Monotone BFGS Method for Non-Convex Unconstrained Optimization, Unnamed Item, A nonmonotone ODE-based method for unconstrained optimization, Benchmarking large-scale distributed convex quadratic programming algorithms, Delayed Gradient Methods for Symmetric and Positive Definite Linear Systems, Unnamed Item, An augmented Lagrangian method for optimization problems with structured geometric constraints, CMFWI: Coupled Multiscenario Full Waveform Inversion, Using Krylov subspace and spectral methods for solving complementarity problems in many-body contact dynamics simulation, Accelerated Dai-Liao projection method for solving systems of monotone nonlinear equations with application to image deblurring, Computation of Sum of Squares Polynomials from Data Points, A scaled nonlinear conjugate gradient algorithm for unconstrained optimization, Convergence of memory gradient methods, Global convergence of a modified Fletcher-Reeves conjugate gradient method with Armijo-type line search, Secant Acceleration of Sequential Residual Methods for Solving Large-Scale Nonlinear Systems of Equations, A harmonic framework for stepsize selection in gradient methods, Unnamed Item, Unnamed Item, A non-monotone linear search algorithm with mixed direction on Stiefel manifold, Gradient methods exploiting spectral properties, An adaptive nonmonotone trust-region method with curvilinear search for minimax problem, Unnamed Item, Convergence of supermemory gradient method, A new conjugate gradient algorithm with cubic Barzilai–Borwein stepsize for unconstrained optimization, 3/4-Discrete Optimal Transport, Augmented Lagrangian methods under the constant positive linear dependence constraint qualification, A NONMONOTONE FILTER BARZILAI-BORWEIN METHOD FOR OPTIMIZATION, Memory gradient method with Goldstein line search, CONVERGENCE PROPERTY AND MODIFICATIONS OF A MEMORY GRADIENT METHOD, A nonmonotone trust region method based on nonincreasing technique of weighted average of the successive function values, Estimation of Graphical Models through Structured Norm Minimization, Nonmonotone Spectral Methods for Large-Scale Nonlinear Systems, Nonmonotone projected gradient methods based on barrier and Euclidean distances, Scaled conjugate gradient algorithms for unconstrained optimization, An efficient hybrid conjugate gradient method for unconstrained optimization, Structured minimal-memory inexact quasi-Newton method and secant preconditioners for augmented Lagrangian optimization, An alternating direction method for linear‐constrained matrix nuclear norm minimization, Application of scaled nonlinear conjugate-gradient algorithms to the inverse natural convection problem, On the asymptotic behaviour of some new gradient methods, A new nonmonotone line search technique for unconstrained optimization, A projected derivative-free algorithm for nonlinear equations with convex constraints, New algorithms for singly linearly constrained quadratic programs subject to lower and upper bounds, Asymptotic behaviour of a family of gradient algorithms in \(\mathbb R^{ d }\) and Hilbert spaces, On memory gradient method with trust region for unconstrained optimization, Scaled memoryless BFGS preconditioned conjugate gradient algorithm for unconstrained optimization, A Simulated Annealing-Based Barzilai–Borwein Gradient Method for Unconstrained Optimization Problems, Spectral gradient projection method for solving nonlinear monotone equations, Barzilai–Borwein method with variable sample size for stochastic linear complementarity problems, Minimization algorithms based on supervisor and searcher cooperation, Low cost optimization techniques for solving the nonlinear seismic reflection tomography problem, On the nonmonotone line search, New line search methods for unconstrained optimization, A new nonmonotone adaptive trust region method based on simple quadratic models, Accelerated gradient descent methods with line search, On the steepest descent algorithm for quadratic functions, An efficient adaptive scaling parameter for the spectral conjugate gradient method, An alternating direction method for solving a class of inverse semi-definite quadratic programming problems, Wei–Yao–Liu conjugate gradient projection algorithm for nonlinear monotone equations with convex constraints, A new nonmonotone filter Barzilai–Borwein method for solving unconstrained optimization problems, Global convergence of conjugate gradient method, A new family of conjugate gradient methods, Spectral residual method without gradient information for solving large-scale nonlinear systems of equations, A New Nonmonotone Linesearch SQP Algorithm for Unconstrained Minimax Problem, A cubic regularization algorithm for unconstrained optimization using line search and nonmonotone techniques, Alternate step gradient method*, A new trust-region method with line search for solving symmetric nonlinear equations, On projected alternating BB methods for variational inequalities, Gradient Method for Optimization on Riemannian Manifolds with Lower Bounded Curvature, A BFGS trust-region method with a new nonmonotone technique for nonlinear equations, Spectral gradient methods for linearly constrained optimization, Convergence of descent method without line search, Descent Property and Global Convergence of a New Search Direction Method for Unconstrained Optimization, A superlinearly convergent nonmonotone quasi-Newton method for unconstrained multiobjective optimization, Simultaneous Reconstruction of Conductivity, Boundary Shape, and Contact Impedances in Electrical Impedance Tomography, Equipping the Barzilai--Borwein Method with the Two Dimensional Quadratic Termination Property, Feasible Barzilai–Borwein-like methods for extreme symmetric eigenvalue problems, A modified two-point stepsize gradient algorithm for unconstrained minimization, Accelerated multiple step-size methods for solving unconstrained optimization problems, Penalty and Augmented Lagrangian Methods for Constrained DC Programming, Extended Dai-Yuan conjugate gradient strategy for large-scale unconstrained optimization with applications to compressive sensing, A CLASS OF MODIFIED BFGS METHODS WITH FUNCTION VALUE INFORMATION FOR UNCONSTRAINED OPTIMIZATION, A new spectral conjugate gradient method for large-scale unconstrained optimization, Optimal control of viscous Burgers equation via an adaptive nonmonotone Barzilai–Borwein gradient method, Two modified spectral conjugate gradient methods and their global convergence for unconstrained optimization, A Spectral Gradient Projection Method for the Positive Semi-definite Procrustes Problem, A nonmonotone trust region method based on simple conic models for unconstrained optimization, A generalized two-point ellipsoidal anisotropic ray tracing for converted waves, A Barzilai-Borwein-like iterative half thresholding algorithm for the \(L_{1/2}\) regularized problem, Hybrid spectral gradient method for the unconstrained minimization problem, Optimization reformulations of the generalized Nash equilibrium problem using Nikaido-Isoda-type functions, On the global convergence rate of the gradient descent method for functions with Hölder continuous gradients, Partial spectral projected gradient method with active-set strategy for linearly constrained optimization, New inexact line search method for unconstrained optimization, Local analysis of a spectral correction for the Gauss-Newton model applied to quadratic residual problems, Gradient methods with adaptive step-sizes, A new adaptive Barzilai and Borwein method for unconstrained optimization, A Barzilai-Borwein conjugate gradient method, A deterministic optimization approach for solving the rainfall disaggregation problem, A globally convergent method for nonlinear least-squares problems based on the Gauss-Newton model with spectral correction, Modified spectral projected subgradient method: convergence analysis and momentum parameter heuristics, Constrained optimization with integer and continuous variables using inexact restoration and projected gradients, A convex optimization approach for solving large scale linear systems, Non-monotone algorithm for minimization on arbitrary domains with applications to large-scale orthogonal Procrustes problem, A new nonmonotone spectral residual method for nonsmooth nonlinear equations, On the worst case performance of the steepest descent algorithm for quadratic functions, Monotone projected gradient methods for large-scale box-constrained quadratic programming, A joint matrix minimization approach for multi-image face recognition, A Barzilai and Borwein scaling conjugate gradient method for unconstrained optimization problems, A spectral dai-yuan-type conjugate gradient method for unconstrained optimization, Inverse determination of a heat source from natural convection in a porous cavity, Scaling on the spectral gradient method, Two derivative-free projection approaches for systems of large-scale nonlinear monotone equations, Scaled diagonal gradient-type method with extra update for large-scale unconstrained optimization, Nonlinear conjugate gradient methods with Wolfe type line search, Spectral projected subgradient with a momentum term for the Lagrangean dual approach, Regularized quadratic penalty methods for shape from shading, The convergence of conjugate gradient method with nonmonotone line search, An extended nonmonotone line search technique for large-scale unconstrained optimization, Density-based globally convergent trust-region methods for self-consistent field electronic structure calculations, Two modified scaled nonlinear conjugate gradient methods, A simple sufficient descent method for unconstrained optimization, Nonsmooth spectral gradient methods for unconstrained optimization, Adaptive stochastic approximation algorithm, A variant spectral-type FR conjugate gradient method and its global convergence, A multivariate spectral projected gradient method for bound constrained optimization, A modified conjugate gradient algorithm with cyclic Barzilai-Borwein steplength for unconstrained optimization, An accelerated double step size model in unconstrained optimization, A Barzilai-Borwein-based heuristic algorithm for locating multiple facilities with regional demand, Estimation of optical parameters of very thin films, Implementation of an optimal first-order method for strongly convex total variation regularization, Modified active set projected spectral gradient method for bound constrained optimization, Global convergence of a spectral conjugate gradient method for unconstrained optimization, A BFGS trust-region method for nonlinear equations, Multi-step spectral gradient methods with modified weak secant relation for large scale unconstrained optimization, Hybrid optimal control problems for a class of semilinear parabolic equations, Limited memory BFGS method with backtracking for symmetric nonlinear equations, A structured diagonal Hessian approximation method with evaluation complexity analysis for nonlinear least squares, Quadratic regularization projected Barzilai-Borwein method for nonnegative matrix factorization, A new analysis on the Barzilai-Borwein gradient method, Global convergence of Schubert's method for solving sparse nonlinear equations, A limited memory BFGS method for solving large-scale symmetric nonlinear equations, A new method with sufficient descent property for unconstrained optimization, A new nonlinear filter constructed from the Newton method and EPR in image restoration, A numerical study of applying spectral-step subgradient method for solving nonsmooth unconstrained optimization problems, Flow search approach and new bounds for the \(m\)-step linear conjugate gradient algorithm, Scalar correction method for solving large scale unconstrained minimization problems, Nonmonotone Barzilai-Borwein gradient algorithm for \(\ell_1\)-regularized nonsmooth minimization in compressive sensing, Efficient projected gradient methods for cardinality constrained optimization, An efficient Barzilai-Borwein conjugate gradient method for unconstrained optimization, An efficient gradient method using the Yuan steplength, On a smooth dual gap function for a class of quasi-variational inequalities, An extension of the Fletcher-Reeves method to linear equality constrained optimization problem, A derivative-free nonmonotone line-search technique for unconstrained optimization, Spectral projected gradient methods for generalized tensor eigenvalue complementarity problems, A new generalized shrinkage conjugate gradient method for sparse recovery, FR type methods for systems of large-scale nonlinear monotone equations, On a smooth dual gap function for a class of player convex generalized Nash equilibrium problems, Solving bound constrained optimization via a new nonmonotone spectral projected gradient method, A Barzilai-Borwein type method for minimizing composite functions, Global convergence of a modified spectral FR conjugate gradient method, Spectral gradient method for impulse noise removal, A nonmonotone line search method for noisy minimization, Multivariate spectral gradient method for unconstrained optimization, A quasi-Newton algorithm for large-scale nonlinear equations, Global convergence of the nonmonotone MBFGS method for nonconvex unconstrained minimization, A computation study on an integrated alternating direction method of multipliers for large scale optimization, An efficient gradient method with approximate optimal stepsize for large-scale unconstrained optimization, Acceleration of the EM algorithm via extrapolation methods: review, comparison and new methods, A hybrid ODE-based method for unconstrained optimization problems, Modified nonmonotone Armijo line search for descent method, Applying powell's symmetrical technique to conjugate gradient methods, A box constrained gradient projection algorithm for compressed sensing, A feasible method for optimization with orthogonality constraints, Convergence properties of nonmonotone spectral projected gradient methods, Residual methods for the large-scale matrix \(p\)th root and some related problems, A limited memory steepest descent method, Notes on the Dai-Yuan-Yuan modified spectral gradient method, A nonmonotone supermemory gradient algorithm for unconstrained optimization, An affine-scaling interior-point CBB method for box-constrained optimization, A framework of constraint preserving update schemes for optimization on Stiefel manifold, Subspace Barzilai-Borwein gradient method for large-scale bound constrained optimization, A globally convergent BFGS method with nonmonotone line search for non-convex minimization, A descent algorithm without line search for unconstrained optimization, Estimation of the optimal constants and the thickness of thin films using unconstrained optimization, Convergence of descent method with new line search, Computing the Action Ground State for the Rotating Nonlinear Schrödinger Equation, A homogeneous Rayleigh quotient with applications in gradient methods, An efficient modified residual-based algorithm for large scale symmetric nonlinear equations by approximating successive iterated gradients, A machine‐learning based ConvLSTM architecture for NDVI forecasting, A structured Fletcher-Revees spectral conjugate gradient method for unconstrained optimization with application in robotic model, Optimal Control for a Class of Infinite Dimensional Systems Involving an ‐term in the Cost Functional, Optimal polynomial feedback laws for finite horizon control problems, Inexact free derivative quasi-Newton method for large-scale nonlinear system of equations, Structured adaptive spectral-based algorithms for nonlinear least squares problems with robotic arm modelling applications, Relaxation approach for learning neural network regularizers for a class of identification problems, Nonmonotone feasible arc search algorithm for minimization on Stiefel manifold, New spectral LS conjugate gradient method for nonlinear unconstrained optimization, A gradient method exploiting the two dimensional quadratic termination property, Solving graph equipartition SDPs on an algebraic variety, Linear convergence rate analysis of a class of exact first-order distributed methods for weight-balanced time-varying networks and uncoordinated step sizes, Sensitivity analysis and tailored design of minimization diagrams, Solving nonlinear equations with a direct Broyden method and its acceleration, A hybrid BB-type method for solving large scale unconstrained optimization, Convergence of a Class of Nonmonotone Descent Methods for Kurdyka–Łojasiewicz Optimization Problems, A collection of efficient retractions for the symplectic Stiefel manifold, Proximal gradient/semismooth Newton methods for projection onto a polyhedron via the duality-gap-active-set strategy, An overview of nonlinear optimization, A convergence analysis of hybrid gradient projection algorithm for constrained nonlinear equations with applications in compressed sensing, A nonmonotonic hybrid algorithm for min-max problem, A new simple model trust-region method with generalized Barzilai-Borwein parameter for large-scale optimization, Stable equilibrium configuration of two bar truss by an efficient nonmonotone global Barzilai-Borwein gradient method in a fuzzy environment, A regularized limited memory BFGS method for large-scale unconstrained optimization and its efficient implementations, Novel algorithms for noisy minimization problems with applications to neural networks training, Smoothing projected Barzilai-Borwein method for constrained non-Lipschitz optimization, On initial point selection of the steepest descent algorithm for general quadratic functions, An extended projected residual algorithm for solving smooth convex optimization problems, LMBOPT: a limited memory method for bound-constrained optimization, Nonmonotone derivative-free methods for nonlinear equations, Implicit and adaptive inverse preconditioned gradient methods for nonlinear problems, Optimal scaling parameters for spectral conjugate gradient methods, Constructing fair curves and surfaces with a Sobolev gradient method, An extended delayed weighted gradient algorithm for solving strongly convex optimization problems, Steepest descent method with random step lengths, Global convergence of a nonmonotone Broyden family method for nonconvex unconstrained minimization, A modified nonmonotone BFGS algorithm for unconstrained optimization, Runge-Kutta-like scaling techniques for first-order methods in convex optimization, Hybrid nonmonotone spectral gradient method for the unconstrained minimization problem, Nonmonotone spectral gradient method based on memoryless symmetric rank-one update for large-scale unconstrained optimization, Several efficient gradient methods with approximate optimal stepsizes for large scale unconstrained optimization, A note on the spectral gradient projection method for nonlinear monotone equations with applications, Subsampled nonmonotone spectral gradient methods, A new subspace minimization conjugate gradient method with nonmonotone line search for unconstrained optimization, A descent Dai-Liao conjugate gradient method for nonlinear equations, The Uzawa-MBB type algorithm for nonsymmetric saddle point problems, Structured two-point stepsize gradient methods for nonlinear least squares, An efficient gradient method with approximately optimal stepsize based on tensor model for unconstrained optimization, Gradient method with multiple damping for large-scale unconstrained optimization, Non-monotone inexact restoration method for nonlinear programming, On the steplength selection in gradient methods for unconstrained optimization, A dynamical Tikhonov regularization for solving ill-posed linear algebraic systems, Monotone and nonmonotone trust-region-based algorithms for large scale unconstrained optimization problems, A spectral conjugate gradient method for solving large-scale unconstrained optimization, A family of modified spectral projection methods for nonlinear monotone equations with convex constraint, A survey of gradient methods for solving nonlinear optimization, New stepsizes for the gradient method, A relaxed interior point method for low-rank semidefinite programming problems with applications to matrix completion, A second-order gradient method for convex minimization, An effective first order reliability method based on Barzilai-Borwein step, A derivative-free conjugate gradient method and its global convergence for solving symmetric nonlinear equations, Projected nonmonotone search methods for optimization with orthogonality constraints, A nonmonotone trust region method based on simple quadratic models, A new spectral method for \(l_1\)-regularized minimization, Nonlocal problem for a general second-order elliptic operator, Alternating direction multiplier method for matrix \(l_{2,1}\)-norm optimization in multitask feature learning problems, Steplength selection in gradient projection methods for box-constrained quadratic programs, Nonmonotone adaptive trust region method with line search based on new diagonal updating, Augmented Lagrangian algorithms based on the spectral projected gradient method for solving nonlinear programming problems, Projected Barzilai-Borwein methods for large-scale box-constrained quadratic programming, Accelerated scaled memoryless BFGS preconditioned conjugate gradient algorithm for unconstrained optimization, Spectral gradient projection method for monotone nonlinear equations with convex constraints, Analysis of continuous \(H^{-1}\)-least-squares methods for the steady Navier-Stokes system, An efficient nonmonotone adaptive cubic regularization method with line search for unconstrained optimization problem, A new nonmonotone trust region Barzilai-Borwein method for unconstrained optimization problems, A family of Hager-Zhang conjugate gradient methods for system of monotone nonlinear equations, A structured quasi-Newton algorithm with nonmonotone search strategy for structured NLS problems and its application in robotic motion control, Exact spectral-like gradient method for distributed optimization, On efficiency of nonmonotone Armijo-type line searches, Limited memory technique using trust regions for nonlinear equations, Two adaptive scaled gradient projection methods for Stiefel manifold constrained optimization, Scaled three-term derivative-free methods for solving large-scale nonlinear monotone equations, A spectral three-term Hestenes-Stiefel conjugate gradient method, On the global convergence of a new spectral residual algorithm for nonlinear systems of equations, Dirichlet problem for a nonlocal \(p\)-Laplacian elliptic equation, Dynamic search trajectory methods for global optimization, On sparse beamformer design with reverberation, A global Newton method for the nonsmooth vector fields on Riemannian manifolds, Prediction-correction matrix splitting iteration algorithm for a class of large and sparse linear systems, A unified convergence framework for nonmonotone inexact decomposition methods, A residual-based algorithm for solving a class of structured nonsmooth optimization problems, Spectral residual method for nonlinear equations on Riemannian manifolds, A new descent spectral Polak-Ribière-Polyak method based on the memoryless BFGS update, On the asymptotic convergence and acceleration of gradient methods, Solving nonlinear systems of equations via spectral residual methods: stepsize selection and applications, A tensor trust-region model for nonlinear system, Iterative reconstruction algorithms for solving the Schrödinger equations on conical spaces, A Schrödinger-type algorithm for solving the Schrödinger equations via Phragmén-Lindelöf inequalities, On \(R\)-linear convergence analysis for a class of gradient methods, A modified spectral conjugate gradient method with global convergence, A subspace minimization conjugate gradient method based on conic model for unconstrained optimization, Accelerated augmented Lagrangian method for total variation minimization, A family of spectral gradient methods for optimization, Scaled nonlinear conjugate gradient methods for nonlinear least squares problems, Convergence analysis of a nonmonotone projected gradient method for multiobjective optimization problems, Regularized graph cuts based discrete tomography reconstruction methods, A genetic algorithm with a self-reproduction operator to solve systems of nonlinear equations, Optimal control problem for viscous systems of conservation laws, with geometric parameter, and application to the shallow-water equations, Nonmonotone line search methods with variable sample size, A class of line search-type methods for nonsmooth convex regularized minimization, Design of the monodomain model by artificial neural networks, A three-terms Polak-Ribière-Polyak conjugate gradient algorithm for large-scale nonlinear equations, A flexible inexact-restoration method for constrained optimization, Structured spectral algorithm with a nonmonotone line search for nonlinear least squares, Solvability for boundary value problem of the general Schrödinger equation with general superlinear nonlinearity, On the acceleration of the Barzilai-Borwein method, Diagonal BFGS updates and applications to the limited memory BFGS method, Structured diagonal Gauss-Newton method for nonlinear least squares, Minimization subproblems and heuristics for an applied clustering problem, Convergence analysis for the modified spectral projected subgradient method


Uses Software