Media Summary: Nesterov's accelerated gradient method and Polyak heavy ball method. Two metric projection method, manifold suboptimization method. Projections on some simple sets, Frank Wolfe method, Gradient projection method.
Ece 5759 Nonlinear Programming Lec 10 - Detailed Analysis & Overview
Nesterov's accelerated gradient method and Polyak heavy ball method. Two metric projection method, manifold suboptimization method. Projections on some simple sets, Frank Wolfe method, Gradient projection method. Gradient projection method, Constrained Newton's method. A Lagrangian method coupled with the method of multipliers. Convergence proof using Banach contraction mapping theorem. ... go over assignments we can go over any problem you may have within this class the course text is
Convexity of dual problem, geometric interpretation of weak duality theorem, dual of Manifold suboptimization method, Simplex method. Manifold suboptimization method and its relationship to simplex method for Banach contraction mapping theorem and its application to Second derivative of the function, Mean value theorem, Taylor series expansion, matrices, eigenvalues, symmetric matrices, ...
