Media Summary: Proof of Lagrange multiplier theorem using the penalty approach. Mirror descent algorithm, Proximal gradient algorithm. Second derivative of the function, Mean value theorem, Taylor series expansion, matrices, eigenvalues, symmetric matrices, ...
Ece 5759 Nonlinear Programming Lec 15 - Detailed Analysis & Overview
Proof of Lagrange multiplier theorem using the penalty approach. Mirror descent algorithm, Proximal gradient algorithm. Second derivative of the function, Mean value theorem, Taylor series expansion, matrices, eigenvalues, symmetric matrices, ... Application of contraction mapping principle to establish convergence of Lagrangian methods. Gauss-Newton's method and Conjugate direction method. Convexity of dual problem, geometric interpretation of weak duality theorem, dual of
Lagrange multiplier theorem and its proof using the penalty approach. A Lagrangian method coupled with the method of multipliers. Convergence proof using Banach contraction mapping theorem.