Computational Optimization

Basics

QR Factorization

Regularization

Gradients

Nonlinear Least-Squares

Gradient Descent

Descent Methods

Scaled Descent

Cholesky Factorization

Linear Constraints

Convex Set

Convex Functions

Global Optimal of Convex Optimization

Optimality for Convex Optimization

Projection Onto Convex Sets

Stochastic Gradient Descent (SGD)