Smoothness and Adaptivity in Nonlinear Optimization for Machine Learning Applications

Nonlinear optimization has become the workhorse of machine learning. However, our theoretical understanding of optimization in machine learning is still limited. For example, classical optimization theory relies on assumptions like bounded Lipschitz smoothness of the loss function which are rarely m...

Full description

Bibliographic Details
Main Author: Li, Haochuan
Other Authors: Jadbabaie, Ali
Format: Thesis
Published: Massachusetts Institute of Technology 2024
Online Access:https://hdl.handle.net/1721.1/156294