Deep Frank-Wolfe for neural network optimization
Learning a deep neural network requires solving a challenging optimization problem: it is a high-dimensional, non-convex and non-smooth minimization problem with a large number of terms. The current practice in neural network optimization is to rely on the stochastic gradient descent (SGD) algorithm...
Egile Nagusiak: | Berrada, L, Zisserman, A, Kumar, MP |
---|---|
Formatua: | Internet publication |
Hizkuntza: | English |
Argitaratua: |
arXiv
2018
|
Antzeko izenburuak
-
Deep Frank-Wolfe for neural network optimization
nork: Berrada, L, et al.
Argitaratua: (2019) -
Training neural networks for and by interpolation
nork: Berrada, L, et al.
Argitaratua: (2020) -
Riemannian Optimization via Frank-Wolfe Methods
nork: Weber, Melanie, et al.
Argitaratua: (2022) -
Riemannian optimization via Frank-Wolfe methods
nork: Weber, M, et al.
Argitaratua: (2022) -
New analysis and results for the Frank–Wolfe method
nork: Freund, Robert Michael, et al.
Argitaratua: (2016)