Deep Frank-Wolfe for neural network optimization
Learning a deep neural network requires solving a challenging optimization problem: it is a high-dimensional, non-convex and non-smooth minimization problem with a large number of terms. The current practice in neural network optimization is to rely on the stochastic gradient descent (SGD) algorithm...
Príomhchruthaitheoirí: | Berrada, L, Zisserman, A, Kumar, MP |
---|---|
Formáid: | Internet publication |
Teanga: | English |
Foilsithe / Cruthaithe: |
arXiv
2018
|
Míreanna comhchosúla
Míreanna comhchosúla
-
Deep Frank-Wolfe for neural network optimization
de réir: Berrada, L, et al.
Foilsithe / Cruthaithe: (2019) -
Training neural networks for and by interpolation
de réir: Berrada, L, et al.
Foilsithe / Cruthaithe: (2020) -
Riemannian Optimization via Frank-Wolfe Methods
de réir: Weber, Melanie, et al.
Foilsithe / Cruthaithe: (2022) -
Riemannian optimization via Frank-Wolfe methods
de réir: Weber, M, et al.
Foilsithe / Cruthaithe: (2022) -
New analysis and results for the Frank–Wolfe method
de réir: Freund, Robert Michael, et al.
Foilsithe / Cruthaithe: (2016)