Deep Frank-Wolfe for neural network optimization

Deep Frank-Wolfe for neural network optimization

Show other versions (1)

Learning a deep neural network requires solving a challenging optimization problem: it is a high-dimensional, non-convex and non-smooth minimization problem with a large number of terms. The current practice in neural network optimization is to rely on the stochastic gradient descent (SGD) algorithm...

Disgrifiad llawn

Manylion Llyfryddiaeth
Prif Awduron:	Berrada, L, Zisserman, A, Kumar, MP
Fformat:	Internet publication
Iaith:	English
Cyhoeddwyd:	arXiv 2018

Eitemau Tebyg

Deep Frank-Wolfe for neural network optimization
gan: Berrada, L, et al.
Cyhoeddwyd: (2019)

Training neural networks for and by interpolation
gan: Berrada, L, et al.
Cyhoeddwyd: (2020)

Riemannian Optimization via Frank-Wolfe Methods
gan: Weber, Melanie, et al.
Cyhoeddwyd: (2022)

Riemannian optimization via Frank-Wolfe methods
gan: Weber, M, et al.
Cyhoeddwyd: (2022)

New analysis and results for the Frank–Wolfe method
gan: Freund, Robert Michael, et al.
Cyhoeddwyd: (2016)

Smooth loss functions for deep top-k classification
gan: Berrada, L, et al.
Cyhoeddwyd: (2018)

Smooth loss functions for deep top-k classification
gan: Berrada, L, et al.
Cyhoeddwyd: (2018)

Investigating Frank-Wolfe-based demand forecasting methods
gan: Soh, Chloe Sze Yee
Cyhoeddwyd: (2024)

Generalized stochastic Frank–Wolfe algorithm with stochastic “substitute” gradient for structured convex optimization
gan: Lu, Haihao, et al.
Cyhoeddwyd: (2021)

A generalized Frank–Wolfe method with “dual averaging” for strongly convex composite optimization
gan: Zhao, Renbo, et al.
Cyhoeddwyd: (2022)

Analysis of the Frank–Wolfe method for convex composite optimization involving a logarithmically-homogeneous barrier
gan: Zhao, Renbo, et al.
Cyhoeddwyd: (2022)

Short Paper - A note on the Frank–Wolfe algorithm for a class of nonconvex and nonsmooth optimization problems
gan: de Oliveira, Welington
Cyhoeddwyd: (2023-01-01)

Improved Deep Neural Network for OFDM Signal Recognition Using Hybrid Grey Wolf Optimization
gan: Yan Zhang, et al.
Cyhoeddwyd: (2020-01-01)

Improved local models and new Bell inequalities via Frank-Wolfe algorithms
gan: Sébastien Designolle, et al.
Cyhoeddwyd: (2023-10-01)

Trusting SVM for piecewise linear CNNs
gan: Berrada, L, et al.
Cyhoeddwyd: (2016)

Trusting SVM for piecewise linear CNNs
gan: Berrada, L, et al.
Cyhoeddwyd: (2017)

An Improved Grey Wolf Optimization-based Learning of Artificial Neural Network for Medical Data Classification
gan: Kumar, Narender, et al.
Cyhoeddwyd: (2021)

AN IMPROVED GREY WOLF OPTIMIZATION-BASED LEARNING OF ARTIFICIAL NEURAL NETWORK FOR MEDICAL DATA CLASSIFICATION
gan: Narender Kumar, et al.
Cyhoeddwyd: (2021-02-01)

An ensemble of neural network and modified grey wolf optimizer for stock prediction
gan: Das, Debashish
Cyhoeddwyd: (2019)

An Extended Frank--Wolfe Method with “In-Face” Directions, and Its Application to Low-Rank Matrix Completion
gan: Grigas, Paul, et al.
Cyhoeddwyd: (2018)

Customer Churn Modeling via the Grey Wolf Optimizer and Ensemble Neural Networks
gan: Maryam Rahmaty, et al.
Cyhoeddwyd: (2022-01-01)

A Frank–Wolfe Progressive Hedging Algorithm for Improved Lower Bounds in Stochastic SCUC
gan: Ananth M. Palani, et al.
Cyhoeddwyd: (2019-01-01)

A multi hidden recurrent neural network with a modified grey wolf optimizer.
gan: Tarik A Rashid, et al.
Cyhoeddwyd: (2019-01-01)

Trained neural networking framework based skin cancer diagnosis and categorization using grey wolf optimization
gan: Amit Kumar K., et al.
Cyhoeddwyd: (2024-04-01)

Estimates of Energy Consumption Using Neural Networks with the Grey Wolf Optimizer Algorithm for Turkey
gan: Ergun UZLU
Cyhoeddwyd: (2019-06-01)

Control Application of Wolf Group Optimization Convolutional Neural Network in Ship Virtual Manufacturing
gan: XIAO Shi-long, WU Di, TANG Chao-chen, SHEN Xian-hao, ZHANG De-yu
Cyhoeddwyd: (2021-10-01)

Grey Wolf Optimization-based Neural Network for Deaf and Mute Sign Language Recognition: Survey
gan: Hussein Zahraa A., et al.
Cyhoeddwyd: (2024-01-01)

Leveraging structure for optimization in deep learning
gan: Berrada, L
Cyhoeddwyd: (2019)

Learner Emotional Value Recognition Technology: An Artificial Neural Network Optimized by the Grey Wolf Algorithm
gan: Qi Chen
Cyhoeddwyd: (2023-01-01)

Transformer Fault Diagnosis Model Based on Improved Gray Wolf Optimizer and Probabilistic Neural Network
gan: Yichen Zhou, et al.
Cyhoeddwyd: (2021-05-01)

Electrical Impedance Tomography Based on Grey Wolf Optimized Radial Basis Function Neural Network
gan: Guanghua Wang, et al.
Cyhoeddwyd: (2022-07-01)

Fault Detection in HVDC System with Gray Wolf Optimization Algorithm Based on Artificial Neural Network
gan: Raad Salih Jawad, et al.
Cyhoeddwyd: (2022-10-01)

Deepwater Oil-Based Drilling Fluid Systembased on Grey Wolf Optimized BP neural network
gan: Sui Dianjie, et al.
Cyhoeddwyd: (2022-01-01)

An artificial neural network optimized by grey wolf optimizer for prediction of hourly wind speed in Tamil Nadu, India
gan: Ahmet Cevahir Cinar, et al.
Cyhoeddwyd: (2022-11-01)

An optimized model based on adaptive convolutional neural network and grey wolf algorithm for breast cancer diagnosis.
gan: Khaled Alnowaiser, et al.
Cyhoeddwyd: (2024-01-01)

Hybrid Whale and Gray Wolf Deep Learning Optimization Algorithm for Prediction of Alzheimer’s Disease
gan: Chitradevi Dhakhinamoorthy, et al.
Cyhoeddwyd: (2023-02-01)

Optimizing Cardiovascular Disease Prediction: A Synergistic Approach of Grey Wolf Levenberg Model and Neural Networks
gan: Sheikh Amir Fayaz Fayaz, et al.
Cyhoeddwyd: (2023-11-01)

Short-Term Solar Power Forecasting via General Regression Neural Network with Grey Wolf Optimization
gan: Chia-Sheng Tu, et al.
Cyhoeddwyd: (2022-09-01)

Identifikasi Ekspresi Wajah Manusia Menggunakan Algoritma Grey Wolf Optimizer dan Convolutional Neural Network
gan: Ni’matur Rohim, et al.
Cyhoeddwyd: (2024-04-01)

PID Control Model Based on Back Propagation Neural Network Optimized by Adversarial Learning-Based Grey Wolf Optimization
gan: Huaiqin Liu, et al.
Cyhoeddwyd: (2023-04-01)