Training neural networks for and by interpolation

Training neural networks for and by interpolation

In modern supervised learning, many deep neural networks are able to interpolate the data: the empirical loss can be driven to near zero on all samples simultaneously. In this work, we explicitly exploit this interpolation property for the design of a new optimization algorithm for deep learning, wh...

Disgrifiad llawn

Manylion Llyfryddiaeth
Prif Awduron:	Berrada, L, Zisserman, A, Kumar, MP
Fformat:	Conference item
Iaith:	English
Cyhoeddwyd:	Journal of Machine Learning Research 2020

Eitemau Tebyg

Deep Frank-Wolfe for neural network optimization
gan: Berrada, L, et al.
Cyhoeddwyd: (2018)

Deep Frank-Wolfe for neural network optimization
gan: Berrada, L, et al.
Cyhoeddwyd: (2019)

Smooth loss functions for deep top-k classification
gan: Berrada, L, et al.
Cyhoeddwyd: (2018)

Smooth loss functions for deep top-k classification
gan: Berrada, L, et al.
Cyhoeddwyd: (2018)

Trusting SVM for piecewise linear CNNs
gan: Berrada, L, et al.
Cyhoeddwyd: (2016)

Trusting SVM for piecewise linear CNNs
gan: Berrada, L, et al.
Cyhoeddwyd: (2017)

Kilonova light-curve interpolation with neural networks
gan: Yinglei Peng, et al.
Cyhoeddwyd: (2024-07-01)

An Importance Sampling Method for Generating Optimal Interpolation Points in Training Physics-Informed Neural Networks
gan: Hui Li, et al.
Cyhoeddwyd: (2025-01-01)

Image Interpolation Based on Spiking Neural Network Model
gan: Mürsel Ozan İncetaş
Cyhoeddwyd: (2023-02-01)

Discrete Orthogonal Transforms and Neural Networks for Image Interpolation
gan: J. Polec, et al.
Cyhoeddwyd: (1999-09-01)

Interpolating convolutional neural networks using batch normalization
gan: Data, G, et al.
Cyhoeddwyd: (2018)

Interpolation for Neural Network Operators Activated by Smooth Ramp Functions
gan: Fesal Baxhaku, et al.
Cyhoeddwyd: (2024-07-01)

Pontryagin Neural Networks with Functional Interpolation for Optimal Intercept Problems
gan: Andrea D’Ambrosio, et al.
Cyhoeddwyd: (2021-04-01)

Artificial Neural Network (ANN) Based Empirical Interpolation of Precipitation
gan: Rajesh Joshi
Cyhoeddwyd: (2016-12-01)

On the choice of interpolation scheme for neural CDEs
gan: Morrill, J, et al.
Cyhoeddwyd: (2022)

Treatment of outliers via interpolation method with neural network forecast performances
gan: Wahir, N. A., et al.
Cyhoeddwyd: (2017)

Comparison of DEM Super-Resolution Methods Based on Interpolation and Neural Networks
gan: Yifan Zhang, et al.
Cyhoeddwyd: (2022-01-01)

Application of two-component neural network for exchange-correlation functional interpolation
gan: Alexander Ryabov, et al.
Cyhoeddwyd: (2022-08-01)

Sparse self-attention aggregation networks for neural sequence slice interpolation
gan: Zejin Wang, et al.
Cyhoeddwyd: (2021-02-01)

Fractional Voronovskaya type asymptotic expansions for quasi-interpolation neural network operators
gan: George A Anastassiou
Cyhoeddwyd: (2012-10-01)

Interpolative Boolean Networks
gan: Vladimir Dobrić, et al.
Cyhoeddwyd: (2017-01-01)

Interpolation for neural-network operators activated with a generalized logistic-type function
gan: Hande Uyan, et al.
Cyhoeddwyd: (2024-09-01)

Recurrent Neural Network-Based Approach for Sparse Geomagnetic Data Interpolation and Reconstruction
gan: Huan Liu, et al.
Cyhoeddwyd: (2019-01-01)

Medical Image Interpolation Using Recurrent Type-2 Fuzzy Neural Network
gan: Jafar Tavoosi, et al.
Cyhoeddwyd: (2021-09-01)

Interpolation : cubic spline interpolation and hermite interpolation /
gan: 495552 Gan, Loon Keat, et al.
Cyhoeddwyd: (2004)

Alternative method: outlier treatments with box-jenkins and neural network via interpolation method
gan: Wahir, Norsoraya Azurin, et al.
Cyhoeddwyd: (2018)

Alternative method outlier treatments with Box-Jenkins and neural network via interpolation method
gan: Wahir, Norsoraya Azurin, et al.
Cyhoeddwyd: (2018)

Balancing Wigner sampling and geometry interpolation for deep neural networks learning photochemical reactions
gan: Li Wang, et al.
Cyhoeddwyd: (2023-12-01)

Physics-Informed Neural Networks and Functional Interpolation for Solving the Matrix Differential Riccati Equation
gan: Kristofer Drozd, et al.
Cyhoeddwyd: (2023-08-01)

A generalized spatial autoregressive neural network method for three-dimensional spatial interpolation
gan: J. Zhan, et al.
Cyhoeddwyd: (2023-05-01)

NEURAL NETWORK INTERPOLATION PARAMETERS OF A MULTI-MODE DYNAMIC MODEL OF THE AIRCRAFT ENGINE
gan: Aleksandr Tamargazin, et al.
Cyhoeddwyd: (2020-08-01)

EXPLORING THE ROLE OF GENETIC ALGORITHMS AND ARTIFICIAL NEURAL NETWORKS FOR INTERPOLATION OF ELEVATION IN GEOINFORMATION MODELS
gan: H. Bagheri, et al.
Cyhoeddwyd: (2013-09-01)

Spatial Interpolation of Rainfall Erosivity Using Artificial Neural Networks for Southern Brazil Conditions
gan: Michel Castro Moreira, et al.

Surface Roughness Prediction Using Circular Interpolation Based on Artificial Neural Network in Milling Operation
gan: Maan Aabid Tawfiq, et al.
Cyhoeddwyd: (2016-05-01)

Neural Hierarchical Interpolation for Standardized Precipitation Index Forecasting
gan: Rafael Magallanes-Quintanar, et al.
Cyhoeddwyd: (2024-07-01)

Video frame interpolation neural network for 3D tomography across different length scales
gan: Laura Gambini, et al.
Cyhoeddwyd: (2024-09-01)

Recording of Full-Color Snapshot Digital Holographic Portraits Using Neural Network Image Interpolation
gan: Philippe Gentet, et al.
Cyhoeddwyd: (2023-11-01)

Deep image retrieval using artificial neural network interpolation and indexing based on similarity measurement
gan: Faiyaz Ahmad
Cyhoeddwyd: (2022-06-01)

Enlarging smaller images before inputting into convolutional neural network: zero-padding vs. interpolation
gan: Mahdi Hashemi
Cyhoeddwyd: (2019-11-01)

Analysis and Application of Wind Speed Interpolation in Wind Farm Based on BP Neural Network Method
gan: ZHENG Kan, et al.
Cyhoeddwyd: (2021-03-01)