Training neural networks for and by interpolation

Training neural networks for and by interpolation

In modern supervised learning, many deep neural networks are able to interpolate the data: the empirical loss can be driven to near zero on all samples simultaneously. In this work, we explicitly exploit this interpolation property for the design of a new optimization algorithm for deep learning, wh...

Descripció completa

Dades bibliogràfiques
Autors principals:	Berrada, L, Zisserman, A, Kumar, MP
Format:	Conference item
Idioma:	English
Publicat:	Journal of Machine Learning Research 2020

Ítems similars

Deep Frank-Wolfe for neural network optimization
per: Berrada, L, et al.
Publicat: (2018)

Deep Frank-Wolfe for neural network optimization
per: Berrada, L, et al.
Publicat: (2019)

Smooth loss functions for deep top-k classification
per: Berrada, L, et al.
Publicat: (2018)

Smooth loss functions for deep top-k classification
per: Berrada, L, et al.
Publicat: (2018)

Trusting SVM for piecewise linear CNNs
per: Berrada, L, et al.
Publicat: (2016)

Trusting SVM for piecewise linear CNNs
per: Berrada, L, et al.
Publicat: (2017)

Kilonova light-curve interpolation with neural networks
per: Yinglei Peng, et al.
Publicat: (2024-07-01)

An Importance Sampling Method for Generating Optimal Interpolation Points in Training Physics-Informed Neural Networks
per: Hui Li, et al.
Publicat: (2025-01-01)

Image Interpolation Based on Spiking Neural Network Model
per: Mürsel Ozan İncetaş
Publicat: (2023-02-01)

Discrete Orthogonal Transforms and Neural Networks for Image Interpolation
per: J. Polec, et al.
Publicat: (1999-09-01)

Interpolating convolutional neural networks using batch normalization
per: Data, G, et al.
Publicat: (2018)

Interpolation for Neural Network Operators Activated by Smooth Ramp Functions
per: Fesal Baxhaku, et al.
Publicat: (2024-07-01)

Pontryagin Neural Networks with Functional Interpolation for Optimal Intercept Problems
per: Andrea D’Ambrosio, et al.
Publicat: (2021-04-01)

Artificial Neural Network (ANN) Based Empirical Interpolation of Precipitation
per: Rajesh Joshi
Publicat: (2016-12-01)

On the choice of interpolation scheme for neural CDEs
per: Morrill, J, et al.
Publicat: (2022)

Treatment of outliers via interpolation method with neural network forecast performances
per: Wahir, N. A., et al.
Publicat: (2017)

Comparison of DEM Super-Resolution Methods Based on Interpolation and Neural Networks
per: Yifan Zhang, et al.
Publicat: (2022-01-01)

Application of two-component neural network for exchange-correlation functional interpolation
per: Alexander Ryabov, et al.
Publicat: (2022-08-01)

Sparse self-attention aggregation networks for neural sequence slice interpolation
per: Zejin Wang, et al.
Publicat: (2021-02-01)

Fractional Voronovskaya type asymptotic expansions for quasi-interpolation neural network operators
per: George A Anastassiou
Publicat: (2012-10-01)

Interpolative Boolean Networks
per: Vladimir Dobrić, et al.
Publicat: (2017-01-01)

Interpolation for neural-network operators activated with a generalized logistic-type function
per: Hande Uyan, et al.
Publicat: (2024-09-01)

Recurrent Neural Network-Based Approach for Sparse Geomagnetic Data Interpolation and Reconstruction
per: Huan Liu, et al.
Publicat: (2019-01-01)

Interpolation : cubic spline interpolation and hermite interpolation /
per: 495552 Gan, Loon Keat, et al.
Publicat: (2004)

Surface Roughness Prediction Using Circular Interpolation Based on Artificial Neural Network in Milling Operation
per: Maan Aabid Tawfiq, et al.
Publicat: (2016-05-01)

Alternative method: outlier treatments with box-jenkins and neural network via interpolation method
per: Wahir, Norsoraya Azurin, et al.
Publicat: (2018)

Alternative method outlier treatments with Box-Jenkins and neural network via interpolation method
per: Wahir, Norsoraya Azurin, et al.
Publicat: (2018)

Balancing Wigner sampling and geometry interpolation for deep neural networks learning photochemical reactions
per: Li Wang, et al.
Publicat: (2023-12-01)

Physics-Informed Neural Networks and Functional Interpolation for Solving the Matrix Differential Riccati Equation
per: Kristofer Drozd, et al.
Publicat: (2023-08-01)

A generalized spatial autoregressive neural network method for three-dimensional spatial interpolation
per: J. Zhan, et al.
Publicat: (2023-05-01)

NEURAL NETWORK INTERPOLATION PARAMETERS OF A MULTI-MODE DYNAMIC MODEL OF THE AIRCRAFT ENGINE
per: Aleksandr Tamargazin, et al.
Publicat: (2020-08-01)

EXPLORING THE ROLE OF GENETIC ALGORITHMS AND ARTIFICIAL NEURAL NETWORKS FOR INTERPOLATION OF ELEVATION IN GEOINFORMATION MODELS
per: H. Bagheri, et al.
Publicat: (2013-09-01)

Spatial Interpolation of Rainfall Erosivity Using Artificial Neural Networks for Southern Brazil Conditions
per: Michel Castro Moreira, et al.

Neural Hierarchical Interpolation for Standardized Precipitation Index Forecasting
per: Rafael Magallanes-Quintanar, et al.
Publicat: (2024-07-01)

Video frame interpolation neural network for 3D tomography across different length scales
per: Laura Gambini, et al.
Publicat: (2024-09-01)

Recording of Full-Color Snapshot Digital Holographic Portraits Using Neural Network Image Interpolation
per: Philippe Gentet, et al.
Publicat: (2023-11-01)

Deep image retrieval using artificial neural network interpolation and indexing based on similarity measurement
per: Faiyaz Ahmad
Publicat: (2022-06-01)

Enlarging smaller images before inputting into convolutional neural network: zero-padding vs. interpolation
per: Mahdi Hashemi
Publicat: (2019-11-01)

Interpolation of natural cubic spline
per: Arun Kumar, et al.
Publicat: (1992-01-01)

Interpolative relations and interpolative preference structures
per: Radojević Dragan
Publicat: (2005-01-01)