Training neural networks for and by interpolation

Training neural networks for and by interpolation

In modern supervised learning, many deep neural networks are able to interpolate the data: the empirical loss can be driven to near zero on all samples simultaneously. In this work, we explicitly exploit this interpolation property for the design of a new optimization algorithm for deep learning, wh...

Mô tả đầy đủ

Chi tiết về thư mục
Những tác giả chính:	Berrada, L, Zisserman, A, Kumar, MP
Định dạng:	Conference item
Ngôn ngữ:	English
Được phát hành:	Journal of Machine Learning Research 2020

Những quyển sách tương tự

Deep Frank-Wolfe for neural network optimization
Bằng: Berrada, L, et al.
Được phát hành: (2018)

Deep Frank-Wolfe for neural network optimization
Bằng: Berrada, L, et al.
Được phát hành: (2019)

Smooth loss functions for deep top-k classification
Bằng: Berrada, L, et al.
Được phát hành: (2018)

Smooth loss functions for deep top-k classification
Bằng: Berrada, L, et al.
Được phát hành: (2018)

Trusting SVM for piecewise linear CNNs
Bằng: Berrada, L, et al.
Được phát hành: (2016)

Trusting SVM for piecewise linear CNNs
Bằng: Berrada, L, et al.
Được phát hành: (2017)

Kilonova light-curve interpolation with neural networks
Bằng: Yinglei Peng, et al.
Được phát hành: (2024-07-01)

An Importance Sampling Method for Generating Optimal Interpolation Points in Training Physics-Informed Neural Networks
Bằng: Hui Li, et al.
Được phát hành: (2025-01-01)

Image Interpolation Based on Spiking Neural Network Model
Bằng: Mürsel Ozan İncetaş
Được phát hành: (2023-02-01)

Discrete Orthogonal Transforms and Neural Networks for Image Interpolation
Bằng: J. Polec, et al.
Được phát hành: (1999-09-01)

Interpolating convolutional neural networks using batch normalization
Bằng: Data, G, et al.
Được phát hành: (2018)

Interpolation for Neural Network Operators Activated by Smooth Ramp Functions
Bằng: Fesal Baxhaku, et al.
Được phát hành: (2024-07-01)

Pontryagin Neural Networks with Functional Interpolation for Optimal Intercept Problems
Bằng: Andrea D’Ambrosio, et al.
Được phát hành: (2021-04-01)

Artificial Neural Network (ANN) Based Empirical Interpolation of Precipitation
Bằng: Rajesh Joshi
Được phát hành: (2016-12-01)

On the choice of interpolation scheme for neural CDEs
Bằng: Morrill, J, et al.
Được phát hành: (2022)

Treatment of outliers via interpolation method with neural network forecast performances
Bằng: Wahir, N. A., et al.
Được phát hành: (2017)

Comparison of DEM Super-Resolution Methods Based on Interpolation and Neural Networks
Bằng: Yifan Zhang, et al.
Được phát hành: (2022-01-01)

Application of two-component neural network for exchange-correlation functional interpolation
Bằng: Alexander Ryabov, et al.
Được phát hành: (2022-08-01)

Sparse self-attention aggregation networks for neural sequence slice interpolation
Bằng: Zejin Wang, et al.
Được phát hành: (2021-02-01)

Fractional Voronovskaya type asymptotic expansions for quasi-interpolation neural network operators
Bằng: George A Anastassiou
Được phát hành: (2012-10-01)

Interpolative Boolean Networks
Bằng: Vladimir Dobrić, et al.
Được phát hành: (2017-01-01)

Interpolation for neural-network operators activated with a generalized logistic-type function
Bằng: Hande Uyan, et al.
Được phát hành: (2024-09-01)

Recurrent Neural Network-Based Approach for Sparse Geomagnetic Data Interpolation and Reconstruction
Bằng: Huan Liu, et al.
Được phát hành: (2019-01-01)

Interpolation : cubic spline interpolation and hermite interpolation /
Bằng: 495552 Gan, Loon Keat, et al.
Được phát hành: (2004)

Surface Roughness Prediction Using Circular Interpolation Based on Artificial Neural Network in Milling Operation
Bằng: Maan Aabid Tawfiq, et al.
Được phát hành: (2016-05-01)

Alternative method: outlier treatments with box-jenkins and neural network via interpolation method
Bằng: Wahir, Norsoraya Azurin, et al.
Được phát hành: (2018)

Alternative method outlier treatments with Box-Jenkins and neural network via interpolation method
Bằng: Wahir, Norsoraya Azurin, et al.
Được phát hành: (2018)

Balancing Wigner sampling and geometry interpolation for deep neural networks learning photochemical reactions
Bằng: Li Wang, et al.
Được phát hành: (2023-12-01)

Physics-Informed Neural Networks and Functional Interpolation for Solving the Matrix Differential Riccati Equation
Bằng: Kristofer Drozd, et al.
Được phát hành: (2023-08-01)

A generalized spatial autoregressive neural network method for three-dimensional spatial interpolation
Bằng: J. Zhan, et al.
Được phát hành: (2023-05-01)

NEURAL NETWORK INTERPOLATION PARAMETERS OF A MULTI-MODE DYNAMIC MODEL OF THE AIRCRAFT ENGINE
Bằng: Aleksandr Tamargazin, et al.
Được phát hành: (2020-08-01)

EXPLORING THE ROLE OF GENETIC ALGORITHMS AND ARTIFICIAL NEURAL NETWORKS FOR INTERPOLATION OF ELEVATION IN GEOINFORMATION MODELS
Bằng: H. Bagheri, et al.
Được phát hành: (2013-09-01)

Spatial Interpolation of Rainfall Erosivity Using Artificial Neural Networks for Southern Brazil Conditions
Bằng: Michel Castro Moreira, et al.

Neural Hierarchical Interpolation for Standardized Precipitation Index Forecasting
Bằng: Rafael Magallanes-Quintanar, et al.
Được phát hành: (2024-07-01)

Video frame interpolation neural network for 3D tomography across different length scales
Bằng: Laura Gambini, et al.
Được phát hành: (2024-09-01)

Recording of Full-Color Snapshot Digital Holographic Portraits Using Neural Network Image Interpolation
Bằng: Philippe Gentet, et al.
Được phát hành: (2023-11-01)

Deep image retrieval using artificial neural network interpolation and indexing based on similarity measurement
Bằng: Faiyaz Ahmad
Được phát hành: (2022-06-01)

Enlarging smaller images before inputting into convolutional neural network: zero-padding vs. interpolation
Bằng: Mahdi Hashemi
Được phát hành: (2019-11-01)

Interpolation of natural cubic spline
Bằng: Arun Kumar, et al.
Được phát hành: (1992-01-01)

Interpolative relations and interpolative preference structures
Bằng: Radojević Dragan
Được phát hành: (2005-01-01)