An analysis of training and generalization errors in shallow and deep networks

This paper is motivated by an open problem around deep networks, namely, the apparent absence of overfitting despite large over-parametrization which allows perfect fitting of the training data. In this paper, we analyze this phenomenon in the case of regression problems when each unit evaluates a p...

Full description

Bibliographic Details
Main Authors: Mhaskar, H.N., Poggio, Tomaso
Format: Technical Report
Published: Center for Brains, Minds and Machines (CBMM), arXiv.org 2019
Online Access:https://hdl.handle.net/1721.1/121183