Learning Real and Boolean Functions: When Is Deep Better Than Shallow
We describe computational tasks - especially in vision - that correspond to compositional/hierarchical functions. While the universal approximation property holds both for hierarchical and shallow networks, we prove that deep (hierarchical) networks can approximate the class of compositional functio...
Main Authors: | Mhaskar, Hrushikesh, Liao, Qianli, Poggio, Tomaso |
---|---|
Format: | Technical Report |
Language: | en_US |
Published: |
Center for Brains, Minds and Machines (CBMM), arXiv
2016
|
Subjects: | |
Online Access: | http://hdl.handle.net/1721.1/101635 |
Similar Items
-
Can a biologically-plausible hierarchy e ectively replace face detection, alignment, and recognition pipelines?
by: Liao, Qianli, et al.
Published: (2015) -
Why and when can deep-but not shallow-networks avoid the curse of dimensionality: A review
by: Mhaskar, Hrushikesh, et al.
Published: (2017) -
An analysis of training and generalization errors in shallow and deep networks
by: Mhaskar, Hrushikesh, et al.
Published: (2018) -
Deep vs. shallow networks : An approximation theory perspective
by: Mhaskar, Hrushikesh, et al.
Published: (2016) -
Theory I: Why and When Can Deep Networks Avoid the Curse of Dimensionality?
by: Poggio, Tomaso, et al.
Published: (2016)