Entropic Dynamics in Neural Networks, the Renormalization Group and the Hamilton-Jacobi-Bellman Equation

Entropic Dynamics in Neural Networks, the Renormalization Group and the Hamilton-Jacobi-Bellman Equation

We study the dynamics of information processing in the continuum depth limit of deep feed-forward Neural Networks (NN) and find that it can be described in language similar to the Renormalization Group (RG). The association of concepts to patterns by a NN is analogous to the identification of the fe...

Full description

Bibliographic Details
Main Author: Nestor Caticha
Format: Article
Language:English
Published: MDPI AG 2020-05-01
Series:Entropy
Subjects:
neural networks
renormalization group
entropic dynamics
learning algorithms
Online Access:https://www.mdpi.com/1099-4300/22/5/587

Internet

https://www.mdpi.com/1099-4300/22/5/587

Similar Items