Entropic Dynamics in Neural Networks, the Renormalization Group and the Hamilton-Jacobi-Bellman Equation
We study the dynamics of information processing in the continuum depth limit of deep feed-forward Neural Networks (NN) and find that it can be described in language similar to the Renormalization Group (RG). The association of concepts to patterns by a NN is analogous to the identification of the fe...
| Váldodahkki: | |
|---|---|
| Materiálatiipa: | Artihkal |
| Giella: | English |
| Almmustuhtton: |
MDPI AG
2020-05-01
|
| Ráidu: | Entropy |
| Fáttát: | |
| Liŋkkat: | https://www.mdpi.com/1099-4300/22/5/587 |