Entropy Learning in Neural Network
In this paper, entropy term is used in the learning phase of a neural network. As learning progresses, more hidden nodes get into saturation. The early creation of such hidden nodes may impair generalisation. Hence entropy approach is proposed to dampen the early creation of such nodes. The entr...
Main Authors: | Geok See Ng, D. Shi, A. Wahab, H. Singh |
---|---|
Format: | Article |
Language: | English |
Published: |
Universiti Brunei Darussalam
2017-12-01
|
Series: | ASEAN Journal on Science and Technology for Development |
Online Access: | http://www.ajstd.org/index.php/ajstd/article/view/362 |
Similar Items
-
Entropy learning in neural network
by: Geok, See Ng, et al.
Published: (2003) -
Entropy learning and relevance criteria for neural network pruning
by: Geok, See Ng, et al.
Published: (2003) -
Learning in Convolutional Neural Networks Accelerated by Transfer Entropy
by: Adrian Moldovan, et al.
Published: (2021-09-01) -
Learning in Feedforward Neural Networks Accelerated by Transfer Entropy
by: Adrian Moldovan, et al.
Published: (2020-01-01) -
An Entropy Metric for Regular Grammar Classification and Learning with Recurrent Neural Networks
by: Kaixuan Zhang, et al.
Published: (2021-01-01)