PARAMETRIC FLATTEN-T SWISH: AN ADAPTIVE NONLINEAR ACTIVATION FUNCTION FOR DEEP LEARNING
QActivation function is a key component in deep learning that performs non-linear mappings between the inputs and outputs. Rectified Linear Unit (ReLU) has been the most popular activation function across the deep learning community. However, ReLU contains several shortcomings that can result in ine...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
UUM Press
2020-10-01
|
| Series: | Journal of ICT |
| Online Access: | https://www.scienceopen.com/document?vid=4423025f-cc63-457c-9a28-5fdfb8de0723 |