A Large-Scale Study of Activation Functions in Modern Deep Neural Network Architectures for Efficient Convergence
Activation functions play an important role in the convergence of learning algorithms based on neural networks. Theyprovide neural networks with nonlinear ability and the possibility to fit in any complex data. However, no deep study exists in theliterature on the comportment of activation function...
Main Authors: | Andrinandrasana David Rasamoelina, Ivan Cík, Peter Sincak, Marián Mach, Lukáš Hruška |
---|---|
Format: | Article |
Language: | English |
Published: |
Asociación Española para la Inteligencia Artificial
2022-12-01
|
Series: | Inteligencia Artificial |
Subjects: | |
Online Access: | https://journal.iberamia.org/index.php/intartif/article/view/845 |
Similar Items
-
Deep Learning for Genomics: From Early Neural Nets to Modern Large Language Models
by: Tianwei Yue, et al.
Published: (2023-11-01) -
MEDUSA: Multi-Scale Encoder-Decoder Self-Attention Deep Neural Network Architecture for Medical Image Analysis
by: Hossein Aboutalebi, et al.
Published: (2022-02-01) -
Robust 2D and 3D registration with deep neural networks
by: Wang, Z
Published: (2024) -
A Heterogeneous Architecture for the Vision Processing Unit with a Hybrid Deep Neural Network Accelerator
by: Peng Liu, et al.
Published: (2022-02-01) -
ResTS: Residual Deep interpretable architecture for plant disease detection
by: Dhruvil Shah, et al.
Published: (2022-06-01)