A Large-Scale Study of Activation Functions in Modern Deep Neural Network Architectures for Efficient Convergence

Activation functions play an important role in the convergence of learning algorithms based on neural networks. Theyprovide neural networks with nonlinear ability and the possibility to fit in any complex data. However, no deep study exists in theliterature on the comportment of activation function...

Full description

Bibliographic Details
Main Authors: Andrinandrasana David Rasamoelina, Ivan Cík, Peter Sincak, Marián Mach, Lukáš Hruška
Format: Article
Language:English
Published: Asociación Española para la Inteligencia Artificial 2022-12-01
Series:Inteligencia Artificial
Subjects:
Online Access:https://journal.iberamia.org/index.php/intartif/article/view/845