A new class activation functions with application in the theory of impulse technics

In this note we define the new activation functions, based on the well-known hyperbolic tangent and half--hyperbolic tangent activation functions. We consider the Hausdorff distance between the ''double step'' function $\sigma^{\ast}(t)$ (resp. function $\sigma^{\ast \ast}(t)$) a...

Full description

Bibliographic Details
Main Author: Nikolay Kyurkchiev
Format: Article
Language:English
Published: Mahmut Akyigit 2018-05-01
Series:Journal of Mathematical Sciences and Modelling
Subjects:
Online Access:https://dergipark.org.tr/tr/download/article-file/482673
Description
Summary:In this note we define the new activation functions, based on the well-known hyperbolic tangent and half--hyperbolic tangent activation functions. We consider the Hausdorff distance between the ''double step'' function $\sigma^{\ast}(t)$ (resp. function $\sigma^{\ast \ast}(t)$) and the new classes of activation functions. The results have independent significance in the study of issues related to neural networks and impulse techniques. Numerical examples, illustrating our results are presented using programming environment Mathematica.
ISSN:2636-8692