PARAMETRIC FLATTEN-T SWISH: AN ADAPTIVE NONLINEAR ACTIVATION FUNCTION FOR DEEP LEARNING

PARAMETRIC FLATTEN-T SWISH: AN ADAPTIVE NONLINEAR ACTIVATION FUNCTION FOR DEEP LEARNING

Show other versions (2)

QActivation function is a key component in deep learning that performs non-linear mappings between the inputs and outputs. Rectified Linear Unit (ReLU) has been the most popular activation function across the deep learning community. However, ReLU contains several shortcomings that can result in in...

Full description

Bibliographic Details
Main Authors:	Hock Hung Chieng, Noorhaniza Wahid, Pauline Ong
Format:	Article
Language:	English
Published:	UUM Press 2020-11-01
Series:	Journal of ICT
Subjects:	Activation function deep learning Flatten-T Swish non-linearity ReLU
Online Access:	https://e-journal.uum.edu.my/index.php/jict/article/view/12398

Similar Items

Flatten-T Swish: a thresholded ReLU-Swish-like activation function for deep learning
by: Hock Hung Chieng, et al.
Published: (2018-07-01)

Optimization of Microchannels and Application of Basic Activation Functions of Deep Neural Network for Accuracy Analysis of Microfluidic Parameter Data
by: Feroz Ahmed, et al.
Published: (2022-08-01)

Parametric flatten-t swish: an adaptive nonlinear activation function for deep learning
by: Hock, Hung Chieng, et al.
Published: (2021)

PARAMETRIC FLATTEN-T SWISH: AN ADAPTIVE NONLINEAR ACTIVATION FUNCTION FOR DEEP LEARNING
by: Hock Chieng, et al.
Published: (2020-10-01)

Flatten-T Swish: a thresholded ReLU-Swish-like activation function for deep learning
by: Hock, Hung Chieng, et al.
Published: (2018)

Efficient-SwishNet Based System for Facial Emotion Recognition
by: Tarim Dar, et al.
Published: (2022-01-01)

PERFORMANCE EVALUATION OF STOCK PREDICTION MODELS USING EMAGRU
by: Erizal ERIZAL, et al.
Published: (2023-09-01)

Optimization and acceleration of convolutional neural networks: A survey
by: Gousia Habib, et al.
Published: (2022-07-01)

Locally linear attributes of ReLU neural networks
by: Ben Sattelberg, et al.
Published: (2023-11-01)

A method to improve the computational performance of nonlinear all—optical diffractive deep neural network model
by: Yichen Sun, et al.
Published: (2023-12-01)

On the Generative Power of ReLU Network for Generating Similar Strings
by: Mamoona Ghafoor, et al.
Published: (2024-01-01)

Applied AI with PLC and IRB1200
by: Monika Rybczak, et al.
Published: (2022-12-01)

Learnable Leaky ReLU (LeLeLU): An Alternative Accuracy-Optimized Activation Function
by: Andreas Maniatopoulos, et al.
Published: (2021-12-01)

Early Prediction of DNN Activation Using Hierarchical Computations
by: Bharathwaj Suresh, et al.
Published: (2021-12-01)

Convolutional Neural Network with a Learnable Spatial Activation Function for SAR Image Despeckling and Forest Image Analysis
by: Hao Wang, et al.
Published: (2021-08-01)

DPReLU: Dynamic Parametric Rectified Linear Unit and Its Proper Weight Initialization Method
by: Donghun Yang, et al.
Published: (2023-02-01)

ERDNN: Error-Resilient Deep Neural Networks With a New Error Correction Layer and Piece-Wise Rectified Linear Unit
by: Muhammad Salman Ali, et al.
Published: (2020-01-01)

FPSNET: An Architecture for Neural-Network-Based Feature Point Extraction for SLAM
by: Fasih Ud Din Farrukh, et al.
Published: (2022-12-01)

An Intelligent Fashion Object Classification Using CNN
by: Debabrata Swain, et al.
Published: (2023-11-01)

BERT-Based Chinese Relation Extraction for Public Security
by: Jiaqi Hou, et al.
Published: (2020-01-01)

Deep vs. shallow networks : An approximation theory perspective
by: Mhaskar, Hrushikesh, et al.
Published: (2016)

Nonparametric Estimation for High-Dimensional Space Models Based on a Deep Neural Network
by: Hongxia Wang, et al.
Published: (2023-09-01)

A Family of Swish Diffusion Strategy Based Adaptive Algorithms for Distributed Active Noise Control
by: Rajapantula Kranthi, et al.
Published: (2024-01-01)

Concatenated Modified LeNet Approach for Classifying Pneumonia Images
by: Dhayanithi Jaganathan, et al.
Published: (2024-03-01)

RBUE: a ReLU-based uncertainty estimation method for convolutional neural networks
by: Yufeng Xia, et al.
Published: (2023-02-01)

Handling Vanishing Gradient Problem Using Artificial Derivative
by: Zheng Hu, et al.
Published: (2021-01-01)

An Integrated Design for Classification and Localization of Diabetic Foot Ulcer Based on CNN and YOLOv2-DFU Models
by: Javaria Amin, et al.
Published: (2020-01-01)

An Interferogram Re-Flattening Method for InSAR Based on Local Residual Fringe Removal and Adaptively Adjusted Windows
by: Di Zhuang, et al.
Published: (2023-04-01)

Intelligent Crack Detection Method Based on GM-ResNet
by: Xinran Li, et al.
Published: (2023-10-01)

Swish and gargle saliva sampling is a patient-friendly and comparable alternative to nasopharyngeal swabs to detect SARS-CoV-2 in outpatient settings for adults and children
by: Sandra Isabel, et al.
Published: (2023-12-01)

An analytical approach for unsupervised learning rate estimation using rectified linear units
by: Chaoxiang Chen, et al.
Published: (2024-04-01)

Implementation of Analog Perceptron as an Essential Element of Configurable Neural Networks
by: Chao Geng, et al.
Published: (2020-07-01)

The Dosimetric Comparison of Different SBRT Techniques for Treatment of Liver Cancer Using Flattened and Flattening Filter Free Beam
by: SURESH T, et al.
Published: (2022-11-01)

Concentration Inequalities and Optimal Number of Layers for Stochastic Deep Neural Networks
by: Michele Caprio, et al.
Published: (2023-01-01)

Density results by deep neural network operators with integer weights
by: Danilo Costarelli
Published: (2022-11-01)

MRI brain tumor detection and classification using parallel deep convolutional neural networks
by: Takowa Rahman, et al.
Published: (2023-04-01)

Inverse Result of Approximation for the Max-Product Neural Network Operators of the Kantorovich Type and Their Saturation Order
by: Marco Cantarini, et al.
Published: (2021-12-01)

Mathematical Analysis of DCN-Based Super-Resolution
by: C. Lee, et al.
Published: (2020-01-01)

Total contribution score and fuzzy entropy based two‐stage selection of FC, ReLU and inverseReLU features of multiple convolution neural networks for erythrocytes detection
by: Sriparna Banerjee, et al.
Published: (2019-10-01)

Peranan Teknologi dalam Mendukung Proses Berpikir Level C3 Siswa pada Materi Operasi Himpunan melalui Penggunaan Swish Max4
by: Arinaldi Arinaldi, et al.
Published: (2018-03-01)