Local Linear Approximation Algorithm for Neural Network

This paper aims to develop a new training strategy to improve efficiency in estimation of weights and biases in a feedforward neural network (FNN). We propose a local linear approximation (LLA) algorithm, which approximates ReLU with a linear function at the neuron level and estimate the weights and...

Full description

Bibliographic Details
Main Authors: Mudong Zeng, Yujie Liao, Runze Li, Agus Sudjianto
Format: Article
Language:English
Published: MDPI AG 2022-02-01
Series:Mathematics
Subjects:
Online Access:https://www.mdpi.com/2227-7390/10/3/494