Differential Evolution for Neural Networks Optimization

In this paper, a Neural Networks optimizer based on Self-adaptive Differential Evolution is presented. This optimizer applies mutation and crossover operators in a new way, taking into account the structure of the network according to a per layer strategy. Moreover, a new crossover called <i>i...

Full description

Bibliographic Details
Main Authors: Marco Baioletti, Gabriele Di Bari, Alfredo Milani, Valentina Poggioni
Format: Article
Language:English
Published: MDPI AG 2020-01-01
Series:Mathematics
Subjects:
Online Access:https://www.mdpi.com/2227-7390/8/1/69
Description
Summary:In this paper, a Neural Networks optimizer based on Self-adaptive Differential Evolution is presented. This optimizer applies mutation and crossover operators in a new way, taking into account the structure of the network according to a per layer strategy. Moreover, a new crossover called <i>interm</i> is proposed, and a new self-adaptive version of DE called <i>MAB-ShaDE</i> is suggested to reduce the number of parameters. The framework has been tested on some well-known classification problems and a comparative study on the various combinations of self-adaptive methods, mutation, and crossover operators available in literature is performed. Experimental results show that DENN reaches good performances in terms of accuracy, better than or at least comparable with those obtained by backpropagation.
ISSN:2227-7390