Convolutional Extreme Learning Machines: A Systematic Review

Much work has recently identified the need to combine deep learning with extreme learning in order to strike a performance balance with accuracy, especially in the domain of multimedia applications. When considering this new paradigm—namely, the convolutional extreme learning machine (CELM)—we prese...

Full description

Bibliographic Details
Main Authors: Iago Richard Rodrigues, Sebastião Rogério da Silva Neto, Judith Kelner, Djamel Sadok, Patricia Takako Endo
Format: Article
Language:English
Published: MDPI AG 2021-05-01
Series:Informatics
Subjects:
Online Access:https://www.mdpi.com/2227-9709/8/2/33
_version_ 1797534286662860800
author Iago Richard Rodrigues
Sebastião Rogério da Silva Neto
Judith Kelner
Djamel Sadok
Patricia Takako Endo
author_facet Iago Richard Rodrigues
Sebastião Rogério da Silva Neto
Judith Kelner
Djamel Sadok
Patricia Takako Endo
author_sort Iago Richard Rodrigues
collection DOAJ
description Much work has recently identified the need to combine deep learning with extreme learning in order to strike a performance balance with accuracy, especially in the domain of multimedia applications. When considering this new paradigm—namely, the convolutional extreme learning machine (CELM)—we present a systematic review that investigates alternative deep learning architectures that use the extreme learning machine (ELM) for faster training to solve problems that are based on image analysis. We detail each of the architectures that are found in the literature along with their application scenarios, benchmark datasets, main results, and advantages, and then present the open challenges for CELM. We followed a well-structured methodology and established relevant research questions that guided our findings. Based on 81 primary studies, we found that object recognition is the most common problem that is solved by CELM, and CCN with predefined kernels is the most common CELM architecture proposed in the literature. The results from experiments show that CELM models present good precision, convergence, and computational performance, and they are able to decrease the total processing time that is required by the learning process. The results presented in this systematic review are expected to contribute to the research area of CELM, providing a good starting point for dealing with some of the current problems in the analysis of computer vision based on images.
first_indexed 2024-03-10T11:27:27Z
format Article
id doaj.art-132795a07320425e9a0d6cde18260fbc
institution Directory Open Access Journal
issn 2227-9709
language English
last_indexed 2024-03-10T11:27:27Z
publishDate 2021-05-01
publisher MDPI AG
record_format Article
series Informatics
spelling doaj.art-132795a07320425e9a0d6cde18260fbc2023-11-21T19:31:02ZengMDPI AGInformatics2227-97092021-05-01823310.3390/informatics8020033Convolutional Extreme Learning Machines: A Systematic ReviewIago Richard Rodrigues0Sebastião Rogério da Silva Neto1Judith Kelner2Djamel Sadok3Patricia Takako Endo4Centro de Informática, Universidade Federal de Pernambuco (UFPE), Recife 50670-420, BrazilPrograma de Pós-Graduação em Engenharia da Computação, Universidade de Pernambuco (UPE), Recife 50050-000, BrazilCentro de Informática, Universidade Federal de Pernambuco (UFPE), Recife 50670-420, BrazilCentro de Informática, Universidade Federal de Pernambuco (UFPE), Recife 50670-420, BrazilPrograma de Pós-Graduação em Engenharia da Computação, Universidade de Pernambuco (UPE), Recife 50050-000, BrazilMuch work has recently identified the need to combine deep learning with extreme learning in order to strike a performance balance with accuracy, especially in the domain of multimedia applications. When considering this new paradigm—namely, the convolutional extreme learning machine (CELM)—we present a systematic review that investigates alternative deep learning architectures that use the extreme learning machine (ELM) for faster training to solve problems that are based on image analysis. We detail each of the architectures that are found in the literature along with their application scenarios, benchmark datasets, main results, and advantages, and then present the open challenges for CELM. We followed a well-structured methodology and established relevant research questions that guided our findings. Based on 81 primary studies, we found that object recognition is the most common problem that is solved by CELM, and CCN with predefined kernels is the most common CELM architecture proposed in the literature. The results from experiments show that CELM models present good precision, convergence, and computational performance, and they are able to decrease the total processing time that is required by the learning process. The results presented in this systematic review are expected to contribute to the research area of CELM, providing a good starting point for dealing with some of the current problems in the analysis of computer vision based on images.https://www.mdpi.com/2227-9709/8/2/33convolutional extreme learning machinedeep learningmultimedia analysis
spellingShingle Iago Richard Rodrigues
Sebastião Rogério da Silva Neto
Judith Kelner
Djamel Sadok
Patricia Takako Endo
Convolutional Extreme Learning Machines: A Systematic Review
Informatics
convolutional extreme learning machine
deep learning
multimedia analysis
title Convolutional Extreme Learning Machines: A Systematic Review
title_full Convolutional Extreme Learning Machines: A Systematic Review
title_fullStr Convolutional Extreme Learning Machines: A Systematic Review
title_full_unstemmed Convolutional Extreme Learning Machines: A Systematic Review
title_short Convolutional Extreme Learning Machines: A Systematic Review
title_sort convolutional extreme learning machines a systematic review
topic convolutional extreme learning machine
deep learning
multimedia analysis
url https://www.mdpi.com/2227-9709/8/2/33
work_keys_str_mv AT iagorichardrodrigues convolutionalextremelearningmachinesasystematicreview
AT sebastiaorogeriodasilvaneto convolutionalextremelearningmachinesasystematicreview
AT judithkelner convolutionalextremelearningmachinesasystematicreview
AT djamelsadok convolutionalextremelearningmachinesasystematicreview
AT patriciatakakoendo convolutionalextremelearningmachinesasystematicreview