Convolutional Extreme Learning Machines: A Systematic Review
Much work has recently identified the need to combine deep learning with extreme learning in order to strike a performance balance with accuracy, especially in the domain of multimedia applications. When considering this new paradigm—namely, the convolutional extreme learning machine (CELM)—we prese...
Main Authors: | , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
MDPI AG
2021-05-01
|
Series: | Informatics |
Subjects: | |
Online Access: | https://www.mdpi.com/2227-9709/8/2/33 |
_version_ | 1797534286662860800 |
---|---|
author | Iago Richard Rodrigues Sebastião Rogério da Silva Neto Judith Kelner Djamel Sadok Patricia Takako Endo |
author_facet | Iago Richard Rodrigues Sebastião Rogério da Silva Neto Judith Kelner Djamel Sadok Patricia Takako Endo |
author_sort | Iago Richard Rodrigues |
collection | DOAJ |
description | Much work has recently identified the need to combine deep learning with extreme learning in order to strike a performance balance with accuracy, especially in the domain of multimedia applications. When considering this new paradigm—namely, the convolutional extreme learning machine (CELM)—we present a systematic review that investigates alternative deep learning architectures that use the extreme learning machine (ELM) for faster training to solve problems that are based on image analysis. We detail each of the architectures that are found in the literature along with their application scenarios, benchmark datasets, main results, and advantages, and then present the open challenges for CELM. We followed a well-structured methodology and established relevant research questions that guided our findings. Based on 81 primary studies, we found that object recognition is the most common problem that is solved by CELM, and CCN with predefined kernels is the most common CELM architecture proposed in the literature. The results from experiments show that CELM models present good precision, convergence, and computational performance, and they are able to decrease the total processing time that is required by the learning process. The results presented in this systematic review are expected to contribute to the research area of CELM, providing a good starting point for dealing with some of the current problems in the analysis of computer vision based on images. |
first_indexed | 2024-03-10T11:27:27Z |
format | Article |
id | doaj.art-132795a07320425e9a0d6cde18260fbc |
institution | Directory Open Access Journal |
issn | 2227-9709 |
language | English |
last_indexed | 2024-03-10T11:27:27Z |
publishDate | 2021-05-01 |
publisher | MDPI AG |
record_format | Article |
series | Informatics |
spelling | doaj.art-132795a07320425e9a0d6cde18260fbc2023-11-21T19:31:02ZengMDPI AGInformatics2227-97092021-05-01823310.3390/informatics8020033Convolutional Extreme Learning Machines: A Systematic ReviewIago Richard Rodrigues0Sebastião Rogério da Silva Neto1Judith Kelner2Djamel Sadok3Patricia Takako Endo4Centro de Informática, Universidade Federal de Pernambuco (UFPE), Recife 50670-420, BrazilPrograma de Pós-Graduação em Engenharia da Computação, Universidade de Pernambuco (UPE), Recife 50050-000, BrazilCentro de Informática, Universidade Federal de Pernambuco (UFPE), Recife 50670-420, BrazilCentro de Informática, Universidade Federal de Pernambuco (UFPE), Recife 50670-420, BrazilPrograma de Pós-Graduação em Engenharia da Computação, Universidade de Pernambuco (UPE), Recife 50050-000, BrazilMuch work has recently identified the need to combine deep learning with extreme learning in order to strike a performance balance with accuracy, especially in the domain of multimedia applications. When considering this new paradigm—namely, the convolutional extreme learning machine (CELM)—we present a systematic review that investigates alternative deep learning architectures that use the extreme learning machine (ELM) for faster training to solve problems that are based on image analysis. We detail each of the architectures that are found in the literature along with their application scenarios, benchmark datasets, main results, and advantages, and then present the open challenges for CELM. We followed a well-structured methodology and established relevant research questions that guided our findings. Based on 81 primary studies, we found that object recognition is the most common problem that is solved by CELM, and CCN with predefined kernels is the most common CELM architecture proposed in the literature. The results from experiments show that CELM models present good precision, convergence, and computational performance, and they are able to decrease the total processing time that is required by the learning process. The results presented in this systematic review are expected to contribute to the research area of CELM, providing a good starting point for dealing with some of the current problems in the analysis of computer vision based on images.https://www.mdpi.com/2227-9709/8/2/33convolutional extreme learning machinedeep learningmultimedia analysis |
spellingShingle | Iago Richard Rodrigues Sebastião Rogério da Silva Neto Judith Kelner Djamel Sadok Patricia Takako Endo Convolutional Extreme Learning Machines: A Systematic Review Informatics convolutional extreme learning machine deep learning multimedia analysis |
title | Convolutional Extreme Learning Machines: A Systematic Review |
title_full | Convolutional Extreme Learning Machines: A Systematic Review |
title_fullStr | Convolutional Extreme Learning Machines: A Systematic Review |
title_full_unstemmed | Convolutional Extreme Learning Machines: A Systematic Review |
title_short | Convolutional Extreme Learning Machines: A Systematic Review |
title_sort | convolutional extreme learning machines a systematic review |
topic | convolutional extreme learning machine deep learning multimedia analysis |
url | https://www.mdpi.com/2227-9709/8/2/33 |
work_keys_str_mv | AT iagorichardrodrigues convolutionalextremelearningmachinesasystematicreview AT sebastiaorogeriodasilvaneto convolutionalextremelearningmachinesasystematicreview AT judithkelner convolutionalextremelearningmachinesasystematicreview AT djamelsadok convolutionalextremelearningmachinesasystematicreview AT patriciatakakoendo convolutionalextremelearningmachinesasystematicreview |