An efficient binary Gradient-based optimizer for feature selection
Feature selection (FS) is a classic and challenging optimization task in the field of machine learning and data mining. Gradient-based optimizer (GBO) is a recently developed metaheuristic with population-based characteristics inspired by gradient-based Newton's method that uses two main operat...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
AIMS Press
2021-05-01
|
| Series: | Mathematical Biosciences and Engineering |
| Subjects: | |
| Online Access: | http://www.aimspress.com/article/doi/10.3934/mbe.2021192?viewType=HTML |
| _version_ | 1818608470057811968 |
|---|---|
| author | Yugui Jiang Qifang Luo Yuanfei Wei Laith Abualigah Yongquan Zhou |
| author_facet | Yugui Jiang Qifang Luo Yuanfei Wei Laith Abualigah Yongquan Zhou |
| author_sort | Yugui Jiang |
| collection | DOAJ |
| description | Feature selection (FS) is a classic and challenging optimization task in the field of machine learning and data mining. Gradient-based optimizer (GBO) is a recently developed metaheuristic with population-based characteristics inspired by gradient-based Newton's method that uses two main operators: the gradient search rule (GSR), the local escape operator (LEO) and a set of vectors to explore the search space for solving continuous problems. This article presents a binary GBO (BGBO) algorithm and for feature selecting problems. The eight independent GBO variants are proposed, and eight transfer functions divided into two families of S-shaped and V-shaped are evaluated to map the search space to a discrete space of research. To verify the performance of the proposed binary GBO algorithm, 18 well-known UCI datasets and 10 high-dimensional datasets are tested and compared with other advanced FS methods. The experimental results show that among the proposed binary GBO algorithms has the best comprehensive performance and has better performance than other well known metaheuristic algorithms in terms of the performance measures. |
| first_indexed | 2024-12-16T14:43:09Z |
| format | Article |
| id | doaj.art-1a56474179414a9c949eae2f98a075df |
| institution | Directory Open Access Journal |
| issn | 1551-0018 |
| language | English |
| last_indexed | 2024-12-16T14:43:09Z |
| publishDate | 2021-05-01 |
| publisher | AIMS Press |
| record_format | Article |
| series | Mathematical Biosciences and Engineering |
| spelling | doaj.art-1a56474179414a9c949eae2f98a075df2022-12-21T22:27:50ZengAIMS PressMathematical Biosciences and Engineering1551-00182021-05-011843813385410.3934/mbe.2021192An efficient binary Gradient-based optimizer for feature selectionYugui Jiang0Qifang Luo1Yuanfei Wei 2Laith Abualigah3Yongquan Zhou41. College of Artificial Intelligence, Guangxi University for Nationalities, Nanning 530006, China3. Guangxi Key Laboratories of Hybrid Computation and IC Design Analysis, Nanning 530006, China1. College of Artificial Intelligence, Guangxi University for Nationalities, Nanning 530006, China3. Guangxi Key Laboratories of Hybrid Computation and IC Design Analysis, Nanning 530006, China2. Xiangsihu College of Gunagxi University for Nationalities, Nanning, Guangxi 532100, China4. Faculty of Computer Sciences and Informatics, Amman Arab University, Amman 11953, Jordan1. College of Artificial Intelligence, Guangxi University for Nationalities, Nanning 530006, China3. Guangxi Key Laboratories of Hybrid Computation and IC Design Analysis, Nanning 530006, ChinaFeature selection (FS) is a classic and challenging optimization task in the field of machine learning and data mining. Gradient-based optimizer (GBO) is a recently developed metaheuristic with population-based characteristics inspired by gradient-based Newton's method that uses two main operators: the gradient search rule (GSR), the local escape operator (LEO) and a set of vectors to explore the search space for solving continuous problems. This article presents a binary GBO (BGBO) algorithm and for feature selecting problems. The eight independent GBO variants are proposed, and eight transfer functions divided into two families of S-shaped and V-shaped are evaluated to map the search space to a discrete space of research. To verify the performance of the proposed binary GBO algorithm, 18 well-known UCI datasets and 10 high-dimensional datasets are tested and compared with other advanced FS methods. The experimental results show that among the proposed binary GBO algorithms has the best comprehensive performance and has better performance than other well known metaheuristic algorithms in terms of the performance measures.http://www.aimspress.com/article/doi/10.3934/mbe.2021192?viewType=HTMLgradient-based optimizer (gbo)transfer functionbinary gradient-based optimizerfeature selection (fs) |
| spellingShingle | Yugui Jiang Qifang Luo Yuanfei Wei Laith Abualigah Yongquan Zhou An efficient binary Gradient-based optimizer for feature selection Mathematical Biosciences and Engineering gradient-based optimizer (gbo) transfer function binary gradient-based optimizer feature selection (fs) |
| title | An efficient binary Gradient-based optimizer for feature selection |
| title_full | An efficient binary Gradient-based optimizer for feature selection |
| title_fullStr | An efficient binary Gradient-based optimizer for feature selection |
| title_full_unstemmed | An efficient binary Gradient-based optimizer for feature selection |
| title_short | An efficient binary Gradient-based optimizer for feature selection |
| title_sort | efficient binary gradient based optimizer for feature selection |
| topic | gradient-based optimizer (gbo) transfer function binary gradient-based optimizer feature selection (fs) |
| url | http://www.aimspress.com/article/doi/10.3934/mbe.2021192?viewType=HTML |
| work_keys_str_mv | AT yuguijiang anefficientbinarygradientbasedoptimizerforfeatureselection AT qifangluo anefficientbinarygradientbasedoptimizerforfeatureselection AT yuanfeiwei anefficientbinarygradientbasedoptimizerforfeatureselection AT laithabualigah anefficientbinarygradientbasedoptimizerforfeatureselection AT yongquanzhou anefficientbinarygradientbasedoptimizerforfeatureselection AT yuguijiang efficientbinarygradientbasedoptimizerforfeatureselection AT qifangluo efficientbinarygradientbasedoptimizerforfeatureselection AT yuanfeiwei efficientbinarygradientbasedoptimizerforfeatureselection AT laithabualigah efficientbinarygradientbasedoptimizerforfeatureselection AT yongquanzhou efficientbinarygradientbasedoptimizerforfeatureselection |