A novel improved lemurs optimization algorithm for feature selection problems
The irrelevant and repeated features in high-dimensional datasets can negatively affect the final performance and accuracy of classification-based models. Therefore, feature selection (FS) techniques can be used to determine the most optimal relevant features. In this paper, we fuse a new enhanced m...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Elsevier
2023-09-01
|
| Series: | Journal of King Saud University: Computer and Information Sciences |
| Subjects: | |
| Online Access: | http://www.sciencedirect.com/science/article/pii/S1319157823002586 |
| _version_ | 1797663885202817024 |
|---|---|
| author | Ra’ed M. Al-Khatib Nour Elhuda A. Al-qudah Mahmoud S. Jawarneh Asef Al-Khateeb |
| author_facet | Ra’ed M. Al-Khatib Nour Elhuda A. Al-qudah Mahmoud S. Jawarneh Asef Al-Khateeb |
| author_sort | Ra’ed M. Al-Khatib |
| collection | DOAJ |
| description | The irrelevant and repeated features in high-dimensional datasets can negatively affect the final performance and accuracy of classification-based models. Therefore, feature selection (FS) techniques can be used to determine the most optimal relevant features. In this paper, we fuse a new enhanced model from Lemurs Optimization (LO) algorithm, called Enhanced Lemurs Optimization (ELO). We combine Opposition Based Learning (OBL) and Local Search Algorithm (LSA) to address exploration and exploitation challenges, respectively. Our proposed ELO algorithm incorporates U-shaped and Sigmoid transfer functions during the position update step, leading to improved accuracy and convergence. These new deployments based on the U-shaped and Sigmoid transfer functions are called ELO-U and ELO-S algorithms, respectively. The performance of all three new versions of our proposed optimization algorithms (ELO, ELO-U, and ELO-S) has been evaluated using 21 UCI datasets in different fields and sizes. Moreover, their results are also compared to other competitive algorithms. The evaluation process included several measurements such as fitness value, an average of selected features, and average accuracy. Experimental results demonstrate that our proposed ELO-U algorithm achieves the best average accuracy of 91.03%. Statistical analysis using Friedman and Wilcoxon tests confirms the superiority of ELO-U over other competitors. |
| first_indexed | 2024-03-11T19:21:16Z |
| format | Article |
| id | doaj.art-931f1793c407444a98a8db17881e7b64 |
| institution | Directory Open Access Journal |
| issn | 1319-1578 |
| language | English |
| last_indexed | 2024-03-11T19:21:16Z |
| publishDate | 2023-09-01 |
| publisher | Elsevier |
| record_format | Article |
| series | Journal of King Saud University: Computer and Information Sciences |
| spelling | doaj.art-931f1793c407444a98a8db17881e7b642023-10-07T04:34:07ZengElsevierJournal of King Saud University: Computer and Information Sciences1319-15782023-09-01358101704A novel improved lemurs optimization algorithm for feature selection problemsRa’ed M. Al-Khatib0Nour Elhuda A. Al-qudah1Mahmoud S. Jawarneh2Asef Al-Khateeb3Department of Computer Sciences, Yarmouk University, Irbid 21163, JordanDepartment of Computer Sciences, Yarmouk University, Irbid 21163, JordanFaculty of Information Technology, Applied Science Private University, Amman, JordanMIS Department, College of Business Administration, King Faisal University, Al Ahsa 31982, Saudi ArabiaThe irrelevant and repeated features in high-dimensional datasets can negatively affect the final performance and accuracy of classification-based models. Therefore, feature selection (FS) techniques can be used to determine the most optimal relevant features. In this paper, we fuse a new enhanced model from Lemurs Optimization (LO) algorithm, called Enhanced Lemurs Optimization (ELO). We combine Opposition Based Learning (OBL) and Local Search Algorithm (LSA) to address exploration and exploitation challenges, respectively. Our proposed ELO algorithm incorporates U-shaped and Sigmoid transfer functions during the position update step, leading to improved accuracy and convergence. These new deployments based on the U-shaped and Sigmoid transfer functions are called ELO-U and ELO-S algorithms, respectively. The performance of all three new versions of our proposed optimization algorithms (ELO, ELO-U, and ELO-S) has been evaluated using 21 UCI datasets in different fields and sizes. Moreover, their results are also compared to other competitive algorithms. The evaluation process included several measurements such as fitness value, an average of selected features, and average accuracy. Experimental results demonstrate that our proposed ELO-U algorithm achieves the best average accuracy of 91.03%. Statistical analysis using Friedman and Wilcoxon tests confirms the superiority of ELO-U over other competitors.http://www.sciencedirect.com/science/article/pii/S1319157823002586Artificial Intelligence (AI)Lemurs Optimization (LO)Feature Selection (FS)U-shaped transfer functionLocal Search Algorithm (LSA) |
| spellingShingle | Ra’ed M. Al-Khatib Nour Elhuda A. Al-qudah Mahmoud S. Jawarneh Asef Al-Khateeb A novel improved lemurs optimization algorithm for feature selection problems Journal of King Saud University: Computer and Information Sciences Artificial Intelligence (AI) Lemurs Optimization (LO) Feature Selection (FS) U-shaped transfer function Local Search Algorithm (LSA) |
| title | A novel improved lemurs optimization algorithm for feature selection problems |
| title_full | A novel improved lemurs optimization algorithm for feature selection problems |
| title_fullStr | A novel improved lemurs optimization algorithm for feature selection problems |
| title_full_unstemmed | A novel improved lemurs optimization algorithm for feature selection problems |
| title_short | A novel improved lemurs optimization algorithm for feature selection problems |
| title_sort | novel improved lemurs optimization algorithm for feature selection problems |
| topic | Artificial Intelligence (AI) Lemurs Optimization (LO) Feature Selection (FS) U-shaped transfer function Local Search Algorithm (LSA) |
| url | http://www.sciencedirect.com/science/article/pii/S1319157823002586 |
| work_keys_str_mv | AT raedmalkhatib anovelimprovedlemursoptimizationalgorithmforfeatureselectionproblems AT nourelhudaaalqudah anovelimprovedlemursoptimizationalgorithmforfeatureselectionproblems AT mahmoudsjawarneh anovelimprovedlemursoptimizationalgorithmforfeatureselectionproblems AT asefalkhateeb anovelimprovedlemursoptimizationalgorithmforfeatureselectionproblems AT raedmalkhatib novelimprovedlemursoptimizationalgorithmforfeatureselectionproblems AT nourelhudaaalqudah novelimprovedlemursoptimizationalgorithmforfeatureselectionproblems AT mahmoudsjawarneh novelimprovedlemursoptimizationalgorithmforfeatureselectionproblems AT asefalkhateeb novelimprovedlemursoptimizationalgorithmforfeatureselectionproblems |