A Hybrid Least Squares Support Vector Machine with Bat and Cuckoo Search Algorithms for Time Series Forecasting

Least Squares Support Vector Machine (LSSVM) has been known to be one of the effective forecasting models. However, its operation relies on two important parameters (regularization and kernel). Pre-determining the values of parameters will affect the results of the forecasting model; hence, to find...

Full description

Bibliographic Details
Main Authors: Mohammed, Athraa Jasim, Ghathwan, Khalil Ibrahim, Yusof, Yuhanis
Format: Article
Language:English
Published: Universiti Utara Malaysia Press 2020
Subjects:
Online Access:https://repo.uum.edu.my/id/eprint/28795/1/JICT%2019%2003%202020%20351-379.pdf
_version_ 1825805865093955584
author Mohammed, Athraa Jasim
Ghathwan, Khalil Ibrahim
Yusof, Yuhanis
author_facet Mohammed, Athraa Jasim
Ghathwan, Khalil Ibrahim
Yusof, Yuhanis
author_sort Mohammed, Athraa Jasim
collection UUM
description Least Squares Support Vector Machine (LSSVM) has been known to be one of the effective forecasting models. However, its operation relies on two important parameters (regularization and kernel). Pre-determining the values of parameters will affect the results of the forecasting model; hence, to find the optimal value of these parameters, this study investigates the adaptation of Bat and Cuckoo Search algorithms to optimize LSSVM parameters. Even though Cuckoo Search has been proven to be able to solve global optimization in various areas, the algorithm leads to a slow convergence rate when the step size is large. Hence, to enhance the search ability of Cuckoo Search, it is integrated with Bat algorithm that offers a balanced search between global and local. Evaluation was performed separately to further analyze the strength of Bat and Cuckoo Search to optimize LSSVM parameters. Five evaluation metrics were utilized; mean average percent error (MAPE), accuracy, symmetric mean absolute percent error (SMAPE), root mean square percent error (RMSPE) and fitness value. Experimental results on diabetes forecasting demonstrated that the proposed BAT-LSSVM and CUCKOO-LSSVM generated lower MAPE and SMAPE, at the same time produced higher accuracy and fitness value compared to particle swarm optimization (PSO)-LSSVM and a non-optimized LSSVM. Following the success, this study has integrated the two algorithms to better optimize the LSSVM. The newly proposed forecasting algorithm, termed as CUCKOO-BAT-LSSVM, produces better forecasting in terms of MAPE, accuracy and RMSPE. Such an outcome provides an alternative model to be used in facilitating decision-making in forecasting.
first_indexed 2024-07-04T06:39:12Z
format Article
id uum-28795
institution Universiti Utara Malaysia
language English
last_indexed 2024-07-04T06:39:12Z
publishDate 2020
publisher Universiti Utara Malaysia Press
record_format eprints
spelling uum-287952022-08-07T03:16:22Z https://repo.uum.edu.my/id/eprint/28795/ A Hybrid Least Squares Support Vector Machine with Bat and Cuckoo Search Algorithms for Time Series Forecasting Mohammed, Athraa Jasim Ghathwan, Khalil Ibrahim Yusof, Yuhanis QA75 Electronic computers. Computer science Least Squares Support Vector Machine (LSSVM) has been known to be one of the effective forecasting models. However, its operation relies on two important parameters (regularization and kernel). Pre-determining the values of parameters will affect the results of the forecasting model; hence, to find the optimal value of these parameters, this study investigates the adaptation of Bat and Cuckoo Search algorithms to optimize LSSVM parameters. Even though Cuckoo Search has been proven to be able to solve global optimization in various areas, the algorithm leads to a slow convergence rate when the step size is large. Hence, to enhance the search ability of Cuckoo Search, it is integrated with Bat algorithm that offers a balanced search between global and local. Evaluation was performed separately to further analyze the strength of Bat and Cuckoo Search to optimize LSSVM parameters. Five evaluation metrics were utilized; mean average percent error (MAPE), accuracy, symmetric mean absolute percent error (SMAPE), root mean square percent error (RMSPE) and fitness value. Experimental results on diabetes forecasting demonstrated that the proposed BAT-LSSVM and CUCKOO-LSSVM generated lower MAPE and SMAPE, at the same time produced higher accuracy and fitness value compared to particle swarm optimization (PSO)-LSSVM and a non-optimized LSSVM. Following the success, this study has integrated the two algorithms to better optimize the LSSVM. The newly proposed forecasting algorithm, termed as CUCKOO-BAT-LSSVM, produces better forecasting in terms of MAPE, accuracy and RMSPE. Such an outcome provides an alternative model to be used in facilitating decision-making in forecasting. Universiti Utara Malaysia Press 2020 Article PeerReviewed application/pdf en https://repo.uum.edu.my/id/eprint/28795/1/JICT%2019%2003%202020%20351-379.pdf Mohammed, Athraa Jasim and Ghathwan, Khalil Ibrahim and Yusof, Yuhanis (2020) A Hybrid Least Squares Support Vector Machine with Bat and Cuckoo Search Algorithms for Time Series Forecasting. Journal of Information and Communication Technology, 19 (03). pp. 351-379. ISSN 2180-3862
spellingShingle QA75 Electronic computers. Computer science
Mohammed, Athraa Jasim
Ghathwan, Khalil Ibrahim
Yusof, Yuhanis
A Hybrid Least Squares Support Vector Machine with Bat and Cuckoo Search Algorithms for Time Series Forecasting
title A Hybrid Least Squares Support Vector Machine with Bat and Cuckoo Search Algorithms for Time Series Forecasting
title_full A Hybrid Least Squares Support Vector Machine with Bat and Cuckoo Search Algorithms for Time Series Forecasting
title_fullStr A Hybrid Least Squares Support Vector Machine with Bat and Cuckoo Search Algorithms for Time Series Forecasting
title_full_unstemmed A Hybrid Least Squares Support Vector Machine with Bat and Cuckoo Search Algorithms for Time Series Forecasting
title_short A Hybrid Least Squares Support Vector Machine with Bat and Cuckoo Search Algorithms for Time Series Forecasting
title_sort hybrid least squares support vector machine with bat and cuckoo search algorithms for time series forecasting
topic QA75 Electronic computers. Computer science
url https://repo.uum.edu.my/id/eprint/28795/1/JICT%2019%2003%202020%20351-379.pdf
work_keys_str_mv AT mohammedathraajasim ahybridleastsquaressupportvectormachinewithbatandcuckoosearchalgorithmsfortimeseriesforecasting
AT ghathwankhalilibrahim ahybridleastsquaressupportvectormachinewithbatandcuckoosearchalgorithmsfortimeseriesforecasting
AT yusofyuhanis ahybridleastsquaressupportvectormachinewithbatandcuckoosearchalgorithmsfortimeseriesforecasting
AT mohammedathraajasim hybridleastsquaressupportvectormachinewithbatandcuckoosearchalgorithmsfortimeseriesforecasting
AT ghathwankhalilibrahim hybridleastsquaressupportvectormachinewithbatandcuckoosearchalgorithmsfortimeseriesforecasting
AT yusofyuhanis hybridleastsquaressupportvectormachinewithbatandcuckoosearchalgorithmsfortimeseriesforecasting