An Ensemble Approach to Short-Term Wind Speed Predictions Using Stochastic Methods, Wavelets and Gradient Boosting Decision Trees

Considering that wind power is proportional to the cube of the wind speed variable, which is highly random, complex power grid management tasks have arisen as a result. Wind speed prediction in the short term is crucial for load dispatch planning and load increment/decrement decisions. The chaotic i...

Full description

Bibliographic Details
Main Authors: Khathutshelo Steven Sivhugwana, Edmore Ranganai
Format: Article
Language:English
Published: MDPI AG 2024-02-01
Series:Wind
Subjects:
Online Access:https://www.mdpi.com/2674-032X/4/1/3
_version_ 1797239009213153280
author Khathutshelo Steven Sivhugwana
Edmore Ranganai
author_facet Khathutshelo Steven Sivhugwana
Edmore Ranganai
author_sort Khathutshelo Steven Sivhugwana
collection DOAJ
description Considering that wind power is proportional to the cube of the wind speed variable, which is highly random, complex power grid management tasks have arisen as a result. Wind speed prediction in the short term is crucial for load dispatch planning and load increment/decrement decisions. The chaotic intermittency of speed is often characterised by inherent linear and nonlinear patterns, as well as nonstationary behaviour; thus, it is generally difficult to predict it accurately and efficiently using a single linear or nonlinear model. In this study, wavelet transform (WT), autoregressive integrated moving average (ARIMA), extreme gradient boosting trees (XGBoost), and support vector regression (SVR) are combined to predict high-resolution short-term wind speeds obtained from three Southern African Universities Radiometric Network (SAURAN) stations: Richtersveld (RVD); Central University of Technology (CUT); and University of Pretoria (UPR). This hybrid model is termed WT-ARIMA-XGBoost-SVR. In the proposed hybrid, the ARIMA component is employed to capture linearity, while XGBoost captures nonlinearity using the wavelet decomposed subseries from the residuals as input features. Finally, the SVR model reconciles linear and nonlinear predictions. We evaluated the WT-ARIMA-XGBoost-SVR’s efficacy against ARIMA and two other hybrid models that substitute XGBoost with a light gradient boosting machine (LGB) component to form a WT-ARIMA-LGB-SVR hybrid model and a stochastic gradient boosting machine (SGB) to form a WT-ARIMA-SGB-SVR hybrid model. Based on mean absolute error (MAE), mean absolute percentage error (MAPE), root mean square error (RMSE), coefficient of determination (<i>R</i><sup>2</sup>), and prediction interval normalised average width (PINAW), the proposed hybrid model provided more accurate and reliable predictions with less uncertainty for all three datasets. This study is critical for improving wind speed prediction reliability to ensure the development of effective wind power management strategies.
first_indexed 2024-04-24T17:44:43Z
format Article
id doaj.art-1d58f30d8f4f41e1b948997ff4207686
institution Directory Open Access Journal
issn 2674-032X
language English
last_indexed 2024-04-24T17:44:43Z
publishDate 2024-02-01
publisher MDPI AG
record_format Article
series Wind
spelling doaj.art-1d58f30d8f4f41e1b948997ff42076862024-03-27T14:08:43ZengMDPI AGWind2674-032X2024-02-0141446710.3390/wind4010003An Ensemble Approach to Short-Term Wind Speed Predictions Using Stochastic Methods, Wavelets and Gradient Boosting Decision TreesKhathutshelo Steven Sivhugwana0Edmore Ranganai1Department of Statistics, University of South Africa, Florida Campus, Johannesburg 1709, South AfricaDepartment of Statistics, University of South Africa, Florida Campus, Johannesburg 1709, South AfricaConsidering that wind power is proportional to the cube of the wind speed variable, which is highly random, complex power grid management tasks have arisen as a result. Wind speed prediction in the short term is crucial for load dispatch planning and load increment/decrement decisions. The chaotic intermittency of speed is often characterised by inherent linear and nonlinear patterns, as well as nonstationary behaviour; thus, it is generally difficult to predict it accurately and efficiently using a single linear or nonlinear model. In this study, wavelet transform (WT), autoregressive integrated moving average (ARIMA), extreme gradient boosting trees (XGBoost), and support vector regression (SVR) are combined to predict high-resolution short-term wind speeds obtained from three Southern African Universities Radiometric Network (SAURAN) stations: Richtersveld (RVD); Central University of Technology (CUT); and University of Pretoria (UPR). This hybrid model is termed WT-ARIMA-XGBoost-SVR. In the proposed hybrid, the ARIMA component is employed to capture linearity, while XGBoost captures nonlinearity using the wavelet decomposed subseries from the residuals as input features. Finally, the SVR model reconciles linear and nonlinear predictions. We evaluated the WT-ARIMA-XGBoost-SVR’s efficacy against ARIMA and two other hybrid models that substitute XGBoost with a light gradient boosting machine (LGB) component to form a WT-ARIMA-LGB-SVR hybrid model and a stochastic gradient boosting machine (SGB) to form a WT-ARIMA-SGB-SVR hybrid model. Based on mean absolute error (MAE), mean absolute percentage error (MAPE), root mean square error (RMSE), coefficient of determination (<i>R</i><sup>2</sup>), and prediction interval normalised average width (PINAW), the proposed hybrid model provided more accurate and reliable predictions with less uncertainty for all three datasets. This study is critical for improving wind speed prediction reliability to ensure the development of effective wind power management strategies.https://www.mdpi.com/2674-032X/4/1/3wavelet transformshort termwind speedXGBoostsupport vector regressionARIMA
spellingShingle Khathutshelo Steven Sivhugwana
Edmore Ranganai
An Ensemble Approach to Short-Term Wind Speed Predictions Using Stochastic Methods, Wavelets and Gradient Boosting Decision Trees
Wind
wavelet transform
short term
wind speed
XGBoost
support vector regression
ARIMA
title An Ensemble Approach to Short-Term Wind Speed Predictions Using Stochastic Methods, Wavelets and Gradient Boosting Decision Trees
title_full An Ensemble Approach to Short-Term Wind Speed Predictions Using Stochastic Methods, Wavelets and Gradient Boosting Decision Trees
title_fullStr An Ensemble Approach to Short-Term Wind Speed Predictions Using Stochastic Methods, Wavelets and Gradient Boosting Decision Trees
title_full_unstemmed An Ensemble Approach to Short-Term Wind Speed Predictions Using Stochastic Methods, Wavelets and Gradient Boosting Decision Trees
title_short An Ensemble Approach to Short-Term Wind Speed Predictions Using Stochastic Methods, Wavelets and Gradient Boosting Decision Trees
title_sort ensemble approach to short term wind speed predictions using stochastic methods wavelets and gradient boosting decision trees
topic wavelet transform
short term
wind speed
XGBoost
support vector regression
ARIMA
url https://www.mdpi.com/2674-032X/4/1/3
work_keys_str_mv AT khathutshelostevensivhugwana anensembleapproachtoshorttermwindspeedpredictionsusingstochasticmethodswaveletsandgradientboostingdecisiontrees
AT edmoreranganai anensembleapproachtoshorttermwindspeedpredictionsusingstochasticmethodswaveletsandgradientboostingdecisiontrees
AT khathutshelostevensivhugwana ensembleapproachtoshorttermwindspeedpredictionsusingstochasticmethodswaveletsandgradientboostingdecisiontrees
AT edmoreranganai ensembleapproachtoshorttermwindspeedpredictionsusingstochasticmethodswaveletsandgradientboostingdecisiontrees