Meta-cognitive Recurrent Recursive Kernel OS-ELM for concept drift handling

In this paper, a Meta-cognitive Recurrent Recursive Kernel Online Sequential Extreme Learning Machine with Drift Detector Mechanism (meta-RRKOS-ELM-DDM) is proposed. It combines the strengths of Recurrent Kernel Online Sequential Extreme Learning Machine with a new modified Drift Detector Mechanism...

Full description

Bibliographic Details
Main Authors: Liu, Zongying, Loo, Chu Kiong, Seera, Manjeevan
Format: Article
Published: Elsevier 2019
Subjects:
_version_ 1825721416356462592
author Liu, Zongying
Loo, Chu Kiong
Seera, Manjeevan
author_facet Liu, Zongying
Loo, Chu Kiong
Seera, Manjeevan
author_sort Liu, Zongying
collection UM
description In this paper, a Meta-cognitive Recurrent Recursive Kernel Online Sequential Extreme Learning Machine with Drift Detector Mechanism (meta-RRKOS-ELM-DDM) is proposed. It combines the strengths of Recurrent Kernel Online Sequential Extreme Learning Machine with a new modified Drift Detector Mechanism (DDM) and Approximate Linear Dependency Kernel Filter (ALD) in solving concept drift problems and reducing complex computations in the learning. The recursive kernel method successfully replaces the normal kernel method in Recurrent Kernel Online Sequential Extreme Learning Machine with DDM (RKOS-ELM-DDM) and generates a fixed reservoir with optimized information in enhancing the forecasting performance. Meta-cognitive learning strategy decides when the incoming data needs to be updated, retrained, or discarded during learning and automatically finding ALD threshold that reduces the learning time of prediction model. In the experiment, six synthetic and three real-world time series datasets are used to evaluate the ability of recursive kernel method, the performance of concept drift detectors, and meta-cognitive learning strategy in time series prediction. Experimental results indicate the meta-RRKOS-ELM with DDM has superior prediction ability in the different predicting horizons as compared with other algorithms.
first_indexed 2024-03-06T05:50:01Z
format Article
id um.eprints-20036
institution Universiti Malaya
last_indexed 2024-03-06T05:50:01Z
publishDate 2019
publisher Elsevier
record_format dspace
spelling um.eprints-200362019-02-07T09:20:20Z http://eprints.um.edu.my/20036/ Meta-cognitive Recurrent Recursive Kernel OS-ELM for concept drift handling Liu, Zongying Loo, Chu Kiong Seera, Manjeevan QA75 Electronic computers. Computer science In this paper, a Meta-cognitive Recurrent Recursive Kernel Online Sequential Extreme Learning Machine with Drift Detector Mechanism (meta-RRKOS-ELM-DDM) is proposed. It combines the strengths of Recurrent Kernel Online Sequential Extreme Learning Machine with a new modified Drift Detector Mechanism (DDM) and Approximate Linear Dependency Kernel Filter (ALD) in solving concept drift problems and reducing complex computations in the learning. The recursive kernel method successfully replaces the normal kernel method in Recurrent Kernel Online Sequential Extreme Learning Machine with DDM (RKOS-ELM-DDM) and generates a fixed reservoir with optimized information in enhancing the forecasting performance. Meta-cognitive learning strategy decides when the incoming data needs to be updated, retrained, or discarded during learning and automatically finding ALD threshold that reduces the learning time of prediction model. In the experiment, six synthetic and three real-world time series datasets are used to evaluate the ability of recursive kernel method, the performance of concept drift detectors, and meta-cognitive learning strategy in time series prediction. Experimental results indicate the meta-RRKOS-ELM with DDM has superior prediction ability in the different predicting horizons as compared with other algorithms. Elsevier 2019 Article PeerReviewed Liu, Zongying and Loo, Chu Kiong and Seera, Manjeevan (2019) Meta-cognitive Recurrent Recursive Kernel OS-ELM for concept drift handling. Applied Soft Computing, 75. pp. 494-507. ISSN 1568-4946, DOI https://doi.org/10.1016/j.asoc.2018.11.006 <https://doi.org/10.1016/j.asoc.2018.11.006>. https://doi.org/10.1016/j.asoc.2018.11.006 doi:10.1016/j.asoc.2018.11.006
spellingShingle QA75 Electronic computers. Computer science
Liu, Zongying
Loo, Chu Kiong
Seera, Manjeevan
Meta-cognitive Recurrent Recursive Kernel OS-ELM for concept drift handling
title Meta-cognitive Recurrent Recursive Kernel OS-ELM for concept drift handling
title_full Meta-cognitive Recurrent Recursive Kernel OS-ELM for concept drift handling
title_fullStr Meta-cognitive Recurrent Recursive Kernel OS-ELM for concept drift handling
title_full_unstemmed Meta-cognitive Recurrent Recursive Kernel OS-ELM for concept drift handling
title_short Meta-cognitive Recurrent Recursive Kernel OS-ELM for concept drift handling
title_sort meta cognitive recurrent recursive kernel os elm for concept drift handling
topic QA75 Electronic computers. Computer science
work_keys_str_mv AT liuzongying metacognitiverecurrentrecursivekerneloselmforconceptdrifthandling
AT loochukiong metacognitiverecurrentrecursivekerneloselmforconceptdrifthandling
AT seeramanjeevan metacognitiverecurrentrecursivekerneloselmforconceptdrifthandling