Distributed Online Ensemble Learning Based on Orthogonal Transformation

A new distributed online learning scheme for classifying data captured from distributed data sources is proposed in this paper. The scheme consists of multiple distributed learners that independently classify different streams of data. Each local learner uses an ensemble classifier trained by shared...

Full description

Bibliographic Details
Main Authors: Yu Zhang, Liangshan Shao
Format: Article
Language:English
Published: IEEE 2019-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/8918296/
_version_ 1818875902494244864
author Yu Zhang
Liangshan Shao
author_facet Yu Zhang
Liangshan Shao
author_sort Yu Zhang
collection DOAJ
description A new distributed online learning scheme for classifying data captured from distributed data sources is proposed in this paper. The scheme consists of multiple distributed learners that independently classify different streams of data. Each local learner uses an ensemble classifier trained by shared data to make a prediction. We propose a novel form of shared data, that is, the covariance matrix and mean vector, that has small and stable network traffic when transmitted between nodes. Then, we provide a systematic online ensemble learning approach based on these shared data. In contrast to boosting and bagging, our proposed learning approach is based on orthogonal transformation, which can increase the differences between individual learners without a significant loss in accuracy. Moreover, we discuss the ensemble maintenance method based on weight to adapt the underlying data dynamics. Empirical studies demonstrate the effectiveness of our approach in comparison to existing state-of-the-art methods on several datasets.
first_indexed 2024-12-19T13:33:52Z
format Article
id doaj.art-04f301d27c7a41cbad7c2b74832205cd
institution Directory Open Access Journal
issn 2169-3536
language English
last_indexed 2024-12-19T13:33:52Z
publishDate 2019-01-01
publisher IEEE
record_format Article
series IEEE Access
spelling doaj.art-04f301d27c7a41cbad7c2b74832205cd2022-12-21T20:19:17ZengIEEEIEEE Access2169-35362019-01-01717346317347610.1109/ACCESS.2019.29570048918296Distributed Online Ensemble Learning Based on Orthogonal TransformationYu Zhang0https://orcid.org/0000-0001-9725-5832Liangshan Shao1https://orcid.org/0000-0003-0162-3704School of Science, Liaoning Technical University, Fuxin, ChinaResearch Centre in Management Science, Liaoning Technical University, Fuxin, ChinaA new distributed online learning scheme for classifying data captured from distributed data sources is proposed in this paper. The scheme consists of multiple distributed learners that independently classify different streams of data. Each local learner uses an ensemble classifier trained by shared data to make a prediction. We propose a novel form of shared data, that is, the covariance matrix and mean vector, that has small and stable network traffic when transmitted between nodes. Then, we provide a systematic online ensemble learning approach based on these shared data. In contrast to boosting and bagging, our proposed learning approach is based on orthogonal transformation, which can increase the differences between individual learners without a significant loss in accuracy. Moreover, we discuss the ensemble maintenance method based on weight to adapt the underlying data dynamics. Empirical studies demonstrate the effectiveness of our approach in comparison to existing state-of-the-art methods on several datasets.https://ieeexplore.ieee.org/document/8918296/Distributed online learningensemble learningcovariance matrixmean vectororthogonal transformation
spellingShingle Yu Zhang
Liangshan Shao
Distributed Online Ensemble Learning Based on Orthogonal Transformation
IEEE Access
Distributed online learning
ensemble learning
covariance matrix
mean vector
orthogonal transformation
title Distributed Online Ensemble Learning Based on Orthogonal Transformation
title_full Distributed Online Ensemble Learning Based on Orthogonal Transformation
title_fullStr Distributed Online Ensemble Learning Based on Orthogonal Transformation
title_full_unstemmed Distributed Online Ensemble Learning Based on Orthogonal Transformation
title_short Distributed Online Ensemble Learning Based on Orthogonal Transformation
title_sort distributed online ensemble learning based on orthogonal transformation
topic Distributed online learning
ensemble learning
covariance matrix
mean vector
orthogonal transformation
url https://ieeexplore.ieee.org/document/8918296/
work_keys_str_mv AT yuzhang distributedonlineensemblelearningbasedonorthogonaltransformation
AT liangshanshao distributedonlineensemblelearningbasedonorthogonaltransformation