Introduction to Extreme Seeking Entropy

Recently, the concept of evaluating an unusually large learning effort of an adaptive system to detect novelties in the observed data was introduced. The present paper introduces a new measure of the learning effort of an adaptive system. The proposed method also uses adaptable parameters. Instead o...

Full description

Bibliographic Details
Main Authors: Jan Vrba, Jan Mareš
Format: Article
Language:English
Published: MDPI AG 2020-01-01
Series:Entropy
Subjects:
Online Access:https://www.mdpi.com/1099-4300/22/1/93
_version_ 1798024698259308544
author Jan Vrba
Jan Mareš
author_facet Jan Vrba
Jan Mareš
author_sort Jan Vrba
collection DOAJ
description Recently, the concept of evaluating an unusually large learning effort of an adaptive system to detect novelties in the observed data was introduced. The present paper introduces a new measure of the learning effort of an adaptive system. The proposed method also uses adaptable parameters. Instead of a multi-scale enhanced approach, the generalized Pareto distribution is employed to estimate the probability of unusual updates, as well as for detecting novelties. This measure was successfully tested in various scenarios with (i) synthetic data, (ii) real time series datasets, and multiple adaptive filters and learning algorithms. The results of these experiments are presented.
first_indexed 2024-04-11T18:06:46Z
format Article
id doaj.art-b9ec1bda4660418b93ce01024d388dc7
institution Directory Open Access Journal
issn 1099-4300
language English
last_indexed 2024-04-11T18:06:46Z
publishDate 2020-01-01
publisher MDPI AG
record_format Article
series Entropy
spelling doaj.art-b9ec1bda4660418b93ce01024d388dc72022-12-22T04:10:18ZengMDPI AGEntropy1099-43002020-01-012219310.3390/e22010093e22010093Introduction to Extreme Seeking EntropyJan Vrba0Jan Mareš1Department of Computing and Control Engineering, Faculty of Chemical Engineering, University of Chemistry and Technology, 166 28 Prague, Czech RepublicDepartment of Computing and Control Engineering, Faculty of Chemical Engineering, University of Chemistry and Technology, 166 28 Prague, Czech RepublicRecently, the concept of evaluating an unusually large learning effort of an adaptive system to detect novelties in the observed data was introduced. The present paper introduces a new measure of the learning effort of an adaptive system. The proposed method also uses adaptable parameters. Instead of a multi-scale enhanced approach, the generalized Pareto distribution is employed to estimate the probability of unusual updates, as well as for detecting novelties. This measure was successfully tested in various scenarios with (i) synthetic data, (ii) real time series datasets, and multiple adaptive filters and learning algorithms. The results of these experiments are presented.https://www.mdpi.com/1099-4300/22/1/93novelty detectionlearning systemlearningtime serieslearning entropyextreme seeking entropy
spellingShingle Jan Vrba
Jan Mareš
Introduction to Extreme Seeking Entropy
Entropy
novelty detection
learning system
learning
time series
learning entropy
extreme seeking entropy
title Introduction to Extreme Seeking Entropy
title_full Introduction to Extreme Seeking Entropy
title_fullStr Introduction to Extreme Seeking Entropy
title_full_unstemmed Introduction to Extreme Seeking Entropy
title_short Introduction to Extreme Seeking Entropy
title_sort introduction to extreme seeking entropy
topic novelty detection
learning system
learning
time series
learning entropy
extreme seeking entropy
url https://www.mdpi.com/1099-4300/22/1/93
work_keys_str_mv AT janvrba introductiontoextremeseekingentropy
AT janmares introductiontoextremeseekingentropy