Algorithm for Efficient Entropy Estimation
We consider the problem of the nonparametric entropy estimation of a stationary ergodic process. Our approach is based on the nearest-neighbor distances. We propose a broad class of metrics on the space Ω = AN of right-sided infinite sequences drawn from a finite alphabet A. The new metric has a par...
| Main Author: | |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Yaroslavl State University
2013-04-01
|
| Series: | Моделирование и анализ информационных систем |
| Subjects: | |
| Online Access: | https://www.mais-journal.ru/jour/article/view/216 |
| _version_ | 1797877964995559424 |
|---|---|
| author | E. A. Timofeev |
| author_facet | E. A. Timofeev |
| author_sort | E. A. Timofeev |
| collection | DOAJ |
| description | We consider the problem of the nonparametric entropy estimation of a stationary ergodic process. Our approach is based on the nearest-neighbor distances. We propose a broad class of metrics on the space Ω = AN of right-sided infinite sequences drawn from a finite alphabet A. The new metric has a parameter which is a non-increasing function. We apply this metrics to nearest-neighbor entropy estimators. We prove that, under certain conditions, the estimators has a small variance. We show that a special selection of the metric parameters reduction of the estimator’s bias. The article is published in the author’s wording. |
| first_indexed | 2024-04-10T02:25:11Z |
| format | Article |
| id | doaj.art-a801e41cfff143f2b26a29322402ae5f |
| institution | Directory Open Access Journal |
| issn | 1818-1015 2313-5417 |
| language | English |
| last_indexed | 2024-04-10T02:25:11Z |
| publishDate | 2013-04-01 |
| publisher | Yaroslavl State University |
| record_format | Article |
| series | Моделирование и анализ информационных систем |
| spelling | doaj.art-a801e41cfff143f2b26a29322402ae5f2023-03-13T08:07:31ZengYaroslavl State UniversityМоделирование и анализ информационных систем1818-10152313-54172013-04-0120217818510.18255/1818-1015-2013-2-178-185209Algorithm for Efficient Entropy EstimationE. A. Timofeev0Ярославский государственный университет им. П. Г. ДемидоваWe consider the problem of the nonparametric entropy estimation of a stationary ergodic process. Our approach is based on the nearest-neighbor distances. We propose a broad class of metrics on the space Ω = AN of right-sided infinite sequences drawn from a finite alphabet A. The new metric has a parameter which is a non-increasing function. We apply this metrics to nearest-neighbor entropy estimators. We prove that, under certain conditions, the estimators has a small variance. We show that a special selection of the metric parameters reduction of the estimator’s bias. The article is published in the author’s wording.https://www.mais-journal.ru/jour/article/view/216энтропиянепараметрическая оценкаметрикашармера бернулли |
| spellingShingle | E. A. Timofeev Algorithm for Efficient Entropy Estimation Моделирование и анализ информационных систем энтропия непараметрическая оценка метрика шар мера бернулли |
| title | Algorithm for Efficient Entropy Estimation |
| title_full | Algorithm for Efficient Entropy Estimation |
| title_fullStr | Algorithm for Efficient Entropy Estimation |
| title_full_unstemmed | Algorithm for Efficient Entropy Estimation |
| title_short | Algorithm for Efficient Entropy Estimation |
| title_sort | algorithm for efficient entropy estimation |
| topic | энтропия непараметрическая оценка метрика шар мера бернулли |
| url | https://www.mais-journal.ru/jour/article/view/216 |
| work_keys_str_mv | AT eatimofeev algorithmforefficiententropyestimation |