Projection to Mixture Families and Rate-Distortion Bounds with Power Distortion Measures
The explicit form of the rate-distortion function has rarely been obtained, except for few cases where the Shannon lower bound coincides with the rate-distortion function for the entire range of the positive rate. From an information geometrical point of view, the evaluation of the rate-distortion f...
| Main Author: | |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2017-06-01
|
| Series: | Entropy |
| Subjects: | |
| Online Access: | http://www.mdpi.com/1099-4300/19/6/262 |
| _version_ | 1818001194963959808 |
|---|---|
| author | Kazuho Watanabe |
| author_facet | Kazuho Watanabe |
| author_sort | Kazuho Watanabe |
| collection | DOAJ |
| description | The explicit form of the rate-distortion function has rarely been obtained, except for few cases where the Shannon lower bound coincides with the rate-distortion function for the entire range of the positive rate. From an information geometrical point of view, the evaluation of the rate-distortion function is achieved by a projection to the mixture family defined by the distortion measure. In this paper, we consider the β -th power distortion measure, and prove that β -generalized Gaussian distribution is the only source that can make the Shannon lower bound tight at the minimum distortion level at zero rate. We demonstrate that the tightness of the Shannon lower bound for β = 1 (Laplacian source) and β = 2 (Gaussian source) yields upper bounds to the rate-distortion function of power distortion measures with a different power. These bounds evaluate from above the projection of the source distribution to the mixture family of the generalized Gaussian models. Applying similar arguments to ϵ -insensitive distortion measures, we consider the tightness of the Shannon lower bound and derive an upper bound to the distortion-rate function which is accurate at low rates. |
| first_indexed | 2024-04-14T03:31:27Z |
| format | Article |
| id | doaj.art-e3455a921a874f66af183c25954141b9 |
| institution | Directory Open Access Journal |
| issn | 1099-4300 |
| language | English |
| last_indexed | 2024-04-14T03:31:27Z |
| publishDate | 2017-06-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Entropy |
| spelling | doaj.art-e3455a921a874f66af183c25954141b92022-12-22T02:14:58ZengMDPI AGEntropy1099-43002017-06-0119626210.3390/e19060262e19060262Projection to Mixture Families and Rate-Distortion Bounds with Power Distortion MeasuresKazuho Watanabe0Department of Computer Science and Engineering, Toyohashi University of Technology, 1-1 Hibarigaoka, Tempaku-cho, Toyohashi 441-8580, JapanThe explicit form of the rate-distortion function has rarely been obtained, except for few cases where the Shannon lower bound coincides with the rate-distortion function for the entire range of the positive rate. From an information geometrical point of view, the evaluation of the rate-distortion function is achieved by a projection to the mixture family defined by the distortion measure. In this paper, we consider the β -th power distortion measure, and prove that β -generalized Gaussian distribution is the only source that can make the Shannon lower bound tight at the minimum distortion level at zero rate. We demonstrate that the tightness of the Shannon lower bound for β = 1 (Laplacian source) and β = 2 (Gaussian source) yields upper bounds to the rate-distortion function of power distortion measures with a different power. These bounds evaluate from above the projection of the source distribution to the mixture family of the generalized Gaussian models. Applying similar arguments to ϵ -insensitive distortion measures, we consider the tightness of the Shannon lower bound and derive an upper bound to the distortion-rate function which is accurate at low rates.http://www.mdpi.com/1099-4300/19/6/262rate-distortion functionShannon lower boundgeneralized Gaussian sourcem-projection |
| spellingShingle | Kazuho Watanabe Projection to Mixture Families and Rate-Distortion Bounds with Power Distortion Measures Entropy rate-distortion function Shannon lower bound generalized Gaussian source m-projection |
| title | Projection to Mixture Families and Rate-Distortion Bounds with Power Distortion Measures |
| title_full | Projection to Mixture Families and Rate-Distortion Bounds with Power Distortion Measures |
| title_fullStr | Projection to Mixture Families and Rate-Distortion Bounds with Power Distortion Measures |
| title_full_unstemmed | Projection to Mixture Families and Rate-Distortion Bounds with Power Distortion Measures |
| title_short | Projection to Mixture Families and Rate-Distortion Bounds with Power Distortion Measures |
| title_sort | projection to mixture families and rate distortion bounds with power distortion measures |
| topic | rate-distortion function Shannon lower bound generalized Gaussian source m-projection |
| url | http://www.mdpi.com/1099-4300/19/6/262 |
| work_keys_str_mv | AT kazuhowatanabe projectiontomixturefamiliesandratedistortionboundswithpowerdistortionmeasures |