A Lower Bound on the Expected Distortion of Joint Source-Channel Coding

We consider the classic joint source-channel coding problem of transmitting a memoryless source over a memoryless channel. The focus of this work is on the rate of convergence of the smallest attainable expected distortion to its asymptotic value, as a function of blocklength n. Our main result is t...

Full description

Bibliographic Details
Main Authors: Kochman, Yuval, Ordentlich, Or, Polyanskiy, Yury
Other Authors: Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science
Format: Article
Language:English
Published: Institute of Electrical and Electronics Engineers (IEEE) 2021
Online Access:https://hdl.handle.net/1721.1/129803
_version_ 1811088234002776064
author Kochman, Yuval
Ordentlich, Or
Polyanskiy, Yury
author2 Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science
author_facet Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science
Kochman, Yuval
Ordentlich, Or
Polyanskiy, Yury
author_sort Kochman, Yuval
collection MIT
description We consider the classic joint source-channel coding problem of transmitting a memoryless source over a memoryless channel. The focus of this work is on the rate of convergence of the smallest attainable expected distortion to its asymptotic value, as a function of blocklength n. Our main result is that in general the convergence rate is not faster than n-1/2. In particular, we show that for the problem of transmitting i.i.d uniform bits over a binary symmetric channels with Hamming distortion, the smallest attainable distortion (bit error rate) is at least Ω(n-1/2) above the asymptotic value, if the "bandwidth expansion ratio" is above 1.
first_indexed 2024-09-23T13:58:49Z
format Article
id mit-1721.1/129803
institution Massachusetts Institute of Technology
language English
last_indexed 2024-09-23T13:58:49Z
publishDate 2021
publisher Institute of Electrical and Electronics Engineers (IEEE)
record_format dspace
spelling mit-1721.1/1298032022-10-01T18:21:25Z A Lower Bound on the Expected Distortion of Joint Source-Channel Coding Kochman, Yuval Ordentlich, Or Polyanskiy, Yury Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science We consider the classic joint source-channel coding problem of transmitting a memoryless source over a memoryless channel. The focus of this work is on the rate of convergence of the smallest attainable expected distortion to its asymptotic value, as a function of blocklength n. Our main result is that in general the convergence rate is not faster than n-1/2. In particular, we show that for the problem of transmitting i.i.d uniform bits over a binary symmetric channels with Hamming distortion, the smallest attainable distortion (bit error rate) is at least Ω(n-1/2) above the asymptotic value, if the "bandwidth expansion ratio" is above 1. 2021-02-17T22:13:30Z 2021-02-17T22:13:30Z 2019-09 2019-07 2021-02-16T14:35:27Z Article http://purl.org/eprint/type/ConferencePaper 9781538692912 2157-8117 https://hdl.handle.net/1721.1/129803 Kochman, Yuval et al. "A Lower Bound on the Expected Distortion of Joint Source-Channel Coding." 2019 IEEE International Symposium on Information Theory (ISIT), July 2019, Paris, France, Institute of Electrical and Electronics Engineers, September 2019. © 2019 IEEE en http://dx.doi.org/10.1109/isit.2019.8849390 2019 IEEE International Symposium on Information Theory (ISIT) Creative Commons Attribution-Noncommercial-Share Alike http://creativecommons.org/licenses/by-nc-sa/4.0/ application/pdf Institute of Electrical and Electronics Engineers (IEEE) Prof. Polyanskiy via Phoebe Ayers
spellingShingle Kochman, Yuval
Ordentlich, Or
Polyanskiy, Yury
A Lower Bound on the Expected Distortion of Joint Source-Channel Coding
title A Lower Bound on the Expected Distortion of Joint Source-Channel Coding
title_full A Lower Bound on the Expected Distortion of Joint Source-Channel Coding
title_fullStr A Lower Bound on the Expected Distortion of Joint Source-Channel Coding
title_full_unstemmed A Lower Bound on the Expected Distortion of Joint Source-Channel Coding
title_short A Lower Bound on the Expected Distortion of Joint Source-Channel Coding
title_sort lower bound on the expected distortion of joint source channel coding
url https://hdl.handle.net/1721.1/129803
work_keys_str_mv AT kochmanyuval alowerboundontheexpecteddistortionofjointsourcechannelcoding
AT ordentlichor alowerboundontheexpecteddistortionofjointsourcechannelcoding
AT polyanskiyyury alowerboundontheexpecteddistortionofjointsourcechannelcoding
AT kochmanyuval lowerboundontheexpecteddistortionofjointsourcechannelcoding
AT ordentlichor lowerboundontheexpecteddistortionofjointsourcechannelcoding
AT polyanskiyyury lowerboundontheexpecteddistortionofjointsourcechannelcoding