Channel probing in communication systems: Myopic policies are not always optimal

We consider a multi-channel communication system in which a transmitter has access to a large number of channels, but does not know the state of these channels. We model channel state using an ON/OFF Markovian model, and allow the transmitter to probe one of the channels at predetermined probing int...

Full description

Bibliographic Details
Main Authors: Keslassy, Isaac, Johnston, Matthew Ryan, Modiano, Eytan H
Other Authors: Massachusetts Institute of Technology. Department of Aeronautics and Astronautics
Format: Article
Language:en_US
Published: Institute of Electrical and Electronics Engineers (IEEE) 2018
Online Access:http://hdl.handle.net/1721.1/116524
https://orcid.org/0000-0001-8238-8130
_version_ 1811081916636463104
author Keslassy, Isaac
Johnston, Matthew Ryan
Modiano, Eytan H
author2 Massachusetts Institute of Technology. Department of Aeronautics and Astronautics
author_facet Massachusetts Institute of Technology. Department of Aeronautics and Astronautics
Keslassy, Isaac
Johnston, Matthew Ryan
Modiano, Eytan H
author_sort Keslassy, Isaac
collection MIT
description We consider a multi-channel communication system in which a transmitter has access to a large number of channels, but does not know the state of these channels. We model channel state using an ON/OFF Markovian model, and allow the transmitter to probe one of the channels at predetermined probing intervals to decide over which channel to transmit. For models in which the transmitter must send over the probed channel, it has been shown that a myopic policy that probes the channel most likely to be ON is optimal. In this work, we allow the transmitter to select a channel over which to transmit that is not necessarily the one it probed. We show that the myopic policy is not optimal, and propose a simple alternative probing policy, which achieves a higher per-slot expected throughput. Finally, we consider the case where there is a fixed cost associated with probing and derive optimal probing intervals.
first_indexed 2024-09-23T11:54:27Z
format Article
id mit-1721.1/116524
institution Massachusetts Institute of Technology
language en_US
last_indexed 2024-09-23T11:54:27Z
publishDate 2018
publisher Institute of Electrical and Electronics Engineers (IEEE)
record_format dspace
spelling mit-1721.1/1165242022-10-01T06:51:51Z Channel probing in communication systems: Myopic policies are not always optimal Keslassy, Isaac Johnston, Matthew Ryan Modiano, Eytan H Massachusetts Institute of Technology. Department of Aeronautics and Astronautics Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science Massachusetts Institute of Technology. Laboratory for Information and Decision Systems Johnston, Matthew Ryan Modiano, Eytan H We consider a multi-channel communication system in which a transmitter has access to a large number of channels, but does not know the state of these channels. We model channel state using an ON/OFF Markovian model, and allow the transmitter to probe one of the channels at predetermined probing intervals to decide over which channel to transmit. For models in which the transmitter must send over the probed channel, it has been shown that a myopic policy that probes the channel most likely to be ON is optimal. In this work, we allow the transmitter to select a channel over which to transmit that is not necessarily the one it probed. We show that the myopic policy is not optimal, and propose a simple alternative probing policy, which achieves a higher per-slot expected throughput. Finally, we consider the case where there is a fixed cost associated with probing and derive optimal probing intervals. National Science Foundation (U.S.) (Grant CNS1217048) National Science Foundation (U.S.) (CNS-0915988) United States. Army Research Office. Multidisciplinary University Research Initiative (Grant W911NF-08-1-0238) 2018-06-22T16:41:44Z 2018-06-22T16:41:44Z 2013-10 2013-01 Article http://purl.org/eprint/type/ConferencePaper 978-1-4799-0446-4 2157-8117 2157-8095 http://hdl.handle.net/1721.1/116524 Johnston, Matthew, Eytan Modiano, and Isaac Keslassy. “Channel Probing in Communication Systems: Myopic Policies Are Not Always Optimal.” 2013 IEEE International Symposium on Information Theory (July 2013), Istanbul, Turkey,Institute of Electrical and Electronics Engineers (IEEE), 2013. https://orcid.org/0000-0001-8238-8130 en_US http://dx.doi.org/10.1109/ISIT.2013.6620563 2013 IEEE International Symposium on Information Theory (ISIT) Creative Commons Attribution-Noncommercial-Share Alike http://creativecommons.org/licenses/by-nc-sa/4.0/ application/pdf Institute of Electrical and Electronics Engineers (IEEE) Prof. Modiano
spellingShingle Keslassy, Isaac
Johnston, Matthew Ryan
Modiano, Eytan H
Channel probing in communication systems: Myopic policies are not always optimal
title Channel probing in communication systems: Myopic policies are not always optimal
title_full Channel probing in communication systems: Myopic policies are not always optimal
title_fullStr Channel probing in communication systems: Myopic policies are not always optimal
title_full_unstemmed Channel probing in communication systems: Myopic policies are not always optimal
title_short Channel probing in communication systems: Myopic policies are not always optimal
title_sort channel probing in communication systems myopic policies are not always optimal
url http://hdl.handle.net/1721.1/116524
https://orcid.org/0000-0001-8238-8130
work_keys_str_mv AT keslassyisaac channelprobingincommunicationsystemsmyopicpoliciesarenotalwaysoptimal
AT johnstonmatthewryan channelprobingincommunicationsystemsmyopicpoliciesarenotalwaysoptimal
AT modianoeytanh channelprobingincommunicationsystemsmyopicpoliciesarenotalwaysoptimal