Optimal channel probing in communication systems: The two-channel case
We consider a multi-channel communication system in which a transmitter has access to two channels, but does not know the state of either channel. We model the channel state using an ON/OFF Markovian model, and allow the transmitter to probe one of the channels at predetermined probing intervals to...
| Main Authors: | , |
|---|---|
| Other Authors: | |
| Format: | Article |
| Language: | en_US |
| Published: |
Institute of Electrical and Electronics Engineers (IEEE)
2015
|
| Online Access: | http://hdl.handle.net/1721.1/96987 https://orcid.org/0000-0001-8238-8130 |
| _version_ | 1826205331494010880 |
|---|---|
| author | Johnston, Matthew Ryan Modiano, Eytan H. |
| author2 | Massachusetts Institute of Technology. Department of Aeronautics and Astronautics |
| author_facet | Massachusetts Institute of Technology. Department of Aeronautics and Astronautics Johnston, Matthew Ryan Modiano, Eytan H. |
| author_sort | Johnston, Matthew Ryan |
| collection | MIT |
| description | We consider a multi-channel communication system in which a transmitter has access to two channels, but does not know the state of either channel. We model the channel state using an ON/OFF Markovian model, and allow the transmitter to probe one of the channels at predetermined probing intervals to decide over which channel to transmit. For models in which the transmitter must transmit over the probed channel, it has been shown that a myopic policy that probes the channel most likely to be ON is optimal. In this work, we allow the transmitter to select a channel over which to transmit that is not necessarily the one it probed. We show that in the case where the two channels are i.i.d, all probing policies yield equal reward. We extend this problem to dynamically choose when to probe based on the results of previous probes, and characterize the optimal policy, as well as provide a LP in terms of state action frequencies to find the optimal policy. |
| first_indexed | 2024-09-23T13:11:00Z |
| format | Article |
| id | mit-1721.1/96987 |
| institution | Massachusetts Institute of Technology |
| language | en_US |
| last_indexed | 2024-09-23T13:11:00Z |
| publishDate | 2015 |
| publisher | Institute of Electrical and Electronics Engineers (IEEE) |
| record_format | dspace |
| spelling | mit-1721.1/969872022-09-28T12:28:16Z Optimal channel probing in communication systems: The two-channel case Johnston, Matthew Ryan Modiano, Eytan H. Massachusetts Institute of Technology. Department of Aeronautics and Astronautics Massachusetts Institute of Technology. Laboratory for Information and Decision Systems Johnston, Matthew Ryan Modiano, Eytan H. We consider a multi-channel communication system in which a transmitter has access to two channels, but does not know the state of either channel. We model the channel state using an ON/OFF Markovian model, and allow the transmitter to probe one of the channels at predetermined probing intervals to decide over which channel to transmit. For models in which the transmitter must transmit over the probed channel, it has been shown that a myopic policy that probes the channel most likely to be ON is optimal. In this work, we allow the transmitter to select a channel over which to transmit that is not necessarily the one it probed. We show that in the case where the two channels are i.i.d, all probing policies yield equal reward. We extend this problem to dynamically choose when to probe based on the results of previous probes, and characterize the optimal policy, as well as provide a LP in terms of state action frequencies to find the optimal policy. National Science Foundation (U.S.) (Grant CNS-0915988) National Science Foundation (U.S.) (Grant CNS-1217048) United States. Army Research Office. Multidisciplinary University Research Initiative (Grant W911NF-08-1-0238) 2015-05-14T13:38:21Z 2015-05-14T13:38:21Z 2013-12 Article http://purl.org/eprint/type/ConferencePaper 978-1-4799-1353-4 http://hdl.handle.net/1721.1/96987 Johnston, Matthew, and Eytan Modiano. “Optimal Channel Probing in Communication Systems: The Two-Channel Case.” 2013 IEEE Global Communications Conference (GLOBECOM) (December 2013). https://orcid.org/0000-0001-8238-8130 en_US http://dx.doi.org/10.1109/GLOCOM.2013.6831336 Proceedings of the 2013 IEEE Global Communications Conference (GLOBECOM) Creative Commons Attribution-Noncommercial-Share Alike http://creativecommons.org/licenses/by-nc-sa/4.0/ application/pdf Institute of Electrical and Electronics Engineers (IEEE) MIT web domain |
| spellingShingle | Johnston, Matthew Ryan Modiano, Eytan H. Optimal channel probing in communication systems: The two-channel case |
| title | Optimal channel probing in communication systems: The two-channel case |
| title_full | Optimal channel probing in communication systems: The two-channel case |
| title_fullStr | Optimal channel probing in communication systems: The two-channel case |
| title_full_unstemmed | Optimal channel probing in communication systems: The two-channel case |
| title_short | Optimal channel probing in communication systems: The two-channel case |
| title_sort | optimal channel probing in communication systems the two channel case |
| url | http://hdl.handle.net/1721.1/96987 https://orcid.org/0000-0001-8238-8130 |
| work_keys_str_mv | AT johnstonmatthewryan optimalchannelprobingincommunicationsystemsthetwochannelcase AT modianoeytanh optimalchannelprobingincommunicationsystemsthetwochannelcase |