A better-performing Q-learning game-theoretic distributed routing for underwater wireless sensor networks
Underwater sensor networks have recently emerged as a promising networking technique for various underwater applications. However, the acoustic routing of underwater sensor networks in the aquatic environment presents challenges in terms of dynamic structure, high rates of energy consumption, long p...
| Main Author: | |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Hindawi - SAGE Publishing
2018-01-01
|
| Series: | International Journal of Distributed Sensor Networks |
| Online Access: | https://doi.org/10.1177/1550147718754728 |
| _version_ | 1827008950511337472 |
|---|---|
| author | Sungwook Kim |
| author_facet | Sungwook Kim |
| author_sort | Sungwook Kim |
| collection | DOAJ |
| description | Underwater sensor networks have recently emerged as a promising networking technique for various underwater applications. However, the acoustic routing of underwater sensor networks in the aquatic environment presents challenges in terms of dynamic structure, high rates of energy consumption, long propagation delay, and narrow bandwidth. Therefore, it is difficult to adapt traditional routing protocols, which are known to be reliable in terrestrial wireless networks. In this study, we focus on the development of novel routing algorithms to tackle acoustic transmission problems in underwater sensor networks. The proposed scheme is based on reinforcement learning and game theory and is designed as a routing game model to provide an effective packet-forwarding mechanism. In particular, our Q-learning game paradigm captures the dynamics of the underwater sensor networks system in a decentralized, distributed manner. The results of a performance simulation analysis show that the proposed scheme can outperform existing schemes while displaying balanced system performance in terms of energy efficiency and underwater sensor networks throughput. |
| first_indexed | 2024-03-12T11:09:13Z |
| format | Article |
| id | doaj.art-18da9afa40894e89b10ee53859c7eb80 |
| institution | Directory Open Access Journal |
| issn | 1550-1477 |
| language | English |
| last_indexed | 2025-02-18T12:40:57Z |
| publishDate | 2018-01-01 |
| publisher | Hindawi - SAGE Publishing |
| record_format | Article |
| series | International Journal of Distributed Sensor Networks |
| spelling | doaj.art-18da9afa40894e89b10ee53859c7eb802024-11-02T04:11:56ZengHindawi - SAGE PublishingInternational Journal of Distributed Sensor Networks1550-14772018-01-011410.1177/1550147718754728A better-performing Q-learning game-theoretic distributed routing for underwater wireless sensor networksSungwook KimUnderwater sensor networks have recently emerged as a promising networking technique for various underwater applications. However, the acoustic routing of underwater sensor networks in the aquatic environment presents challenges in terms of dynamic structure, high rates of energy consumption, long propagation delay, and narrow bandwidth. Therefore, it is difficult to adapt traditional routing protocols, which are known to be reliable in terrestrial wireless networks. In this study, we focus on the development of novel routing algorithms to tackle acoustic transmission problems in underwater sensor networks. The proposed scheme is based on reinforcement learning and game theory and is designed as a routing game model to provide an effective packet-forwarding mechanism. In particular, our Q-learning game paradigm captures the dynamics of the underwater sensor networks system in a decentralized, distributed manner. The results of a performance simulation analysis show that the proposed scheme can outperform existing schemes while displaying balanced system performance in terms of energy efficiency and underwater sensor networks throughput.https://doi.org/10.1177/1550147718754728 |
| spellingShingle | Sungwook Kim A better-performing Q-learning game-theoretic distributed routing for underwater wireless sensor networks International Journal of Distributed Sensor Networks |
| title | A better-performing Q-learning game-theoretic distributed routing for underwater wireless sensor networks |
| title_full | A better-performing Q-learning game-theoretic distributed routing for underwater wireless sensor networks |
| title_fullStr | A better-performing Q-learning game-theoretic distributed routing for underwater wireless sensor networks |
| title_full_unstemmed | A better-performing Q-learning game-theoretic distributed routing for underwater wireless sensor networks |
| title_short | A better-performing Q-learning game-theoretic distributed routing for underwater wireless sensor networks |
| title_sort | better performing q learning game theoretic distributed routing for underwater wireless sensor networks |
| url | https://doi.org/10.1177/1550147718754728 |
| work_keys_str_mv | AT sungwookkim abetterperformingqlearninggametheoreticdistributedroutingforunderwaterwirelesssensornetworks AT sungwookkim betterperformingqlearninggametheoreticdistributedroutingforunderwaterwirelesssensornetworks |