RS-RLNC: A Reinforcement Learning-Based Selective Random Linear Network Coding Framework for Tactile Internet
Tactile Internet (TI) has very stringent networking requirements and the transport layer plays a crucial role in meeting these requirements. However, the transport layer has several inherent limitations (e.g., bufferbloat, incast issue, and head of line blocking) due to which the performance of the...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2023-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/10347212/ |
| _version_ | 1797376306534416384 |
|---|---|
| author | Shahzad Rashid Ali Amir Haider Hyung Seok Kim |
| author_facet | Shahzad Rashid Ali Amir Haider Hyung Seok Kim |
| author_sort | Shahzad |
| collection | DOAJ |
| description | Tactile Internet (TI) has very stringent networking requirements and the transport layer plays a crucial role in meeting these requirements. However, the transport layer has several inherent limitations (e.g., bufferbloat, incast issue, and head of line blocking) due to which the performance of the current transport layer solutions is not optimal. We advocate replacing the “store-and-forward” strategy in transport layer solutions with the “compute-and-forward” strategy. One way to implement the “compute-and-forward” strategy is random linear network coding (RLNC). This paper proposes a learning-based RLNC framework called RS-RLNC that utilizes network and receiver feedback to optimally select between block-RLNC and sliding-RLNC to improve overall network performance. We present a simulation-based performance evaluation of current transport layer solutions against the state-of-the-art RLNC and RS-RLNC in terms of throughput, latency, and decoding complexity. Delay is reduced by a factor of 8.5% and decoding complexity is improved up to 20% compared to the state-of-the-art. Simulation results indicate that RS-RLNC has the potential to meet the stringent requirements of TI applications. Additionally, we present three future directions outlining the evolution of RS-RLNC to enhance the transport layer for TI compatibility. |
| first_indexed | 2024-03-08T19:36:39Z |
| format | Article |
| id | doaj.art-ba4bb0a9e89c4e7ab7ea7f55717556bb |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-03-08T19:36:39Z |
| publishDate | 2023-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-ba4bb0a9e89c4e7ab7ea7f55717556bb2023-12-26T00:11:39ZengIEEEIEEE Access2169-35362023-01-011114127714128810.1109/ACCESS.2023.334021010347212RS-RLNC: A Reinforcement Learning-Based Selective Random Linear Network Coding Framework for Tactile Internet Shahzad0https://orcid.org/0000-0002-3743-0309Rashid Ali1Amir Haider2https://orcid.org/0000-0002-1534-061XHyung Seok Kim3https://orcid.org/0000-0002-2240-1337Department of Intelligent Mechatronics Engineering, Sejong University, Seoul, Republic of KoreaDepartment of Engineering Sciences, University West, Trollhättan, SwedenDepartment of Intelligent Mechatronics Engineering, Sejong University, Seoul, Republic of KoreaDepartment of Intelligent Mechatronics Engineering, Sejong University, Seoul, Republic of KoreaTactile Internet (TI) has very stringent networking requirements and the transport layer plays a crucial role in meeting these requirements. However, the transport layer has several inherent limitations (e.g., bufferbloat, incast issue, and head of line blocking) due to which the performance of the current transport layer solutions is not optimal. We advocate replacing the “store-and-forward” strategy in transport layer solutions with the “compute-and-forward” strategy. One way to implement the “compute-and-forward” strategy is random linear network coding (RLNC). This paper proposes a learning-based RLNC framework called RS-RLNC that utilizes network and receiver feedback to optimally select between block-RLNC and sliding-RLNC to improve overall network performance. We present a simulation-based performance evaluation of current transport layer solutions against the state-of-the-art RLNC and RS-RLNC in terms of throughput, latency, and decoding complexity. Delay is reduced by a factor of 8.5% and decoding complexity is improved up to 20% compared to the state-of-the-art. Simulation results indicate that RS-RLNC has the potential to meet the stringent requirements of TI applications. Additionally, we present three future directions outlining the evolution of RS-RLNC to enhance the transport layer for TI compatibility.https://ieeexplore.ieee.org/document/10347212/Network codingRLNCreinforcement learningtactile internetURLLC |
| spellingShingle | Shahzad Rashid Ali Amir Haider Hyung Seok Kim RS-RLNC: A Reinforcement Learning-Based Selective Random Linear Network Coding Framework for Tactile Internet IEEE Access Network coding RLNC reinforcement learning tactile internet URLLC |
| title | RS-RLNC: A Reinforcement Learning-Based Selective Random Linear Network Coding Framework for Tactile Internet |
| title_full | RS-RLNC: A Reinforcement Learning-Based Selective Random Linear Network Coding Framework for Tactile Internet |
| title_fullStr | RS-RLNC: A Reinforcement Learning-Based Selective Random Linear Network Coding Framework for Tactile Internet |
| title_full_unstemmed | RS-RLNC: A Reinforcement Learning-Based Selective Random Linear Network Coding Framework for Tactile Internet |
| title_short | RS-RLNC: A Reinforcement Learning-Based Selective Random Linear Network Coding Framework for Tactile Internet |
| title_sort | rs rlnc a reinforcement learning based selective random linear network coding framework for tactile internet |
| topic | Network coding RLNC reinforcement learning tactile internet URLLC |
| url | https://ieeexplore.ieee.org/document/10347212/ |
| work_keys_str_mv | AT shahzad rsrlncareinforcementlearningbasedselectiverandomlinearnetworkcodingframeworkfortactileinternet AT rashidali rsrlncareinforcementlearningbasedselectiverandomlinearnetworkcodingframeworkfortactileinternet AT amirhaider rsrlncareinforcementlearningbasedselectiverandomlinearnetworkcodingframeworkfortactileinternet AT hyungseokkim rsrlncareinforcementlearningbasedselectiverandomlinearnetworkcodingframeworkfortactileinternet |