Mobility, Residual Energy, and Link Quality Aware Multipath Routing in MANETs with Q-learning Algorithm
To facilitate connectivity to the internet, the easiest way to establish communication infrastructure in areas affected by natural disaster and in remote locations with intermittent cellular services and/or lack of Wi-Fi coverage is to deploy an end-to-end connection over Mobile Ad-hoc Networks (MAN...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2019-04-01
|
| Series: | Applied Sciences |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2076-3417/9/8/1582 |
| _version_ | 1811313956266967040 |
|---|---|
| author | Valmik Tilwari Kaharudin Dimyati MHD Nour Hindia Anas Fattouh Iraj Sadegh Amiri |
| author_facet | Valmik Tilwari Kaharudin Dimyati MHD Nour Hindia Anas Fattouh Iraj Sadegh Amiri |
| author_sort | Valmik Tilwari |
| collection | DOAJ |
| description | To facilitate connectivity to the internet, the easiest way to establish communication infrastructure in areas affected by natural disaster and in remote locations with intermittent cellular services and/or lack of Wi-Fi coverage is to deploy an end-to-end connection over Mobile Ad-hoc Networks (MANETs). However, the potentials of MANETs are yet to be fully realized as existing MANETs routing protocols still suffer some major technical drawback in the areas of mobility, link quality, and battery constraint of mobile nodes between the overlay connections. To address these problems, a routing scheme named Mobility, Residual energy and Link quality Aware Multipath (MRLAM) is proposed for routing in MANETs. The proposed scheme makes routing decisions by determining the optimal route with energy efficient nodes to maintain the stability, reliability, and lifetime of the network over a sustained period of time. The MRLAM scheme uses a Q-Learning algorithm for the selection of optimal intermediate nodes based on the available status of energy level, mobility, and link quality parameters, and then provides positive and negative reward values accordingly. The proposed routing scheme reduces energy cost by 33% and 23%, end to end delay by 15% and 10%, packet loss ratio by 30.76% and 24.59%, and convergence time by 16.49% and 11.34% approximately, compared with other well-known routing schemes such as Multipath Optimized Link State Routing protocol (MP-OLSR) and MP-OLSRv2, respectively. Overall, the acquired results indicate that the proposed MRLAM routing scheme significantly improves the overall performance of the network. |
| first_indexed | 2024-04-13T11:03:31Z |
| format | Article |
| id | doaj.art-9b2452b990724e7fb3a934b41088d242 |
| institution | Directory Open Access Journal |
| issn | 2076-3417 |
| language | English |
| last_indexed | 2024-04-13T11:03:31Z |
| publishDate | 2019-04-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Applied Sciences |
| spelling | doaj.art-9b2452b990724e7fb3a934b41088d2422022-12-22T02:49:20ZengMDPI AGApplied Sciences2076-34172019-04-0198158210.3390/app9081582app9081582Mobility, Residual Energy, and Link Quality Aware Multipath Routing in MANETs with Q-learning AlgorithmValmik Tilwari0Kaharudin Dimyati1MHD Nour Hindia2Anas Fattouh3Iraj Sadegh Amiri4Department of Electrical Engineering, Faculty of Engineering, University of Malaya, Kuala Lumpur 50603, MalaysiaDepartment of Electrical Engineering, Faculty of Engineering, University of Malaya, Kuala Lumpur 50603, MalaysiaDepartment of Electrical Engineering, Faculty of Engineering, University of Malaya, Kuala Lumpur 50603, MalaysiaAcademy of Innovation, Design, and Technology (IDT), Division of Computer Science and Software Engineering, Mälardalen University, 72123 Västerås, SwedenComputational Optics Research Group, Advanced Institute of Materials Science, Ton Duc Thang University, Ho Chi Minh City 700000, VietnamTo facilitate connectivity to the internet, the easiest way to establish communication infrastructure in areas affected by natural disaster and in remote locations with intermittent cellular services and/or lack of Wi-Fi coverage is to deploy an end-to-end connection over Mobile Ad-hoc Networks (MANETs). However, the potentials of MANETs are yet to be fully realized as existing MANETs routing protocols still suffer some major technical drawback in the areas of mobility, link quality, and battery constraint of mobile nodes between the overlay connections. To address these problems, a routing scheme named Mobility, Residual energy and Link quality Aware Multipath (MRLAM) is proposed for routing in MANETs. The proposed scheme makes routing decisions by determining the optimal route with energy efficient nodes to maintain the stability, reliability, and lifetime of the network over a sustained period of time. The MRLAM scheme uses a Q-Learning algorithm for the selection of optimal intermediate nodes based on the available status of energy level, mobility, and link quality parameters, and then provides positive and negative reward values accordingly. The proposed routing scheme reduces energy cost by 33% and 23%, end to end delay by 15% and 10%, packet loss ratio by 30.76% and 24.59%, and convergence time by 16.49% and 11.34% approximately, compared with other well-known routing schemes such as Multipath Optimized Link State Routing protocol (MP-OLSR) and MP-OLSRv2, respectively. Overall, the acquired results indicate that the proposed MRLAM routing scheme significantly improves the overall performance of the network.https://www.mdpi.com/2076-3417/9/8/1582MANETsMRLAMQ-Learning algorithmMP-OLSRRWP |
| spellingShingle | Valmik Tilwari Kaharudin Dimyati MHD Nour Hindia Anas Fattouh Iraj Sadegh Amiri Mobility, Residual Energy, and Link Quality Aware Multipath Routing in MANETs with Q-learning Algorithm Applied Sciences MANETs MRLAM Q-Learning algorithm MP-OLSR RWP |
| title | Mobility, Residual Energy, and Link Quality Aware Multipath Routing in MANETs with Q-learning Algorithm |
| title_full | Mobility, Residual Energy, and Link Quality Aware Multipath Routing in MANETs with Q-learning Algorithm |
| title_fullStr | Mobility, Residual Energy, and Link Quality Aware Multipath Routing in MANETs with Q-learning Algorithm |
| title_full_unstemmed | Mobility, Residual Energy, and Link Quality Aware Multipath Routing in MANETs with Q-learning Algorithm |
| title_short | Mobility, Residual Energy, and Link Quality Aware Multipath Routing in MANETs with Q-learning Algorithm |
| title_sort | mobility residual energy and link quality aware multipath routing in manets with q learning algorithm |
| topic | MANETs MRLAM Q-Learning algorithm MP-OLSR RWP |
| url | https://www.mdpi.com/2076-3417/9/8/1582 |
| work_keys_str_mv | AT valmiktilwari mobilityresidualenergyandlinkqualityawaremultipathroutinginmanetswithqlearningalgorithm AT kaharudindimyati mobilityresidualenergyandlinkqualityawaremultipathroutinginmanetswithqlearningalgorithm AT mhdnourhindia mobilityresidualenergyandlinkqualityawaremultipathroutinginmanetswithqlearningalgorithm AT anasfattouh mobilityresidualenergyandlinkqualityawaremultipathroutinginmanetswithqlearningalgorithm AT irajsadeghamiri mobilityresidualenergyandlinkqualityawaremultipathroutinginmanetswithqlearningalgorithm |