An On-Demand Charging for Connected Target Coverage in WRSNs Using Fuzzy Logic and Q-Learning
In wireless rechargeable sensor networks (WRSNs), a mobile charger (MC) moves around to compensate for sensor nodes’ energy via a wireless medium. In such a context, designing a charging strategy that optimally prolongs the network lifetime is challenging. This work aims to solve the challenges by i...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2021-08-01
|
| Series: | Sensors |
| Subjects: | |
| Online Access: | https://www.mdpi.com/1424-8220/21/16/5520 |
| _version_ | 1797522070776578048 |
|---|---|
| author | Phi Le Nguyen Van Quan La Anh Duy Nguyen Thanh Hung Nguyen Kien Nguyen |
| author_facet | Phi Le Nguyen Van Quan La Anh Duy Nguyen Thanh Hung Nguyen Kien Nguyen |
| author_sort | Phi Le Nguyen |
| collection | DOAJ |
| description | In wireless rechargeable sensor networks (WRSNs), a mobile charger (MC) moves around to compensate for sensor nodes’ energy via a wireless medium. In such a context, designing a charging strategy that optimally prolongs the network lifetime is challenging. This work aims to solve the challenges by introducing a novel, on-demand charging algorithm for MC that attempts to maximize the network lifetime, where the term “network lifetime” is defined by the interval from when the network starts till the first target is not monitored by any sensor. The algorithm, named Fuzzy Q-charging, optimizes both the time and location in which the MC performs its charging tasks. Fuzzy Q-charging uses Fuzzy logic to determine the optimal charging-energy amounts for sensors. From that, we propose a method to find the optimal charging time at each charging location. Fuzzy Q-charging leverages Q-learning to determine the next charging location for maximizing the network lifetime. To this end, Q-charging prioritizes the sensor nodes following their roles and selects a suitable charging location where MC provides sufficient power for the prioritized sensors. We have extensively evaluated the effectiveness of Fuzzy Q-charging in comparison to the related works. The evaluation results show that Fuzzy Q-charging outperforms the others. First, Fuzzy Q-charging can guarantee an infinite lifetime in the WSRNs, which have a sufficient large sensor number or a commensurate target number. Second, in other cases, Fuzzy Q-charging can extend the time until the first target is not monitored by 6.8 times on average and 33.9 times in the best case, compared to existing algorithms. |
| first_indexed | 2024-03-10T08:24:21Z |
| format | Article |
| id | doaj.art-57ae3065c0394e44bcc5880b209cb35f |
| institution | Directory Open Access Journal |
| issn | 1424-8220 |
| language | English |
| last_indexed | 2024-03-10T08:24:21Z |
| publishDate | 2021-08-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Sensors |
| spelling | doaj.art-57ae3065c0394e44bcc5880b209cb35f2023-11-22T09:41:11ZengMDPI AGSensors1424-82202021-08-012116552010.3390/s21165520An On-Demand Charging for Connected Target Coverage in WRSNs Using Fuzzy Logic and Q-LearningPhi Le Nguyen0Van Quan La1Anh Duy Nguyen2Thanh Hung Nguyen3Kien Nguyen4The School of Information and Communication Technology, Hanoi University of Science and Technology, Ha Noi 11615, VietnamThe School of Information and Communication Technology, Hanoi University of Science and Technology, Ha Noi 11615, VietnamThe School of Information and Communication Technology, Hanoi University of Science and Technology, Ha Noi 11615, VietnamThe School of Information and Communication Technology, Hanoi University of Science and Technology, Ha Noi 11615, VietnamThe Graduate School of Engineering, Chiba University, 1-33, Yayoi-cho, Inage-ku, Chiba 263-8522, JapanIn wireless rechargeable sensor networks (WRSNs), a mobile charger (MC) moves around to compensate for sensor nodes’ energy via a wireless medium. In such a context, designing a charging strategy that optimally prolongs the network lifetime is challenging. This work aims to solve the challenges by introducing a novel, on-demand charging algorithm for MC that attempts to maximize the network lifetime, where the term “network lifetime” is defined by the interval from when the network starts till the first target is not monitored by any sensor. The algorithm, named Fuzzy Q-charging, optimizes both the time and location in which the MC performs its charging tasks. Fuzzy Q-charging uses Fuzzy logic to determine the optimal charging-energy amounts for sensors. From that, we propose a method to find the optimal charging time at each charging location. Fuzzy Q-charging leverages Q-learning to determine the next charging location for maximizing the network lifetime. To this end, Q-charging prioritizes the sensor nodes following their roles and selects a suitable charging location where MC provides sufficient power for the prioritized sensors. We have extensively evaluated the effectiveness of Fuzzy Q-charging in comparison to the related works. The evaluation results show that Fuzzy Q-charging outperforms the others. First, Fuzzy Q-charging can guarantee an infinite lifetime in the WSRNs, which have a sufficient large sensor number or a commensurate target number. Second, in other cases, Fuzzy Q-charging can extend the time until the first target is not monitored by 6.8 times on average and 33.9 times in the best case, compared to existing algorithms.https://www.mdpi.com/1424-8220/21/16/5520WRSNQ-learningon-demand charging algorithmtarget coverageconnectivity |
| spellingShingle | Phi Le Nguyen Van Quan La Anh Duy Nguyen Thanh Hung Nguyen Kien Nguyen An On-Demand Charging for Connected Target Coverage in WRSNs Using Fuzzy Logic and Q-Learning Sensors WRSN Q-learning on-demand charging algorithm target coverage connectivity |
| title | An On-Demand Charging for Connected Target Coverage in WRSNs Using Fuzzy Logic and Q-Learning |
| title_full | An On-Demand Charging for Connected Target Coverage in WRSNs Using Fuzzy Logic and Q-Learning |
| title_fullStr | An On-Demand Charging for Connected Target Coverage in WRSNs Using Fuzzy Logic and Q-Learning |
| title_full_unstemmed | An On-Demand Charging for Connected Target Coverage in WRSNs Using Fuzzy Logic and Q-Learning |
| title_short | An On-Demand Charging for Connected Target Coverage in WRSNs Using Fuzzy Logic and Q-Learning |
| title_sort | on demand charging for connected target coverage in wrsns using fuzzy logic and q learning |
| topic | WRSN Q-learning on-demand charging algorithm target coverage connectivity |
| url | https://www.mdpi.com/1424-8220/21/16/5520 |
| work_keys_str_mv | AT philenguyen anondemandchargingforconnectedtargetcoverageinwrsnsusingfuzzylogicandqlearning AT vanquanla anondemandchargingforconnectedtargetcoverageinwrsnsusingfuzzylogicandqlearning AT anhduynguyen anondemandchargingforconnectedtargetcoverageinwrsnsusingfuzzylogicandqlearning AT thanhhungnguyen anondemandchargingforconnectedtargetcoverageinwrsnsusingfuzzylogicandqlearning AT kiennguyen anondemandchargingforconnectedtargetcoverageinwrsnsusingfuzzylogicandqlearning AT philenguyen ondemandchargingforconnectedtargetcoverageinwrsnsusingfuzzylogicandqlearning AT vanquanla ondemandchargingforconnectedtargetcoverageinwrsnsusingfuzzylogicandqlearning AT anhduynguyen ondemandchargingforconnectedtargetcoverageinwrsnsusingfuzzylogicandqlearning AT thanhhungnguyen ondemandchargingforconnectedtargetcoverageinwrsnsusingfuzzylogicandqlearning AT kiennguyen ondemandchargingforconnectedtargetcoverageinwrsnsusingfuzzylogicandqlearning |