Path Planning for Mobile Robot Considering Turnabouts on Narrow Road by Deep Q-Network
This paper proposes a path planning method for a nonholonomic mobile robot that takes turnabouts on a narrow road. A narrow road is any space in which the robot cannot move without turning around. Conventional path planning techniques ignore turnabout points and directions determined by environmenta...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2023-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/10050848/ |
| _version_ | 1811162031772925952 |
|---|---|
| author | Tomoaki Nakamura Masato Kobayashi Naoki Motoi |
| author_facet | Tomoaki Nakamura Masato Kobayashi Naoki Motoi |
| author_sort | Tomoaki Nakamura |
| collection | DOAJ |
| description | This paper proposes a path planning method for a nonholonomic mobile robot that takes turnabouts on a narrow road. A narrow road is any space in which the robot cannot move without turning around. Conventional path planning techniques ignore turnabout points and directions determined by environmental data, which might result in collisions or deadlocks on a narrow road. The proposed method uses the Deep Q-network (DQN) to obtain a control strategy for path planning on narrow roads. In the simulation, the robot learned the optimal velocity commands that maximized the long-term reward. The reward is designed to reach a target with a smaller change in robot velocity and fewer turnabouts. The success rate and the number of turnabouts in the simulation and experiment were used to evaluate the trained model. According to simulation and environmental data, the proposed strategy enables the robot to travel on narrow roads. Additionally, these outcomes demonstrate comparable performance on a number of roadways that are not part of the learning environments, supporting the robustness of the trained model. |
| first_indexed | 2024-04-10T06:23:06Z |
| format | Article |
| id | doaj.art-b6937470fe354c8f85fc420b2f11ceb9 |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-04-10T06:23:06Z |
| publishDate | 2023-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-b6937470fe354c8f85fc420b2f11ceb92023-03-02T00:00:18ZengIEEEIEEE Access2169-35362023-01-0111191111912110.1109/ACCESS.2023.324773010050848Path Planning for Mobile Robot Considering Turnabouts on Narrow Road by Deep Q-NetworkTomoaki Nakamura0https://orcid.org/0000-0002-6468-5745Masato Kobayashi1https://orcid.org/0000-0001-9703-2858Naoki Motoi2https://orcid.org/0000-0003-1536-0095Graduate School of Maritime Science, Kobe University, Kobe, JapanGraduate School of Maritime Science, Kobe University, Kobe, JapanGraduate School of Maritime Science, Kobe University, Kobe, JapanThis paper proposes a path planning method for a nonholonomic mobile robot that takes turnabouts on a narrow road. A narrow road is any space in which the robot cannot move without turning around. Conventional path planning techniques ignore turnabout points and directions determined by environmental data, which might result in collisions or deadlocks on a narrow road. The proposed method uses the Deep Q-network (DQN) to obtain a control strategy for path planning on narrow roads. In the simulation, the robot learned the optimal velocity commands that maximized the long-term reward. The reward is designed to reach a target with a smaller change in robot velocity and fewer turnabouts. The success rate and the number of turnabouts in the simulation and experiment were used to evaluate the trained model. According to simulation and environmental data, the proposed strategy enables the robot to travel on narrow roads. Additionally, these outcomes demonstrate comparable performance on a number of roadways that are not part of the learning environments, supporting the robustness of the trained model.https://ieeexplore.ieee.org/document/10050848/Mobile robotpath planningturnaboutreinforcement learning |
| spellingShingle | Tomoaki Nakamura Masato Kobayashi Naoki Motoi Path Planning for Mobile Robot Considering Turnabouts on Narrow Road by Deep Q-Network IEEE Access Mobile robot path planning turnabout reinforcement learning |
| title | Path Planning for Mobile Robot Considering Turnabouts on Narrow Road by Deep Q-Network |
| title_full | Path Planning for Mobile Robot Considering Turnabouts on Narrow Road by Deep Q-Network |
| title_fullStr | Path Planning for Mobile Robot Considering Turnabouts on Narrow Road by Deep Q-Network |
| title_full_unstemmed | Path Planning for Mobile Robot Considering Turnabouts on Narrow Road by Deep Q-Network |
| title_short | Path Planning for Mobile Robot Considering Turnabouts on Narrow Road by Deep Q-Network |
| title_sort | path planning for mobile robot considering turnabouts on narrow road by deep q network |
| topic | Mobile robot path planning turnabout reinforcement learning |
| url | https://ieeexplore.ieee.org/document/10050848/ |
| work_keys_str_mv | AT tomoakinakamura pathplanningformobilerobotconsideringturnaboutsonnarrowroadbydeepqnetwork AT masatokobayashi pathplanningformobilerobotconsideringturnaboutsonnarrowroadbydeepqnetwork AT naokimotoi pathplanningformobilerobotconsideringturnaboutsonnarrowroadbydeepqnetwork |