Performance characterization of reinforcement learning-enabled evolutionary algorithms for integrated school bus routing and scheduling problem
Bi-objective school bus scheduling optimization problem that is a subset of vehicle fleet scheduling problem is focused in this paper. In the literature, school bus routing and scheduling problem is proven to be an NP-Hard problem. The processed data supplied by our framework is utilized to search a...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
KeAi Communications Co., Ltd.
2021-06-01
|
| Series: | International Journal of Cognitive Computing in Engineering |
| Subjects: | |
| Online Access: | http://www.sciencedirect.com/science/article/pii/S2666307421000061 |
| _version_ | 1797976443276230656 |
|---|---|
| author | Eda Koksal Abhishek R. Hegde Haresh P. Pandiarajan Bharadwaj Veeravalli |
| author_facet | Eda Koksal Abhishek R. Hegde Haresh P. Pandiarajan Bharadwaj Veeravalli |
| author_sort | Eda Koksal |
| collection | DOAJ |
| description | Bi-objective school bus scheduling optimization problem that is a subset of vehicle fleet scheduling problem is focused in this paper. In the literature, school bus routing and scheduling problem is proven to be an NP-Hard problem. The processed data supplied by our framework is utilized to search a near-optimum schedule with the aid of reinforcement learning by evolutionary algorithms. They are named as reinforcement learning-enabled genetic algorithm (RL-enabled GA), reinforcement learning-enabled particle swarm optimization algorithm (RL-enabled PSO), and reinforcement learning-enabled ant colony optimization algorithm (RL-enabled ACO). In this paper, the performance characterization of reinforcement learning-enabled evolutionary algorithms for integrated school bus routing and scheduling problem is investigated. The efficiency of the conventional algorithms is improved, and the near-optimal schedule is achieved significantly in a shorter duration with the active guidance of the reinforcement learning algorithm. We attempt to carry out extensive performance evaluation and conducted experiments on a geospatial dataset comprising road networks, trip trajectories of buses, and the address of students. The conventional and reinforcement learning integrated algorithms are improving the travel time of buses and the students. More than 50% saving by the conventional and the reinforcement learning-enabled ant colony optimization algorithm compared to the constructive heuristic algorithm is achieved from 92nd and 54th iterations, respectively. Similarly, the saving by the conventional and the reinforcement learning-enabled genetic algorithm is 41.34% at 500th iterations and more than 50% improvement from 281st iterations, respectively. Lastly, more than 10% saving by the conventional and the reinforcement learning-enabled particle swarm algorithm is achieved from 432nd and 28th iterations, respectively. |
| first_indexed | 2024-04-11T04:50:56Z |
| format | Article |
| id | doaj.art-56d54a4169194c49a4c7fc6592c114f5 |
| institution | Directory Open Access Journal |
| issn | 2666-3074 |
| language | English |
| last_indexed | 2024-04-11T04:50:56Z |
| publishDate | 2021-06-01 |
| publisher | KeAi Communications Co., Ltd. |
| record_format | Article |
| series | International Journal of Cognitive Computing in Engineering |
| spelling | doaj.art-56d54a4169194c49a4c7fc6592c114f52022-12-27T04:37:14ZengKeAi Communications Co., Ltd.International Journal of Cognitive Computing in Engineering2666-30742021-06-0124756Performance characterization of reinforcement learning-enabled evolutionary algorithms for integrated school bus routing and scheduling problemEda Koksal0Abhishek R. Hegde1Haresh P. Pandiarajan2Bharadwaj Veeravalli3Corresponding author.; Electrical and Computer Engineering Department, National University of Singapore, 117583, SingaporeElectrical and Computer Engineering Department, National University of Singapore, 117583, SingaporeElectrical and Computer Engineering Department, National University of Singapore, 117583, SingaporeElectrical and Computer Engineering Department, National University of Singapore, 117583, SingaporeBi-objective school bus scheduling optimization problem that is a subset of vehicle fleet scheduling problem is focused in this paper. In the literature, school bus routing and scheduling problem is proven to be an NP-Hard problem. The processed data supplied by our framework is utilized to search a near-optimum schedule with the aid of reinforcement learning by evolutionary algorithms. They are named as reinforcement learning-enabled genetic algorithm (RL-enabled GA), reinforcement learning-enabled particle swarm optimization algorithm (RL-enabled PSO), and reinforcement learning-enabled ant colony optimization algorithm (RL-enabled ACO). In this paper, the performance characterization of reinforcement learning-enabled evolutionary algorithms for integrated school bus routing and scheduling problem is investigated. The efficiency of the conventional algorithms is improved, and the near-optimal schedule is achieved significantly in a shorter duration with the active guidance of the reinforcement learning algorithm. We attempt to carry out extensive performance evaluation and conducted experiments on a geospatial dataset comprising road networks, trip trajectories of buses, and the address of students. The conventional and reinforcement learning integrated algorithms are improving the travel time of buses and the students. More than 50% saving by the conventional and the reinforcement learning-enabled ant colony optimization algorithm compared to the constructive heuristic algorithm is achieved from 92nd and 54th iterations, respectively. Similarly, the saving by the conventional and the reinforcement learning-enabled genetic algorithm is 41.34% at 500th iterations and more than 50% improvement from 281st iterations, respectively. Lastly, more than 10% saving by the conventional and the reinforcement learning-enabled particle swarm algorithm is achieved from 432nd and 28th iterations, respectively.http://www.sciencedirect.com/science/article/pii/S2666307421000061Reinforcement learningAnt colony optimizationGenetic algorithmParticle swarm optimizationSchool bus routing and schedulingCombinatorial optimization |
| spellingShingle | Eda Koksal Abhishek R. Hegde Haresh P. Pandiarajan Bharadwaj Veeravalli Performance characterization of reinforcement learning-enabled evolutionary algorithms for integrated school bus routing and scheduling problem International Journal of Cognitive Computing in Engineering Reinforcement learning Ant colony optimization Genetic algorithm Particle swarm optimization School bus routing and scheduling Combinatorial optimization |
| title | Performance characterization of reinforcement learning-enabled evolutionary algorithms for integrated school bus routing and scheduling problem |
| title_full | Performance characterization of reinforcement learning-enabled evolutionary algorithms for integrated school bus routing and scheduling problem |
| title_fullStr | Performance characterization of reinforcement learning-enabled evolutionary algorithms for integrated school bus routing and scheduling problem |
| title_full_unstemmed | Performance characterization of reinforcement learning-enabled evolutionary algorithms for integrated school bus routing and scheduling problem |
| title_short | Performance characterization of reinforcement learning-enabled evolutionary algorithms for integrated school bus routing and scheduling problem |
| title_sort | performance characterization of reinforcement learning enabled evolutionary algorithms for integrated school bus routing and scheduling problem |
| topic | Reinforcement learning Ant colony optimization Genetic algorithm Particle swarm optimization School bus routing and scheduling Combinatorial optimization |
| url | http://www.sciencedirect.com/science/article/pii/S2666307421000061 |
| work_keys_str_mv | AT edakoksal performancecharacterizationofreinforcementlearningenabledevolutionaryalgorithmsforintegratedschoolbusroutingandschedulingproblem AT abhishekrhegde performancecharacterizationofreinforcementlearningenabledevolutionaryalgorithmsforintegratedschoolbusroutingandschedulingproblem AT hareshppandiarajan performancecharacterizationofreinforcementlearningenabledevolutionaryalgorithmsforintegratedschoolbusroutingandschedulingproblem AT bharadwajveeravalli performancecharacterizationofreinforcementlearningenabledevolutionaryalgorithmsforintegratedschoolbusroutingandschedulingproblem |