Robust Autonomous Vehicle Computer-Vision-Based Localization in Challenging Environmental Conditions
In this paper, we present a novel autonomous vehicle (AV) localization design and its implementation, which we recommend to employ in challenging navigation conditions with a poor quality of the satellite navigation system signals and computer vision images. In the case when the GPS signal becomes u...
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2023-05-01
|
| Series: | Applied Sciences |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2076-3417/13/9/5735 |
| _version_ | 1797602945903099904 |
|---|---|
| author | Sergei Chuprov Pavel Belyaev Ruslan Gataullin Leon Reznik Evgenii Neverov Ilia Viksnin |
| author_facet | Sergei Chuprov Pavel Belyaev Ruslan Gataullin Leon Reznik Evgenii Neverov Ilia Viksnin |
| author_sort | Sergei Chuprov |
| collection | DOAJ |
| description | In this paper, we present a novel autonomous vehicle (AV) localization design and its implementation, which we recommend to employ in challenging navigation conditions with a poor quality of the satellite navigation system signals and computer vision images. In the case when the GPS signal becomes unstable, other auxiliary navigation systems, such as computer-vision-based positioning, are employed for more accurate localization and mapping. However, the quality of data obtained from AV’s sensors might be deteriorated by the extreme environmental conditions too, which infinitely leads to the decrease in navigation performance. To verify our computer-vision-based localization system design, we considered the Arctic region use case, which poses additional challenges for the AV’s navigation and might employ artificial visual landmarks for improving the localization quality, which we used for the computer vision training. We further enhanced our data by applying affine transformations to increase its diversity. We selected YOLOv4 image detection architecture for our system design, as it demonstrated the highest performance in our experiments. For the computational platform, we employed a Nvidia Jetson AGX Xavier device, as it is well known and widely used in robotic and AV computer vision, as well as deep learning applications. Our empirical study showed that the proposed computer vision system that was further trained on the dataset enhanced by affine transformations became robust regarding image quality degradation caused by extreme environmental conditions. It was effectively able to detect and recognize images of artificial visual landmarks captured in the extreme Arctic region’s conditions. The developed system can be integrated into vehicle navigation facilities to improve their effectiveness and efficiency and to prevent possible navigation performance deterioration. |
| first_indexed | 2024-03-11T04:23:42Z |
| format | Article |
| id | doaj.art-ed181332cc0b44ceb5af4f7305b55b95 |
| institution | Directory Open Access Journal |
| issn | 2076-3417 |
| language | English |
| last_indexed | 2024-03-11T04:23:42Z |
| publishDate | 2023-05-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Applied Sciences |
| spelling | doaj.art-ed181332cc0b44ceb5af4f7305b55b952023-11-17T22:38:02ZengMDPI AGApplied Sciences2076-34172023-05-01139573510.3390/app13095735Robust Autonomous Vehicle Computer-Vision-Based Localization in Challenging Environmental ConditionsSergei Chuprov0Pavel Belyaev1Ruslan Gataullin2Leon Reznik3Evgenii Neverov4Ilia Viksnin5Department of Computer Science and Global Cybersecurity Institute, Rochester Institute of Technology, Rochester, NY 14623, USADepartment of Computer Science, Saint Petersburg Electrotechnical University “LETI“, St. Petersburg 197022, RussiaDepartment of Computer Science, Saint Petersburg Electrotechnical University “LETI“, St. Petersburg 197022, RussiaDepartment of Computer Science and Global Cybersecurity Institute, Rochester Institute of Technology, Rochester, NY 14623, USADepartment of Computer Science, Saint Petersburg Electrotechnical University “LETI“, St. Petersburg 197022, RussiaDepartment of Computer Science, Saint Petersburg Electrotechnical University “LETI“, St. Petersburg 197022, RussiaIn this paper, we present a novel autonomous vehicle (AV) localization design and its implementation, which we recommend to employ in challenging navigation conditions with a poor quality of the satellite navigation system signals and computer vision images. In the case when the GPS signal becomes unstable, other auxiliary navigation systems, such as computer-vision-based positioning, are employed for more accurate localization and mapping. However, the quality of data obtained from AV’s sensors might be deteriorated by the extreme environmental conditions too, which infinitely leads to the decrease in navigation performance. To verify our computer-vision-based localization system design, we considered the Arctic region use case, which poses additional challenges for the AV’s navigation and might employ artificial visual landmarks for improving the localization quality, which we used for the computer vision training. We further enhanced our data by applying affine transformations to increase its diversity. We selected YOLOv4 image detection architecture for our system design, as it demonstrated the highest performance in our experiments. For the computational platform, we employed a Nvidia Jetson AGX Xavier device, as it is well known and widely used in robotic and AV computer vision, as well as deep learning applications. Our empirical study showed that the proposed computer vision system that was further trained on the dataset enhanced by affine transformations became robust regarding image quality degradation caused by extreme environmental conditions. It was effectively able to detect and recognize images of artificial visual landmarks captured in the extreme Arctic region’s conditions. The developed system can be integrated into vehicle navigation facilities to improve their effectiveness and efficiency and to prevent possible navigation performance deterioration.https://www.mdpi.com/2076-3417/13/9/5735computer visionrobust vehicle localizationdata qualitymachine learning |
| spellingShingle | Sergei Chuprov Pavel Belyaev Ruslan Gataullin Leon Reznik Evgenii Neverov Ilia Viksnin Robust Autonomous Vehicle Computer-Vision-Based Localization in Challenging Environmental Conditions Applied Sciences computer vision robust vehicle localization data quality machine learning |
| title | Robust Autonomous Vehicle Computer-Vision-Based Localization in Challenging Environmental Conditions |
| title_full | Robust Autonomous Vehicle Computer-Vision-Based Localization in Challenging Environmental Conditions |
| title_fullStr | Robust Autonomous Vehicle Computer-Vision-Based Localization in Challenging Environmental Conditions |
| title_full_unstemmed | Robust Autonomous Vehicle Computer-Vision-Based Localization in Challenging Environmental Conditions |
| title_short | Robust Autonomous Vehicle Computer-Vision-Based Localization in Challenging Environmental Conditions |
| title_sort | robust autonomous vehicle computer vision based localization in challenging environmental conditions |
| topic | computer vision robust vehicle localization data quality machine learning |
| url | https://www.mdpi.com/2076-3417/13/9/5735 |
| work_keys_str_mv | AT sergeichuprov robustautonomousvehiclecomputervisionbasedlocalizationinchallengingenvironmentalconditions AT pavelbelyaev robustautonomousvehiclecomputervisionbasedlocalizationinchallengingenvironmentalconditions AT ruslangataullin robustautonomousvehiclecomputervisionbasedlocalizationinchallengingenvironmentalconditions AT leonreznik robustautonomousvehiclecomputervisionbasedlocalizationinchallengingenvironmentalconditions AT evgeniineverov robustautonomousvehiclecomputervisionbasedlocalizationinchallengingenvironmentalconditions AT iliaviksnin robustautonomousvehiclecomputervisionbasedlocalizationinchallengingenvironmentalconditions |