Automating Aircraft Scanning for Inspection or 3D Model Creation with a UAV and Optimal Path Planning
Visual inspections of aircraft exterior surfaces are required in aircraft maintenance routines for identifying possible defects such as dents, cracks, leaking, broken or missing parts, etc. This process is time-consuming and is also prone to error if performed manually. Therefore, it has become a tr...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2022-03-01
|
| Series: | Drones |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2504-446X/6/4/87 |
| _version_ | 1797436015693004800 |
|---|---|
| author | Yufeng Sun Ou Ma |
| author_facet | Yufeng Sun Ou Ma |
| author_sort | Yufeng Sun |
| collection | DOAJ |
| description | Visual inspections of aircraft exterior surfaces are required in aircraft maintenance routines for identifying possible defects such as dents, cracks, leaking, broken or missing parts, etc. This process is time-consuming and is also prone to error if performed manually. Therefore, it has become a trend to use mobile robots equipped with visual sensors to perform automated inspections. For such a robotic inspection, a digital model of the aircraft is usually required for planning the robot’s path, but a CAD model of the entire aircraft is usually inaccessible to most maintenance shops. It is very labor-intensive and time-consuming to generate an accurate digital model of an aircraft, or even a large portion of it, because the scanning work still must be performed manually or by a manually controlled robotic system. This paper presents a two-stage approach of automating aircraft scanning with an unmanned aerial vehicle (UAV) or autonomous drone equipped with a red–green–blue and depth (RGB-D) camera for detailed inspection or for reconstructing a digital replica of the aircraft when its original CAD model is unavailable. In the first stage, the UAV–camera system follows a predefined path far from the aircraft surface (for safety) to quickly scan the aircraft and generate a coarse model of the aircraft. Then, an optimal scanning path (much closer to the surface) in the sense of the shortest flying distance for full coverage is computed based on the coarse model. In the second stage, the UAV–camera system follows the computed path to closely inspect the surface for possible defects or scan the surface for generating a dense and precise model of the aircraft. We solved the coverage path planning (CPP) problem for the aircraft inspection or scanning using a Monte Carlo tree search (MCTS) algorithm. We also implemented the max–min ant system (MMAS) strategy to demonstrate the effectiveness of our approach. We carried out a digital experiment and the results showed that our approach can scan 70% of the aircraft surface within one hour, which is much more efficient than manual scanning. |
| first_indexed | 2024-03-09T10:56:35Z |
| format | Article |
| id | doaj.art-b915b2929fb34352a46ce2f7d4789a6c |
| institution | Directory Open Access Journal |
| issn | 2504-446X |
| language | English |
| last_indexed | 2024-03-09T10:56:35Z |
| publishDate | 2022-03-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Drones |
| spelling | doaj.art-b915b2929fb34352a46ce2f7d4789a6c2023-12-01T01:38:36ZengMDPI AGDrones2504-446X2022-03-01648710.3390/drones6040087Automating Aircraft Scanning for Inspection or 3D Model Creation with a UAV and Optimal Path PlanningYufeng Sun0Ou Ma1Department of Aerospace Engineering and Engineering Mechanics, University of Cincinnati, 2600 Clifton Ave, Cincinnati, OH 45221, USADepartment of Aerospace Engineering and Engineering Mechanics, University of Cincinnati, 2600 Clifton Ave, Cincinnati, OH 45221, USAVisual inspections of aircraft exterior surfaces are required in aircraft maintenance routines for identifying possible defects such as dents, cracks, leaking, broken or missing parts, etc. This process is time-consuming and is also prone to error if performed manually. Therefore, it has become a trend to use mobile robots equipped with visual sensors to perform automated inspections. For such a robotic inspection, a digital model of the aircraft is usually required for planning the robot’s path, but a CAD model of the entire aircraft is usually inaccessible to most maintenance shops. It is very labor-intensive and time-consuming to generate an accurate digital model of an aircraft, or even a large portion of it, because the scanning work still must be performed manually or by a manually controlled robotic system. This paper presents a two-stage approach of automating aircraft scanning with an unmanned aerial vehicle (UAV) or autonomous drone equipped with a red–green–blue and depth (RGB-D) camera for detailed inspection or for reconstructing a digital replica of the aircraft when its original CAD model is unavailable. In the first stage, the UAV–camera system follows a predefined path far from the aircraft surface (for safety) to quickly scan the aircraft and generate a coarse model of the aircraft. Then, an optimal scanning path (much closer to the surface) in the sense of the shortest flying distance for full coverage is computed based on the coarse model. In the second stage, the UAV–camera system follows the computed path to closely inspect the surface for possible defects or scan the surface for generating a dense and precise model of the aircraft. We solved the coverage path planning (CPP) problem for the aircraft inspection or scanning using a Monte Carlo tree search (MCTS) algorithm. We also implemented the max–min ant system (MMAS) strategy to demonstrate the effectiveness of our approach. We carried out a digital experiment and the results showed that our approach can scan 70% of the aircraft surface within one hour, which is much more efficient than manual scanning.https://www.mdpi.com/2504-446X/6/4/87aircraft scanningaircraft inspection3D digitizingUAVpath planningoptimization |
| spellingShingle | Yufeng Sun Ou Ma Automating Aircraft Scanning for Inspection or 3D Model Creation with a UAV and Optimal Path Planning Drones aircraft scanning aircraft inspection 3D digitizing UAV path planning optimization |
| title | Automating Aircraft Scanning for Inspection or 3D Model Creation with a UAV and Optimal Path Planning |
| title_full | Automating Aircraft Scanning for Inspection or 3D Model Creation with a UAV and Optimal Path Planning |
| title_fullStr | Automating Aircraft Scanning for Inspection or 3D Model Creation with a UAV and Optimal Path Planning |
| title_full_unstemmed | Automating Aircraft Scanning for Inspection or 3D Model Creation with a UAV and Optimal Path Planning |
| title_short | Automating Aircraft Scanning for Inspection or 3D Model Creation with a UAV and Optimal Path Planning |
| title_sort | automating aircraft scanning for inspection or 3d model creation with a uav and optimal path planning |
| topic | aircraft scanning aircraft inspection 3D digitizing UAV path planning optimization |
| url | https://www.mdpi.com/2504-446X/6/4/87 |
| work_keys_str_mv | AT yufengsun automatingaircraftscanningforinspectionor3dmodelcreationwithauavandoptimalpathplanning AT ouma automatingaircraftscanningforinspectionor3dmodelcreationwithauavandoptimalpathplanning |