Collaborative Measurement System of Dual Mobile Robots That Integrates Visual Tracking and 3D Measurement
The manufacturing accuracy of large-scale complex components determines the performance and quality of aircraft, ships, high-speed rail, and other equipment. High-precision 3D measurement plays a crucial role in ensuring manufacturing accuracy. At present, the existing measurement methods rely heavi...
| Main Authors: | , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2022-07-01
|
| Series: | Machines |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2075-1702/10/7/540 |
| _version_ | 1797433418776051712 |
|---|---|
| author | Lizhe Qi Zhongxue Gan Jiankun Ren Fuwang Wu Hao Su Zhen Mei Yunquan Sun |
| author_facet | Lizhe Qi Zhongxue Gan Jiankun Ren Fuwang Wu Hao Su Zhen Mei Yunquan Sun |
| author_sort | Lizhe Qi |
| collection | DOAJ |
| description | The manufacturing accuracy of large-scale complex components determines the performance and quality of aircraft, ships, high-speed rail, and other equipment. High-precision 3D measurement plays a crucial role in ensuring manufacturing accuracy. At present, the existing measurement methods rely heavily on manual labor, which cannot satisfy the requirements of industry quality and efficiency. This paper introduces an integrated mobile robotic measurement system for the accurate and automatic 3D measurement of large-scale components with complex curved surfaces. The system consists of the mobile optical scanning measurement device, visual tracking device, and software platform, which can realize comprehensive and accurate data acquisition and stitching of large-scale complex components. The combination of visual tracking and 3D measurement based on the coordinated motion of the dual robot achieved the automatic data acquisition of large-scale complex components without sticking coded targets. Additionally, this paper also introduces a DeepMerge algorithm that combines local and global features of the point cloud, which effectively corrects the initial stitching error of the visual tracking system. The validity of the measurement system and method was shown by the measurement and stitching experiments on the surface of the vehicle nose, ensuring the accurate measurement of the robot’s wide range of motion. |
| first_indexed | 2024-03-09T10:15:48Z |
| format | Article |
| id | doaj.art-d105f3d761a746cbaa16ea44ee33072f |
| institution | Directory Open Access Journal |
| issn | 2075-1702 |
| language | English |
| last_indexed | 2024-03-09T10:15:48Z |
| publishDate | 2022-07-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Machines |
| spelling | doaj.art-d105f3d761a746cbaa16ea44ee33072f2023-12-01T22:23:24ZengMDPI AGMachines2075-17022022-07-0110754010.3390/machines10070540Collaborative Measurement System of Dual Mobile Robots That Integrates Visual Tracking and 3D MeasurementLizhe Qi0Zhongxue Gan1Jiankun Ren2Fuwang Wu3Hao Su4Zhen Mei5Yunquan Sun6Academy for Engineering & Technology, Fudan University, Shanghai 200433, ChinaAcademy for Engineering & Technology, Fudan University, Shanghai 200433, ChinaAcademy for Engineering & Technology, Fudan University, Shanghai 200433, ChinaAcademy for Engineering & Technology, Fudan University, Shanghai 200433, ChinaAcademy for Engineering & Technology, Fudan University, Shanghai 200433, ChinaAcademy for Engineering & Technology, Fudan University, Shanghai 200433, ChinaAcademy for Engineering & Technology, Fudan University, Shanghai 200433, ChinaThe manufacturing accuracy of large-scale complex components determines the performance and quality of aircraft, ships, high-speed rail, and other equipment. High-precision 3D measurement plays a crucial role in ensuring manufacturing accuracy. At present, the existing measurement methods rely heavily on manual labor, which cannot satisfy the requirements of industry quality and efficiency. This paper introduces an integrated mobile robotic measurement system for the accurate and automatic 3D measurement of large-scale components with complex curved surfaces. The system consists of the mobile optical scanning measurement device, visual tracking device, and software platform, which can realize comprehensive and accurate data acquisition and stitching of large-scale complex components. The combination of visual tracking and 3D measurement based on the coordinated motion of the dual robot achieved the automatic data acquisition of large-scale complex components without sticking coded targets. Additionally, this paper also introduces a DeepMerge algorithm that combines local and global features of the point cloud, which effectively corrects the initial stitching error of the visual tracking system. The validity of the measurement system and method was shown by the measurement and stitching experiments on the surface of the vehicle nose, ensuring the accurate measurement of the robot’s wide range of motion.https://www.mdpi.com/2075-1702/10/7/540large-scale measurementdual mobile robotmachine visioncollaborative measurement |
| spellingShingle | Lizhe Qi Zhongxue Gan Jiankun Ren Fuwang Wu Hao Su Zhen Mei Yunquan Sun Collaborative Measurement System of Dual Mobile Robots That Integrates Visual Tracking and 3D Measurement Machines large-scale measurement dual mobile robot machine vision collaborative measurement |
| title | Collaborative Measurement System of Dual Mobile Robots That Integrates Visual Tracking and 3D Measurement |
| title_full | Collaborative Measurement System of Dual Mobile Robots That Integrates Visual Tracking and 3D Measurement |
| title_fullStr | Collaborative Measurement System of Dual Mobile Robots That Integrates Visual Tracking and 3D Measurement |
| title_full_unstemmed | Collaborative Measurement System of Dual Mobile Robots That Integrates Visual Tracking and 3D Measurement |
| title_short | Collaborative Measurement System of Dual Mobile Robots That Integrates Visual Tracking and 3D Measurement |
| title_sort | collaborative measurement system of dual mobile robots that integrates visual tracking and 3d measurement |
| topic | large-scale measurement dual mobile robot machine vision collaborative measurement |
| url | https://www.mdpi.com/2075-1702/10/7/540 |
| work_keys_str_mv | AT lizheqi collaborativemeasurementsystemofdualmobilerobotsthatintegratesvisualtrackingand3dmeasurement AT zhongxuegan collaborativemeasurementsystemofdualmobilerobotsthatintegratesvisualtrackingand3dmeasurement AT jiankunren collaborativemeasurementsystemofdualmobilerobotsthatintegratesvisualtrackingand3dmeasurement AT fuwangwu collaborativemeasurementsystemofdualmobilerobotsthatintegratesvisualtrackingand3dmeasurement AT haosu collaborativemeasurementsystemofdualmobilerobotsthatintegratesvisualtrackingand3dmeasurement AT zhenmei collaborativemeasurementsystemofdualmobilerobotsthatintegratesvisualtrackingand3dmeasurement AT yunquansun collaborativemeasurementsystemofdualmobilerobotsthatintegratesvisualtrackingand3dmeasurement |