Application of machine vision image feature recognition in 3D map construction
Simultaneous localization and mapping algorithm is a technique to simultaneously construct a map of the environment by the sensors it carries. In this paper, we focus on the SLAM (Simultaneous Localization and Mapping) algorithm based on machine vision-depth information, overlap region determination...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Elsevier
2023-02-01
|
| Series: | Alexandria Engineering Journal |
| Subjects: | |
| Online Access: | http://www.sciencedirect.com/science/article/pii/S1110016822007402 |
| _version_ | 1797961152453410816 |
|---|---|
| author | Pinhe Wang Nannan Liu Jianzhong Qiao |
| author_facet | Pinhe Wang Nannan Liu Jianzhong Qiao |
| author_sort | Pinhe Wang |
| collection | DOAJ |
| description | Simultaneous localization and mapping algorithm is a technique to simultaneously construct a map of the environment by the sensors it carries. In this paper, we focus on the SLAM (Simultaneous Localization and Mapping) algorithm based on machine vision-depth information, overlap region determination among local sub-maps, and fusion algorithm of 3D dense maps, and analyze four modules of front-end visual odometry, back-end optimization, loopback detection, and map construction. The front-end visual odometry adopts the ORB (Oriented FAST and Rotated BRIEF) algorithm based on the feature point method to extract and match the features between image frames and uses the iterative nearest point method to solve the camera motion between adjacent images. Meanwhile, a 3D feature descriptor based on the histogram of spatial distribution is designed to encode the feature information around the key points, and the Kd-Tree algorithm is used for radial nearest neighbor search to complete the feature matching. Finally, the 3D map is fused by the 3D-ICP algorithm. The experiments prove that the low-dimensional local feature descriptor designed has good descriptiveness and is superior, and the 3D map fusion based on this descriptor has a good fusion effect and can meet the accuracy requirements of practical applications. |
| first_indexed | 2024-04-11T00:54:55Z |
| format | Article |
| id | doaj.art-e6a75cd47e084faab7170168337f7239 |
| institution | Directory Open Access Journal |
| issn | 1110-0168 |
| language | English |
| last_indexed | 2024-04-11T00:54:55Z |
| publishDate | 2023-02-01 |
| publisher | Elsevier |
| record_format | Article |
| series | Alexandria Engineering Journal |
| spelling | doaj.art-e6a75cd47e084faab7170168337f72392023-01-05T06:46:43ZengElsevierAlexandria Engineering Journal1110-01682023-02-0164731739Application of machine vision image feature recognition in 3D map constructionPinhe Wang0Nannan Liu1Jianzhong Qiao2School Of Computer Science And Engineering, Northeastern University, Shenyang 110169, China; Corresponding author.School of Electronic and Information Engineering, Ningbo University of Technology, Ningbo 315021, China; Information Science And Engineering Institute, Ningbo City College of Vocational Technology, Ningbo 315100, ChinaSchool Of Computer Science And Engineering, Northeastern University, Shenyang 110169, ChinaSimultaneous localization and mapping algorithm is a technique to simultaneously construct a map of the environment by the sensors it carries. In this paper, we focus on the SLAM (Simultaneous Localization and Mapping) algorithm based on machine vision-depth information, overlap region determination among local sub-maps, and fusion algorithm of 3D dense maps, and analyze four modules of front-end visual odometry, back-end optimization, loopback detection, and map construction. The front-end visual odometry adopts the ORB (Oriented FAST and Rotated BRIEF) algorithm based on the feature point method to extract and match the features between image frames and uses the iterative nearest point method to solve the camera motion between adjacent images. Meanwhile, a 3D feature descriptor based on the histogram of spatial distribution is designed to encode the feature information around the key points, and the Kd-Tree algorithm is used for radial nearest neighbor search to complete the feature matching. Finally, the 3D map is fused by the 3D-ICP algorithm. The experiments prove that the low-dimensional local feature descriptor designed has good descriptiveness and is superior, and the 3D map fusion based on this descriptor has a good fusion effect and can meet the accuracy requirements of practical applications.http://www.sciencedirect.com/science/article/pii/S1110016822007402Machine visionMap constructionMachine learningFeature description |
| spellingShingle | Pinhe Wang Nannan Liu Jianzhong Qiao Application of machine vision image feature recognition in 3D map construction Alexandria Engineering Journal Machine vision Map construction Machine learning Feature description |
| title | Application of machine vision image feature recognition in 3D map construction |
| title_full | Application of machine vision image feature recognition in 3D map construction |
| title_fullStr | Application of machine vision image feature recognition in 3D map construction |
| title_full_unstemmed | Application of machine vision image feature recognition in 3D map construction |
| title_short | Application of machine vision image feature recognition in 3D map construction |
| title_sort | application of machine vision image feature recognition in 3d map construction |
| topic | Machine vision Map construction Machine learning Feature description |
| url | http://www.sciencedirect.com/science/article/pii/S1110016822007402 |
| work_keys_str_mv | AT pinhewang applicationofmachinevisionimagefeaturerecognitionin3dmapconstruction AT nannanliu applicationofmachinevisionimagefeaturerecognitionin3dmapconstruction AT jianzhongqiao applicationofmachinevisionimagefeaturerecognitionin3dmapconstruction |