The Plumb-Line Matching Algorithm for UAV Oblique Photographic Photos
Building facades has always been a challenge for feature matching in oblique photogrammetry due to weak textures, non-Lambertian objects, severe occlusion, and distortion. Plumb lines are essential building geometry structural feature lines in building facades, which show strong spatial relevance to...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2023-11-01
|
| Series: | Remote Sensing |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2072-4292/15/22/5290 |
| _version_ | 1797457932227444736 |
|---|---|
| author | Xinnai Zhang Jiuyun Sun Jingxiang Gao Kaijie Yu Sheng Zhang |
| author_facet | Xinnai Zhang Jiuyun Sun Jingxiang Gao Kaijie Yu Sheng Zhang |
| author_sort | Xinnai Zhang |
| collection | DOAJ |
| description | Building facades has always been a challenge for feature matching in oblique photogrammetry due to weak textures, non-Lambertian objects, severe occlusion, and distortion. Plumb lines are essential building geometry structural feature lines in building facades, which show strong spatial relevance to these problems. Achieving plumb line matching has great application potential for optimizing the process and products of oblique photogrammetry. Thus, we proposed a novel matching algorithm for plumb lines based on spatial and color hybrid constraints according to its central projection imaging characteristics. Firstly, based on vanishing point theory, the plumb lines from photos were back-calculated to determine the matching target set; secondly, the property of its large elevation ranges was exploited to calculate the homonymous points as spatial constraints by projecting plumb lines onto the stratified spatial planes; thirdly, the neighboring primary colors on both sides of the plumb lines were extracted as feature descriptors and compared by colorimetry; then, the greedy strategy was employed to successively filter out the locally optimal solutions satisfying the spatial and color hybrid constraints to complete the initial matching; finally, the intersection-over-union analysis of the solution plane and the verticalness evaluation of the matching results were implemented to eliminate errors. The results show that the proposed algorithm can achieve an average accuracy of 97.29% and 78.41% in the forward and lateral overlap experiments from multi-scenes, respectively, displaying a strong adaptability to poor texture, inconsistency, and distortion. In conclusion, thanks to the plumb-line-oriented matching strategy, this algorithm owns inherent advantages in theory and computational complexity. It is suitable for all building-oriented oblique photogrammetry tasks and is highly worthy of promotion and application. |
| first_indexed | 2024-03-09T16:29:52Z |
| format | Article |
| id | doaj.art-e750ea2514304071b967736ab2162824 |
| institution | Directory Open Access Journal |
| issn | 2072-4292 |
| language | English |
| last_indexed | 2024-03-09T16:29:52Z |
| publishDate | 2023-11-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Remote Sensing |
| spelling | doaj.art-e750ea2514304071b967736ab21628242023-11-24T15:04:15ZengMDPI AGRemote Sensing2072-42922023-11-011522529010.3390/rs15225290The Plumb-Line Matching Algorithm for UAV Oblique Photographic PhotosXinnai Zhang0Jiuyun Sun1Jingxiang Gao2Kaijie Yu3Sheng Zhang4School of Environmental Science and Spatial Informatics, China University of Mining and Technology, Xuzhou 221116, ChinaSchool of Environmental Science and Spatial Informatics, China University of Mining and Technology, Xuzhou 221116, ChinaSchool of Environmental Science and Spatial Informatics, China University of Mining and Technology, Xuzhou 221116, ChinaZhejiang TOPRS Technology Co., Ltd., Huzhou 313200, ChinaSchool of Environmental Science and Spatial Informatics, China University of Mining and Technology, Xuzhou 221116, ChinaBuilding facades has always been a challenge for feature matching in oblique photogrammetry due to weak textures, non-Lambertian objects, severe occlusion, and distortion. Plumb lines are essential building geometry structural feature lines in building facades, which show strong spatial relevance to these problems. Achieving plumb line matching has great application potential for optimizing the process and products of oblique photogrammetry. Thus, we proposed a novel matching algorithm for plumb lines based on spatial and color hybrid constraints according to its central projection imaging characteristics. Firstly, based on vanishing point theory, the plumb lines from photos were back-calculated to determine the matching target set; secondly, the property of its large elevation ranges was exploited to calculate the homonymous points as spatial constraints by projecting plumb lines onto the stratified spatial planes; thirdly, the neighboring primary colors on both sides of the plumb lines were extracted as feature descriptors and compared by colorimetry; then, the greedy strategy was employed to successively filter out the locally optimal solutions satisfying the spatial and color hybrid constraints to complete the initial matching; finally, the intersection-over-union analysis of the solution plane and the verticalness evaluation of the matching results were implemented to eliminate errors. The results show that the proposed algorithm can achieve an average accuracy of 97.29% and 78.41% in the forward and lateral overlap experiments from multi-scenes, respectively, displaying a strong adaptability to poor texture, inconsistency, and distortion. In conclusion, thanks to the plumb-line-oriented matching strategy, this algorithm owns inherent advantages in theory and computational complexity. It is suitable for all building-oriented oblique photogrammetry tasks and is highly worthy of promotion and application.https://www.mdpi.com/2072-4292/15/22/5290plumb lineline matchingoblique photogrammetryphotographic geometrycolorimetry |
| spellingShingle | Xinnai Zhang Jiuyun Sun Jingxiang Gao Kaijie Yu Sheng Zhang The Plumb-Line Matching Algorithm for UAV Oblique Photographic Photos Remote Sensing plumb line line matching oblique photogrammetry photographic geometry colorimetry |
| title | The Plumb-Line Matching Algorithm for UAV Oblique Photographic Photos |
| title_full | The Plumb-Line Matching Algorithm for UAV Oblique Photographic Photos |
| title_fullStr | The Plumb-Line Matching Algorithm for UAV Oblique Photographic Photos |
| title_full_unstemmed | The Plumb-Line Matching Algorithm for UAV Oblique Photographic Photos |
| title_short | The Plumb-Line Matching Algorithm for UAV Oblique Photographic Photos |
| title_sort | plumb line matching algorithm for uav oblique photographic photos |
| topic | plumb line line matching oblique photogrammetry photographic geometry colorimetry |
| url | https://www.mdpi.com/2072-4292/15/22/5290 |
| work_keys_str_mv | AT xinnaizhang theplumblinematchingalgorithmforuavobliquephotographicphotos AT jiuyunsun theplumblinematchingalgorithmforuavobliquephotographicphotos AT jingxianggao theplumblinematchingalgorithmforuavobliquephotographicphotos AT kaijieyu theplumblinematchingalgorithmforuavobliquephotographicphotos AT shengzhang theplumblinematchingalgorithmforuavobliquephotographicphotos AT xinnaizhang plumblinematchingalgorithmforuavobliquephotographicphotos AT jiuyunsun plumblinematchingalgorithmforuavobliquephotographicphotos AT jingxianggao plumblinematchingalgorithmforuavobliquephotographicphotos AT kaijieyu plumblinematchingalgorithmforuavobliquephotographicphotos AT shengzhang plumblinematchingalgorithmforuavobliquephotographicphotos |