THE EVALUATION OF STRUCTURE-FROM-MOTION WORKFLOW WITH THE TLS SYNTHETIC IMAGES SIMULATOR – THE CULTURAL HERITAGE APPROACH
Modern measurement technologies such as Terrestrial Laser Scanning or combined Structure-from-Motion with Multi-View Stereo are commonly utilised to monitor, preserve and document cultural heritage objects and sites. For this reason, it is essential to know the capabilities and limitations of the se...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Copernicus Publications
2023-06-01
|
| Series: | The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences |
| Online Access: | https://isprs-archives.copernicus.org/articles/XLVIII-M-2-2023/1013/2023/isprs-archives-XLVIII-M-2-2023-1013-2023.pdf |
| _version_ | 1797795112206467072 |
|---|---|
| author | J. Markiewicz M. Kowalczyk K. Karwel P. Kot Ł. Markiewicz |
| author_facet | J. Markiewicz M. Kowalczyk K. Karwel P. Kot Ł. Markiewicz |
| author_sort | J. Markiewicz |
| collection | DOAJ |
| description | Modern measurement technologies such as Terrestrial Laser Scanning or combined Structure-from-Motion with Multi-View Stereo are commonly utilised to monitor, preserve and document cultural heritage objects and sites. For this reason, it is essential to know the capabilities and limitations of the sensor used, the data processing methods, and in particular, the orientation of the images. However, these algorithms tackle different errors and have different effects on the final accuracy of images orientation. For this reason, it is essential to know how the algorithms implemented in the Structure-from-Motion approach work. Due to the impossibility of obtaining this information for commercial solutions, it is necessary to use synthetic data to assess the quality of the SfM process. Therefore, this article aims to present the method of evaluation of SfM approach implemented in commercial Agisoft Metashape and COLLMAP open-source software based on the synthetic data generated from TLS point clouds of three different Cultural Heritage sites. In addition, obtained results were compared with the author's SfM approach based on BRISK, FAST, CenSurE, SIFT and SURF (and its Affine detectors equivalents) detector implemented (Fig. 1) and Learned-based -feature extraction approach SuperGlue and LoFTR. The second aim of this research is to propose an application to automatically generate scalable benchmark based on point clouds or 3D models of cultural heritage objects. |
| first_indexed | 2024-03-13T03:12:57Z |
| format | Article |
| id | doaj.art-634f8e6c9d5e404582693117636ab52e |
| institution | Directory Open Access Journal |
| issn | 1682-1750 2194-9034 |
| language | English |
| last_indexed | 2024-03-13T03:12:57Z |
| publishDate | 2023-06-01 |
| publisher | Copernicus Publications |
| record_format | Article |
| series | The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences |
| spelling | doaj.art-634f8e6c9d5e404582693117636ab52e2023-06-26T10:13:33ZengCopernicus PublicationsThe International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences1682-17502194-90342023-06-01XLVIII-M-2-20231013102010.5194/isprs-archives-XLVIII-M-2-2023-1013-2023THE EVALUATION OF STRUCTURE-FROM-MOTION WORKFLOW WITH THE TLS SYNTHETIC IMAGES SIMULATOR – THE CULTURAL HERITAGE APPROACHJ. Markiewicz0M. Kowalczyk1K. Karwel2P. Kot3Ł. Markiewicz4Faculty of Geodesy and Cartography, Warsaw University of Technology, Warsaw, PolandFaculty of Geodesy and Cartography, Warsaw University of Technology, Warsaw, PolandFaculty of Geodesy and Cartography, Warsaw University of Technology, Warsaw, PolandBuilt Environment and Sustainable Technologies (BEST) Research Institute, Liverpool John Moores University, Liverpool, United KingdomInstitute of Micromechanics and Photonics, Warsaw University of Technology, Warsaw, PolandModern measurement technologies such as Terrestrial Laser Scanning or combined Structure-from-Motion with Multi-View Stereo are commonly utilised to monitor, preserve and document cultural heritage objects and sites. For this reason, it is essential to know the capabilities and limitations of the sensor used, the data processing methods, and in particular, the orientation of the images. However, these algorithms tackle different errors and have different effects on the final accuracy of images orientation. For this reason, it is essential to know how the algorithms implemented in the Structure-from-Motion approach work. Due to the impossibility of obtaining this information for commercial solutions, it is necessary to use synthetic data to assess the quality of the SfM process. Therefore, this article aims to present the method of evaluation of SfM approach implemented in commercial Agisoft Metashape and COLLMAP open-source software based on the synthetic data generated from TLS point clouds of three different Cultural Heritage sites. In addition, obtained results were compared with the author's SfM approach based on BRISK, FAST, CenSurE, SIFT and SURF (and its Affine detectors equivalents) detector implemented (Fig. 1) and Learned-based -feature extraction approach SuperGlue and LoFTR. The second aim of this research is to propose an application to automatically generate scalable benchmark based on point clouds or 3D models of cultural heritage objects.https://isprs-archives.copernicus.org/articles/XLVIII-M-2-2023/1013/2023/isprs-archives-XLVIII-M-2-2023-1013-2023.pdf |
| spellingShingle | J. Markiewicz M. Kowalczyk K. Karwel P. Kot Ł. Markiewicz THE EVALUATION OF STRUCTURE-FROM-MOTION WORKFLOW WITH THE TLS SYNTHETIC IMAGES SIMULATOR – THE CULTURAL HERITAGE APPROACH The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences |
| title | THE EVALUATION OF STRUCTURE-FROM-MOTION WORKFLOW WITH THE TLS SYNTHETIC IMAGES SIMULATOR – THE CULTURAL HERITAGE APPROACH |
| title_full | THE EVALUATION OF STRUCTURE-FROM-MOTION WORKFLOW WITH THE TLS SYNTHETIC IMAGES SIMULATOR – THE CULTURAL HERITAGE APPROACH |
| title_fullStr | THE EVALUATION OF STRUCTURE-FROM-MOTION WORKFLOW WITH THE TLS SYNTHETIC IMAGES SIMULATOR – THE CULTURAL HERITAGE APPROACH |
| title_full_unstemmed | THE EVALUATION OF STRUCTURE-FROM-MOTION WORKFLOW WITH THE TLS SYNTHETIC IMAGES SIMULATOR – THE CULTURAL HERITAGE APPROACH |
| title_short | THE EVALUATION OF STRUCTURE-FROM-MOTION WORKFLOW WITH THE TLS SYNTHETIC IMAGES SIMULATOR – THE CULTURAL HERITAGE APPROACH |
| title_sort | evaluation of structure from motion workflow with the tls synthetic images simulator the cultural heritage approach |
| url | https://isprs-archives.copernicus.org/articles/XLVIII-M-2-2023/1013/2023/isprs-archives-XLVIII-M-2-2023-1013-2023.pdf |
| work_keys_str_mv | AT jmarkiewicz theevaluationofstructurefrommotionworkflowwiththetlssyntheticimagessimulatortheculturalheritageapproach AT mkowalczyk theevaluationofstructurefrommotionworkflowwiththetlssyntheticimagessimulatortheculturalheritageapproach AT kkarwel theevaluationofstructurefrommotionworkflowwiththetlssyntheticimagessimulatortheculturalheritageapproach AT pkot theevaluationofstructurefrommotionworkflowwiththetlssyntheticimagessimulatortheculturalheritageapproach AT łmarkiewicz theevaluationofstructurefrommotionworkflowwiththetlssyntheticimagessimulatortheculturalheritageapproach AT jmarkiewicz evaluationofstructurefrommotionworkflowwiththetlssyntheticimagessimulatortheculturalheritageapproach AT mkowalczyk evaluationofstructurefrommotionworkflowwiththetlssyntheticimagessimulatortheculturalheritageapproach AT kkarwel evaluationofstructurefrommotionworkflowwiththetlssyntheticimagessimulatortheculturalheritageapproach AT pkot evaluationofstructurefrommotionworkflowwiththetlssyntheticimagessimulatortheculturalheritageapproach AT łmarkiewicz evaluationofstructurefrommotionworkflowwiththetlssyntheticimagessimulatortheculturalheritageapproach |