EFFECT OF KEYFRAMES EXTRACTION FROM THERMAL INFRARED VIDEO STREAM TO GENERATE DENSE POINT CLOUD OF THE BUILDING'S FACADE
Keyframes extraction is required and effective for the 3D reconstruction of objects from a thermal video sequence to increase geometric accuracy, reduce the volume of aerial triangulation calculations, and generate the dense point cloud. The primary goal and focus of this paper are to assess the eff...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Copernicus Publications
2023-01-01
|
| Series: | ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences |
| Online Access: | https://www.isprs-ann-photogramm-remote-sens-spatial-inf-sci.net/X-4-W1-2022/551/2023/isprs-annals-X-4-W1-2022-551-2023.pdf |
| _version_ | 1797952258037514240 |
|---|---|
| author | S. Motayyeb F. Samadzadegan F. Dadrass Javan F. Dadrass Javan H. R. Hosseinpour |
| author_facet | S. Motayyeb F. Samadzadegan F. Dadrass Javan F. Dadrass Javan H. R. Hosseinpour |
| author_sort | S. Motayyeb |
| collection | DOAJ |
| description | Keyframes extraction is required and effective for the 3D reconstruction of objects from a thermal video sequence to increase geometric accuracy, reduce the volume of aerial triangulation calculations, and generate the dense point cloud. The primary goal and focus of this paper are to assess the effect of keyframes extraction from the thermal infrared video sequence on the geometric accuracy of the dense point cloud generated. The method of keyframes extraction of thermal infrared video presented in this paper consists of three basic steps. (A) The ability to identify and remove blur frames from non-blur frames in a sequence of recorded frames. (B) The ability to apply the standard baseline condition between sequence frames to establish the overlap condition and prevent the creation of degeneracy conditions. (C) Evaluating degeneracy conditions and keyframes extraction using Geometric Robust Information Criteria (GRIC). The performance evaluation criteria for keyframes extraction in the generation of the thermal infrared dense point cloud in this paper are to assess the increase in density of the generated three-dimensional point cloud and reduce reprojection error. Based on the results and assessments presented in this paper, using keyframes increases the density of the thermal infrared dense point cloud by about 0.03% to 0.10% of points per square meter. It reduces the reprojection error by about 0.005% of pixels (2 times). |
| first_indexed | 2024-04-10T22:43:27Z |
| format | Article |
| id | doaj.art-074c8000748849b880ac4d50a51c8128 |
| institution | Directory Open Access Journal |
| issn | 2194-9042 2194-9050 |
| language | English |
| last_indexed | 2024-04-10T22:43:27Z |
| publishDate | 2023-01-01 |
| publisher | Copernicus Publications |
| record_format | Article |
| series | ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences |
| spelling | doaj.art-074c8000748849b880ac4d50a51c81282023-01-15T14:02:13ZengCopernicus PublicationsISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences2194-90422194-90502023-01-01X-4-W1-202255156110.5194/isprs-annals-X-4-W1-2022-551-2023EFFECT OF KEYFRAMES EXTRACTION FROM THERMAL INFRARED VIDEO STREAM TO GENERATE DENSE POINT CLOUD OF THE BUILDING'S FACADES. Motayyeb0F. Samadzadegan1F. Dadrass Javan2F. Dadrass Javan3H. R. Hosseinpour4School of Surveying and Geospatial Information Engineering, College of Engineering, University of Tehran, IranSchool of Surveying and Geospatial Information Engineering, College of Engineering, University of Tehran, IranSchool of Surveying and Geospatial Information Engineering, College of Engineering, University of Tehran, IranFaculty of Geo-Information Science and Earth Observation (ITC), University of Twente, 7522 NB Enschede, the NetherlandsSchool of Surveying and Geospatial Information Engineering, College of Engineering, University of Tehran, IranKeyframes extraction is required and effective for the 3D reconstruction of objects from a thermal video sequence to increase geometric accuracy, reduce the volume of aerial triangulation calculations, and generate the dense point cloud. The primary goal and focus of this paper are to assess the effect of keyframes extraction from the thermal infrared video sequence on the geometric accuracy of the dense point cloud generated. The method of keyframes extraction of thermal infrared video presented in this paper consists of three basic steps. (A) The ability to identify and remove blur frames from non-blur frames in a sequence of recorded frames. (B) The ability to apply the standard baseline condition between sequence frames to establish the overlap condition and prevent the creation of degeneracy conditions. (C) Evaluating degeneracy conditions and keyframes extraction using Geometric Robust Information Criteria (GRIC). The performance evaluation criteria for keyframes extraction in the generation of the thermal infrared dense point cloud in this paper are to assess the increase in density of the generated three-dimensional point cloud and reduce reprojection error. Based on the results and assessments presented in this paper, using keyframes increases the density of the thermal infrared dense point cloud by about 0.03% to 0.10% of points per square meter. It reduces the reprojection error by about 0.005% of pixels (2 times).https://www.isprs-ann-photogramm-remote-sens-spatial-inf-sci.net/X-4-W1-2022/551/2023/isprs-annals-X-4-W1-2022-551-2023.pdf |
| spellingShingle | S. Motayyeb F. Samadzadegan F. Dadrass Javan F. Dadrass Javan H. R. Hosseinpour EFFECT OF KEYFRAMES EXTRACTION FROM THERMAL INFRARED VIDEO STREAM TO GENERATE DENSE POINT CLOUD OF THE BUILDING'S FACADE ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences |
| title | EFFECT OF KEYFRAMES EXTRACTION FROM THERMAL INFRARED VIDEO STREAM TO GENERATE DENSE POINT CLOUD OF THE BUILDING'S FACADE |
| title_full | EFFECT OF KEYFRAMES EXTRACTION FROM THERMAL INFRARED VIDEO STREAM TO GENERATE DENSE POINT CLOUD OF THE BUILDING'S FACADE |
| title_fullStr | EFFECT OF KEYFRAMES EXTRACTION FROM THERMAL INFRARED VIDEO STREAM TO GENERATE DENSE POINT CLOUD OF THE BUILDING'S FACADE |
| title_full_unstemmed | EFFECT OF KEYFRAMES EXTRACTION FROM THERMAL INFRARED VIDEO STREAM TO GENERATE DENSE POINT CLOUD OF THE BUILDING'S FACADE |
| title_short | EFFECT OF KEYFRAMES EXTRACTION FROM THERMAL INFRARED VIDEO STREAM TO GENERATE DENSE POINT CLOUD OF THE BUILDING'S FACADE |
| title_sort | effect of keyframes extraction from thermal infrared video stream to generate dense point cloud of the building s facade |
| url | https://www.isprs-ann-photogramm-remote-sens-spatial-inf-sci.net/X-4-W1-2022/551/2023/isprs-annals-X-4-W1-2022-551-2023.pdf |
| work_keys_str_mv | AT smotayyeb effectofkeyframesextractionfromthermalinfraredvideostreamtogeneratedensepointcloudofthebuildingsfacade AT fsamadzadegan effectofkeyframesextractionfromthermalinfraredvideostreamtogeneratedensepointcloudofthebuildingsfacade AT fdadrassjavan effectofkeyframesextractionfromthermalinfraredvideostreamtogeneratedensepointcloudofthebuildingsfacade AT fdadrassjavan effectofkeyframesextractionfromthermalinfraredvideostreamtogeneratedensepointcloudofthebuildingsfacade AT hrhosseinpour effectofkeyframesextractionfromthermalinfraredvideostreamtogeneratedensepointcloudofthebuildingsfacade |