PLAUSIBLE RECONSTRUCTION OF AN APPROXIMATED MESH MODEL FOR NEXT-BEST VIEW PLANNING OF SFM-MVS
Structure-from-Motion (SfM) and Multi-View Stereo (MVS) are widely used methods in three dimensional (3D) model reconstruction for an infrastructure maintenance purpose. However, if a set of images is not captured from well-placed positions, the final dense model can contain low-quality regions. Sin...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Copernicus Publications
2020-08-01
|
| Series: | The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences |
| Online Access: | https://www.int-arch-photogramm-remote-sens-spatial-inf-sci.net/XLIII-B2-2020/465/2020/isprs-archives-XLIII-B2-2020-465-2020.pdf |
| _version_ | 1819230122592436224 |
|---|---|
| author | R. Moritani S. Kanai H. Date Y. Niina R. Honma |
| author_facet | R. Moritani S. Kanai H. Date Y. Niina R. Honma |
| author_sort | R. Moritani |
| collection | DOAJ |
| description | Structure-from-Motion (SfM) and Multi-View Stereo (MVS) are widely used methods in three dimensional (3D) model reconstruction for an infrastructure maintenance purpose. However, if a set of images is not captured from well-placed positions, the final dense model can contain low-quality regions. Since MVS requires a much longer processing time than SfM as larger amounts of images are provided, it is impossible for surveyors to wait for the SfM–MVS process to complete and evaluate the geometric quality of a final dense model on-site. This challenge results in response inefficiency and the deterioration of dense models in 3D model reconstruction. If the quality of the final dense model can be predicted immediately after SfM, it will be possible to revalidate the images much earlier and to obtain the dense model with better quality than the existing SfM–MVS process. Therefore, we propose a method for reconstructing a more plausible 3D mesh model that accurately approximates the geometry of the final dense model only from sparse point clouds generated from SfM. This approximated mesh model can be generated using Delaunay triangulation for the sparse point clouds and triangle as well as tetrahedron filtering. The approximated model can be used to predict the geometric quality of the final dense model and for an optimization-based view planning. Some experimental results showed that our method is effective in predicting the quality of the final dense model and finding the potentially degraded regions. Moreover, it was confirmed that the average reconstruction errors of the dense model generated by the optimization-based view planning went below tens of millimeters and falls within an acceptable range for an infrastructure maintenance purpose. |
| first_indexed | 2024-12-23T11:24:03Z |
| format | Article |
| id | doaj.art-c8bbcab00dd44b4798baba08fa4858f1 |
| institution | Directory Open Access Journal |
| issn | 1682-1750 2194-9034 |
| language | English |
| last_indexed | 2024-12-23T11:24:03Z |
| publishDate | 2020-08-01 |
| publisher | Copernicus Publications |
| record_format | Article |
| series | The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences |
| spelling | doaj.art-c8bbcab00dd44b4798baba08fa4858f12022-12-21T17:49:00ZengCopernicus PublicationsThe International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences1682-17502194-90342020-08-01XLIII-B2-202046547110.5194/isprs-archives-XLIII-B2-2020-465-2020PLAUSIBLE RECONSTRUCTION OF AN APPROXIMATED MESH MODEL FOR NEXT-BEST VIEW PLANNING OF SFM-MVSR. Moritani0S. Kanai1H. Date2Y. Niina3R. Honma4Graduate School of Information Science and Technology, Hokkaido University, JapanFaculty of Information Science and Technology, Hokkaido University, JapanFaculty of Information Science and Technology, Hokkaido University, JapanAsia Air Survey Co., Ltd.Asia Air Survey Co., Ltd.Structure-from-Motion (SfM) and Multi-View Stereo (MVS) are widely used methods in three dimensional (3D) model reconstruction for an infrastructure maintenance purpose. However, if a set of images is not captured from well-placed positions, the final dense model can contain low-quality regions. Since MVS requires a much longer processing time than SfM as larger amounts of images are provided, it is impossible for surveyors to wait for the SfM–MVS process to complete and evaluate the geometric quality of a final dense model on-site. This challenge results in response inefficiency and the deterioration of dense models in 3D model reconstruction. If the quality of the final dense model can be predicted immediately after SfM, it will be possible to revalidate the images much earlier and to obtain the dense model with better quality than the existing SfM–MVS process. Therefore, we propose a method for reconstructing a more plausible 3D mesh model that accurately approximates the geometry of the final dense model only from sparse point clouds generated from SfM. This approximated mesh model can be generated using Delaunay triangulation for the sparse point clouds and triangle as well as tetrahedron filtering. The approximated model can be used to predict the geometric quality of the final dense model and for an optimization-based view planning. Some experimental results showed that our method is effective in predicting the quality of the final dense model and finding the potentially degraded regions. Moreover, it was confirmed that the average reconstruction errors of the dense model generated by the optimization-based view planning went below tens of millimeters and falls within an acceptable range for an infrastructure maintenance purpose.https://www.int-arch-photogramm-remote-sens-spatial-inf-sci.net/XLIII-B2-2020/465/2020/isprs-archives-XLIII-B2-2020-465-2020.pdf |
| spellingShingle | R. Moritani S. Kanai H. Date Y. Niina R. Honma PLAUSIBLE RECONSTRUCTION OF AN APPROXIMATED MESH MODEL FOR NEXT-BEST VIEW PLANNING OF SFM-MVS The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences |
| title | PLAUSIBLE RECONSTRUCTION OF AN APPROXIMATED MESH MODEL FOR NEXT-BEST VIEW PLANNING OF SFM-MVS |
| title_full | PLAUSIBLE RECONSTRUCTION OF AN APPROXIMATED MESH MODEL FOR NEXT-BEST VIEW PLANNING OF SFM-MVS |
| title_fullStr | PLAUSIBLE RECONSTRUCTION OF AN APPROXIMATED MESH MODEL FOR NEXT-BEST VIEW PLANNING OF SFM-MVS |
| title_full_unstemmed | PLAUSIBLE RECONSTRUCTION OF AN APPROXIMATED MESH MODEL FOR NEXT-BEST VIEW PLANNING OF SFM-MVS |
| title_short | PLAUSIBLE RECONSTRUCTION OF AN APPROXIMATED MESH MODEL FOR NEXT-BEST VIEW PLANNING OF SFM-MVS |
| title_sort | plausible reconstruction of an approximated mesh model for next best view planning of sfm mvs |
| url | https://www.int-arch-photogramm-remote-sens-spatial-inf-sci.net/XLIII-B2-2020/465/2020/isprs-archives-XLIII-B2-2020-465-2020.pdf |
| work_keys_str_mv | AT rmoritani plausiblereconstructionofanapproximatedmeshmodelfornextbestviewplanningofsfmmvs AT skanai plausiblereconstructionofanapproximatedmeshmodelfornextbestviewplanningofsfmmvs AT hdate plausiblereconstructionofanapproximatedmeshmodelfornextbestviewplanningofsfmmvs AT yniina plausiblereconstructionofanapproximatedmeshmodelfornextbestviewplanningofsfmmvs AT rhonma plausiblereconstructionofanapproximatedmeshmodelfornextbestviewplanningofsfmmvs |