MoReLab: A Software for User-Assisted 3D Reconstruction
We present MoReLab, a tool for user-assisted 3D reconstruction. This reconstruction requires an understanding of the shapes of the desired objects. Our experiments demonstrate that existing Structure from Motion (SfM) software packages fail to estimate accurate 3D models in low-quality videos due to...
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2023-07-01
|
| Series: | Sensors |
| Subjects: | |
| Online Access: | https://www.mdpi.com/1424-8220/23/14/6456 |
| _version_ | 1797587513431293952 |
|---|---|
| author | Arslan Siddique Francesco Banterle Massimiliano Corsini Paolo Cignoni Daniel Sommerville Chris Joffe |
| author_facet | Arslan Siddique Francesco Banterle Massimiliano Corsini Paolo Cignoni Daniel Sommerville Chris Joffe |
| author_sort | Arslan Siddique |
| collection | DOAJ |
| description | We present MoReLab, a tool for user-assisted 3D reconstruction. This reconstruction requires an understanding of the shapes of the desired objects. Our experiments demonstrate that existing Structure from Motion (SfM) software packages fail to estimate accurate 3D models in low-quality videos due to several issues such as low resolution, featureless surfaces, low lighting, etc. In such scenarios, which are common for industrial utility companies, user assistance becomes necessary to create reliable 3D models. In our system, the user first needs to add features and correspondences manually on multiple video frames. Then, classic camera calibration and bundle adjustment are applied. At this point, MoReLab provides several primitive shape tools such as rectangles, cylinders, curved cylinders, etc., to model different parts of the scene and export 3D meshes. These shapes are essential for modeling industrial equipment whose videos are typically captured by utility companies with old video cameras (low resolution, compression artifacts, etc.) and in disadvantageous lighting conditions (low lighting, torchlight attached to the video camera, etc.). We evaluate our tool on real industrial case scenarios and compare it against existing approaches. Visual comparisons and quantitative results show that MoReLab achieves superior results with regard to other user-interactive 3D modeling tools. |
| first_indexed | 2024-03-11T00:40:00Z |
| format | Article |
| id | doaj.art-5a4965ee1b194cb0b0063e1cea0c1078 |
| institution | Directory Open Access Journal |
| issn | 1424-8220 |
| language | English |
| last_indexed | 2024-03-11T00:40:00Z |
| publishDate | 2023-07-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Sensors |
| spelling | doaj.art-5a4965ee1b194cb0b0063e1cea0c10782023-11-18T21:17:59ZengMDPI AGSensors1424-82202023-07-012314645610.3390/s23146456MoReLab: A Software for User-Assisted 3D ReconstructionArslan Siddique0Francesco Banterle1Massimiliano Corsini2Paolo Cignoni3Daniel Sommerville4Chris Joffe5Department of Computer Science, Pisa University, Largo Bruno Pontecorvo 3, 56127 Pisa, ItalyVisual Computing Laboratory, ISTI-CNR, Via G. Moruzzi 1, 56124 Pisa, ItalyVisual Computing Laboratory, ISTI-CNR, Via G. Moruzzi 1, 56124 Pisa, ItalyVisual Computing Laboratory, ISTI-CNR, Via G. Moruzzi 1, 56124 Pisa, ItalyEPRI, 3420 Hillview Avenue, Palo Alto, CA 94304, USAEPRI, 3420 Hillview Avenue, Palo Alto, CA 94304, USAWe present MoReLab, a tool for user-assisted 3D reconstruction. This reconstruction requires an understanding of the shapes of the desired objects. Our experiments demonstrate that existing Structure from Motion (SfM) software packages fail to estimate accurate 3D models in low-quality videos due to several issues such as low resolution, featureless surfaces, low lighting, etc. In such scenarios, which are common for industrial utility companies, user assistance becomes necessary to create reliable 3D models. In our system, the user first needs to add features and correspondences manually on multiple video frames. Then, classic camera calibration and bundle adjustment are applied. At this point, MoReLab provides several primitive shape tools such as rectangles, cylinders, curved cylinders, etc., to model different parts of the scene and export 3D meshes. These shapes are essential for modeling industrial equipment whose videos are typically captured by utility companies with old video cameras (low resolution, compression artifacts, etc.) and in disadvantageous lighting conditions (low lighting, torchlight attached to the video camera, etc.). We evaluate our tool on real industrial case scenarios and compare it against existing approaches. Visual comparisons and quantitative results show that MoReLab achieves superior results with regard to other user-interactive 3D modeling tools.https://www.mdpi.com/1424-8220/23/14/6456image-based 3D reconstruction3D modelinguser-assisted 3D reconstructionvideo-based 3D reconstructionStructure from MotionHCI |
| spellingShingle | Arslan Siddique Francesco Banterle Massimiliano Corsini Paolo Cignoni Daniel Sommerville Chris Joffe MoReLab: A Software for User-Assisted 3D Reconstruction Sensors image-based 3D reconstruction 3D modeling user-assisted 3D reconstruction video-based 3D reconstruction Structure from Motion HCI |
| title | MoReLab: A Software for User-Assisted 3D Reconstruction |
| title_full | MoReLab: A Software for User-Assisted 3D Reconstruction |
| title_fullStr | MoReLab: A Software for User-Assisted 3D Reconstruction |
| title_full_unstemmed | MoReLab: A Software for User-Assisted 3D Reconstruction |
| title_short | MoReLab: A Software for User-Assisted 3D Reconstruction |
| title_sort | morelab a software for user assisted 3d reconstruction |
| topic | image-based 3D reconstruction 3D modeling user-assisted 3D reconstruction video-based 3D reconstruction Structure from Motion HCI |
| url | https://www.mdpi.com/1424-8220/23/14/6456 |
| work_keys_str_mv | AT arslansiddique morelabasoftwareforuserassisted3dreconstruction AT francescobanterle morelabasoftwareforuserassisted3dreconstruction AT massimilianocorsini morelabasoftwareforuserassisted3dreconstruction AT paolocignoni morelabasoftwareforuserassisted3dreconstruction AT danielsommerville morelabasoftwareforuserassisted3dreconstruction AT chrisjoffe morelabasoftwareforuserassisted3dreconstruction |