Visual Three-Dimensional Reconstruction Based on Spatiotemporal Analysis Method

To accurately reconstruct the three-dimensional (3D) surface of dynamic objects, we proposed a wrapped phase extraction method for spatiotemporal analysis based on 3D wavelet transform (WT). Our proposed method uses a 2D spatial fringe image combined with the time dimension and forms a 3D image sequ...

Full description

Bibliographic Details
Main Authors: Xiaoliang Meng, Fuzhen Sun, Liye Zhang, Chao Fang, Xiaoyu Wang
Format: Article
Language:English
Published: MDPI AG 2023-01-01
Series:Electronics
Subjects:
Online Access:https://www.mdpi.com/2079-9292/12/3/535
_version_ 1797624839821852672
author Xiaoliang Meng
Fuzhen Sun
Liye Zhang
Chao Fang
Xiaoyu Wang
author_facet Xiaoliang Meng
Fuzhen Sun
Liye Zhang
Chao Fang
Xiaoyu Wang
author_sort Xiaoliang Meng
collection DOAJ
description To accurately reconstruct the three-dimensional (3D) surface of dynamic objects, we proposed a wrapped phase extraction method for spatiotemporal analysis based on 3D wavelet transform (WT). Our proposed method uses a 2D spatial fringe image combined with the time dimension and forms a 3D image sequence. The encoded fringe image sequence’s wrapped phase information was extracted by 3D WT and complex Morlet wavelet, and we improved the wrapped phase extraction’s accuracy by using the characteristics of spatiotemporal analysis and a multi-scale analysis of 3D WT, then we reconstructed the measured object by wrapped phase unwrapping and phase height transformation. Our simulation experiment results show that our proposed method can further filter the noise in the time dimension, and its accuracy is better than that of the one- (1D) and two-dimensional (2D) WT wrapped phase extraction method and the 3D Fourier transform wrapped phase extraction method because the reconstructed spherical crown’s RMSE value does not exceed 0.25 and the PVE value is less than 0.95. Our results show that the proposed method can be applied to the dynamic 3D reconstruction of a real human thoracic and abdominal surface, which fluctuates slowly with respiration movement, further verifying its effectiveness.
first_indexed 2024-03-11T09:48:22Z
format Article
id doaj.art-ba3e340f2e154e6e990f209f11ec365f
institution Directory Open Access Journal
issn 2079-9292
language English
last_indexed 2024-03-11T09:48:22Z
publishDate 2023-01-01
publisher MDPI AG
record_format Article
series Electronics
spelling doaj.art-ba3e340f2e154e6e990f209f11ec365f2023-11-16T16:27:51ZengMDPI AGElectronics2079-92922023-01-0112353510.3390/electronics12030535Visual Three-Dimensional Reconstruction Based on Spatiotemporal Analysis MethodXiaoliang Meng0Fuzhen Sun1Liye Zhang2Chao Fang3Xiaoyu Wang4School of Computer Science and Technology, Shandong University of Technology, Zibo 255000, Shandong, ChinaSchool of Computer Science and Technology, Shandong University of Technology, Zibo 255000, Shandong, ChinaSchool of Computer Science and Technology, Shandong University of Technology, Zibo 255000, Shandong, ChinaSchool of Computer Science and Technology, Shandong University of Technology, Zibo 255000, Shandong, ChinaSchool of Computer Science and Technology, Shandong University of Technology, Zibo 255000, Shandong, ChinaTo accurately reconstruct the three-dimensional (3D) surface of dynamic objects, we proposed a wrapped phase extraction method for spatiotemporal analysis based on 3D wavelet transform (WT). Our proposed method uses a 2D spatial fringe image combined with the time dimension and forms a 3D image sequence. The encoded fringe image sequence’s wrapped phase information was extracted by 3D WT and complex Morlet wavelet, and we improved the wrapped phase extraction’s accuracy by using the characteristics of spatiotemporal analysis and a multi-scale analysis of 3D WT, then we reconstructed the measured object by wrapped phase unwrapping and phase height transformation. Our simulation experiment results show that our proposed method can further filter the noise in the time dimension, and its accuracy is better than that of the one- (1D) and two-dimensional (2D) WT wrapped phase extraction method and the 3D Fourier transform wrapped phase extraction method because the reconstructed spherical crown’s RMSE value does not exceed 0.25 and the PVE value is less than 0.95. Our results show that the proposed method can be applied to the dynamic 3D reconstruction of a real human thoracic and abdominal surface, which fluctuates slowly with respiration movement, further verifying its effectiveness.https://www.mdpi.com/2079-9292/12/3/535three-dimensional wavelet transformspatiotemporal analysiscomplex Morlet waveletwrapped phase extractionthree-dimensional reconstruction
spellingShingle Xiaoliang Meng
Fuzhen Sun
Liye Zhang
Chao Fang
Xiaoyu Wang
Visual Three-Dimensional Reconstruction Based on Spatiotemporal Analysis Method
Electronics
three-dimensional wavelet transform
spatiotemporal analysis
complex Morlet wavelet
wrapped phase extraction
three-dimensional reconstruction
title Visual Three-Dimensional Reconstruction Based on Spatiotemporal Analysis Method
title_full Visual Three-Dimensional Reconstruction Based on Spatiotemporal Analysis Method
title_fullStr Visual Three-Dimensional Reconstruction Based on Spatiotemporal Analysis Method
title_full_unstemmed Visual Three-Dimensional Reconstruction Based on Spatiotemporal Analysis Method
title_short Visual Three-Dimensional Reconstruction Based on Spatiotemporal Analysis Method
title_sort visual three dimensional reconstruction based on spatiotemporal analysis method
topic three-dimensional wavelet transform
spatiotemporal analysis
complex Morlet wavelet
wrapped phase extraction
three-dimensional reconstruction
url https://www.mdpi.com/2079-9292/12/3/535
work_keys_str_mv AT xiaoliangmeng visualthreedimensionalreconstructionbasedonspatiotemporalanalysismethod
AT fuzhensun visualthreedimensionalreconstructionbasedonspatiotemporalanalysismethod
AT liyezhang visualthreedimensionalreconstructionbasedonspatiotemporalanalysismethod
AT chaofang visualthreedimensionalreconstructionbasedonspatiotemporalanalysismethod
AT xiaoyuwang visualthreedimensionalreconstructionbasedonspatiotemporalanalysismethod