Spatio-Temporal Consistency in Depth Video Enhancement
In recent years, new active range sensors have been developed for 3D data acquirement, such as time-of-flight cameras. These sensors enable acquiring of range data at video rate and are suited for dynamic environment. Unfortunately, the resolution of the range data is quite limited and the captured...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
The Japan Society of Mechanical Engineers
2013-11-01
|
| Series: | Journal of Advanced Mechanical Design, Systems, and Manufacturing |
| Subjects: | |
| Online Access: | https://www.jstage.jst.go.jp/article/jamdsm/7/5/7_808/_pdf/-char/en |
| _version_ | 1811291826104041472 |
|---|---|
| author | Li LI Caiming ZHANG |
| author_facet | Li LI Caiming ZHANG |
| author_sort | Li LI |
| collection | DOAJ |
| description | In recent years, new active range sensors have been developed for 3D data acquirement, such as time-of-flight cameras. These sensors enable acquiring of range data at video rate and are suited for dynamic environment. Unfortunately, the resolution of the range data is quite limited and the captured data are typically contaminated by noise. In this paper, we propose a novel method for depth video enhancement. Using high resolution color video as guidance reference, we iteratively refine the input depth map based on a newly presented linear filter model, in terms of both its spatial resolution and depth precision. The linear filter has a good edge-preserving property and a runtime independent of filter size, which fulfills both accuracy and speed requirements. For temporally consistent estimate on depth video, we extend the method into temporally neighboring frames. Simple optical flow and patch-based similarity measure are used to obtain accurate depth in an efficient manner. Experimental results show that the proposed method greatly improves the quality and boosts the resolution of range data while achieving high computational efficiency. We also show that the temporally consistent constraint addresses a flickering problem and improves the accuracy of depth video. |
| first_indexed | 2024-04-13T04:35:13Z |
| format | Article |
| id | doaj.art-8ad6546e3831445584118769602675f9 |
| institution | Directory Open Access Journal |
| issn | 1881-3054 |
| language | English |
| last_indexed | 2024-04-13T04:35:13Z |
| publishDate | 2013-11-01 |
| publisher | The Japan Society of Mechanical Engineers |
| record_format | Article |
| series | Journal of Advanced Mechanical Design, Systems, and Manufacturing |
| spelling | doaj.art-8ad6546e3831445584118769602675f92022-12-22T03:02:11ZengThe Japan Society of Mechanical EngineersJournal of Advanced Mechanical Design, Systems, and Manufacturing1881-30542013-11-017580881710.1299/jamdsm.7.808jamdsmSpatio-Temporal Consistency in Depth Video EnhancementLi LI0Caiming ZHANG1Shandong Provincial Key Laboratory of Digital Media Technology School of Computer Science and Technology Shandong University of Finance and EconomicsShandong Provincial Key Laboratory of Digital Media Technology School of Computer Science and Technology Shandong University of Finance and EconomicsIn recent years, new active range sensors have been developed for 3D data acquirement, such as time-of-flight cameras. These sensors enable acquiring of range data at video rate and are suited for dynamic environment. Unfortunately, the resolution of the range data is quite limited and the captured data are typically contaminated by noise. In this paper, we propose a novel method for depth video enhancement. Using high resolution color video as guidance reference, we iteratively refine the input depth map based on a newly presented linear filter model, in terms of both its spatial resolution and depth precision. The linear filter has a good edge-preserving property and a runtime independent of filter size, which fulfills both accuracy and speed requirements. For temporally consistent estimate on depth video, we extend the method into temporally neighboring frames. Simple optical flow and patch-based similarity measure are used to obtain accurate depth in an efficient manner. Experimental results show that the proposed method greatly improves the quality and boosts the resolution of range data while achieving high computational efficiency. We also show that the temporally consistent constraint addresses a flickering problem and improves the accuracy of depth video.https://www.jstage.jst.go.jp/article/jamdsm/7/5/7_808/_pdf/-char/enrange datadepth video enhancementlinear filtertemporal consistency |
| spellingShingle | Li LI Caiming ZHANG Spatio-Temporal Consistency in Depth Video Enhancement Journal of Advanced Mechanical Design, Systems, and Manufacturing range data depth video enhancement linear filter temporal consistency |
| title | Spatio-Temporal Consistency in Depth Video Enhancement |
| title_full | Spatio-Temporal Consistency in Depth Video Enhancement |
| title_fullStr | Spatio-Temporal Consistency in Depth Video Enhancement |
| title_full_unstemmed | Spatio-Temporal Consistency in Depth Video Enhancement |
| title_short | Spatio-Temporal Consistency in Depth Video Enhancement |
| title_sort | spatio temporal consistency in depth video enhancement |
| topic | range data depth video enhancement linear filter temporal consistency |
| url | https://www.jstage.jst.go.jp/article/jamdsm/7/5/7_808/_pdf/-char/en |
| work_keys_str_mv | AT lili spatiotemporalconsistencyindepthvideoenhancement AT caimingzhang spatiotemporalconsistencyindepthvideoenhancement |