Robustness of ToF and stereo fusion for high‐accuracy depth map
A depth map can be used in many applications such as robotic navigation, driverless, video production and 3D reconstruction. Both passive stereo and time‐of‐flight (ToF) cameras can provide the depth map for the captured real scenes, but they both have innate limitations. Since ToF cameras and passi...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Wiley
2019-10-01
|
| Series: | IET Computer Vision |
| Subjects: | |
| Online Access: | https://doi.org/10.1049/iet-cvi.2018.5476 |
| _version_ | 1797684723101728768 |
|---|---|
| author | Zhenshan Bao Bowen Li Wenbo Zhang |
| author_facet | Zhenshan Bao Bowen Li Wenbo Zhang |
| author_sort | Zhenshan Bao |
| collection | DOAJ |
| description | A depth map can be used in many applications such as robotic navigation, driverless, video production and 3D reconstruction. Both passive stereo and time‐of‐flight (ToF) cameras can provide the depth map for the captured real scenes, but they both have innate limitations. Since ToF cameras and passive stereo are intrinsically complementary for certain scenes, it is desirable to appropriately leverage all the available information by ToF cameras and passive stereo. As a result, this study proposes an approach to integrate ToF cameras and passive stereo to obtain high‐accuracy depth maps. The main contributions are: the first step is to design an energy cost function to utilise the depth map from ToF cameras to guide the stereo matching of passive stereo and the second step is to design their weight function for depth maps pixel‐level fusion. The experiments show that the proposed approach achieves the improved results with high accuracy and robustness. |
| first_indexed | 2024-03-12T00:33:52Z |
| format | Article |
| id | doaj.art-1d3f0535153f4b46bc60cc4ab8b9ab3d |
| institution | Directory Open Access Journal |
| issn | 1751-9632 1751-9640 |
| language | English |
| last_indexed | 2024-03-12T00:33:52Z |
| publishDate | 2019-10-01 |
| publisher | Wiley |
| record_format | Article |
| series | IET Computer Vision |
| spelling | doaj.art-1d3f0535153f4b46bc60cc4ab8b9ab3d2023-09-15T10:06:29ZengWileyIET Computer Vision1751-96321751-96402019-10-0113767668110.1049/iet-cvi.2018.5476Robustness of ToF and stereo fusion for high‐accuracy depth mapZhenshan Bao0Bowen Li1Wenbo Zhang2Faculty of InformationBeijing University of TechnologyNo. 100 Pingleyuan, Chaoyang DistrictBeijingPeople's Republic of ChinaFaculty of InformationBeijing University of TechnologyNo. 100 Pingleyuan, Chaoyang DistrictBeijingPeople's Republic of ChinaFaculty of InformationBeijing University of TechnologyNo. 100 Pingleyuan, Chaoyang DistrictBeijingPeople's Republic of ChinaA depth map can be used in many applications such as robotic navigation, driverless, video production and 3D reconstruction. Both passive stereo and time‐of‐flight (ToF) cameras can provide the depth map for the captured real scenes, but they both have innate limitations. Since ToF cameras and passive stereo are intrinsically complementary for certain scenes, it is desirable to appropriately leverage all the available information by ToF cameras and passive stereo. As a result, this study proposes an approach to integrate ToF cameras and passive stereo to obtain high‐accuracy depth maps. The main contributions are: the first step is to design an energy cost function to utilise the depth map from ToF cameras to guide the stereo matching of passive stereo and the second step is to design their weight function for depth maps pixel‐level fusion. The experiments show that the proposed approach achieves the improved results with high accuracy and robustness.https://doi.org/10.1049/iet-cvi.2018.5476stereo fusionhigh-accuracy depth mapdriverless productionvideo productiontime-of-flight camerasToF cameras |
| spellingShingle | Zhenshan Bao Bowen Li Wenbo Zhang Robustness of ToF and stereo fusion for high‐accuracy depth map IET Computer Vision stereo fusion high-accuracy depth map driverless production video production time-of-flight cameras ToF cameras |
| title | Robustness of ToF and stereo fusion for high‐accuracy depth map |
| title_full | Robustness of ToF and stereo fusion for high‐accuracy depth map |
| title_fullStr | Robustness of ToF and stereo fusion for high‐accuracy depth map |
| title_full_unstemmed | Robustness of ToF and stereo fusion for high‐accuracy depth map |
| title_short | Robustness of ToF and stereo fusion for high‐accuracy depth map |
| title_sort | robustness of tof and stereo fusion for high accuracy depth map |
| topic | stereo fusion high-accuracy depth map driverless production video production time-of-flight cameras ToF cameras |
| url | https://doi.org/10.1049/iet-cvi.2018.5476 |
| work_keys_str_mv | AT zhenshanbao robustnessoftofandstereofusionforhighaccuracydepthmap AT bowenli robustnessoftofandstereofusionforhighaccuracydepthmap AT wenbozhang robustnessoftofandstereofusionforhighaccuracydepthmap |