Very High Frame Rate Volumetric Integration of Depth Images on Mobile Devices
Volumetric methods provide efficient, flexible and simple ways of integrating multiple depth images into a full 3D model. They provide dense and photorealistic 3D reconstructions, and parallelised implementations on GPUs achieve real-time performance on modern graphics hardware. To run such methods...
| Main Authors: | , , , , , |
|---|---|
| Format: | Journal article |
| Language: | English |
| Published: |
Institute of Electrical and Electronics Engineers
2015
|
| _version_ | 1826287974551126016 |
|---|---|
| author | Kähler, O Adrian Prisacariu, V Yuheng Ren, C Sun, X Torr, P Murray, D |
| author_facet | Kähler, O Adrian Prisacariu, V Yuheng Ren, C Sun, X Torr, P Murray, D |
| author_sort | Kähler, O |
| collection | OXFORD |
| description | Volumetric methods provide efficient, flexible and simple ways of integrating multiple depth images into a full 3D model. They provide dense and photorealistic 3D reconstructions, and parallelised implementations on GPUs achieve real-time performance on modern graphics hardware. To run such methods on mobile devices, providing users with freedom of movement and instantaneous reconstruction feedback, remains challenging however. In this paper we present a range of modifications to existing volumetric integration methods based on voxel block hashing, considerably improving their performance and making them applicable to tablet computer applications. We present (i) optimisations for the basic data structure, and its allocation and integration; (ii) a highly optimised raycasting pipeline; and (iii) extensions to the camera tracker to incorporate IMU data. In total, our system thus achieves frame rates up 47 Hz on a Nvidia Shield Tablet and 910 Hz on a Nvidia GTX Titan XGPU, or even beyond 1.1 kHz without visualisation. |
| first_indexed | 2024-03-07T02:06:44Z |
| format | Journal article |
| id | oxford-uuid:9f4119cf-0482-432e-b4fc-b53307ce925c |
| institution | University of Oxford |
| language | English |
| last_indexed | 2024-03-07T02:06:44Z |
| publishDate | 2015 |
| publisher | Institute of Electrical and Electronics Engineers |
| record_format | dspace |
| spelling | oxford-uuid:9f4119cf-0482-432e-b4fc-b53307ce925c2022-03-27T00:56:00ZVery High Frame Rate Volumetric Integration of Depth Images on Mobile DevicesJournal articlehttp://purl.org/coar/resource_type/c_dcae04bcuuid:9f4119cf-0482-432e-b4fc-b53307ce925cEnglishSymplectic Elements at OxfordInstitute of Electrical and Electronics Engineers2015Kähler, OAdrian Prisacariu, VYuheng Ren, CSun, XTorr, PMurray, DVolumetric methods provide efficient, flexible and simple ways of integrating multiple depth images into a full 3D model. They provide dense and photorealistic 3D reconstructions, and parallelised implementations on GPUs achieve real-time performance on modern graphics hardware. To run such methods on mobile devices, providing users with freedom of movement and instantaneous reconstruction feedback, remains challenging however. In this paper we present a range of modifications to existing volumetric integration methods based on voxel block hashing, considerably improving their performance and making them applicable to tablet computer applications. We present (i) optimisations for the basic data structure, and its allocation and integration; (ii) a highly optimised raycasting pipeline; and (iii) extensions to the camera tracker to incorporate IMU data. In total, our system thus achieves frame rates up 47 Hz on a Nvidia Shield Tablet and 910 Hz on a Nvidia GTX Titan XGPU, or even beyond 1.1 kHz without visualisation. |
| spellingShingle | Kähler, O Adrian Prisacariu, V Yuheng Ren, C Sun, X Torr, P Murray, D Very High Frame Rate Volumetric Integration of Depth Images on Mobile Devices |
| title | Very High Frame Rate Volumetric Integration of Depth Images on Mobile Devices |
| title_full | Very High Frame Rate Volumetric Integration of Depth Images on Mobile Devices |
| title_fullStr | Very High Frame Rate Volumetric Integration of Depth Images on Mobile Devices |
| title_full_unstemmed | Very High Frame Rate Volumetric Integration of Depth Images on Mobile Devices |
| title_short | Very High Frame Rate Volumetric Integration of Depth Images on Mobile Devices |
| title_sort | very high frame rate volumetric integration of depth images on mobile devices |
| work_keys_str_mv | AT kahlero veryhighframeratevolumetricintegrationofdepthimagesonmobiledevices AT adrianprisacariuv veryhighframeratevolumetricintegrationofdepthimagesonmobiledevices AT yuhengrenc veryhighframeratevolumetricintegrationofdepthimagesonmobiledevices AT sunx veryhighframeratevolumetricintegrationofdepthimagesonmobiledevices AT torrp veryhighframeratevolumetricintegrationofdepthimagesonmobiledevices AT murrayd veryhighframeratevolumetricintegrationofdepthimagesonmobiledevices |