Evaluation of HoloLens Tracking and Depth Sensing for Indoor Mapping Applications

The Microsoft HoloLens is a head-worn mobile augmented reality device that is capable of mapping its direct environment in real-time as triangle meshes and localize itself within these three-dimensional meshes simultaneously. The device is equipped with a variety of sensors including four tracking c...

Full description

Bibliographic Details
Main Authors: Patrick Hübner, Kate Clintworth, Qingyi Liu, Martin Weinmann, Sven Wursthorn
Format: Article
Language:English
Published: MDPI AG 2020-02-01
Series:Sensors
Subjects:
Online Access:https://www.mdpi.com/1424-8220/20/4/1021
_version_ 1798039848932605952
author Patrick Hübner
Kate Clintworth
Qingyi Liu
Martin Weinmann
Sven Wursthorn
author_facet Patrick Hübner
Kate Clintworth
Qingyi Liu
Martin Weinmann
Sven Wursthorn
author_sort Patrick Hübner
collection DOAJ
description The Microsoft HoloLens is a head-worn mobile augmented reality device that is capable of mapping its direct environment in real-time as triangle meshes and localize itself within these three-dimensional meshes simultaneously. The device is equipped with a variety of sensors including four tracking cameras and a time-of-flight (ToF) range camera. Sensor images and their poses estimated by the built-in tracking system can be accessed by the user. This makes the HoloLens potentially interesting as an indoor mapping device. In this paper, we introduce the different sensors of the device and evaluate the complete system in respect of the task of mapping indoor environments. The overall quality of such a system depends mainly on the quality of the depth sensor together with its associated pose derived from the tracking system. For this purpose, we first evaluate the performance of the HoloLens depth sensor and its tracking system separately. Finally, we evaluate the overall system regarding its capability for mapping multi-room environments.
first_indexed 2024-04-11T21:59:21Z
format Article
id doaj.art-3e6812f145514a979bdea55d128ae9be
institution Directory Open Access Journal
issn 1424-8220
language English
last_indexed 2024-04-11T21:59:21Z
publishDate 2020-02-01
publisher MDPI AG
record_format Article
series Sensors
spelling doaj.art-3e6812f145514a979bdea55d128ae9be2022-12-22T04:01:00ZengMDPI AGSensors1424-82202020-02-01204102110.3390/s20041021s20041021Evaluation of HoloLens Tracking and Depth Sensing for Indoor Mapping ApplicationsPatrick Hübner0Kate Clintworth1Qingyi Liu2Martin Weinmann3Sven Wursthorn4Institute of Photogrammetry and Remote Sensing, Karlsruhe Institute of Technology, 76128 Karlsruhe, GermanyInstitute of Photogrammetry and Remote Sensing, Karlsruhe Institute of Technology, 76128 Karlsruhe, GermanyInstitute of Photogrammetry and Remote Sensing, Karlsruhe Institute of Technology, 76128 Karlsruhe, GermanyInstitute of Photogrammetry and Remote Sensing, Karlsruhe Institute of Technology, 76128 Karlsruhe, GermanyInstitute of Photogrammetry and Remote Sensing, Karlsruhe Institute of Technology, 76128 Karlsruhe, GermanyThe Microsoft HoloLens is a head-worn mobile augmented reality device that is capable of mapping its direct environment in real-time as triangle meshes and localize itself within these three-dimensional meshes simultaneously. The device is equipped with a variety of sensors including four tracking cameras and a time-of-flight (ToF) range camera. Sensor images and their poses estimated by the built-in tracking system can be accessed by the user. This makes the HoloLens potentially interesting as an indoor mapping device. In this paper, we introduce the different sensors of the device and evaluate the complete system in respect of the task of mapping indoor environments. The overall quality of such a system depends mainly on the quality of the depth sensor together with its associated pose derived from the tracking system. For this purpose, we first evaluate the performance of the HoloLens depth sensor and its tracking system separately. Finally, we evaluate the overall system regarding its capability for mapping multi-room environments.https://www.mdpi.com/1424-8220/20/4/1021indoor mappingaugmented realityhololenstime-of-flight cameradepth cameratracking
spellingShingle Patrick Hübner
Kate Clintworth
Qingyi Liu
Martin Weinmann
Sven Wursthorn
Evaluation of HoloLens Tracking and Depth Sensing for Indoor Mapping Applications
Sensors
indoor mapping
augmented reality
hololens
time-of-flight camera
depth camera
tracking
title Evaluation of HoloLens Tracking and Depth Sensing for Indoor Mapping Applications
title_full Evaluation of HoloLens Tracking and Depth Sensing for Indoor Mapping Applications
title_fullStr Evaluation of HoloLens Tracking and Depth Sensing for Indoor Mapping Applications
title_full_unstemmed Evaluation of HoloLens Tracking and Depth Sensing for Indoor Mapping Applications
title_short Evaluation of HoloLens Tracking and Depth Sensing for Indoor Mapping Applications
title_sort evaluation of hololens tracking and depth sensing for indoor mapping applications
topic indoor mapping
augmented reality
hololens
time-of-flight camera
depth camera
tracking
url https://www.mdpi.com/1424-8220/20/4/1021
work_keys_str_mv AT patrickhubner evaluationofhololenstrackinganddepthsensingforindoormappingapplications
AT kateclintworth evaluationofhololenstrackinganddepthsensingforindoormappingapplications
AT qingyiliu evaluationofhololenstrackinganddepthsensingforindoormappingapplications
AT martinweinmann evaluationofhololenstrackinganddepthsensingforindoormappingapplications
AT svenwursthorn evaluationofhololenstrackinganddepthsensingforindoormappingapplications