Exploring Effects of Information Filtering With a VR Interface for Multi-Robot Supervision

Supervising and controlling remote robot systems currently requires many specialised operators to have knowledge of the internal state of the system in addition to the environment. For applications such as remote maintenance of future nuclear fusion reactors, the number of robots (and hence supervis...

Full description

Bibliographic Details
Main Authors: Daniel Butters, Emil T. Jonasson, Vijay M. Pawar
Format: Article
Language:English
Published: Frontiers Media S.A. 2021-09-01
Series:Frontiers in Robotics and AI
Subjects:
Online Access:https://www.frontiersin.org/articles/10.3389/frobt.2021.692180/full
_version_ 1819240100748328960
author Daniel Butters
Emil T. Jonasson
Vijay M. Pawar
author_facet Daniel Butters
Emil T. Jonasson
Vijay M. Pawar
author_sort Daniel Butters
collection DOAJ
description Supervising and controlling remote robot systems currently requires many specialised operators to have knowledge of the internal state of the system in addition to the environment. For applications such as remote maintenance of future nuclear fusion reactors, the number of robots (and hence supervisors) required to maintain or decommission a facility is too large to be financially feasible. To address this issue, this work explores the idea of intelligently filtering information so that a single user can supervise multiple robots safely. We gathered feedback from participants using five methods for teleoperating a semi-autonomous multi-robot system via Virtual Reality (VR). We present a novel 3D interaction method to filter the displayed information to allow the user to read information from the environment without being overwhelmed. The novelty of the interface design is the link between Semantic and Spatial filtering and the hierarchical information contained within the multi robot system. We conducted a user study including a cohort of expert robot teleoperators comparing these methods; highlighting the significant effects of 3D interface design on the performance and perceived workload of a user teleoperating many robot agents in complex environments. The results from this experiment and subjective user feedback will inform future investigations that build upon this initial work.
first_indexed 2024-12-23T14:02:39Z
format Article
id doaj.art-7a3dbf8d63914453b31a0bd61d6fa47e
institution Directory Open Access Journal
issn 2296-9144
language English
last_indexed 2024-12-23T14:02:39Z
publishDate 2021-09-01
publisher Frontiers Media S.A.
record_format Article
series Frontiers in Robotics and AI
spelling doaj.art-7a3dbf8d63914453b31a0bd61d6fa47e2022-12-21T17:44:16ZengFrontiers Media S.A.Frontiers in Robotics and AI2296-91442021-09-01810.3389/frobt.2021.692180692180Exploring Effects of Information Filtering With a VR Interface for Multi-Robot SupervisionDaniel Butters0Emil T. Jonasson1Vijay M. Pawar2Autonomous Manufacturing Laboratory, Department of Computer Science, University College London, London, United KingdomRemote Applications in Challenging Environments (RACE), UK Atomic Energy Authority, Culham Science Centre, Abingdon, United KingdomAutonomous Manufacturing Laboratory, Department of Computer Science, University College London, London, United KingdomSupervising and controlling remote robot systems currently requires many specialised operators to have knowledge of the internal state of the system in addition to the environment. For applications such as remote maintenance of future nuclear fusion reactors, the number of robots (and hence supervisors) required to maintain or decommission a facility is too large to be financially feasible. To address this issue, this work explores the idea of intelligently filtering information so that a single user can supervise multiple robots safely. We gathered feedback from participants using five methods for teleoperating a semi-autonomous multi-robot system via Virtual Reality (VR). We present a novel 3D interaction method to filter the displayed information to allow the user to read information from the environment without being overwhelmed. The novelty of the interface design is the link between Semantic and Spatial filtering and the hierarchical information contained within the multi robot system. We conducted a user study including a cohort of expert robot teleoperators comparing these methods; highlighting the significant effects of 3D interface design on the performance and perceived workload of a user teleoperating many robot agents in complex environments. The results from this experiment and subjective user feedback will inform future investigations that build upon this initial work.https://www.frontiersin.org/articles/10.3389/frobt.2021.692180/fullvirtual realityhuman-robot interactionmulti-robot systemsinterface designrobot supervisioninformation display
spellingShingle Daniel Butters
Emil T. Jonasson
Vijay M. Pawar
Exploring Effects of Information Filtering With a VR Interface for Multi-Robot Supervision
Frontiers in Robotics and AI
virtual reality
human-robot interaction
multi-robot systems
interface design
robot supervision
information display
title Exploring Effects of Information Filtering With a VR Interface for Multi-Robot Supervision
title_full Exploring Effects of Information Filtering With a VR Interface for Multi-Robot Supervision
title_fullStr Exploring Effects of Information Filtering With a VR Interface for Multi-Robot Supervision
title_full_unstemmed Exploring Effects of Information Filtering With a VR Interface for Multi-Robot Supervision
title_short Exploring Effects of Information Filtering With a VR Interface for Multi-Robot Supervision
title_sort exploring effects of information filtering with a vr interface for multi robot supervision
topic virtual reality
human-robot interaction
multi-robot systems
interface design
robot supervision
information display
url https://www.frontiersin.org/articles/10.3389/frobt.2021.692180/full
work_keys_str_mv AT danielbutters exploringeffectsofinformationfilteringwithavrinterfaceformultirobotsupervision
AT emiltjonasson exploringeffectsofinformationfilteringwithavrinterfaceformultirobotsupervision
AT vijaympawar exploringeffectsofinformationfilteringwithavrinterfaceformultirobotsupervision