VETO: An Immersive Virtual Environment for Tele-Operation

This work investigates an over-arching question: how can an immersive virtual environment be connected with its intelligent physical counterpart to allow for a more efficient man-machine collaboration. To this end, an immersive user interface for the purpose of robot tele-operation is designed. A la...

Full description

Bibliographic Details
Main Authors: Brandon Wilson, Matthew Bounds, David McFadden, Jace Regenbrecht, Loveth Ohenhen, Alireza Tavakkoli, Donald Loffredo
Format: Article
Language:English
Published: MDPI AG 2018-06-01
Series:Robotics
Subjects:
Online Access:http://www.mdpi.com/2218-6581/7/2/26
_version_ 1828120390899073024
author Brandon Wilson
Matthew Bounds
David McFadden
Jace Regenbrecht
Loveth Ohenhen
Alireza Tavakkoli
Donald Loffredo
author_facet Brandon Wilson
Matthew Bounds
David McFadden
Jace Regenbrecht
Loveth Ohenhen
Alireza Tavakkoli
Donald Loffredo
author_sort Brandon Wilson
collection DOAJ
description This work investigates an over-arching question: how can an immersive virtual environment be connected with its intelligent physical counterpart to allow for a more efficient man-machine collaboration. To this end, an immersive user interface for the purpose of robot tele-operation is designed. A large amount of sensory data is utilized to build models of the world and its inhabitants in a way that is intuitive to the operator and accurately represents the robot’s real-world state and environment. The game client is capable of handling multiple users, much like a traditional multiplayer game, while visualizing multiple robotic agents operating within the real world. The proposed Virtual Environment for Tele-Operation (VETO) architecture is a tele-operation system that provides a feature-rich framework to implement robotic agents into an immersive end-user game interface. Game levels are generated dynamically on a Graphic Processing Unit or GPU-accelerated server based on real-world sensor data from the robotic agents. A set of user studies are conducted to validate the performance of the proposed architecture compared to traditional tele-robotic applications. The experimental results show significant improvements in both task completion time and task completion rate over traditional tools.
first_indexed 2024-04-11T14:04:15Z
format Article
id doaj.art-e50fe9b16260496b9f2100e5c426b9e6
institution Directory Open Access Journal
issn 2218-6581
language English
last_indexed 2024-04-11T14:04:15Z
publishDate 2018-06-01
publisher MDPI AG
record_format Article
series Robotics
spelling doaj.art-e50fe9b16260496b9f2100e5c426b9e62022-12-22T04:19:57ZengMDPI AGRobotics2218-65812018-06-01722610.3390/robotics7020026robotics7020026VETO: An Immersive Virtual Environment for Tele-OperationBrandon Wilson0Matthew Bounds1David McFadden2Jace Regenbrecht3Loveth Ohenhen4Alireza Tavakkoli5Donald Loffredo6Department of Computer Science, University of Houston-Victoria, Victoria, TX 77901, USADepartment of Computer Science, University of Houston-Victoria, Victoria, TX 77901, USADepartment of Computer Science, University of Houston-Victoria, Victoria, TX 77901, USADepartment of Computer Science, University of Houston-Victoria, Victoria, TX 77901, USADepartment of Computer Science, University of Houston-Victoria, Victoria, TX 77901, USADepartment of Computer Science, University of Houston-Victoria, Victoria, TX 77901, USADepartment of Psychology, University of Houston-Victoria, Victoria, TX 77901, USAThis work investigates an over-arching question: how can an immersive virtual environment be connected with its intelligent physical counterpart to allow for a more efficient man-machine collaboration. To this end, an immersive user interface for the purpose of robot tele-operation is designed. A large amount of sensory data is utilized to build models of the world and its inhabitants in a way that is intuitive to the operator and accurately represents the robot’s real-world state and environment. The game client is capable of handling multiple users, much like a traditional multiplayer game, while visualizing multiple robotic agents operating within the real world. The proposed Virtual Environment for Tele-Operation (VETO) architecture is a tele-operation system that provides a feature-rich framework to implement robotic agents into an immersive end-user game interface. Game levels are generated dynamically on a Graphic Processing Unit or GPU-accelerated server based on real-world sensor data from the robotic agents. A set of user studies are conducted to validate the performance of the proposed architecture compared to traditional tele-robotic applications. The experimental results show significant improvements in both task completion time and task completion rate over traditional tools.http://www.mdpi.com/2218-6581/7/2/26immersive virtual environmentstele-operationimmersive game clientsdynamic level generationsensory fusionautonomous operation
spellingShingle Brandon Wilson
Matthew Bounds
David McFadden
Jace Regenbrecht
Loveth Ohenhen
Alireza Tavakkoli
Donald Loffredo
VETO: An Immersive Virtual Environment for Tele-Operation
Robotics
immersive virtual environments
tele-operation
immersive game clients
dynamic level generation
sensory fusion
autonomous operation
title VETO: An Immersive Virtual Environment for Tele-Operation
title_full VETO: An Immersive Virtual Environment for Tele-Operation
title_fullStr VETO: An Immersive Virtual Environment for Tele-Operation
title_full_unstemmed VETO: An Immersive Virtual Environment for Tele-Operation
title_short VETO: An Immersive Virtual Environment for Tele-Operation
title_sort veto an immersive virtual environment for tele operation
topic immersive virtual environments
tele-operation
immersive game clients
dynamic level generation
sensory fusion
autonomous operation
url http://www.mdpi.com/2218-6581/7/2/26
work_keys_str_mv AT brandonwilson vetoanimmersivevirtualenvironmentforteleoperation
AT matthewbounds vetoanimmersivevirtualenvironmentforteleoperation
AT davidmcfadden vetoanimmersivevirtualenvironmentforteleoperation
AT jaceregenbrecht vetoanimmersivevirtualenvironmentforteleoperation
AT lovethohenhen vetoanimmersivevirtualenvironmentforteleoperation
AT alirezatavakkoli vetoanimmersivevirtualenvironmentforteleoperation
AT donaldloffredo vetoanimmersivevirtualenvironmentforteleoperation