VETO: An Immersive Virtual Environment for Tele-Operation
This work investigates an over-arching question: how can an immersive virtual environment be connected with its intelligent physical counterpart to allow for a more efficient man-machine collaboration. To this end, an immersive user interface for the purpose of robot tele-operation is designed. A la...
Main Authors: | , , , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
MDPI AG
2018-06-01
|
Series: | Robotics |
Subjects: | |
Online Access: | http://www.mdpi.com/2218-6581/7/2/26 |
_version_ | 1828120390899073024 |
---|---|
author | Brandon Wilson Matthew Bounds David McFadden Jace Regenbrecht Loveth Ohenhen Alireza Tavakkoli Donald Loffredo |
author_facet | Brandon Wilson Matthew Bounds David McFadden Jace Regenbrecht Loveth Ohenhen Alireza Tavakkoli Donald Loffredo |
author_sort | Brandon Wilson |
collection | DOAJ |
description | This work investigates an over-arching question: how can an immersive virtual environment be connected with its intelligent physical counterpart to allow for a more efficient man-machine collaboration. To this end, an immersive user interface for the purpose of robot tele-operation is designed. A large amount of sensory data is utilized to build models of the world and its inhabitants in a way that is intuitive to the operator and accurately represents the robot’s real-world state and environment. The game client is capable of handling multiple users, much like a traditional multiplayer game, while visualizing multiple robotic agents operating within the real world. The proposed Virtual Environment for Tele-Operation (VETO) architecture is a tele-operation system that provides a feature-rich framework to implement robotic agents into an immersive end-user game interface. Game levels are generated dynamically on a Graphic Processing Unit or GPU-accelerated server based on real-world sensor data from the robotic agents. A set of user studies are conducted to validate the performance of the proposed architecture compared to traditional tele-robotic applications. The experimental results show significant improvements in both task completion time and task completion rate over traditional tools. |
first_indexed | 2024-04-11T14:04:15Z |
format | Article |
id | doaj.art-e50fe9b16260496b9f2100e5c426b9e6 |
institution | Directory Open Access Journal |
issn | 2218-6581 |
language | English |
last_indexed | 2024-04-11T14:04:15Z |
publishDate | 2018-06-01 |
publisher | MDPI AG |
record_format | Article |
series | Robotics |
spelling | doaj.art-e50fe9b16260496b9f2100e5c426b9e62022-12-22T04:19:57ZengMDPI AGRobotics2218-65812018-06-01722610.3390/robotics7020026robotics7020026VETO: An Immersive Virtual Environment for Tele-OperationBrandon Wilson0Matthew Bounds1David McFadden2Jace Regenbrecht3Loveth Ohenhen4Alireza Tavakkoli5Donald Loffredo6Department of Computer Science, University of Houston-Victoria, Victoria, TX 77901, USADepartment of Computer Science, University of Houston-Victoria, Victoria, TX 77901, USADepartment of Computer Science, University of Houston-Victoria, Victoria, TX 77901, USADepartment of Computer Science, University of Houston-Victoria, Victoria, TX 77901, USADepartment of Computer Science, University of Houston-Victoria, Victoria, TX 77901, USADepartment of Computer Science, University of Houston-Victoria, Victoria, TX 77901, USADepartment of Psychology, University of Houston-Victoria, Victoria, TX 77901, USAThis work investigates an over-arching question: how can an immersive virtual environment be connected with its intelligent physical counterpart to allow for a more efficient man-machine collaboration. To this end, an immersive user interface for the purpose of robot tele-operation is designed. A large amount of sensory data is utilized to build models of the world and its inhabitants in a way that is intuitive to the operator and accurately represents the robot’s real-world state and environment. The game client is capable of handling multiple users, much like a traditional multiplayer game, while visualizing multiple robotic agents operating within the real world. The proposed Virtual Environment for Tele-Operation (VETO) architecture is a tele-operation system that provides a feature-rich framework to implement robotic agents into an immersive end-user game interface. Game levels are generated dynamically on a Graphic Processing Unit or GPU-accelerated server based on real-world sensor data from the robotic agents. A set of user studies are conducted to validate the performance of the proposed architecture compared to traditional tele-robotic applications. The experimental results show significant improvements in both task completion time and task completion rate over traditional tools.http://www.mdpi.com/2218-6581/7/2/26immersive virtual environmentstele-operationimmersive game clientsdynamic level generationsensory fusionautonomous operation |
spellingShingle | Brandon Wilson Matthew Bounds David McFadden Jace Regenbrecht Loveth Ohenhen Alireza Tavakkoli Donald Loffredo VETO: An Immersive Virtual Environment for Tele-Operation Robotics immersive virtual environments tele-operation immersive game clients dynamic level generation sensory fusion autonomous operation |
title | VETO: An Immersive Virtual Environment for Tele-Operation |
title_full | VETO: An Immersive Virtual Environment for Tele-Operation |
title_fullStr | VETO: An Immersive Virtual Environment for Tele-Operation |
title_full_unstemmed | VETO: An Immersive Virtual Environment for Tele-Operation |
title_short | VETO: An Immersive Virtual Environment for Tele-Operation |
title_sort | veto an immersive virtual environment for tele operation |
topic | immersive virtual environments tele-operation immersive game clients dynamic level generation sensory fusion autonomous operation |
url | http://www.mdpi.com/2218-6581/7/2/26 |
work_keys_str_mv | AT brandonwilson vetoanimmersivevirtualenvironmentforteleoperation AT matthewbounds vetoanimmersivevirtualenvironmentforteleoperation AT davidmcfadden vetoanimmersivevirtualenvironmentforteleoperation AT jaceregenbrecht vetoanimmersivevirtualenvironmentforteleoperation AT lovethohenhen vetoanimmersivevirtualenvironmentforteleoperation AT alirezatavakkoli vetoanimmersivevirtualenvironmentforteleoperation AT donaldloffredo vetoanimmersivevirtualenvironmentforteleoperation |