Augmented Reality for Robotics: A Review

Augmented reality (AR) is used to enhance the perception of the real world by integrating virtual objects to an image sequence acquired from various camera technologies. Numerous AR applications in robotics have been developed in recent years. The aim of this paper is to provide an overview of AR re...

Full description

Bibliographic Details
Main Authors: Zhanat Makhataeva, Huseyin Atakan Varol
Format: Article
Language:English
Published: MDPI AG 2020-04-01
Series:Robotics
Subjects:
Online Access:https://www.mdpi.com/2218-6581/9/2/21
_version_ 1797571615496601600
author Zhanat Makhataeva
Huseyin Atakan Varol
author_facet Zhanat Makhataeva
Huseyin Atakan Varol
author_sort Zhanat Makhataeva
collection DOAJ
description Augmented reality (AR) is used to enhance the perception of the real world by integrating virtual objects to an image sequence acquired from various camera technologies. Numerous AR applications in robotics have been developed in recent years. The aim of this paper is to provide an overview of AR research in robotics during the five year period from 2015 to 2019. We classified these works in terms of application areas into four categories: (1) Medical robotics: Robot-Assisted surgery (RAS), prosthetics, rehabilitation, and training systems; (2) Motion planning and control: trajectory generation, robot programming, simulation, and manipulation; (3) Human-robot interaction (HRI): teleoperation, collaborative interfaces, wearable robots, haptic interfaces, brain-computer interfaces (BCIs), and gaming; (4) Multi-agent systems: use of visual feedback to remotely control drones, robot swarms, and robots with shared workspace. Recent developments in AR technology are discussed followed by the challenges met in AR due to issues of camera localization, environment mapping, and registration. We explore AR applications in terms of how AR was integrated and which improvements it introduced to corresponding fields of robotics. In addition, we summarize the major limitations of the presented applications in each category. Finally, we conclude our review with future directions of AR research in robotics. The survey covers over 100 research works published over the last five years.
first_indexed 2024-03-10T20:43:09Z
format Article
id doaj.art-a4cff00359374fcf99f0aa2b2771bc3a
institution Directory Open Access Journal
issn 2218-6581
language English
last_indexed 2024-03-10T20:43:09Z
publishDate 2020-04-01
publisher MDPI AG
record_format Article
series Robotics
spelling doaj.art-a4cff00359374fcf99f0aa2b2771bc3a2023-11-19T20:33:11ZengMDPI AGRobotics2218-65812020-04-01922110.3390/robotics9020021Augmented Reality for Robotics: A ReviewZhanat Makhataeva0Huseyin Atakan Varol1Department of Robotics, Nazarbayev University, Nur-Sultan City Z05H0P9, KazakhstanDepartment of Robotics, Nazarbayev University, Nur-Sultan City Z05H0P9, KazakhstanAugmented reality (AR) is used to enhance the perception of the real world by integrating virtual objects to an image sequence acquired from various camera technologies. Numerous AR applications in robotics have been developed in recent years. The aim of this paper is to provide an overview of AR research in robotics during the five year period from 2015 to 2019. We classified these works in terms of application areas into four categories: (1) Medical robotics: Robot-Assisted surgery (RAS), prosthetics, rehabilitation, and training systems; (2) Motion planning and control: trajectory generation, robot programming, simulation, and manipulation; (3) Human-robot interaction (HRI): teleoperation, collaborative interfaces, wearable robots, haptic interfaces, brain-computer interfaces (BCIs), and gaming; (4) Multi-agent systems: use of visual feedback to remotely control drones, robot swarms, and robots with shared workspace. Recent developments in AR technology are discussed followed by the challenges met in AR due to issues of camera localization, environment mapping, and registration. We explore AR applications in terms of how AR was integrated and which improvements it introduced to corresponding fields of robotics. In addition, we summarize the major limitations of the presented applications in each category. Finally, we conclude our review with future directions of AR research in robotics. The survey covers over 100 research works published over the last five years.https://www.mdpi.com/2218-6581/9/2/21augmented realityroboticshuman–robot interactionrobot assisted surgeryteleoperationremote control
spellingShingle Zhanat Makhataeva
Huseyin Atakan Varol
Augmented Reality for Robotics: A Review
Robotics
augmented reality
robotics
human–robot interaction
robot assisted surgery
teleoperation
remote control
title Augmented Reality for Robotics: A Review
title_full Augmented Reality for Robotics: A Review
title_fullStr Augmented Reality for Robotics: A Review
title_full_unstemmed Augmented Reality for Robotics: A Review
title_short Augmented Reality for Robotics: A Review
title_sort augmented reality for robotics a review
topic augmented reality
robotics
human–robot interaction
robot assisted surgery
teleoperation
remote control
url https://www.mdpi.com/2218-6581/9/2/21
work_keys_str_mv AT zhanatmakhataeva augmentedrealityforroboticsareview
AT huseyinatakanvarol augmentedrealityforroboticsareview