Vision-Based UAV-UGV Collaboration for Autonomous Construction Site Preparation

Construction site preparation tasks rely on experienced operators and heavy machinery for clearing debris, earthmoving, leveling, and soil stabilization. These actions require complex collaboration between human teams to survey the site, estimate the material condition, and guide the operators accor...

Full description

Bibliographic Details
Main Authors: Oren Elmakis, Tom Shaked, Amir Degani
Format: Article
Language:English
Published: IEEE 2022-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/9762958/
_version_ 1817986521284739072
author Oren Elmakis
Tom Shaked
Amir Degani
author_facet Oren Elmakis
Tom Shaked
Amir Degani
author_sort Oren Elmakis
collection DOAJ
description Construction site preparation tasks rely on experienced operators and heavy machinery for clearing debris, earthmoving, leveling, and soil stabilization. These actions require complex collaboration between human teams to survey the site, estimate the material condition, and guide the operators accordingly. In recent years there has been a critical labor shortage due to increasing demands in construction. Integrating autonomous systems can mitigate this gap by replacing traditional methods with robotic solutions. However, while ideal conditions for automatic systems are static and highly controlled, construction sites are dynamic and unstructured environments. The ability of autonomous systems to overcome these conditions during outdoor construction site preparation tasks relies on their capacity to map the material on-site and continuously perform localization. This study suggests a solution to these problems by collaborating between an Unmanned Aerial Vehicle (UAV) and an Unmanned Ground Vehicle (UGV). In this method, the UAV produces a material map and monitors the UGV’s location relative to known static landmarks. These measurements are then sent to the ground vehicle and are added to the onboard sensors using the Extended Kalman Filter (EKF) approach. Thus, the UAV enhances the operation of the UGV by providing an accurate localization and mapping from the air and allowing it to perform a site-preparation task beyond mere sensing. This approach is examined with simulation and validated by outdoor experiments. Additionally, this method is integrated within Shepherd, a custom-developed plugin for computer-aided design applications.
first_indexed 2024-04-14T00:11:11Z
format Article
id doaj.art-26ea24543852458bbe9e42febb30fd11
institution Directory Open Access Journal
issn 2169-3536
language English
last_indexed 2024-04-14T00:11:11Z
publishDate 2022-01-01
publisher IEEE
record_format Article
series IEEE Access
spelling doaj.art-26ea24543852458bbe9e42febb30fd112022-12-22T02:23:20ZengIEEEIEEE Access2169-35362022-01-0110512095122010.1109/ACCESS.2022.31704089762958Vision-Based UAV-UGV Collaboration for Autonomous Construction Site PreparationOren Elmakis0https://orcid.org/0000-0001-8321-3965Tom Shaked1https://orcid.org/0000-0002-1811-8731Amir Degani2https://orcid.org/0000-0002-4813-8506Technion Autonomous Systems Program, Technion - Israel Institute of Technology, Haifa, IsraelTechnion Autonomous Systems Program, Technion - Israel Institute of Technology, Haifa, IsraelTechnion Autonomous Systems Program, Technion - Israel Institute of Technology, Haifa, IsraelConstruction site preparation tasks rely on experienced operators and heavy machinery for clearing debris, earthmoving, leveling, and soil stabilization. These actions require complex collaboration between human teams to survey the site, estimate the material condition, and guide the operators accordingly. In recent years there has been a critical labor shortage due to increasing demands in construction. Integrating autonomous systems can mitigate this gap by replacing traditional methods with robotic solutions. However, while ideal conditions for automatic systems are static and highly controlled, construction sites are dynamic and unstructured environments. The ability of autonomous systems to overcome these conditions during outdoor construction site preparation tasks relies on their capacity to map the material on-site and continuously perform localization. This study suggests a solution to these problems by collaborating between an Unmanned Aerial Vehicle (UAV) and an Unmanned Ground Vehicle (UGV). In this method, the UAV produces a material map and monitors the UGV’s location relative to known static landmarks. These measurements are then sent to the ground vehicle and are added to the onboard sensors using the Extended Kalman Filter (EKF) approach. Thus, the UAV enhances the operation of the UGV by providing an accurate localization and mapping from the air and allowing it to perform a site-preparation task beyond mere sensing. This approach is examined with simulation and validated by outdoor experiments. Additionally, this method is integrated within Shepherd, a custom-developed plugin for computer-aided design applications.https://ieeexplore.ieee.org/document/9762958/Autonomous systemsmulti-robot systemspose estimationrobotics and automationsystem implementation
spellingShingle Oren Elmakis
Tom Shaked
Amir Degani
Vision-Based UAV-UGV Collaboration for Autonomous Construction Site Preparation
IEEE Access
Autonomous systems
multi-robot systems
pose estimation
robotics and automation
system implementation
title Vision-Based UAV-UGV Collaboration for Autonomous Construction Site Preparation
title_full Vision-Based UAV-UGV Collaboration for Autonomous Construction Site Preparation
title_fullStr Vision-Based UAV-UGV Collaboration for Autonomous Construction Site Preparation
title_full_unstemmed Vision-Based UAV-UGV Collaboration for Autonomous Construction Site Preparation
title_short Vision-Based UAV-UGV Collaboration for Autonomous Construction Site Preparation
title_sort vision based uav ugv collaboration for autonomous construction site preparation
topic Autonomous systems
multi-robot systems
pose estimation
robotics and automation
system implementation
url https://ieeexplore.ieee.org/document/9762958/
work_keys_str_mv AT orenelmakis visionbaseduavugvcollaborationforautonomousconstructionsitepreparation
AT tomshaked visionbaseduavugvcollaborationforautonomousconstructionsitepreparation
AT amirdegani visionbaseduavugvcollaborationforautonomousconstructionsitepreparation