Development of Visual Servoing-Based Autonomous Docking Capabilities in a Heterogeneous Swarm of Marine Robots

This paper describes the design, development, and testing of both hardware and software for a visual servoing-based system that enables agents within a heterogeneous marine robotic swarm to share energy. The goal of this system is prolonging the active operational time of the swarm as a whole, allow...

Full description

Bibliographic Details
Main Authors: Anja Babić, Filip Mandić, Nikola Mišković
Format: Article
Language:English
Published: MDPI AG 2020-10-01
Series:Applied Sciences
Subjects:
Online Access:https://www.mdpi.com/2076-3417/10/20/7124
_version_ 1797551156079099904
author Anja Babić
Filip Mandić
Nikola Mišković
author_facet Anja Babić
Filip Mandić
Nikola Mišković
author_sort Anja Babić
collection DOAJ
description This paper describes the design, development, and testing of both hardware and software for a visual servoing-based system that enables agents within a heterogeneous marine robotic swarm to share energy. The goal of this system is prolonging the active operational time of the swarm as a whole, allowing it to perform long-term environmental monitoring and data collection missions. The implementation presented in the paper features an over-actuated autonomous surface platform docking up to four floating sensor nodes at a time and replenishing their batteries using wireless inductive charging. Mechanical solutions for each robot segment related to the docking procedure are presented, along with pertinent high-level and low-level control structures. A node featuring an extended Kalman filter and additional heuristics is used to fuse measurements from a neural network trained for object detection and a hue thresholding image processing algorithm, in order to track the docking target and achieve visual servoing. Finally, experimental results in both a controlled environment and challenging conditions on-site are presented. Once deployed, the developed system successfully enables the approach and docking of the designated target, showing its feasibility in different real-life conditions.
first_indexed 2024-03-10T15:39:43Z
format Article
id doaj.art-aa98bb622eb24d3fa8ed35358e0a6e94
institution Directory Open Access Journal
issn 2076-3417
language English
last_indexed 2024-03-10T15:39:43Z
publishDate 2020-10-01
publisher MDPI AG
record_format Article
series Applied Sciences
spelling doaj.art-aa98bb622eb24d3fa8ed35358e0a6e942023-11-20T16:55:15ZengMDPI AGApplied Sciences2076-34172020-10-011020712410.3390/app10207124Development of Visual Servoing-Based Autonomous Docking Capabilities in a Heterogeneous Swarm of Marine RobotsAnja Babić0Filip Mandić1Nikola Mišković2LABUST—Laboratory for Underwater Systems and Technologies, Faculty of Electrical Engineering and Computing, University of Zagreb, Unska 3, 10000 Zagreb, CroatiaLABUST—Laboratory for Underwater Systems and Technologies, Faculty of Electrical Engineering and Computing, University of Zagreb, Unska 3, 10000 Zagreb, CroatiaLABUST—Laboratory for Underwater Systems and Technologies, Faculty of Electrical Engineering and Computing, University of Zagreb, Unska 3, 10000 Zagreb, CroatiaThis paper describes the design, development, and testing of both hardware and software for a visual servoing-based system that enables agents within a heterogeneous marine robotic swarm to share energy. The goal of this system is prolonging the active operational time of the swarm as a whole, allowing it to perform long-term environmental monitoring and data collection missions. The implementation presented in the paper features an over-actuated autonomous surface platform docking up to four floating sensor nodes at a time and replenishing their batteries using wireless inductive charging. Mechanical solutions for each robot segment related to the docking procedure are presented, along with pertinent high-level and low-level control structures. A node featuring an extended Kalman filter and additional heuristics is used to fuse measurements from a neural network trained for object detection and a hue thresholding image processing algorithm, in order to track the docking target and achieve visual servoing. Finally, experimental results in both a controlled environment and challenging conditions on-site are presented. Once deployed, the developed system successfully enables the approach and docking of the designated target, showing its feasibility in different real-life conditions.https://www.mdpi.com/2076-3417/10/20/7124marine roboticsmulti-vehicle systemvisual servoingenergy sharing
spellingShingle Anja Babić
Filip Mandić
Nikola Mišković
Development of Visual Servoing-Based Autonomous Docking Capabilities in a Heterogeneous Swarm of Marine Robots
Applied Sciences
marine robotics
multi-vehicle system
visual servoing
energy sharing
title Development of Visual Servoing-Based Autonomous Docking Capabilities in a Heterogeneous Swarm of Marine Robots
title_full Development of Visual Servoing-Based Autonomous Docking Capabilities in a Heterogeneous Swarm of Marine Robots
title_fullStr Development of Visual Servoing-Based Autonomous Docking Capabilities in a Heterogeneous Swarm of Marine Robots
title_full_unstemmed Development of Visual Servoing-Based Autonomous Docking Capabilities in a Heterogeneous Swarm of Marine Robots
title_short Development of Visual Servoing-Based Autonomous Docking Capabilities in a Heterogeneous Swarm of Marine Robots
title_sort development of visual servoing based autonomous docking capabilities in a heterogeneous swarm of marine robots
topic marine robotics
multi-vehicle system
visual servoing
energy sharing
url https://www.mdpi.com/2076-3417/10/20/7124
work_keys_str_mv AT anjababic developmentofvisualservoingbasedautonomousdockingcapabilitiesinaheterogeneousswarmofmarinerobots
AT filipmandic developmentofvisualservoingbasedautonomousdockingcapabilitiesinaheterogeneousswarmofmarinerobots
AT nikolamiskovic developmentofvisualservoingbasedautonomousdockingcapabilitiesinaheterogeneousswarmofmarinerobots