Mixed-Reality Based Multi-Agent Robotics Framework for Artificial Swarm Intelligence Experiments

The term “Swarm intelligence” outlines a broad scope, which is generally defined as the collective behaviour of many individuals towards a certain task, each operating autonomously in a decentralised manner. Swarms are inspired by the type of biological behaviours of animals an...

Full description

Bibliographic Details
Main Authors: Dilshani Karunarathna, Nuwan Jaliyagoda, Ganindu Jayalath, Janaka Alawatugoda, Roshan Ragel, Isuru Nawinne
Format: Article
Language:English
Published: IEEE 2023-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/10256101/
_version_ 1797666946253062144
author Dilshani Karunarathna
Nuwan Jaliyagoda
Ganindu Jayalath
Janaka Alawatugoda
Roshan Ragel
Isuru Nawinne
author_facet Dilshani Karunarathna
Nuwan Jaliyagoda
Ganindu Jayalath
Janaka Alawatugoda
Roshan Ragel
Isuru Nawinne
author_sort Dilshani Karunarathna
collection DOAJ
description The term “Swarm intelligence” outlines a broad scope, which is generally defined as the collective behaviour of many individuals towards a certain task, each operating autonomously in a decentralised manner. Swarms are inspired by the type of biological behaviours of animals and this technology involves decentralised local control and communication, which ensures the problem-solving process is more efficient through modification and infusion into swarm robotic technology. Swarm robotics related experiments and applications are relatively expensive compared to other types of robotics experiments. The most common solution is to use computer based virtual simulations and accordingly, this study introduces a reliable and cost-effective hybrid solution using Mixed Reality (MR) technologies to perform swarm experiments on real robots and virtually deployed robots simultaneously. MR bridges the gap between the virtual and physical realms through Augmented Reality (AR) and Augmented Virtuality (AV) and addressing the weaknesses of simulators and providing a more accurate representation of real-world performance. This approach provides a platform for researchers to explore swarm robotics with enhanced realism and interactivity and conduct experiments that mimic real-world conditions. To validate this method we conducted experiments with both physical and virtual robots in near real-time in a mixed reality environment. In addition, an open-source, distributed, and modular mixed reality simulation framework was implemented with support libraries and applications. Our work not only demonstrates the potential of MR in swarm robotics but also emphasizes its value in advancing the understanding and application of swarm intelligence principles in practical contexts.
first_indexed 2024-03-11T20:06:00Z
format Article
id doaj.art-ef9cebe65af749619ad0ce4dff8bcb87
institution Directory Open Access Journal
issn 2169-3536
language English
last_indexed 2024-03-11T20:06:00Z
publishDate 2023-01-01
publisher IEEE
record_format Article
series IEEE Access
spelling doaj.art-ef9cebe65af749619ad0ce4dff8bcb872023-10-03T23:00:33ZengIEEEIEEE Access2169-35362023-01-011110571810573310.1109/ACCESS.2023.331743410256101Mixed-Reality Based Multi-Agent Robotics Framework for Artificial Swarm Intelligence ExperimentsDilshani Karunarathna0https://orcid.org/0000-0003-0168-0514Nuwan Jaliyagoda1https://orcid.org/0000-0002-0340-1008Ganindu Jayalath2Janaka Alawatugoda3https://orcid.org/0000-0001-9431-5836Roshan Ragel4https://orcid.org/0000-0002-4511-2335Isuru Nawinne5Department of Computer Engineering, Faculty of Engineering, University of Peradeniya, Peradeniya, Sri LankaDepartment of Computer Engineering, Faculty of Engineering, University of Peradeniya, Peradeniya, Sri LankaDepartment of Computer Engineering, Faculty of Engineering, University of Peradeniya, Peradeniya, Sri LankaResearch and Innovation Centers Division, Faculty of Resilience, Rabdan Academy, Abu Dhabi, United Arab EmiratesDepartment of Computer Engineering, Faculty of Engineering, University of Peradeniya, Peradeniya, Sri LankaDepartment of Computer Engineering, Faculty of Engineering, University of Peradeniya, Peradeniya, Sri LankaThe term “Swarm intelligence” outlines a broad scope, which is generally defined as the collective behaviour of many individuals towards a certain task, each operating autonomously in a decentralised manner. Swarms are inspired by the type of biological behaviours of animals and this technology involves decentralised local control and communication, which ensures the problem-solving process is more efficient through modification and infusion into swarm robotic technology. Swarm robotics related experiments and applications are relatively expensive compared to other types of robotics experiments. The most common solution is to use computer based virtual simulations and accordingly, this study introduces a reliable and cost-effective hybrid solution using Mixed Reality (MR) technologies to perform swarm experiments on real robots and virtually deployed robots simultaneously. MR bridges the gap between the virtual and physical realms through Augmented Reality (AR) and Augmented Virtuality (AV) and addressing the weaknesses of simulators and providing a more accurate representation of real-world performance. This approach provides a platform for researchers to explore swarm robotics with enhanced realism and interactivity and conduct experiments that mimic real-world conditions. To validate this method we conducted experiments with both physical and virtual robots in near real-time in a mixed reality environment. In addition, an open-source, distributed, and modular mixed reality simulation framework was implemented with support libraries and applications. Our work not only demonstrates the potential of MR in swarm robotics but also emphasizes its value in advancing the understanding and application of swarm intelligence principles in practical contexts.https://ieeexplore.ieee.org/document/10256101/Mixed-realitymulti-agent roboticsswarm intelligenceartificial intelligencevirtual reality
spellingShingle Dilshani Karunarathna
Nuwan Jaliyagoda
Ganindu Jayalath
Janaka Alawatugoda
Roshan Ragel
Isuru Nawinne
Mixed-Reality Based Multi-Agent Robotics Framework for Artificial Swarm Intelligence Experiments
IEEE Access
Mixed-reality
multi-agent robotics
swarm intelligence
artificial intelligence
virtual reality
title Mixed-Reality Based Multi-Agent Robotics Framework for Artificial Swarm Intelligence Experiments
title_full Mixed-Reality Based Multi-Agent Robotics Framework for Artificial Swarm Intelligence Experiments
title_fullStr Mixed-Reality Based Multi-Agent Robotics Framework for Artificial Swarm Intelligence Experiments
title_full_unstemmed Mixed-Reality Based Multi-Agent Robotics Framework for Artificial Swarm Intelligence Experiments
title_short Mixed-Reality Based Multi-Agent Robotics Framework for Artificial Swarm Intelligence Experiments
title_sort mixed reality based multi agent robotics framework for artificial swarm intelligence experiments
topic Mixed-reality
multi-agent robotics
swarm intelligence
artificial intelligence
virtual reality
url https://ieeexplore.ieee.org/document/10256101/
work_keys_str_mv AT dilshanikarunarathna mixedrealitybasedmultiagentroboticsframeworkforartificialswarmintelligenceexperiments
AT nuwanjaliyagoda mixedrealitybasedmultiagentroboticsframeworkforartificialswarmintelligenceexperiments
AT ganindujayalath mixedrealitybasedmultiagentroboticsframeworkforartificialswarmintelligenceexperiments
AT janakaalawatugoda mixedrealitybasedmultiagentroboticsframeworkforartificialswarmintelligenceexperiments
AT roshanragel mixedrealitybasedmultiagentroboticsframeworkforartificialswarmintelligenceexperiments
AT isurunawinne mixedrealitybasedmultiagentroboticsframeworkforartificialswarmintelligenceexperiments