Mixed-Reality Based Multi-Agent Robotics Framework for Artificial Swarm Intelligence Experiments
The term “Swarm intelligence” outlines a broad scope, which is generally defined as the collective behaviour of many individuals towards a certain task, each operating autonomously in a decentralised manner. Swarms are inspired by the type of biological behaviours of animals an...
Main Authors: | , , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
IEEE
2023-01-01
|
Series: | IEEE Access |
Subjects: | |
Online Access: | https://ieeexplore.ieee.org/document/10256101/ |
_version_ | 1797666946253062144 |
---|---|
author | Dilshani Karunarathna Nuwan Jaliyagoda Ganindu Jayalath Janaka Alawatugoda Roshan Ragel Isuru Nawinne |
author_facet | Dilshani Karunarathna Nuwan Jaliyagoda Ganindu Jayalath Janaka Alawatugoda Roshan Ragel Isuru Nawinne |
author_sort | Dilshani Karunarathna |
collection | DOAJ |
description | The term “Swarm intelligence” outlines a broad scope, which is generally defined as the collective behaviour of many individuals towards a certain task, each operating autonomously in a decentralised manner. Swarms are inspired by the type of biological behaviours of animals and this technology involves decentralised local control and communication, which ensures the problem-solving process is more efficient through modification and infusion into swarm robotic technology. Swarm robotics related experiments and applications are relatively expensive compared to other types of robotics experiments. The most common solution is to use computer based virtual simulations and accordingly, this study introduces a reliable and cost-effective hybrid solution using Mixed Reality (MR) technologies to perform swarm experiments on real robots and virtually deployed robots simultaneously. MR bridges the gap between the virtual and physical realms through Augmented Reality (AR) and Augmented Virtuality (AV) and addressing the weaknesses of simulators and providing a more accurate representation of real-world performance. This approach provides a platform for researchers to explore swarm robotics with enhanced realism and interactivity and conduct experiments that mimic real-world conditions. To validate this method we conducted experiments with both physical and virtual robots in near real-time in a mixed reality environment. In addition, an open-source, distributed, and modular mixed reality simulation framework was implemented with support libraries and applications. Our work not only demonstrates the potential of MR in swarm robotics but also emphasizes its value in advancing the understanding and application of swarm intelligence principles in practical contexts. |
first_indexed | 2024-03-11T20:06:00Z |
format | Article |
id | doaj.art-ef9cebe65af749619ad0ce4dff8bcb87 |
institution | Directory Open Access Journal |
issn | 2169-3536 |
language | English |
last_indexed | 2024-03-11T20:06:00Z |
publishDate | 2023-01-01 |
publisher | IEEE |
record_format | Article |
series | IEEE Access |
spelling | doaj.art-ef9cebe65af749619ad0ce4dff8bcb872023-10-03T23:00:33ZengIEEEIEEE Access2169-35362023-01-011110571810573310.1109/ACCESS.2023.331743410256101Mixed-Reality Based Multi-Agent Robotics Framework for Artificial Swarm Intelligence ExperimentsDilshani Karunarathna0https://orcid.org/0000-0003-0168-0514Nuwan Jaliyagoda1https://orcid.org/0000-0002-0340-1008Ganindu Jayalath2Janaka Alawatugoda3https://orcid.org/0000-0001-9431-5836Roshan Ragel4https://orcid.org/0000-0002-4511-2335Isuru Nawinne5Department of Computer Engineering, Faculty of Engineering, University of Peradeniya, Peradeniya, Sri LankaDepartment of Computer Engineering, Faculty of Engineering, University of Peradeniya, Peradeniya, Sri LankaDepartment of Computer Engineering, Faculty of Engineering, University of Peradeniya, Peradeniya, Sri LankaResearch and Innovation Centers Division, Faculty of Resilience, Rabdan Academy, Abu Dhabi, United Arab EmiratesDepartment of Computer Engineering, Faculty of Engineering, University of Peradeniya, Peradeniya, Sri LankaDepartment of Computer Engineering, Faculty of Engineering, University of Peradeniya, Peradeniya, Sri LankaThe term “Swarm intelligence” outlines a broad scope, which is generally defined as the collective behaviour of many individuals towards a certain task, each operating autonomously in a decentralised manner. Swarms are inspired by the type of biological behaviours of animals and this technology involves decentralised local control and communication, which ensures the problem-solving process is more efficient through modification and infusion into swarm robotic technology. Swarm robotics related experiments and applications are relatively expensive compared to other types of robotics experiments. The most common solution is to use computer based virtual simulations and accordingly, this study introduces a reliable and cost-effective hybrid solution using Mixed Reality (MR) technologies to perform swarm experiments on real robots and virtually deployed robots simultaneously. MR bridges the gap between the virtual and physical realms through Augmented Reality (AR) and Augmented Virtuality (AV) and addressing the weaknesses of simulators and providing a more accurate representation of real-world performance. This approach provides a platform for researchers to explore swarm robotics with enhanced realism and interactivity and conduct experiments that mimic real-world conditions. To validate this method we conducted experiments with both physical and virtual robots in near real-time in a mixed reality environment. In addition, an open-source, distributed, and modular mixed reality simulation framework was implemented with support libraries and applications. Our work not only demonstrates the potential of MR in swarm robotics but also emphasizes its value in advancing the understanding and application of swarm intelligence principles in practical contexts.https://ieeexplore.ieee.org/document/10256101/Mixed-realitymulti-agent roboticsswarm intelligenceartificial intelligencevirtual reality |
spellingShingle | Dilshani Karunarathna Nuwan Jaliyagoda Ganindu Jayalath Janaka Alawatugoda Roshan Ragel Isuru Nawinne Mixed-Reality Based Multi-Agent Robotics Framework for Artificial Swarm Intelligence Experiments IEEE Access Mixed-reality multi-agent robotics swarm intelligence artificial intelligence virtual reality |
title | Mixed-Reality Based Multi-Agent Robotics Framework for Artificial Swarm Intelligence Experiments |
title_full | Mixed-Reality Based Multi-Agent Robotics Framework for Artificial Swarm Intelligence Experiments |
title_fullStr | Mixed-Reality Based Multi-Agent Robotics Framework for Artificial Swarm Intelligence Experiments |
title_full_unstemmed | Mixed-Reality Based Multi-Agent Robotics Framework for Artificial Swarm Intelligence Experiments |
title_short | Mixed-Reality Based Multi-Agent Robotics Framework for Artificial Swarm Intelligence Experiments |
title_sort | mixed reality based multi agent robotics framework for artificial swarm intelligence experiments |
topic | Mixed-reality multi-agent robotics swarm intelligence artificial intelligence virtual reality |
url | https://ieeexplore.ieee.org/document/10256101/ |
work_keys_str_mv | AT dilshanikarunarathna mixedrealitybasedmultiagentroboticsframeworkforartificialswarmintelligenceexperiments AT nuwanjaliyagoda mixedrealitybasedmultiagentroboticsframeworkforartificialswarmintelligenceexperiments AT ganindujayalath mixedrealitybasedmultiagentroboticsframeworkforartificialswarmintelligenceexperiments AT janakaalawatugoda mixedrealitybasedmultiagentroboticsframeworkforartificialswarmintelligenceexperiments AT roshanragel mixedrealitybasedmultiagentroboticsframeworkforartificialswarmintelligenceexperiments AT isurunawinne mixedrealitybasedmultiagentroboticsframeworkforartificialswarmintelligenceexperiments |