Integrated and scalable augmented reality multiplayer robotic platform
We propose a scalable AR (Augmented Reality) multiplayer robotic platform, which enables multiple players to control different machines (a drone and a robot) in shared environments, i.e virtual and real environments. We use state-of-theart visual SLAM (Simultaneous Localization and Mapping) algorith...
| Main Authors: | , , , |
|---|---|
| Other Authors: | |
| Format: | Conference Paper |
| Language: | English |
| Published: |
2020
|
| Subjects: | |
| Online Access: | https://hdl.handle.net/10356/142569 |
| _version_ | 1811697288088649728 |
|---|---|
| author | Tandianus, Budianto Seah, Hock Soon Wang, Li Quah, Chee Kwang |
| author2 | School of Computer Science and Engineering |
| author_facet | School of Computer Science and Engineering Tandianus, Budianto Seah, Hock Soon Wang, Li Quah, Chee Kwang |
| author_sort | Tandianus, Budianto |
| collection | NTU |
| description | We propose a scalable AR (Augmented Reality) multiplayer robotic platform, which enables multiple players to control different machines (a drone and a robot) in shared environments, i.e virtual and real environments. We use state-of-theart visual SLAM (Simultaneous Localization and Mapping) algorithms for tracking machine poses based on camera and IMU (Inertial Measurement Units) inputs. Players will observe consistent AR objects between them thanks to our backend system, which synchronizes the AR objects between players. Moreover, the system is scalable in term of hardware (e.g. IMU, camera, machine type) and software (SLAM algorithm) as we utilize ROS for communication between modules. We demonstrate our system on a game developed in Unity, a robust and widely used popular game engine. We present some statistics of the game such as its frames-per-second performance. |
| first_indexed | 2024-10-01T07:52:52Z |
| format | Conference Paper |
| id | ntu-10356/142569 |
| institution | Nanyang Technological University |
| language | English |
| last_indexed | 2024-10-01T07:52:52Z |
| publishDate | 2020 |
| record_format | dspace |
| spelling | ntu-10356/1425692020-06-24T07:50:50Z Integrated and scalable augmented reality multiplayer robotic platform Tandianus, Budianto Seah, Hock Soon Wang, Li Quah, Chee Kwang School of Computer Science and Engineering International Workshop on Advanced Imaging Technology (IWAIT) 2020 Engineering::Computer science and engineering SLAM ORB-SLAM2 We propose a scalable AR (Augmented Reality) multiplayer robotic platform, which enables multiple players to control different machines (a drone and a robot) in shared environments, i.e virtual and real environments. We use state-of-theart visual SLAM (Simultaneous Localization and Mapping) algorithms for tracking machine poses based on camera and IMU (Inertial Measurement Units) inputs. Players will observe consistent AR objects between them thanks to our backend system, which synchronizes the AR objects between players. Moreover, the system is scalable in term of hardware (e.g. IMU, camera, machine type) and software (SLAM algorithm) as we utilize ROS for communication between modules. We demonstrate our system on a game developed in Unity, a robust and widely used popular game engine. We present some statistics of the game such as its frames-per-second performance. NRF (Natl Research Foundation, S’pore) Published version 2020-06-24T07:44:40Z 2020-06-24T07:44:40Z 2020 Conference Paper Tandianus, B., Seah, H. S., Wang, L., & Quah, C. K. (2020). Integrated and scalable augmented reality multiplayer robotic platform. Proceedings of SPIE - International Workshop on Advanced Imaging Technology (IWAIT) 2020. doi:10.1117/12.2566243 9781510638358 https://hdl.handle.net/10356/142569 10.1117/12.2566243 11515 en SRP-4 Copyright 2020 Society of Photo-Optical Instrumentation Engineers (SPIE). One print or electronic copy may be made for personal use only. Systematic reproduction and distribution, duplication of any material in this paper for a fee or for commercial purposes, or modification of the content of the paper are prohibited. application/pdf |
| spellingShingle | Engineering::Computer science and engineering SLAM ORB-SLAM2 Tandianus, Budianto Seah, Hock Soon Wang, Li Quah, Chee Kwang Integrated and scalable augmented reality multiplayer robotic platform |
| title | Integrated and scalable augmented reality multiplayer robotic platform |
| title_full | Integrated and scalable augmented reality multiplayer robotic platform |
| title_fullStr | Integrated and scalable augmented reality multiplayer robotic platform |
| title_full_unstemmed | Integrated and scalable augmented reality multiplayer robotic platform |
| title_short | Integrated and scalable augmented reality multiplayer robotic platform |
| title_sort | integrated and scalable augmented reality multiplayer robotic platform |
| topic | Engineering::Computer science and engineering SLAM ORB-SLAM2 |
| url | https://hdl.handle.net/10356/142569 |
| work_keys_str_mv | AT tandianusbudianto integratedandscalableaugmentedrealitymultiplayerroboticplatform AT seahhocksoon integratedandscalableaugmentedrealitymultiplayerroboticplatform AT wangli integratedandscalableaugmentedrealitymultiplayerroboticplatform AT quahcheekwang integratedandscalableaugmentedrealitymultiplayerroboticplatform |