Phygital Field: An Integrated Field with Physical Robots and Digital Images Using Projection-Based Localization and Control Method
Collaboration between computer graphics and multiple robots has attracted increasing attention in several fields. To enhance the seamless connection between them, the system should be able to accurately determine the position and state of the robots and to control them easily and instantly. However,...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Taylor & Francis Group
2018-07-01
|
| Series: | SICE Journal of Control, Measurement, and System Integration |
| Subjects: | |
| Online Access: | http://dx.doi.org/10.9746/jcmsi.11.302 |
| _version_ | 1797661001358770176 |
|---|---|
| author | Takefumi Hiraki Shogo Fukushima Yoshihiro Kawahara Takeshi Naemura |
| author_facet | Takefumi Hiraki Shogo Fukushima Yoshihiro Kawahara Takeshi Naemura |
| author_sort | Takefumi Hiraki |
| collection | DOAJ |
| description | Collaboration between computer graphics and multiple robots has attracted increasing attention in several fields. To enhance the seamless connection between them, the system should be able to accurately determine the position and state of the robots and to control them easily and instantly. However, realizing a responsive control system for a large number of mobile robots without complicated settings while avoiding the system load problem is not trivial. We propose a novel system, called “Phygital Field,” for the localization and control of multiple mobile robots. Utilizing pixel-level visible light communication technology, our system can project two types of information in the same location: visible images for humans and data patterns for mobile robots. The system uses coded light superimposed onto a visual image and projected onto the robots. The robots localize their position by receiving and decoding the projected light and can follow a target using the coded velocity vector field. Localization and control information can be independently conveyed in each pixel, and we can change this information over time. The system only requires a projector to control the robot swarm; thus, it can be used on any projection surface. We experimentally assess the localization accuracy of our system for both stationary and moving robots. To further illustrate the utility of our proposed system, we demonstrate the control of multiple mobile robots in spatially and temporally varying vector fields. We also propose prototype applications that can provide users with novel content from collaboration between computer graphics and robot swarm. |
| first_indexed | 2024-03-11T18:39:05Z |
| format | Article |
| id | doaj.art-b3a43ffba7154b9680764cc246e70367 |
| institution | Directory Open Access Journal |
| issn | 1884-9970 |
| language | English |
| last_indexed | 2024-03-11T18:39:05Z |
| publishDate | 2018-07-01 |
| publisher | Taylor & Francis Group |
| record_format | Article |
| series | SICE Journal of Control, Measurement, and System Integration |
| spelling | doaj.art-b3a43ffba7154b9680764cc246e703672023-10-12T13:43:55ZengTaylor & Francis GroupSICE Journal of Control, Measurement, and System Integration1884-99702018-07-0111430231110.9746/jcmsi.11.30212103221Phygital Field: An Integrated Field with Physical Robots and Digital Images Using Projection-Based Localization and Control MethodTakefumi Hiraki0Shogo Fukushima1Yoshihiro Kawahara2Takeshi Naemura3Graduate School of Information Science and Technology, The University of TokyoPRESTO, Japan Science and Technology Agency (JST)Graduate School of Information Science and Technology, The University of TokyoGraduate School of Information Science and Technology, The University of TokyoCollaboration between computer graphics and multiple robots has attracted increasing attention in several fields. To enhance the seamless connection between them, the system should be able to accurately determine the position and state of the robots and to control them easily and instantly. However, realizing a responsive control system for a large number of mobile robots without complicated settings while avoiding the system load problem is not trivial. We propose a novel system, called “Phygital Field,” for the localization and control of multiple mobile robots. Utilizing pixel-level visible light communication technology, our system can project two types of information in the same location: visible images for humans and data patterns for mobile robots. The system uses coded light superimposed onto a visual image and projected onto the robots. The robots localize their position by receiving and decoding the projected light and can follow a target using the coded velocity vector field. Localization and control information can be independently conveyed in each pixel, and we can change this information over time. The system only requires a projector to control the robot swarm; thus, it can be used on any projection surface. We experimentally assess the localization accuracy of our system for both stationary and moving robots. To further illustrate the utility of our proposed system, we demonstrate the control of multiple mobile robots in spatially and temporally varying vector fields. We also propose prototype applications that can provide users with novel content from collaboration between computer graphics and robot swarm.http://dx.doi.org/10.9746/jcmsi.11.302projection-based controlpixel-level visible light communicationdigital micromirror devicerobot swarmmixed reality |
| spellingShingle | Takefumi Hiraki Shogo Fukushima Yoshihiro Kawahara Takeshi Naemura Phygital Field: An Integrated Field with Physical Robots and Digital Images Using Projection-Based Localization and Control Method SICE Journal of Control, Measurement, and System Integration projection-based control pixel-level visible light communication digital micromirror device robot swarm mixed reality |
| title | Phygital Field: An Integrated Field with Physical Robots and Digital Images Using Projection-Based Localization and Control Method |
| title_full | Phygital Field: An Integrated Field with Physical Robots and Digital Images Using Projection-Based Localization and Control Method |
| title_fullStr | Phygital Field: An Integrated Field with Physical Robots and Digital Images Using Projection-Based Localization and Control Method |
| title_full_unstemmed | Phygital Field: An Integrated Field with Physical Robots and Digital Images Using Projection-Based Localization and Control Method |
| title_short | Phygital Field: An Integrated Field with Physical Robots and Digital Images Using Projection-Based Localization and Control Method |
| title_sort | phygital field an integrated field with physical robots and digital images using projection based localization and control method |
| topic | projection-based control pixel-level visible light communication digital micromirror device robot swarm mixed reality |
| url | http://dx.doi.org/10.9746/jcmsi.11.302 |
| work_keys_str_mv | AT takefumihiraki phygitalfieldanintegratedfieldwithphysicalrobotsanddigitalimagesusingprojectionbasedlocalizationandcontrolmethod AT shogofukushima phygitalfieldanintegratedfieldwithphysicalrobotsanddigitalimagesusingprojectionbasedlocalizationandcontrolmethod AT yoshihirokawahara phygitalfieldanintegratedfieldwithphysicalrobotsanddigitalimagesusingprojectionbasedlocalizationandcontrolmethod AT takeshinaemura phygitalfieldanintegratedfieldwithphysicalrobotsanddigitalimagesusingprojectionbasedlocalizationandcontrolmethod |