Novel robotic UI toolset
This report delves into integrating Foxglove Studio, a cutting-edge robotics visualization tool, within the broader context of robotic systems development. Mobile robots, with their advanced sensors and control systems, are increasingly becoming integral in sectors where human intervention is limite...
| Main Author: | |
|---|---|
| Other Authors: | |
| Format: | Final Year Project (FYP) |
| Language: | English |
| Published: |
Nanyang Technological University
2024
|
| Subjects: | |
| Online Access: | https://hdl.handle.net/10356/177326 |
| _version_ | 1826120124849979392 |
|---|---|
| author | Liu, Xinyao |
| author2 | Tang Xiaohong |
| author_facet | Tang Xiaohong Liu, Xinyao |
| author_sort | Liu, Xinyao |
| collection | NTU |
| description | This report delves into integrating Foxglove Studio, a cutting-edge robotics visualization tool, within the broader context of robotic systems development. Mobile robots, with their advanced sensors and control systems, are increasingly becoming integral in sectors where human intervention is limited. Despite their growing adoption, adequate visualization and debugging of robotic data remains a critical challenge, often not addressed by traditional debugging techniques. This report reviews existing visualization solutions like Rviz and Webviz and outlines the limitations of these tools in collaborative and non-engineering environments.
Addressing these gaps, this report introduces an innovative approach to enhance the functionality of Foxglove. It details the development of a translation tool that facilitates the integration of UI/UX designs from Figma into Foxglove, enabling a seamless transition from design prototypes to functional panels. However, this method encounters certain constraints with the manual layout conversion logic. To overcome these challenges, we integrate the OpenAI API to automate the process. Following the layout conversion, we employ sample data, local data bag files, and ultimately live ROS2 data to rigorously test the usability of the panels created by our translation tool.
The implications of this work are significant. This translator tool will bridge the gap between the designer and engineer, and future developments aim to generalize this tool for broader applications. This would enable designers to contribute directly to the robotic data visualization interface, democratizing the design process within robotics software interaction. The report underscores the importance of user-friendly and accessible technology in robotics, paving the way for inclusive advancements in the field. |
| first_indexed | 2024-10-01T05:11:23Z |
| format | Final Year Project (FYP) |
| id | ntu-10356/177326 |
| institution | Nanyang Technological University |
| language | English |
| last_indexed | 2024-10-01T05:11:23Z |
| publishDate | 2024 |
| publisher | Nanyang Technological University |
| record_format | dspace |
| spelling | ntu-10356/1773262024-05-31T15:44:25Z Novel robotic UI toolset Liu, Xinyao Tang Xiaohong School of Electrical and Electronic Engineering Schaeffler Group EXHTang@ntu.edu.sg Computer and Information Science Engineering This report delves into integrating Foxglove Studio, a cutting-edge robotics visualization tool, within the broader context of robotic systems development. Mobile robots, with their advanced sensors and control systems, are increasingly becoming integral in sectors where human intervention is limited. Despite their growing adoption, adequate visualization and debugging of robotic data remains a critical challenge, often not addressed by traditional debugging techniques. This report reviews existing visualization solutions like Rviz and Webviz and outlines the limitations of these tools in collaborative and non-engineering environments. Addressing these gaps, this report introduces an innovative approach to enhance the functionality of Foxglove. It details the development of a translation tool that facilitates the integration of UI/UX designs from Figma into Foxglove, enabling a seamless transition from design prototypes to functional panels. However, this method encounters certain constraints with the manual layout conversion logic. To overcome these challenges, we integrate the OpenAI API to automate the process. Following the layout conversion, we employ sample data, local data bag files, and ultimately live ROS2 data to rigorously test the usability of the panels created by our translation tool. The implications of this work are significant. This translator tool will bridge the gap between the designer and engineer, and future developments aim to generalize this tool for broader applications. This would enable designers to contribute directly to the robotic data visualization interface, democratizing the design process within robotics software interaction. The report underscores the importance of user-friendly and accessible technology in robotics, paving the way for inclusive advancements in the field. Bachelor's degree 2024-05-28T01:09:48Z 2024-05-28T01:09:48Z 2024 Final Year Project (FYP) Liu, X. (2024). Novel robotic UI toolset. Final Year Project (FYP), Nanyang Technological University, Singapore. https://hdl.handle.net/10356/177326 https://hdl.handle.net/10356/177326 en EEE FYP A2213-231 application/pdf Nanyang Technological University |
| spellingShingle | Computer and Information Science Engineering Liu, Xinyao Novel robotic UI toolset |
| title | Novel robotic UI toolset |
| title_full | Novel robotic UI toolset |
| title_fullStr | Novel robotic UI toolset |
| title_full_unstemmed | Novel robotic UI toolset |
| title_short | Novel robotic UI toolset |
| title_sort | novel robotic ui toolset |
| topic | Computer and Information Science Engineering |
| url | https://hdl.handle.net/10356/177326 |
| work_keys_str_mv | AT liuxinyao novelroboticuitoolset |