Implementation of UI/UX in AR systems to enhance human-machine interaction

The rising interest in Industry 4.0 where Augmented Reality becomes part of manufacturing has garnered much attention as to whether augmented reality technology can be implemented in many new technological industries. Augmented reality systems consist of a computer that is able to generate images th...

Full description

Bibliographic Details
Main Author: Kuo, Yu Chen
Other Authors: Yeo Song Huat
Format: Final Year Project (FYP)
Language:English
Published: Nanyang Technological University 2020
Subjects:
Online Access:https://hdl.handle.net/10356/140992
_version_ 1811691233664303104
author Kuo, Yu Chen
author2 Yeo Song Huat
author_facet Yeo Song Huat
Kuo, Yu Chen
author_sort Kuo, Yu Chen
collection NTU
description The rising interest in Industry 4.0 where Augmented Reality becomes part of manufacturing has garnered much attention as to whether augmented reality technology can be implemented in many new technological industries. Augmented reality systems consist of a computer that is able to generate images that overlay onto reality though wearable glasses. These glasses allow the user to move freely in reality with the supplement of information from the glasses inside 3D space. These systems are high versatile and are able to be adapted to manufacturing cells that can allow users to visualize the machinery’s future movements. This is done by overlaying an augmented image of the machine’s next position into the glasses which the user can view as an object in reality. This FYP report presents the approach to designing an application with a fluid user interface to enhance the interaction between machine and humans. The communication is improved with networking capabilities to wirelessly connect to a robot for the exchange of information. The user interface consisted of receiving inputs from the user to establish connections as well as displaying the connection status. Furthermore, the aim to allow the user to communicate with the robot in a hands-free manner through voice recognition required user interface elements which displayed and recognized voice inputs and key command words. Subsequently, the implementation of the user interface was developed in Unity3D and exported as a Universal Windows Program. This application was executed in a microcontroller unit that is portable and allowed users are able to move freely in. Lastly, a user experience survey was planned for a better understanding on the shortcomings of the design of the user interface and experience of using augmented reality glasses.
first_indexed 2024-10-01T06:16:38Z
format Final Year Project (FYP)
id ntu-10356/140992
institution Nanyang Technological University
language English
last_indexed 2024-10-01T06:16:38Z
publishDate 2020
publisher Nanyang Technological University
record_format dspace
spelling ntu-10356/1409922023-03-04T19:29:13Z Implementation of UI/UX in AR systems to enhance human-machine interaction Kuo, Yu Chen Yeo Song Huat School of Mechanical and Aerospace Engineering Advanced Remanufacturing and Technology Centre Robotics Research Centre MYEOSH@ntu.edu.sg Engineering::Mechanical engineering::Mechatronics The rising interest in Industry 4.0 where Augmented Reality becomes part of manufacturing has garnered much attention as to whether augmented reality technology can be implemented in many new technological industries. Augmented reality systems consist of a computer that is able to generate images that overlay onto reality though wearable glasses. These glasses allow the user to move freely in reality with the supplement of information from the glasses inside 3D space. These systems are high versatile and are able to be adapted to manufacturing cells that can allow users to visualize the machinery’s future movements. This is done by overlaying an augmented image of the machine’s next position into the glasses which the user can view as an object in reality. This FYP report presents the approach to designing an application with a fluid user interface to enhance the interaction between machine and humans. The communication is improved with networking capabilities to wirelessly connect to a robot for the exchange of information. The user interface consisted of receiving inputs from the user to establish connections as well as displaying the connection status. Furthermore, the aim to allow the user to communicate with the robot in a hands-free manner through voice recognition required user interface elements which displayed and recognized voice inputs and key command words. Subsequently, the implementation of the user interface was developed in Unity3D and exported as a Universal Windows Program. This application was executed in a microcontroller unit that is portable and allowed users are able to move freely in. Lastly, a user experience survey was planned for a better understanding on the shortcomings of the design of the user interface and experience of using augmented reality glasses. Bachelor of Engineering (Aerospace Engineering) 2020-06-03T06:06:28Z 2020-06-03T06:06:28Z 2020 Final Year Project (FYP) https://hdl.handle.net/10356/140992 en B017 application/pdf Nanyang Technological University
spellingShingle Engineering::Mechanical engineering::Mechatronics
Kuo, Yu Chen
Implementation of UI/UX in AR systems to enhance human-machine interaction
title Implementation of UI/UX in AR systems to enhance human-machine interaction
title_full Implementation of UI/UX in AR systems to enhance human-machine interaction
title_fullStr Implementation of UI/UX in AR systems to enhance human-machine interaction
title_full_unstemmed Implementation of UI/UX in AR systems to enhance human-machine interaction
title_short Implementation of UI/UX in AR systems to enhance human-machine interaction
title_sort implementation of ui ux in ar systems to enhance human machine interaction
topic Engineering::Mechanical engineering::Mechatronics
url https://hdl.handle.net/10356/140992
work_keys_str_mv AT kuoyuchen implementationofuiuxinarsystemstoenhancehumanmachineinteraction