Design and Implementation of a Robotic Arm Assistant with Voice Interaction Using Machine Vision
It is evident that the technological growth of the last few decades has signaled the development of several application domains. One application domain that has expanded massively in recent years is robotics. The usage and spread of robotic systems in commercial and non-commercial environments resul...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2021-10-01
|
| Series: | Automation |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2673-4052/2/4/15 |
| _version_ | 1797506602416209920 |
|---|---|
| author | George Nantzios Nikolaos Baras Minas Dasygenis |
| author_facet | George Nantzios Nikolaos Baras Minas Dasygenis |
| author_sort | George Nantzios |
| collection | DOAJ |
| description | It is evident that the technological growth of the last few decades has signaled the development of several application domains. One application domain that has expanded massively in recent years is robotics. The usage and spread of robotic systems in commercial and non-commercial environments resulted in increased productivity, efficiency, and higher quality of life. Many researchers have developed systems that improve many aspects of people’s lives, based on robotics. Most of the engineers use high-cost robotic arms, which are usually out of the reach of typical consumers. We fill this gap by presenting a low-cost and high-accuracy project to be used as a robotic assistant for every consumer. Our project aims to further improve people’s quality of life, and more specifically people with physical and mobility impairments. The robotic system is based on the Niryo-One robotic arm, equipped with a USB (Universal Serial Bus) HD (High Definition) camera on the end-effector. To achieve high accuracy, we modified the YOLO algorithm by adding novel features and additional computations to be used in the kinematic model. We evaluated the proposed system by conducting experiments using PhD students of our laboratory and demonstrated its effectiveness. The experimental results indicate that the robotic arm can detect and deliver the requested object in a timely manner with a 96.66% accuracy. |
| first_indexed | 2024-03-10T04:35:52Z |
| format | Article |
| id | doaj.art-91c6aff280a34ae585b3a72e3f9deed9 |
| institution | Directory Open Access Journal |
| issn | 2673-4052 |
| language | English |
| last_indexed | 2024-03-10T04:35:52Z |
| publishDate | 2021-10-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Automation |
| spelling | doaj.art-91c6aff280a34ae585b3a72e3f9deed92023-11-23T03:48:45ZengMDPI AGAutomation2673-40522021-10-012423825110.3390/automation2040015Design and Implementation of a Robotic Arm Assistant with Voice Interaction Using Machine VisionGeorge Nantzios0Nikolaos Baras1Minas Dasygenis2Department of Electrical and Computer Engineering, University of Western Macedonia, 501 00 Kozani, GreeceDepartment of Electrical and Computer Engineering, University of Western Macedonia, 501 00 Kozani, GreeceDepartment of Electrical and Computer Engineering, University of Western Macedonia, 501 00 Kozani, GreeceIt is evident that the technological growth of the last few decades has signaled the development of several application domains. One application domain that has expanded massively in recent years is robotics. The usage and spread of robotic systems in commercial and non-commercial environments resulted in increased productivity, efficiency, and higher quality of life. Many researchers have developed systems that improve many aspects of people’s lives, based on robotics. Most of the engineers use high-cost robotic arms, which are usually out of the reach of typical consumers. We fill this gap by presenting a low-cost and high-accuracy project to be used as a robotic assistant for every consumer. Our project aims to further improve people’s quality of life, and more specifically people with physical and mobility impairments. The robotic system is based on the Niryo-One robotic arm, equipped with a USB (Universal Serial Bus) HD (High Definition) camera on the end-effector. To achieve high accuracy, we modified the YOLO algorithm by adding novel features and additional computations to be used in the kinematic model. We evaluated the proposed system by conducting experiments using PhD students of our laboratory and demonstrated its effectiveness. The experimental results indicate that the robotic arm can detect and deliver the requested object in a timely manner with a 96.66% accuracy.https://www.mdpi.com/2673-4052/2/4/15roboticsrobotic armniryo-onemachine visionYOLOopencv |
| spellingShingle | George Nantzios Nikolaos Baras Minas Dasygenis Design and Implementation of a Robotic Arm Assistant with Voice Interaction Using Machine Vision Automation robotics robotic arm niryo-one machine vision YOLO opencv |
| title | Design and Implementation of a Robotic Arm Assistant with Voice Interaction Using Machine Vision |
| title_full | Design and Implementation of a Robotic Arm Assistant with Voice Interaction Using Machine Vision |
| title_fullStr | Design and Implementation of a Robotic Arm Assistant with Voice Interaction Using Machine Vision |
| title_full_unstemmed | Design and Implementation of a Robotic Arm Assistant with Voice Interaction Using Machine Vision |
| title_short | Design and Implementation of a Robotic Arm Assistant with Voice Interaction Using Machine Vision |
| title_sort | design and implementation of a robotic arm assistant with voice interaction using machine vision |
| topic | robotics robotic arm niryo-one machine vision YOLO opencv |
| url | https://www.mdpi.com/2673-4052/2/4/15 |
| work_keys_str_mv | AT georgenantzios designandimplementationofaroboticarmassistantwithvoiceinteractionusingmachinevision AT nikolaosbaras designandimplementationofaroboticarmassistantwithvoiceinteractionusingmachinevision AT minasdasygenis designandimplementationofaroboticarmassistantwithvoiceinteractionusingmachinevision |