Development of gesture-controlled robotic arm for upper limb hemiplegia therapy
Human-computer interactions using hand gesture recognition has emerge as a current approach in recent rehabilitation studies. The introduction of a vision-based system such as the Microsoft Kinect and the Leap Motion sensor (LMS) provides a very informative description of hand pose that can be explo...
| Main Author: | |
|---|---|
| Format: | Thesis |
| Language: | English English English |
| Published: |
2022
|
| Subjects: | |
| Online Access: | http://eprints.uthm.edu.my/8366/1/24p%20WAN%20NORLIYANA%20WAN%20AZLAN.pdf http://eprints.uthm.edu.my/8366/2/WAN%20NORLIYANA%20WAN%20AZLAN%20COPYRIGHT%20DECLARATION.pdf http://eprints.uthm.edu.my/8366/3/WAN%20NORLIYANA%20WAN%20AZLAN%20WATERMARK.pdf |
| _version_ | 1825710559111151616 |
|---|---|
| author | Wan Azlan, Wan Norliyana |
| author_facet | Wan Azlan, Wan Norliyana |
| author_sort | Wan Azlan, Wan Norliyana |
| collection | UTHM |
| description | Human-computer interactions using hand gesture recognition has emerge as a current approach in recent rehabilitation studies. The introduction of a vision-based system such as the Microsoft Kinect and the Leap Motion sensor (LMS) provides a very informative description of hand pose that can be exploited for tracking applications. Compared to the Kinect depth camera, the LMS produces a more limited amount of information and interaction zone, but the output data is more accurate. Thus, this study aims to explore the LMS system as an effective method for hand gesture recognition controlled robotic arm in improving upper-extremity motor function therapy. Many engineering challenges are addressed to develop a viable system for the therapy application: a real-time and accurate system for hand movement detection, limitation of robot workspace and hand-robot coordination, and development of hand motion-based robot position algorithm. EMU HS4 robot arm and controller have been retrofitted to allow 3 degrees of freedom (DOF) moment and directly controlled by LMS-based gesture recognition. A series of wrist revolving rehabilitation exercises are conducted that provides a good agreement where the robot can move according to hand movement. The potential of the proposed system has been further illustrated and verified through comprehensive rehabilitation training exercises with around 90% accuracy for flexion-extension training. In conclusion, these findings have significant implications for the understanding of hand recognition application towards robotic-based upper limb assistive and rehabilitation procedures. |
| first_indexed | 2024-03-05T21:59:26Z |
| format | Thesis |
| id | uthm.eprints-8366 |
| institution | Universiti Tun Hussein Onn Malaysia |
| language | English English English |
| last_indexed | 2024-03-05T21:59:26Z |
| publishDate | 2022 |
| record_format | dspace |
| spelling | uthm.eprints-83662023-02-22T02:22:57Z http://eprints.uthm.edu.my/8366/ Development of gesture-controlled robotic arm for upper limb hemiplegia therapy Wan Azlan, Wan Norliyana T Technology (General) Human-computer interactions using hand gesture recognition has emerge as a current approach in recent rehabilitation studies. The introduction of a vision-based system such as the Microsoft Kinect and the Leap Motion sensor (LMS) provides a very informative description of hand pose that can be exploited for tracking applications. Compared to the Kinect depth camera, the LMS produces a more limited amount of information and interaction zone, but the output data is more accurate. Thus, this study aims to explore the LMS system as an effective method for hand gesture recognition controlled robotic arm in improving upper-extremity motor function therapy. Many engineering challenges are addressed to develop a viable system for the therapy application: a real-time and accurate system for hand movement detection, limitation of robot workspace and hand-robot coordination, and development of hand motion-based robot position algorithm. EMU HS4 robot arm and controller have been retrofitted to allow 3 degrees of freedom (DOF) moment and directly controlled by LMS-based gesture recognition. A series of wrist revolving rehabilitation exercises are conducted that provides a good agreement where the robot can move according to hand movement. The potential of the proposed system has been further illustrated and verified through comprehensive rehabilitation training exercises with around 90% accuracy for flexion-extension training. In conclusion, these findings have significant implications for the understanding of hand recognition application towards robotic-based upper limb assistive and rehabilitation procedures. 2022-06 Thesis NonPeerReviewed text en http://eprints.uthm.edu.my/8366/1/24p%20WAN%20NORLIYANA%20WAN%20AZLAN.pdf text en http://eprints.uthm.edu.my/8366/2/WAN%20NORLIYANA%20WAN%20AZLAN%20COPYRIGHT%20DECLARATION.pdf text en http://eprints.uthm.edu.my/8366/3/WAN%20NORLIYANA%20WAN%20AZLAN%20WATERMARK.pdf Wan Azlan, Wan Norliyana (2022) Development of gesture-controlled robotic arm for upper limb hemiplegia therapy. Masters thesis, Universiti Tun Hussein Onn Malaysia. |
| spellingShingle | T Technology (General) Wan Azlan, Wan Norliyana Development of gesture-controlled robotic arm for upper limb hemiplegia therapy |
| title | Development of gesture-controlled robotic arm for upper limb hemiplegia therapy |
| title_full | Development of gesture-controlled robotic arm for upper limb hemiplegia therapy |
| title_fullStr | Development of gesture-controlled robotic arm for upper limb hemiplegia therapy |
| title_full_unstemmed | Development of gesture-controlled robotic arm for upper limb hemiplegia therapy |
| title_short | Development of gesture-controlled robotic arm for upper limb hemiplegia therapy |
| title_sort | development of gesture controlled robotic arm for upper limb hemiplegia therapy |
| topic | T Technology (General) |
| url | http://eprints.uthm.edu.my/8366/1/24p%20WAN%20NORLIYANA%20WAN%20AZLAN.pdf http://eprints.uthm.edu.my/8366/2/WAN%20NORLIYANA%20WAN%20AZLAN%20COPYRIGHT%20DECLARATION.pdf http://eprints.uthm.edu.my/8366/3/WAN%20NORLIYANA%20WAN%20AZLAN%20WATERMARK.pdf |
| work_keys_str_mv | AT wanazlanwannorliyana developmentofgesturecontrolledroboticarmforupperlimbhemiplegiatherapy |