Smart Control of Home Appliances Using Hand Gesture Recognition in an IoT-Enabled System
Recently, with the vigorous development of the Internet of Things (IoT) technology, all kinds of intelligent home appliances in the market are constantly innovating. The public requirements for residential safety and convenience are also increasing. Meanwhile, with the improvement of indigenous medi...
| Main Authors: | , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Taylor & Francis Group
2023-12-01
|
| Series: | Applied Artificial Intelligence |
| Online Access: | http://dx.doi.org/10.1080/08839514.2023.2176607 |
| _version_ | 1797684822935601152 |
|---|---|
| author | Cheng-Ying Yang Yi-Nan Lin Sheng-Kuan Wang Victor R.L. Shen Yi-Chih Tung Frank H.C. Shen Chun-Hsiang Huang |
| author_facet | Cheng-Ying Yang Yi-Nan Lin Sheng-Kuan Wang Victor R.L. Shen Yi-Chih Tung Frank H.C. Shen Chun-Hsiang Huang |
| author_sort | Cheng-Ying Yang |
| collection | DOAJ |
| description | Recently, with the vigorous development of the Internet of Things (IoT) technology, all kinds of intelligent home appliances in the market are constantly innovating. The public requirements for residential safety and convenience are also increasing. Meanwhile, with the improvement of indigenous medical technology and quality of life, people’s average lifespan is gradually increasing. However, countries around the world are facing the problem of aging societies. Hand gesture recognition is gaining popularity in the fields of gesture control, robotics, or medical applications. Therefore, how to create a convenient and smart control system of home appliances for the elderly or the disabled has become the objective of this study. It aims to use Google MediaPipe to develop a hand tracking system, which detected 21 key points of a hand through the camera lens of a mobile device and used a vector formula to calculate the angle of the intersection of two lines based on four key points. After the angle of bending finger is obtained, users’ hand gesture can be recognized. Our experiments have confirmed that the recognition precision and recall values of hand gesture for numbers 0–9 reached 98.80% and 97.67%, respectively; and the recognition results were used to control home appliances through the low-cost IoT-Enabled system. |
| first_indexed | 2024-03-12T00:35:18Z |
| format | Article |
| id | doaj.art-922d717ddd904b478be9f18c3f55395a |
| institution | Directory Open Access Journal |
| issn | 0883-9514 1087-6545 |
| language | English |
| last_indexed | 2024-03-12T00:35:18Z |
| publishDate | 2023-12-01 |
| publisher | Taylor & Francis Group |
| record_format | Article |
| series | Applied Artificial Intelligence |
| spelling | doaj.art-922d717ddd904b478be9f18c3f55395a2023-09-15T10:01:05ZengTaylor & Francis GroupApplied Artificial Intelligence0883-95141087-65452023-12-0137110.1080/08839514.2023.21766072176607Smart Control of Home Appliances Using Hand Gesture Recognition in an IoT-Enabled SystemCheng-Ying Yang0Yi-Nan Lin1Sheng-Kuan Wang2Victor R.L. Shen3Yi-Chih Tung4Frank H.C. Shen5Chun-Hsiang Huang6University of Taipei 1Ming Chi University of Technology 84Ming Chi University of Technology 84National Taipei University 151Ming Chi University of Technology 84Fu Jen Catholic University 510Ming Chi University of Technology 84Recently, with the vigorous development of the Internet of Things (IoT) technology, all kinds of intelligent home appliances in the market are constantly innovating. The public requirements for residential safety and convenience are also increasing. Meanwhile, with the improvement of indigenous medical technology and quality of life, people’s average lifespan is gradually increasing. However, countries around the world are facing the problem of aging societies. Hand gesture recognition is gaining popularity in the fields of gesture control, robotics, or medical applications. Therefore, how to create a convenient and smart control system of home appliances for the elderly or the disabled has become the objective of this study. It aims to use Google MediaPipe to develop a hand tracking system, which detected 21 key points of a hand through the camera lens of a mobile device and used a vector formula to calculate the angle of the intersection of two lines based on four key points. After the angle of bending finger is obtained, users’ hand gesture can be recognized. Our experiments have confirmed that the recognition precision and recall values of hand gesture for numbers 0–9 reached 98.80% and 97.67%, respectively; and the recognition results were used to control home appliances through the low-cost IoT-Enabled system.http://dx.doi.org/10.1080/08839514.2023.2176607 |
| spellingShingle | Cheng-Ying Yang Yi-Nan Lin Sheng-Kuan Wang Victor R.L. Shen Yi-Chih Tung Frank H.C. Shen Chun-Hsiang Huang Smart Control of Home Appliances Using Hand Gesture Recognition in an IoT-Enabled System Applied Artificial Intelligence |
| title | Smart Control of Home Appliances Using Hand Gesture Recognition in an IoT-Enabled System |
| title_full | Smart Control of Home Appliances Using Hand Gesture Recognition in an IoT-Enabled System |
| title_fullStr | Smart Control of Home Appliances Using Hand Gesture Recognition in an IoT-Enabled System |
| title_full_unstemmed | Smart Control of Home Appliances Using Hand Gesture Recognition in an IoT-Enabled System |
| title_short | Smart Control of Home Appliances Using Hand Gesture Recognition in an IoT-Enabled System |
| title_sort | smart control of home appliances using hand gesture recognition in an iot enabled system |
| url | http://dx.doi.org/10.1080/08839514.2023.2176607 |
| work_keys_str_mv | AT chengyingyang smartcontrolofhomeappliancesusinghandgesturerecognitioninaniotenabledsystem AT yinanlin smartcontrolofhomeappliancesusinghandgesturerecognitioninaniotenabledsystem AT shengkuanwang smartcontrolofhomeappliancesusinghandgesturerecognitioninaniotenabledsystem AT victorrlshen smartcontrolofhomeappliancesusinghandgesturerecognitioninaniotenabledsystem AT yichihtung smartcontrolofhomeappliancesusinghandgesturerecognitioninaniotenabledsystem AT frankhcshen smartcontrolofhomeappliancesusinghandgesturerecognitioninaniotenabledsystem AT chunhsianghuang smartcontrolofhomeappliancesusinghandgesturerecognitioninaniotenabledsystem |