Design of Human–Computer Interaction Gesture Tracking Model Based on Improved PSO and KCF Algorithms
The detection and tracking of gesture targets is an important aspect in the dynamic gesture recognition. To meet the accuracy and speed requirements of human-computer interaction for dynamic gesture recognition, this study explores long-term gesture recognition under monocular RGB cameras. This stud...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2024-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/10464287/ |
| _version_ | 1797243296638042112 |
|---|---|
| author | Dinghua He Yan Yang Rangzhong Wu |
| author_facet | Dinghua He Yan Yang Rangzhong Wu |
| author_sort | Dinghua He |
| collection | DOAJ |
| description | The detection and tracking of gesture targets is an important aspect in the dynamic gesture recognition. To meet the accuracy and speed requirements of human-computer interaction for dynamic gesture recognition, this study explores long-term gesture recognition under monocular RGB cameras. This study uses an improved particle swarm optimization algorithm as the feature extraction method, and introduces a mixed Gaussian model and kernel correlation filtering to complete gesture detection and tracking. And it has constructed a dynamic gesture tracking model on the ground of kernel correlation filtering. The experimental results show that the skin color based gesture detection algorithm has the minimum average relative error value of 0.321 on different datasets, with accuracy and recall rates higher than 0.8. The maximum correlation coefficient R-squared value is 0.823, and the detection speed reaches 36.32 frames per second. And this detection method has high repeatability on different datasets, with better detection accuracy for different gesture targets. The F1 value of the gesture tracking model has the largest area of the receiver operation characteristic curve, and the two error values of the model are small, resulting in better gesture tracking performance. In human-computer interaction systems, the detection accuracy and target rejection rate of this method have been significantly improved, and the subjective evaluation of the interaction system by the subjects is relatively high, resulting in good application effects. This study enriches the theoretical foundation of dynamic gesture detection and tracking technology, and improves the quality level of gesture tracking in the field of human-computer interaction. This helps to expand the application scope of human-computer interaction. |
| first_indexed | 2024-04-24T18:52:52Z |
| format | Article |
| id | doaj.art-736ec95d6dd8442590322bf9b585c770 |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-04-24T18:52:52Z |
| publishDate | 2024-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-736ec95d6dd8442590322bf9b585c7702024-03-26T17:47:54ZengIEEEIEEE Access2169-35362024-01-0112399133992510.1109/ACCESS.2024.337535110464287Design of Human–Computer Interaction Gesture Tracking Model Based on Improved PSO and KCF AlgorithmsDinghua He0Yan Yang1Rangzhong Wu2https://orcid.org/0009-0006-0493-5243School of Information Technology Application and Innovation, Wuhan Polytechnic, Wuhan, ChinaSchool of Information Technology Application and Innovation, Wuhan Polytechnic, Wuhan, ChinaSchool of Mechanical Engineering and Electronic Information, China University of Geosciences, Wuhan, ChinaThe detection and tracking of gesture targets is an important aspect in the dynamic gesture recognition. To meet the accuracy and speed requirements of human-computer interaction for dynamic gesture recognition, this study explores long-term gesture recognition under monocular RGB cameras. This study uses an improved particle swarm optimization algorithm as the feature extraction method, and introduces a mixed Gaussian model and kernel correlation filtering to complete gesture detection and tracking. And it has constructed a dynamic gesture tracking model on the ground of kernel correlation filtering. The experimental results show that the skin color based gesture detection algorithm has the minimum average relative error value of 0.321 on different datasets, with accuracy and recall rates higher than 0.8. The maximum correlation coefficient R-squared value is 0.823, and the detection speed reaches 36.32 frames per second. And this detection method has high repeatability on different datasets, with better detection accuracy for different gesture targets. The F1 value of the gesture tracking model has the largest area of the receiver operation characteristic curve, and the two error values of the model are small, resulting in better gesture tracking performance. In human-computer interaction systems, the detection accuracy and target rejection rate of this method have been significantly improved, and the subjective evaluation of the interaction system by the subjects is relatively high, resulting in good application effects. This study enriches the theoretical foundation of dynamic gesture detection and tracking technology, and improves the quality level of gesture tracking in the field of human-computer interaction. This helps to expand the application scope of human-computer interaction.https://ieeexplore.ieee.org/document/10464287/Human–computer interactionparticle swarm optimizationskin tone modelkernel correlation filteringdynamic gesture detectionhand tracking |
| spellingShingle | Dinghua He Yan Yang Rangzhong Wu Design of Human–Computer Interaction Gesture Tracking Model Based on Improved PSO and KCF Algorithms IEEE Access Human–computer interaction particle swarm optimization skin tone model kernel correlation filtering dynamic gesture detection hand tracking |
| title | Design of Human–Computer Interaction Gesture Tracking Model Based on Improved PSO and KCF Algorithms |
| title_full | Design of Human–Computer Interaction Gesture Tracking Model Based on Improved PSO and KCF Algorithms |
| title_fullStr | Design of Human–Computer Interaction Gesture Tracking Model Based on Improved PSO and KCF Algorithms |
| title_full_unstemmed | Design of Human–Computer Interaction Gesture Tracking Model Based on Improved PSO and KCF Algorithms |
| title_short | Design of Human–Computer Interaction Gesture Tracking Model Based on Improved PSO and KCF Algorithms |
| title_sort | design of human x2013 computer interaction gesture tracking model based on improved pso and kcf algorithms |
| topic | Human–computer interaction particle swarm optimization skin tone model kernel correlation filtering dynamic gesture detection hand tracking |
| url | https://ieeexplore.ieee.org/document/10464287/ |
| work_keys_str_mv | AT dinghuahe designofhumanx2013computerinteractiongesturetrackingmodelbasedonimprovedpsoandkcfalgorithms AT yanyang designofhumanx2013computerinteractiongesturetrackingmodelbasedonimprovedpsoandkcfalgorithms AT rangzhongwu designofhumanx2013computerinteractiongesturetrackingmodelbasedonimprovedpsoandkcfalgorithms |