Multi-Sensor-Based Action Monitoring and Recognition via Hybrid Descriptors and Logistic Regression
In the fields of body-worn sensors and computer vision, current research is being done to track and detect falls and activities of daily living using the automatic recognition of human actions. In the area of human–machine communication, different combinations of sensors and communication...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2023-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/10123938/ |
| _version_ | 1797822187638358016 |
|---|---|
| author | Sadaf Hafeez Saud S. Alotaibi Abdulwahab Alazeb Naif Al Mudawi Wooseong Kim |
| author_facet | Sadaf Hafeez Saud S. Alotaibi Abdulwahab Alazeb Naif Al Mudawi Wooseong Kim |
| author_sort | Sadaf Hafeez |
| collection | DOAJ |
| description | In the fields of body-worn sensors and computer vision, current research is being done to track and detect falls and activities of daily living using the automatic recognition of human actions. In the area of human–machine communication, different combinations of sensors and communication technologies are often used to capture human action. Many researchers have also worked with artificial intelligent systems to detect actions, understand scenes, and implement systems that are more efficient in human action recognition. Although effective approaches are needed to detect outdoor activities with the combination of human actions, feature extraction can be quite a complicated task in a human activity recognition system development. Thus, this paper proposed a solution to detect human activities via hybrid descriptors based on robust features and accurate results. In this study, complex backgrounds, including multiple humans in video frames, were detected. First, inertial signal and video frames are pre-processed using denoising techniques, after which the frames are used to remove the background by detecting human motions and extracting the silhouettes. Then, these silhouettes are further used to extract the human body key points to make the human skeleton. Then the time and frequency domain features are extracted for inertial signals, and geometric features are extracted for the skeleton body points. Finally, multiple feature sets are combined and fed into a zero order optimization model, after which logistic regression is utilized to recognize each action. The proposed system has been evaluated on three benchmark datasets, including, the UP Fall dataset, the University of Rzeszow Fall dataset, and the SisFall dataset and proved its significance by achieving accuracy of 91.51%, 92.98%, and 90.23%, on the aforementioned datasets respectively. |
| first_indexed | 2024-03-13T10:04:15Z |
| format | Article |
| id | doaj.art-50979bea2f25423cbbc62da0de50cc45 |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-03-13T10:04:15Z |
| publishDate | 2023-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-50979bea2f25423cbbc62da0de50cc452023-05-22T23:00:24ZengIEEEIEEE Access2169-35362023-01-0111481454815710.1109/ACCESS.2023.327573310123938Multi-Sensor-Based Action Monitoring and Recognition via Hybrid Descriptors and Logistic RegressionSadaf Hafeez0Saud S. Alotaibi1https://orcid.org/0000-0003-1082-513XAbdulwahab Alazeb2https://orcid.org/0000-0001-9661-7440Naif Al Mudawi3https://orcid.org/0000-0001-8361-6561Wooseong Kim4https://orcid.org/0000-0003-0955-3421Department of Computer Science, Air University, Islamabad, PakistanInformation Systems Department, Umm Al-Qura University, Makkah, Saudi ArabiaDepartment of Computer Science, College of Computer Science and Information System, Najran University, Najran, Saudi ArabiaDepartment of Computer Science, College of Computer Science and Information System, Najran University, Najran, Saudi ArabiaDepartment of Computer Engineering, Gachon University, Seongnam, South KoreaIn the fields of body-worn sensors and computer vision, current research is being done to track and detect falls and activities of daily living using the automatic recognition of human actions. In the area of human–machine communication, different combinations of sensors and communication technologies are often used to capture human action. Many researchers have also worked with artificial intelligent systems to detect actions, understand scenes, and implement systems that are more efficient in human action recognition. Although effective approaches are needed to detect outdoor activities with the combination of human actions, feature extraction can be quite a complicated task in a human activity recognition system development. Thus, this paper proposed a solution to detect human activities via hybrid descriptors based on robust features and accurate results. In this study, complex backgrounds, including multiple humans in video frames, were detected. First, inertial signal and video frames are pre-processed using denoising techniques, after which the frames are used to remove the background by detecting human motions and extracting the silhouettes. Then, these silhouettes are further used to extract the human body key points to make the human skeleton. Then the time and frequency domain features are extracted for inertial signals, and geometric features are extracted for the skeleton body points. Finally, multiple feature sets are combined and fed into a zero order optimization model, after which logistic regression is utilized to recognize each action. The proposed system has been evaluated on three benchmark datasets, including, the UP Fall dataset, the University of Rzeszow Fall dataset, and the SisFall dataset and proved its significance by achieving accuracy of 91.51%, 92.98%, and 90.23%, on the aforementioned datasets respectively.https://ieeexplore.ieee.org/document/10123938/Fall detectiongeometric characteristicshuman activity recognitioninertial sensors |
| spellingShingle | Sadaf Hafeez Saud S. Alotaibi Abdulwahab Alazeb Naif Al Mudawi Wooseong Kim Multi-Sensor-Based Action Monitoring and Recognition via Hybrid Descriptors and Logistic Regression IEEE Access Fall detection geometric characteristics human activity recognition inertial sensors |
| title | Multi-Sensor-Based Action Monitoring and Recognition via Hybrid Descriptors and Logistic Regression |
| title_full | Multi-Sensor-Based Action Monitoring and Recognition via Hybrid Descriptors and Logistic Regression |
| title_fullStr | Multi-Sensor-Based Action Monitoring and Recognition via Hybrid Descriptors and Logistic Regression |
| title_full_unstemmed | Multi-Sensor-Based Action Monitoring and Recognition via Hybrid Descriptors and Logistic Regression |
| title_short | Multi-Sensor-Based Action Monitoring and Recognition via Hybrid Descriptors and Logistic Regression |
| title_sort | multi sensor based action monitoring and recognition via hybrid descriptors and logistic regression |
| topic | Fall detection geometric characteristics human activity recognition inertial sensors |
| url | https://ieeexplore.ieee.org/document/10123938/ |
| work_keys_str_mv | AT sadafhafeez multisensorbasedactionmonitoringandrecognitionviahybriddescriptorsandlogisticregression AT saudsalotaibi multisensorbasedactionmonitoringandrecognitionviahybriddescriptorsandlogisticregression AT abdulwahabalazeb multisensorbasedactionmonitoringandrecognitionviahybriddescriptorsandlogisticregression AT naifalmudawi multisensorbasedactionmonitoringandrecognitionviahybriddescriptorsandlogisticregression AT wooseongkim multisensorbasedactionmonitoringandrecognitionviahybriddescriptorsandlogisticregression |