Elderly and visually impaired indoor activity monitoring based on Wi-Fi and Deep Hybrid convolutional neural network
Abstract A drop in physical activity and a deterioration in the capacity to undertake daily life activities are both connected with ageing and have negative effects on physical and mental health. An Elderly and Visually Impaired Human Activity Monitoring (EV-HAM) system that keeps tabs on a person’s...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Nature Portfolio
2023-12-01
|
| Series: | Scientific Reports |
| Online Access: | https://doi.org/10.1038/s41598-023-48860-5 |
| _version_ | 1797376992132202496 |
|---|---|
| author | K. Deepa Nebojsa Bacanin S. S. Askar Mohamed Abouhawwash |
| author_facet | K. Deepa Nebojsa Bacanin S. S. Askar Mohamed Abouhawwash |
| author_sort | K. Deepa |
| collection | DOAJ |
| description | Abstract A drop in physical activity and a deterioration in the capacity to undertake daily life activities are both connected with ageing and have negative effects on physical and mental health. An Elderly and Visually Impaired Human Activity Monitoring (EV-HAM) system that keeps tabs on a person’s routine and steps in if a change in behaviour or a crisis might greatly help an elderly person or a visually impaired. These individuals may find greater freedom with the help of an EVHAM system. As the backbone of human-centric applications like actively supported living and in-home monitoring for the elderly and visually impaired, an EVHAM system is essential. Big data-driven product design is flourishing in this age of 5G and the IoT. Recent advancements in processing power and software architectures have also contributed to the emergence and development of artificial intelligence (AI). In this context, the digital twin has emerged as a state-of-the-art technology that bridges the gap between the real and virtual worlds by evaluating data from several sensors using artificial intelligence algorithms. Although promising findings have been reported by Wi-Fi-based human activity identification techniques so far, their effectiveness is vulnerable to environmental variations. Using the environment-independent fingerprints generated from the Wi-Fi channel state information (CSI), we introduce Wi-Sense. This human activity identification system employs a Deep Hybrid convolutional neural network (DHCNN). The proposed system begins by collecting the CSI with a regular Wi-Fi Network Interface Controller. Wi-Sense uses the CSI ratio technique to lessen the effect of noise and the phase offset. The t- Distributed Stochastic Neighbor Embedding (t-SNE) is used to eliminate unnecessary data further. The data dimension is decreased, and the negative effects on the environment are eliminated in this process. The resulting spectrogram of the processed data exposes the activity’s micro-Doppler fingerprints as a function of both time and location. These spectrograms are put to use in the training of a DHCNN. Based on our findings, EVHAM can accurately identify these actions 99% of the time. |
| first_indexed | 2024-03-08T19:47:35Z |
| format | Article |
| id | doaj.art-978fba297e77449eb3b2c6f69eae4184 |
| institution | Directory Open Access Journal |
| issn | 2045-2322 |
| language | English |
| last_indexed | 2024-03-08T19:47:35Z |
| publishDate | 2023-12-01 |
| publisher | Nature Portfolio |
| record_format | Article |
| series | Scientific Reports |
| spelling | doaj.art-978fba297e77449eb3b2c6f69eae41842023-12-24T12:17:52ZengNature PortfolioScientific Reports2045-23222023-12-0113111610.1038/s41598-023-48860-5Elderly and visually impaired indoor activity monitoring based on Wi-Fi and Deep Hybrid convolutional neural networkK. Deepa0Nebojsa Bacanin1S. S. Askar2Mohamed Abouhawwash3Department of Computer Science and Engineering, K.Ramakrishnan College of TechnologySingidunum UniversityDepartment of Statistics and Operations Research, College of Science, King Saud UniversityDepartment of Computational Mathematics, Science and Engineering (CMSE), College of Engineering, Michigan State UniversityAbstract A drop in physical activity and a deterioration in the capacity to undertake daily life activities are both connected with ageing and have negative effects on physical and mental health. An Elderly and Visually Impaired Human Activity Monitoring (EV-HAM) system that keeps tabs on a person’s routine and steps in if a change in behaviour or a crisis might greatly help an elderly person or a visually impaired. These individuals may find greater freedom with the help of an EVHAM system. As the backbone of human-centric applications like actively supported living and in-home monitoring for the elderly and visually impaired, an EVHAM system is essential. Big data-driven product design is flourishing in this age of 5G and the IoT. Recent advancements in processing power and software architectures have also contributed to the emergence and development of artificial intelligence (AI). In this context, the digital twin has emerged as a state-of-the-art technology that bridges the gap between the real and virtual worlds by evaluating data from several sensors using artificial intelligence algorithms. Although promising findings have been reported by Wi-Fi-based human activity identification techniques so far, their effectiveness is vulnerable to environmental variations. Using the environment-independent fingerprints generated from the Wi-Fi channel state information (CSI), we introduce Wi-Sense. This human activity identification system employs a Deep Hybrid convolutional neural network (DHCNN). The proposed system begins by collecting the CSI with a regular Wi-Fi Network Interface Controller. Wi-Sense uses the CSI ratio technique to lessen the effect of noise and the phase offset. The t- Distributed Stochastic Neighbor Embedding (t-SNE) is used to eliminate unnecessary data further. The data dimension is decreased, and the negative effects on the environment are eliminated in this process. The resulting spectrogram of the processed data exposes the activity’s micro-Doppler fingerprints as a function of both time and location. These spectrograms are put to use in the training of a DHCNN. Based on our findings, EVHAM can accurately identify these actions 99% of the time.https://doi.org/10.1038/s41598-023-48860-5 |
| spellingShingle | K. Deepa Nebojsa Bacanin S. S. Askar Mohamed Abouhawwash Elderly and visually impaired indoor activity monitoring based on Wi-Fi and Deep Hybrid convolutional neural network Scientific Reports |
| title | Elderly and visually impaired indoor activity monitoring based on Wi-Fi and Deep Hybrid convolutional neural network |
| title_full | Elderly and visually impaired indoor activity monitoring based on Wi-Fi and Deep Hybrid convolutional neural network |
| title_fullStr | Elderly and visually impaired indoor activity monitoring based on Wi-Fi and Deep Hybrid convolutional neural network |
| title_full_unstemmed | Elderly and visually impaired indoor activity monitoring based on Wi-Fi and Deep Hybrid convolutional neural network |
| title_short | Elderly and visually impaired indoor activity monitoring based on Wi-Fi and Deep Hybrid convolutional neural network |
| title_sort | elderly and visually impaired indoor activity monitoring based on wi fi and deep hybrid convolutional neural network |
| url | https://doi.org/10.1038/s41598-023-48860-5 |
| work_keys_str_mv | AT kdeepa elderlyandvisuallyimpairedindooractivitymonitoringbasedonwifianddeephybridconvolutionalneuralnetwork AT nebojsabacanin elderlyandvisuallyimpairedindooractivitymonitoringbasedonwifianddeephybridconvolutionalneuralnetwork AT ssaskar elderlyandvisuallyimpairedindooractivitymonitoringbasedonwifianddeephybridconvolutionalneuralnetwork AT mohamedabouhawwash elderlyandvisuallyimpairedindooractivitymonitoringbasedonwifianddeephybridconvolutionalneuralnetwork |