Deep SE-BiLSTM with IFPOA Fine-Tuning for Human Activity Recognition Using Mobile and Wearable Sensors

Pervasive computing, human–computer interaction, human behavior analysis, and human activity recognition (HAR) fields have grown significantly. Deep learning (DL)-based techniques have recently been effectively used to predict various human actions using time series data from wearable sensors and mo...

Full description

Bibliographic Details
Main Authors: Shaik Jameer, Hussain Syed
Format: Article
Language:English
Published: MDPI AG 2023-04-01
Series:Sensors
Subjects:
Online Access:https://www.mdpi.com/1424-8220/23/9/4319
_version_ 1827742592520945664
author Shaik Jameer
Hussain Syed
author_facet Shaik Jameer
Hussain Syed
author_sort Shaik Jameer
collection DOAJ
description Pervasive computing, human–computer interaction, human behavior analysis, and human activity recognition (HAR) fields have grown significantly. Deep learning (DL)-based techniques have recently been effectively used to predict various human actions using time series data from wearable sensors and mobile devices. The management of time series data remains difficult for DL-based techniques, despite their excellent performance in activity detection. Time series data still has several problems, such as difficulties in heavily biased data and feature extraction. For HAR, an ensemble of Deep SqueezeNet (SE) and bidirectional long short-term memory (BiLSTM) with improved flower pollination optimization algorithm (IFPOA) is designed to construct a reliable classification model utilizing wearable sensor data in this research. The significant features are extracted automatically from the raw sensor data by multi-branch SE-BiLSTM. The model can learn both short-term dependencies and long-term features in sequential data due to SqueezeNet and BiLSTM. The different temporal local dependencies are captured effectively by the proposed model, enhancing the feature extraction process. The hyperparameters of the BiLSTM network are optimized by the IFPOA. The model performance is analyzed using three benchmark datasets: MHEALTH, KU-HAR, and PAMPA2. The proposed model has achieved 99.98%, 99.76%, and 99.54% accuracies on MHEALTH, KU-HAR, and PAMPA2 datasets, respectively. The proposed model performs better than other approaches from the obtained experimental results. The suggested model delivers competitive results compared to state-of-the-art techniques, according to experimental results on four publicly accessible datasets.
first_indexed 2024-03-11T04:07:13Z
format Article
id doaj.art-cad6f11f33004c3985371a00bf8ada32
institution Directory Open Access Journal
issn 1424-8220
language English
last_indexed 2024-03-11T04:07:13Z
publishDate 2023-04-01
publisher MDPI AG
record_format Article
series Sensors
spelling doaj.art-cad6f11f33004c3985371a00bf8ada322023-11-17T23:42:46ZengMDPI AGSensors1424-82202023-04-01239431910.3390/s23094319Deep SE-BiLSTM with IFPOA Fine-Tuning for Human Activity Recognition Using Mobile and Wearable SensorsShaik Jameer0Hussain Syed1School of Computer Science and Engineering, VIT AP University, Amaravati 522237, IndiaSchool of Computer Science and Engineering, VIT AP University, Amaravati 522237, IndiaPervasive computing, human–computer interaction, human behavior analysis, and human activity recognition (HAR) fields have grown significantly. Deep learning (DL)-based techniques have recently been effectively used to predict various human actions using time series data from wearable sensors and mobile devices. The management of time series data remains difficult for DL-based techniques, despite their excellent performance in activity detection. Time series data still has several problems, such as difficulties in heavily biased data and feature extraction. For HAR, an ensemble of Deep SqueezeNet (SE) and bidirectional long short-term memory (BiLSTM) with improved flower pollination optimization algorithm (IFPOA) is designed to construct a reliable classification model utilizing wearable sensor data in this research. The significant features are extracted automatically from the raw sensor data by multi-branch SE-BiLSTM. The model can learn both short-term dependencies and long-term features in sequential data due to SqueezeNet and BiLSTM. The different temporal local dependencies are captured effectively by the proposed model, enhancing the feature extraction process. The hyperparameters of the BiLSTM network are optimized by the IFPOA. The model performance is analyzed using three benchmark datasets: MHEALTH, KU-HAR, and PAMPA2. The proposed model has achieved 99.98%, 99.76%, and 99.54% accuracies on MHEALTH, KU-HAR, and PAMPA2 datasets, respectively. The proposed model performs better than other approaches from the obtained experimental results. The suggested model delivers competitive results compared to state-of-the-art techniques, according to experimental results on four publicly accessible datasets.https://www.mdpi.com/1424-8220/23/9/4319data pre-processingfeature extractionhyperparameterstime series datawearable sensors
spellingShingle Shaik Jameer
Hussain Syed
Deep SE-BiLSTM with IFPOA Fine-Tuning for Human Activity Recognition Using Mobile and Wearable Sensors
Sensors
data pre-processing
feature extraction
hyperparameters
time series data
wearable sensors
title Deep SE-BiLSTM with IFPOA Fine-Tuning for Human Activity Recognition Using Mobile and Wearable Sensors
title_full Deep SE-BiLSTM with IFPOA Fine-Tuning for Human Activity Recognition Using Mobile and Wearable Sensors
title_fullStr Deep SE-BiLSTM with IFPOA Fine-Tuning for Human Activity Recognition Using Mobile and Wearable Sensors
title_full_unstemmed Deep SE-BiLSTM with IFPOA Fine-Tuning for Human Activity Recognition Using Mobile and Wearable Sensors
title_short Deep SE-BiLSTM with IFPOA Fine-Tuning for Human Activity Recognition Using Mobile and Wearable Sensors
title_sort deep se bilstm with ifpoa fine tuning for human activity recognition using mobile and wearable sensors
topic data pre-processing
feature extraction
hyperparameters
time series data
wearable sensors
url https://www.mdpi.com/1424-8220/23/9/4319
work_keys_str_mv AT shaikjameer deepsebilstmwithifpoafinetuningforhumanactivityrecognitionusingmobileandwearablesensors
AT hussainsyed deepsebilstmwithifpoafinetuningforhumanactivityrecognitionusingmobileandwearablesensors