Design and Validation of Vision-Based Exercise Biofeedback for Tele-Rehabilitation

Tele-rehabilitation has the potential to considerably change the way patients are monitored from their homes during the care process, by providing equitable access without the need to travel to rehab centers or shoulder the high cost of personal in-home services. Developing a tele-rehab platform wit...

Full description

Bibliographic Details
Main Authors: Ali Barzegar Khanghah, Geoff Fernie, Atena Roshan Fekr
Format: Article
Language:English
Published: MDPI AG 2023-01-01
Series:Sensors
Subjects:
Online Access:https://www.mdpi.com/1424-8220/23/3/1206
_version_ 1797623241539321856
author Ali Barzegar Khanghah
Geoff Fernie
Atena Roshan Fekr
author_facet Ali Barzegar Khanghah
Geoff Fernie
Atena Roshan Fekr
author_sort Ali Barzegar Khanghah
collection DOAJ
description Tele-rehabilitation has the potential to considerably change the way patients are monitored from their homes during the care process, by providing equitable access without the need to travel to rehab centers or shoulder the high cost of personal in-home services. Developing a tele-rehab platform with the capability of automating exercise guidance is likely to have a significant impact on rehabilitation outcomes. In this paper, a new vision-based biofeedback system is designed and validated to identify the quality of performed exercises. This new system will help patients to refine their movements to get the most out of their plan of care. An open dataset was used, which consisted of data from 30 participants performing nine different exercises. Each exercise was labeled as “Correctly” or “Incorrectly” executed by five clinicians. We used a pre-trained 3D Convolution Neural Network (3D-CNN) to design our biofeedback system. The proposed system achieved average accuracy values of 90.57% ± 9.17% and 83.78% ± 7.63% using 10-Fold and Leave-One-Subject-Out (LOSO) cross validation, respectively. In addition, we obtained average F1-scores of 71.78% ± 5.68% using 10-Fold and 60.64% ± 21.3% using LOSO validation. The proposed 3D-CNN was able to classify the rehabilitation videos and feedback on the quality of exercises to help users modify their movement patterns.
first_indexed 2024-03-11T09:25:53Z
format Article
id doaj.art-1f907529f008460994b6025d668002c1
institution Directory Open Access Journal
issn 1424-8220
language English
last_indexed 2024-03-11T09:25:53Z
publishDate 2023-01-01
publisher MDPI AG
record_format Article
series Sensors
spelling doaj.art-1f907529f008460994b6025d668002c12023-11-16T17:57:42ZengMDPI AGSensors1424-82202023-01-01233120610.3390/s23031206Design and Validation of Vision-Based Exercise Biofeedback for Tele-RehabilitationAli Barzegar Khanghah0Geoff Fernie1Atena Roshan Fekr2KITE Research Institute, Toronto Rehabilitation Institute, University Health Network, 550 University Ave, Toronto, ON M5G 2A2, CanadaKITE Research Institute, Toronto Rehabilitation Institute, University Health Network, 550 University Ave, Toronto, ON M5G 2A2, CanadaKITE Research Institute, Toronto Rehabilitation Institute, University Health Network, 550 University Ave, Toronto, ON M5G 2A2, CanadaTele-rehabilitation has the potential to considerably change the way patients are monitored from their homes during the care process, by providing equitable access without the need to travel to rehab centers or shoulder the high cost of personal in-home services. Developing a tele-rehab platform with the capability of automating exercise guidance is likely to have a significant impact on rehabilitation outcomes. In this paper, a new vision-based biofeedback system is designed and validated to identify the quality of performed exercises. This new system will help patients to refine their movements to get the most out of their plan of care. An open dataset was used, which consisted of data from 30 participants performing nine different exercises. Each exercise was labeled as “Correctly” or “Incorrectly” executed by five clinicians. We used a pre-trained 3D Convolution Neural Network (3D-CNN) to design our biofeedback system. The proposed system achieved average accuracy values of 90.57% ± 9.17% and 83.78% ± 7.63% using 10-Fold and Leave-One-Subject-Out (LOSO) cross validation, respectively. In addition, we obtained average F1-scores of 71.78% ± 5.68% using 10-Fold and 60.64% ± 21.3% using LOSO validation. The proposed 3D-CNN was able to classify the rehabilitation videos and feedback on the quality of exercises to help users modify their movement patterns.https://www.mdpi.com/1424-8220/23/3/1206tele-rehabilitationdeep learningbiofeedbackartificial intelligence3D model
spellingShingle Ali Barzegar Khanghah
Geoff Fernie
Atena Roshan Fekr
Design and Validation of Vision-Based Exercise Biofeedback for Tele-Rehabilitation
Sensors
tele-rehabilitation
deep learning
biofeedback
artificial intelligence
3D model
title Design and Validation of Vision-Based Exercise Biofeedback for Tele-Rehabilitation
title_full Design and Validation of Vision-Based Exercise Biofeedback for Tele-Rehabilitation
title_fullStr Design and Validation of Vision-Based Exercise Biofeedback for Tele-Rehabilitation
title_full_unstemmed Design and Validation of Vision-Based Exercise Biofeedback for Tele-Rehabilitation
title_short Design and Validation of Vision-Based Exercise Biofeedback for Tele-Rehabilitation
title_sort design and validation of vision based exercise biofeedback for tele rehabilitation
topic tele-rehabilitation
deep learning
biofeedback
artificial intelligence
3D model
url https://www.mdpi.com/1424-8220/23/3/1206
work_keys_str_mv AT alibarzegarkhanghah designandvalidationofvisionbasedexercisebiofeedbackfortelerehabilitation
AT geofffernie designandvalidationofvisionbasedexercisebiofeedbackfortelerehabilitation
AT atenaroshanfekr designandvalidationofvisionbasedexercisebiofeedbackfortelerehabilitation