Predicting later categories of upper limb activity from earlier clinical assessments following stroke: an exploratory analysis
Abstract Background Accelerometers allow for direct measurement of upper limb (UL) activity. Recently, multi-dimensional categories of UL performance have been formed to provide a more complete measure of UL use in daily life. Prediction of motor outcomes after stroke have tremendous clinical utilit...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
BMC
2023-02-01
|
| Series: | Journal of NeuroEngineering and Rehabilitation |
| Subjects: | |
| Online Access: | https://doi.org/10.1186/s12984-023-01148-1 |
| _version_ | 1797865381092655104 |
|---|---|
| author | Jessica Barth Keith R. Lohse Marghuretta D. Bland Catherine E. Lang |
| author_facet | Jessica Barth Keith R. Lohse Marghuretta D. Bland Catherine E. Lang |
| author_sort | Jessica Barth |
| collection | DOAJ |
| description | Abstract Background Accelerometers allow for direct measurement of upper limb (UL) activity. Recently, multi-dimensional categories of UL performance have been formed to provide a more complete measure of UL use in daily life. Prediction of motor outcomes after stroke have tremendous clinical utility and a next step is to explore what factors might predict someone’s subsequent UL performance category. Purpose To explore how different machine learning techniques can be used to understand how clinical measures and participant demographics captured early after stroke are associated with the subsequent UL performance categories. Methods This study analyzed data from two time points from a previous cohort (n = 54). Data used was participant characteristics and clinical measures from early after stroke and a previously established category of UL performance at a later post stroke time point. Different machine learning techniques (a single decision tree, bagged trees, and random forests) were used to build predictive models with different input variables. Model performance was quantified with the explanatory power (in-sample accuracy), predictive power (out-of-bag estimate of error), and variable importance. Results A total of seven models were built, including one single decision tree, three bagged trees, and three random forests. Measures of UL impairment and capacity were the most important predictors of the subsequent UL performance category, regardless of the machine learning algorithm used. Other non-motor clinical measures emerged as key predictors, while participant demographics predictors (with the exception of age) were generally less important across the models. Models built with the bagging algorithms outperformed the single decision tree for in-sample accuracy (26–30% better classification) but had only modest cross-validation accuracy (48–55% out of bag classification). Conclusions UL clinical measures were the most important predictors of the subsequent UL performance category in this exploratory analysis regardless of the machine learning algorithm used. Interestingly, cognitive and affective measures emerged as important predictors when the number of input variables was expanded. These results reinforce that UL performance, in vivo, is not a simple product of body functions nor the capacity for movement, instead being a complex phenomenon dependent on many physiological and psychological factors. Utilizing machine learning, this exploratory analysis is a productive step toward the prediction of UL performance. Trial registration NA |
| first_indexed | 2024-04-09T23:07:05Z |
| format | Article |
| id | doaj.art-1802ce2c3e944278b28d9ef6c63db459 |
| institution | Directory Open Access Journal |
| issn | 1743-0003 |
| language | English |
| last_indexed | 2024-04-09T23:07:05Z |
| publishDate | 2023-02-01 |
| publisher | BMC |
| record_format | Article |
| series | Journal of NeuroEngineering and Rehabilitation |
| spelling | doaj.art-1802ce2c3e944278b28d9ef6c63db4592023-03-22T10:36:24ZengBMCJournal of NeuroEngineering and Rehabilitation1743-00032023-02-0120111610.1186/s12984-023-01148-1Predicting later categories of upper limb activity from earlier clinical assessments following stroke: an exploratory analysisJessica Barth0Keith R. Lohse1Marghuretta D. Bland2Catherine E. Lang3Program in Physical Therapy, Washington University School of MedicineProgram in Physical Therapy, Washington University School of MedicineProgram in Physical Therapy, Washington University School of MedicineProgram in Physical Therapy, Washington University School of MedicineAbstract Background Accelerometers allow for direct measurement of upper limb (UL) activity. Recently, multi-dimensional categories of UL performance have been formed to provide a more complete measure of UL use in daily life. Prediction of motor outcomes after stroke have tremendous clinical utility and a next step is to explore what factors might predict someone’s subsequent UL performance category. Purpose To explore how different machine learning techniques can be used to understand how clinical measures and participant demographics captured early after stroke are associated with the subsequent UL performance categories. Methods This study analyzed data from two time points from a previous cohort (n = 54). Data used was participant characteristics and clinical measures from early after stroke and a previously established category of UL performance at a later post stroke time point. Different machine learning techniques (a single decision tree, bagged trees, and random forests) were used to build predictive models with different input variables. Model performance was quantified with the explanatory power (in-sample accuracy), predictive power (out-of-bag estimate of error), and variable importance. Results A total of seven models were built, including one single decision tree, three bagged trees, and three random forests. Measures of UL impairment and capacity were the most important predictors of the subsequent UL performance category, regardless of the machine learning algorithm used. Other non-motor clinical measures emerged as key predictors, while participant demographics predictors (with the exception of age) were generally less important across the models. Models built with the bagging algorithms outperformed the single decision tree for in-sample accuracy (26–30% better classification) but had only modest cross-validation accuracy (48–55% out of bag classification). Conclusions UL clinical measures were the most important predictors of the subsequent UL performance category in this exploratory analysis regardless of the machine learning algorithm used. Interestingly, cognitive and affective measures emerged as important predictors when the number of input variables was expanded. These results reinforce that UL performance, in vivo, is not a simple product of body functions nor the capacity for movement, instead being a complex phenomenon dependent on many physiological and psychological factors. Utilizing machine learning, this exploratory analysis is a productive step toward the prediction of UL performance. Trial registration NAhttps://doi.org/10.1186/s12984-023-01148-1Upper extremityAccelerometrySupervised machine learningRehabilitationOutcome assessmentsStroke |
| spellingShingle | Jessica Barth Keith R. Lohse Marghuretta D. Bland Catherine E. Lang Predicting later categories of upper limb activity from earlier clinical assessments following stroke: an exploratory analysis Journal of NeuroEngineering and Rehabilitation Upper extremity Accelerometry Supervised machine learning Rehabilitation Outcome assessments Stroke |
| title | Predicting later categories of upper limb activity from earlier clinical assessments following stroke: an exploratory analysis |
| title_full | Predicting later categories of upper limb activity from earlier clinical assessments following stroke: an exploratory analysis |
| title_fullStr | Predicting later categories of upper limb activity from earlier clinical assessments following stroke: an exploratory analysis |
| title_full_unstemmed | Predicting later categories of upper limb activity from earlier clinical assessments following stroke: an exploratory analysis |
| title_short | Predicting later categories of upper limb activity from earlier clinical assessments following stroke: an exploratory analysis |
| title_sort | predicting later categories of upper limb activity from earlier clinical assessments following stroke an exploratory analysis |
| topic | Upper extremity Accelerometry Supervised machine learning Rehabilitation Outcome assessments Stroke |
| url | https://doi.org/10.1186/s12984-023-01148-1 |
| work_keys_str_mv | AT jessicabarth predictinglatercategoriesofupperlimbactivityfromearlierclinicalassessmentsfollowingstrokeanexploratoryanalysis AT keithrlohse predictinglatercategoriesofupperlimbactivityfromearlierclinicalassessmentsfollowingstrokeanexploratoryanalysis AT marghurettadbland predictinglatercategoriesofupperlimbactivityfromearlierclinicalassessmentsfollowingstrokeanexploratoryanalysis AT catherineelang predictinglatercategoriesofupperlimbactivityfromearlierclinicalassessmentsfollowingstrokeanexploratoryanalysis |