A Smartwatch Step-Counting App for Older Adults: Development and Evaluation Study
BackgroundOlder adults who engage in physical activity can reduce their risk of mobility impairment and disability. Short amounts of walking can improve quality of life, physical function, and cardiovascular health. Various programs have been implemented to encourage older ad...
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
JMIR Publications
2022-08-01
|
| Series: | JMIR Aging |
| Online Access: | https://aging.jmir.org/2022/3/e33845 |
| _version_ | 1827858057154002944 |
|---|---|
| author | George Boateng Curtis L Petersen David Kotz Karen L Fortuna Rebecca Masutani John A Batsis |
| author_facet | George Boateng Curtis L Petersen David Kotz Karen L Fortuna Rebecca Masutani John A Batsis |
| author_sort | George Boateng |
| collection | DOAJ |
| description |
BackgroundOlder adults who engage in physical activity can reduce their risk of mobility impairment and disability. Short amounts of walking can improve quality of life, physical function, and cardiovascular health. Various programs have been implemented to encourage older adults to engage in physical activity, but sustaining their motivation continues to be a challenge. Ubiquitous devices, such as mobile phones and smartwatches, coupled with machine-learning algorithms, can potentially encourage older adults to be more physically active. Current algorithms that are deployed in consumer devices (eg, Fitbit) are proprietary, often are not tailored to the movements of older adults, and have been shown to be inaccurate in clinical settings. Step-counting algorithms have been developed for smartwatches, but only using data from younger adults and, often, were only validated in controlled laboratory settings.
ObjectiveWe sought to develop and validate a smartwatch step-counting app for older adults and evaluate the algorithm in free-living settings over a long period of time.
MethodsWe developed and evaluated a step-counting app for older adults on an open-source wrist-worn device (Amulet). The app includes algorithms to infer the level of physical activity and to count steps. We validated the step-counting algorithm in the lab (counting steps from a video recording, n=20) and in free-living conditions—one 2-day field study (n=6) and two 12-week field studies (using the Fitbit as ground truth, n=16). During app system development, we evaluated 4 walking patterns: normal, fast, up and down a staircase, and intermittent speed. For the field studies, we evaluated 5 different cut-off values for the algorithm, using correlation and error rate as the evaluation metrics.
ResultsThe step-counting algorithm performed well. In the lab study, for normal walking (R2=0.5), there was a stronger correlation between the Amulet steps and the video-validated steps; for all activities, the Amulet’s count was on average 3.2 (2.1%) steps lower (SD 25.9) than the video-validated count. For the 2-day field study, the best parameter settings led to an association between Amulet and Fitbit (R2=0.989) and 3.1% (SD 25.1) steps lower than Fitbit, respectively. For the 12-week field study, the best parameter setting led to an R2 value of 0.669.
ConclusionsOur findings demonstrate the importance of an iterative process in algorithm development before field-based deployment. This work highlights various challenges and insights involved in developing and validating monitoring systems in real-world settings. Nonetheless, our step-counting app for older adults had good performance relative to the ground truth (a commercial Fitbit step counter). Our app could potentially be used to help improve physical activity among older adults. |
| first_indexed | 2024-03-12T12:49:25Z |
| format | Article |
| id | doaj.art-4243ef47aa204085885e8d933d65d374 |
| institution | Directory Open Access Journal |
| issn | 2561-7605 |
| language | English |
| last_indexed | 2024-03-12T12:49:25Z |
| publishDate | 2022-08-01 |
| publisher | JMIR Publications |
| record_format | Article |
| series | JMIR Aging |
| spelling | doaj.art-4243ef47aa204085885e8d933d65d3742023-08-28T22:51:27ZengJMIR PublicationsJMIR Aging2561-76052022-08-0153e3384510.2196/33845A Smartwatch Step-Counting App for Older Adults: Development and Evaluation StudyGeorge Boatenghttps://orcid.org/0000-0003-4540-9582Curtis L Petersenhttps://orcid.org/0000-0002-7210-447XDavid Kotzhttps://orcid.org/0000-0001-7411-2783Karen L Fortunahttps://orcid.org/0000-0003-0343-2346Rebecca Masutanihttps://orcid.org/0000-0002-3917-2606John A Batsishttps://orcid.org/0000-0002-0845-4416 BackgroundOlder adults who engage in physical activity can reduce their risk of mobility impairment and disability. Short amounts of walking can improve quality of life, physical function, and cardiovascular health. Various programs have been implemented to encourage older adults to engage in physical activity, but sustaining their motivation continues to be a challenge. Ubiquitous devices, such as mobile phones and smartwatches, coupled with machine-learning algorithms, can potentially encourage older adults to be more physically active. Current algorithms that are deployed in consumer devices (eg, Fitbit) are proprietary, often are not tailored to the movements of older adults, and have been shown to be inaccurate in clinical settings. Step-counting algorithms have been developed for smartwatches, but only using data from younger adults and, often, were only validated in controlled laboratory settings. ObjectiveWe sought to develop and validate a smartwatch step-counting app for older adults and evaluate the algorithm in free-living settings over a long period of time. MethodsWe developed and evaluated a step-counting app for older adults on an open-source wrist-worn device (Amulet). The app includes algorithms to infer the level of physical activity and to count steps. We validated the step-counting algorithm in the lab (counting steps from a video recording, n=20) and in free-living conditions—one 2-day field study (n=6) and two 12-week field studies (using the Fitbit as ground truth, n=16). During app system development, we evaluated 4 walking patterns: normal, fast, up and down a staircase, and intermittent speed. For the field studies, we evaluated 5 different cut-off values for the algorithm, using correlation and error rate as the evaluation metrics. ResultsThe step-counting algorithm performed well. In the lab study, for normal walking (R2=0.5), there was a stronger correlation between the Amulet steps and the video-validated steps; for all activities, the Amulet’s count was on average 3.2 (2.1%) steps lower (SD 25.9) than the video-validated count. For the 2-day field study, the best parameter settings led to an association between Amulet and Fitbit (R2=0.989) and 3.1% (SD 25.1) steps lower than Fitbit, respectively. For the 12-week field study, the best parameter setting led to an R2 value of 0.669. ConclusionsOur findings demonstrate the importance of an iterative process in algorithm development before field-based deployment. This work highlights various challenges and insights involved in developing and validating monitoring systems in real-world settings. Nonetheless, our step-counting app for older adults had good performance relative to the ground truth (a commercial Fitbit step counter). Our app could potentially be used to help improve physical activity among older adults.https://aging.jmir.org/2022/3/e33845 |
| spellingShingle | George Boateng Curtis L Petersen David Kotz Karen L Fortuna Rebecca Masutani John A Batsis A Smartwatch Step-Counting App for Older Adults: Development and Evaluation Study JMIR Aging |
| title | A Smartwatch Step-Counting App for Older Adults: Development and Evaluation Study |
| title_full | A Smartwatch Step-Counting App for Older Adults: Development and Evaluation Study |
| title_fullStr | A Smartwatch Step-Counting App for Older Adults: Development and Evaluation Study |
| title_full_unstemmed | A Smartwatch Step-Counting App for Older Adults: Development and Evaluation Study |
| title_short | A Smartwatch Step-Counting App for Older Adults: Development and Evaluation Study |
| title_sort | smartwatch step counting app for older adults development and evaluation study |
| url | https://aging.jmir.org/2022/3/e33845 |
| work_keys_str_mv | AT georgeboateng asmartwatchstepcountingappforolderadultsdevelopmentandevaluationstudy AT curtislpetersen asmartwatchstepcountingappforolderadultsdevelopmentandevaluationstudy AT davidkotz asmartwatchstepcountingappforolderadultsdevelopmentandevaluationstudy AT karenlfortuna asmartwatchstepcountingappforolderadultsdevelopmentandevaluationstudy AT rebeccamasutani asmartwatchstepcountingappforolderadultsdevelopmentandevaluationstudy AT johnabatsis asmartwatchstepcountingappforolderadultsdevelopmentandevaluationstudy AT georgeboateng smartwatchstepcountingappforolderadultsdevelopmentandevaluationstudy AT curtislpetersen smartwatchstepcountingappforolderadultsdevelopmentandevaluationstudy AT davidkotz smartwatchstepcountingappforolderadultsdevelopmentandevaluationstudy AT karenlfortuna smartwatchstepcountingappforolderadultsdevelopmentandevaluationstudy AT rebeccamasutani smartwatchstepcountingappforolderadultsdevelopmentandevaluationstudy AT johnabatsis smartwatchstepcountingappforolderadultsdevelopmentandevaluationstudy |