Exploring Test-Retest Reliability and Longitudinal Stability of Digital Biomarkers for Parkinson Disease in the m-Power Data Set: Cohort Study
BackgroundDigital biomarkers (DB), as captured using sensors embedded in modern smart devices, are a promising technology for home-based sign and symptom monitoring in Parkinson disease (PD). ObjectiveDespite extensive application in recent studies, test-retest re...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
JMIR Publications
2021-09-01
|
| Series: | Journal of Medical Internet Research |
| Online Access: | https://www.jmir.org/2021/9/e26608 |
| _version_ | 1797735774695718912 |
|---|---|
| author | Mehran Sahandi Far Simon B Eickhoff Maria Goni Juergen Dukart |
| author_facet | Mehran Sahandi Far Simon B Eickhoff Maria Goni Juergen Dukart |
| author_sort | Mehran Sahandi Far |
| collection | DOAJ |
| description |
BackgroundDigital biomarkers (DB), as captured using sensors embedded in modern smart devices, are a promising technology for home-based sign and symptom monitoring in Parkinson disease (PD).
ObjectiveDespite extensive application in recent studies, test-retest reliability and longitudinal stability of DB have not been well addressed in this context. We utilized the large-scale m-Power data set to establish the test-retest reliability and longitudinal stability of gait, balance, voice, and tapping tasks in an unsupervised and self-administered daily life setting in patients with PD and healthy controls (HC).
MethodsIntraclass correlation coefficients were computed to estimate the test-retest reliability of features that also differentiate between patients with PD and healthy volunteers. In addition, we tested for longitudinal stability of DB measures in PD and HC, as well as for their sensitivity to PD medication effects.
ResultsAmong the features differing between PD and HC, only a few tapping and voice features had good to excellent test-retest reliabilities and medium to large effect sizes. All other features performed poorly in this respect. Only a few features were sensitive to medication effects. The longitudinal analyses revealed significant alterations over time across a variety of features and in particular for the tapping task.
ConclusionsThese results indicate the need for further development of more standardized, sensitive, and reliable DB for application in self-administered remote studies in patients with PD. Motivational, learning, and other confounders may cause variations in performance that need to be considered in DB longitudinal applications. |
| first_indexed | 2024-03-12T13:03:57Z |
| format | Article |
| id | doaj.art-f482c94dd6604ef3bbc5b48ed1f40a0a |
| institution | Directory Open Access Journal |
| issn | 1438-8871 |
| language | English |
| last_indexed | 2024-03-12T13:03:57Z |
| publishDate | 2021-09-01 |
| publisher | JMIR Publications |
| record_format | Article |
| series | Journal of Medical Internet Research |
| spelling | doaj.art-f482c94dd6604ef3bbc5b48ed1f40a0a2023-08-28T19:03:01ZengJMIR PublicationsJournal of Medical Internet Research1438-88712021-09-01239e2660810.2196/26608Exploring Test-Retest Reliability and Longitudinal Stability of Digital Biomarkers for Parkinson Disease in the m-Power Data Set: Cohort StudyMehran Sahandi Farhttps://orcid.org/0000-0002-5311-8286Simon B Eickhoffhttps://orcid.org/0000-0001-6363-2759Maria Gonihttps://orcid.org/0000-0001-7897-2537Juergen Dukarthttps://orcid.org/0000-0003-0492-5644 BackgroundDigital biomarkers (DB), as captured using sensors embedded in modern smart devices, are a promising technology for home-based sign and symptom monitoring in Parkinson disease (PD). ObjectiveDespite extensive application in recent studies, test-retest reliability and longitudinal stability of DB have not been well addressed in this context. We utilized the large-scale m-Power data set to establish the test-retest reliability and longitudinal stability of gait, balance, voice, and tapping tasks in an unsupervised and self-administered daily life setting in patients with PD and healthy controls (HC). MethodsIntraclass correlation coefficients were computed to estimate the test-retest reliability of features that also differentiate between patients with PD and healthy volunteers. In addition, we tested for longitudinal stability of DB measures in PD and HC, as well as for their sensitivity to PD medication effects. ResultsAmong the features differing between PD and HC, only a few tapping and voice features had good to excellent test-retest reliabilities and medium to large effect sizes. All other features performed poorly in this respect. Only a few features were sensitive to medication effects. The longitudinal analyses revealed significant alterations over time across a variety of features and in particular for the tapping task. ConclusionsThese results indicate the need for further development of more standardized, sensitive, and reliable DB for application in self-administered remote studies in patients with PD. Motivational, learning, and other confounders may cause variations in performance that need to be considered in DB longitudinal applications.https://www.jmir.org/2021/9/e26608 |
| spellingShingle | Mehran Sahandi Far Simon B Eickhoff Maria Goni Juergen Dukart Exploring Test-Retest Reliability and Longitudinal Stability of Digital Biomarkers for Parkinson Disease in the m-Power Data Set: Cohort Study Journal of Medical Internet Research |
| title | Exploring Test-Retest Reliability and Longitudinal Stability of Digital Biomarkers for Parkinson Disease in the m-Power Data Set: Cohort Study |
| title_full | Exploring Test-Retest Reliability and Longitudinal Stability of Digital Biomarkers for Parkinson Disease in the m-Power Data Set: Cohort Study |
| title_fullStr | Exploring Test-Retest Reliability and Longitudinal Stability of Digital Biomarkers for Parkinson Disease in the m-Power Data Set: Cohort Study |
| title_full_unstemmed | Exploring Test-Retest Reliability and Longitudinal Stability of Digital Biomarkers for Parkinson Disease in the m-Power Data Set: Cohort Study |
| title_short | Exploring Test-Retest Reliability and Longitudinal Stability of Digital Biomarkers for Parkinson Disease in the m-Power Data Set: Cohort Study |
| title_sort | exploring test retest reliability and longitudinal stability of digital biomarkers for parkinson disease in the m power data set cohort study |
| url | https://www.jmir.org/2021/9/e26608 |
| work_keys_str_mv | AT mehransahandifar exploringtestretestreliabilityandlongitudinalstabilityofdigitalbiomarkersforparkinsondiseaseinthempowerdatasetcohortstudy AT simonbeickhoff exploringtestretestreliabilityandlongitudinalstabilityofdigitalbiomarkersforparkinsondiseaseinthempowerdatasetcohortstudy AT mariagoni exploringtestretestreliabilityandlongitudinalstabilityofdigitalbiomarkersforparkinsondiseaseinthempowerdatasetcohortstudy AT juergendukart exploringtestretestreliabilityandlongitudinalstabilityofdigitalbiomarkersforparkinsondiseaseinthempowerdatasetcohortstudy |