Multiangle Correlation Feature Extraction and Disease Prediction Model Construction for Patients With Post-Stroke Dysarthria
The clinical diagnosis and treatment of motor dysarthria in post-stroke patients is often subjective and neglects the impact of psychological and emotional disorders on disease progression. This study aims to analyze the correlation among emotional expression, psychological state, facial expression,...
| Principais autores: | , , , , |
|---|---|
| Formato: | Artigo |
| Idioma: | English |
| Publicado em: |
IEEE
2025-01-01
|
| coleção: | IEEE Transactions on Neural Systems and Rehabilitation Engineering |
| Assuntos: | |
| Acesso em linha: | https://ieeexplore.ieee.org/document/10841469/ |
| _version_ | 1826846493479272448 |
|---|---|
| author | Ting Zhu Shufei Duan Huizhi Liang Fujiang Li Wei Zhang |
| author_facet | Ting Zhu Shufei Duan Huizhi Liang Fujiang Li Wei Zhang |
| author_sort | Ting Zhu |
| collection | DOAJ |
| description | The clinical diagnosis and treatment of motor dysarthria in post-stroke patients is often subjective and neglects the impact of psychological and emotional disorders on disease progression. This study aims to analyze the correlation among emotional expression, psychological state, facial expression, and dysarthria disease severity and is dedicated to the construction of a dysarthria prediction model. We first designed THE-POSSD, a novel Chinese multimodal emotional pathology expression database, which collected acoustic, glottal, and facial data under emotional stimuli from patients at different disease stages and healthy controls. Emotional speech was labeled for intelligibility scores, emotion types, and discrete dimensional space. Then, their correlation with disease development was investigated and analyzed. A total of 154 significant correlation features were extracted for analysis. To mitigate the limitations of subjective clinical scale diagnosis and account for psychological and emotional factors, this study introduced the grey correlation theory and constructed a dysarthria prediction model based on the grey relational analysis-deep belief network (GRA-DBN). Principal Component Analysis and Variance Inflation Factor were employed to optimize GRA-DBN model. Both proposed models achieved a high prediction accuracy, with an adjusted R2 value of 0.85 for GRA-DBN and 0.92 for optimised model. This study fills the gap in the international multimodal emotional pathological expression dataset and provides a comprehensive framework for analyzing the association between mental state, emotional expression, and the degree of dysarthria. Furthermore, the incorporation of key multimodal features into the predictive model highlights its potential to enhance the precision of clinical diagnostic processes significantly. |
| first_indexed | 2025-02-16T15:03:13Z |
| format | Article |
| id | doaj.art-bc50c78a3afb4af8b9688de948fd9c38 |
| institution | Directory Open Access Journal |
| issn | 1534-4320 1558-0210 |
| language | English |
| last_indexed | 2025-02-16T15:03:13Z |
| publishDate | 2025-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Transactions on Neural Systems and Rehabilitation Engineering |
| spelling | doaj.art-bc50c78a3afb4af8b9688de948fd9c382025-01-31T00:00:10ZengIEEEIEEE Transactions on Neural Systems and Rehabilitation Engineering1534-43201558-02102025-01-013358759710.1109/TNSRE.2025.352951810841469Multiangle Correlation Feature Extraction and Disease Prediction Model Construction for Patients With Post-Stroke DysarthriaTing Zhu0https://orcid.org/0000-0003-3681-8659Shufei Duan1https://orcid.org/0000-0001-6072-8237Huizhi Liang2https://orcid.org/0000-0003-4408-4528Fujiang Li3Wei Zhang4College of Electronic Information Engineering, Taiyuan University of Technology, Taiyuan, Shanxi, ChinaCollege of Electronic Information Engineering, Taiyuan University of Technology, Taiyuan, Shanxi, ChinaSchool of Computing, Newcastle University, Newcastle, U.K.College of Electronic Information Engineering, Taiyuan University of Technology, Taiyuan, Shanxi, ChinaTaiyuan Hospital, Peking University First Hospital, Taiyuan, Shanxi, ChinaThe clinical diagnosis and treatment of motor dysarthria in post-stroke patients is often subjective and neglects the impact of psychological and emotional disorders on disease progression. This study aims to analyze the correlation among emotional expression, psychological state, facial expression, and dysarthria disease severity and is dedicated to the construction of a dysarthria prediction model. We first designed THE-POSSD, a novel Chinese multimodal emotional pathology expression database, which collected acoustic, glottal, and facial data under emotional stimuli from patients at different disease stages and healthy controls. Emotional speech was labeled for intelligibility scores, emotion types, and discrete dimensional space. Then, their correlation with disease development was investigated and analyzed. A total of 154 significant correlation features were extracted for analysis. To mitigate the limitations of subjective clinical scale diagnosis and account for psychological and emotional factors, this study introduced the grey correlation theory and constructed a dysarthria prediction model based on the grey relational analysis-deep belief network (GRA-DBN). Principal Component Analysis and Variance Inflation Factor were employed to optimize GRA-DBN model. Both proposed models achieved a high prediction accuracy, with an adjusted R2 value of 0.85 for GRA-DBN and 0.92 for optimised model. This study fills the gap in the international multimodal emotional pathological expression dataset and provides a comprehensive framework for analyzing the association between mental state, emotional expression, and the degree of dysarthria. Furthermore, the incorporation of key multimodal features into the predictive model highlights its potential to enhance the precision of clinical diagnostic processes significantly.https://ieeexplore.ieee.org/document/10841469/Disease prediction modelemotional pathological speech databasegrey relational analysismotor dysarthriaaffective computingpost-stroke |
| spellingShingle | Ting Zhu Shufei Duan Huizhi Liang Fujiang Li Wei Zhang Multiangle Correlation Feature Extraction and Disease Prediction Model Construction for Patients With Post-Stroke Dysarthria IEEE Transactions on Neural Systems and Rehabilitation Engineering Disease prediction model emotional pathological speech database grey relational analysis motor dysarthria affective computing post-stroke |
| title | Multiangle Correlation Feature Extraction and Disease Prediction Model Construction for Patients With Post-Stroke Dysarthria |
| title_full | Multiangle Correlation Feature Extraction and Disease Prediction Model Construction for Patients With Post-Stroke Dysarthria |
| title_fullStr | Multiangle Correlation Feature Extraction and Disease Prediction Model Construction for Patients With Post-Stroke Dysarthria |
| title_full_unstemmed | Multiangle Correlation Feature Extraction and Disease Prediction Model Construction for Patients With Post-Stroke Dysarthria |
| title_short | Multiangle Correlation Feature Extraction and Disease Prediction Model Construction for Patients With Post-Stroke Dysarthria |
| title_sort | multiangle correlation feature extraction and disease prediction model construction for patients with post stroke dysarthria |
| topic | Disease prediction model emotional pathological speech database grey relational analysis motor dysarthria affective computing post-stroke |
| url | https://ieeexplore.ieee.org/document/10841469/ |
| work_keys_str_mv | AT tingzhu multianglecorrelationfeatureextractionanddiseasepredictionmodelconstructionforpatientswithpoststrokedysarthria AT shufeiduan multianglecorrelationfeatureextractionanddiseasepredictionmodelconstructionforpatientswithpoststrokedysarthria AT huizhiliang multianglecorrelationfeatureextractionanddiseasepredictionmodelconstructionforpatientswithpoststrokedysarthria AT fujiangli multianglecorrelationfeatureextractionanddiseasepredictionmodelconstructionforpatientswithpoststrokedysarthria AT weizhang multianglecorrelationfeatureextractionanddiseasepredictionmodelconstructionforpatientswithpoststrokedysarthria |