AI-Based Speech Assessment of Cognitive Impairment Disorders
Previous research has shown that speech can be used to detect cognitive impairment in patients with dementia and other neurodegenerative diseases. These diseases produce cognitive deficits that lead to changes in the acoustic and linguistic content of the speech produced by the patients. In this...
| Main Author: | |
|---|---|
| Other Authors: | |
| Format: | Thesis |
| Published: |
Massachusetts Institute of Technology
2023
|
| Online Access: | https://hdl.handle.net/1721.1/151700 |
| _version_ | 1826194532985733120 |
|---|---|
| author | Haulcy, R'mani |
| author2 | Glass, James |
| author_facet | Glass, James Haulcy, R'mani |
| author_sort | Haulcy, R'mani |
| collection | MIT |
| description | Previous research has shown that speech can be used to detect cognitive impairment in patients with dementia and other neurodegenerative diseases. These diseases produce cognitive deficits that lead to changes in the acoustic and linguistic content of the speech produced by the patients.
In this thesis, we analyze the speech of subjects with Alzheimer’s Disease (AD), Frontotemporal Dementia (FTD), and Primary Progressive Aphasia (PPA). We show that AD subjects can be distinguished from healthy controls with 85.4% accuracy and that the Mini- Mental State Examination scores of the subjects can be predicted with a root mean squared error of 4.56, using sentence embeddings. We present the Crowdsourced Language Assessment Corpus (CLAC), a corpus that we created to provide the community with a collection of audio samples from various speakers that can be used to learn a general representation for speech from healthy subjects, as well as complement other health-related speech datasets.
We present a novel, language-agnostic approach for measuring the quality of repetition in a recording, a method that was inspired by the need to automatically quantify the impaired repetition abilities that characterize the speech of people with the logopenic variant of PPA (lvPPA). A subset of the CLAC corpus was used as healthy controls and we demonstrated the feasibility of our approach by using it to distinguish between healthy and lvPPA speakers with impaired repetition with 85.7% accuracy. Lastly, we compare standard linguistic features to more advanced sentence embeddings by using a variety of feature extraction methods to extract features from picture description and monologue data for four different FTD/PPA variants. We show that all variants can be distinguished from healthy controls with >= 90% accuracy using transformer-based sentence embeddings.
We hope that the work presented in this thesis will contribute to the goal of using artificial intelligence to improve human health, clinical trial design, and drug development. |
| first_indexed | 2024-09-23T09:57:33Z |
| format | Thesis |
| id | mit-1721.1/151700 |
| institution | Massachusetts Institute of Technology |
| last_indexed | 2024-09-23T09:57:33Z |
| publishDate | 2023 |
| publisher | Massachusetts Institute of Technology |
| record_format | dspace |
| spelling | mit-1721.1/1517002023-08-01T04:07:48Z AI-Based Speech Assessment of Cognitive Impairment Disorders Haulcy, R'mani Glass, James Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science Previous research has shown that speech can be used to detect cognitive impairment in patients with dementia and other neurodegenerative diseases. These diseases produce cognitive deficits that lead to changes in the acoustic and linguistic content of the speech produced by the patients. In this thesis, we analyze the speech of subjects with Alzheimer’s Disease (AD), Frontotemporal Dementia (FTD), and Primary Progressive Aphasia (PPA). We show that AD subjects can be distinguished from healthy controls with 85.4% accuracy and that the Mini- Mental State Examination scores of the subjects can be predicted with a root mean squared error of 4.56, using sentence embeddings. We present the Crowdsourced Language Assessment Corpus (CLAC), a corpus that we created to provide the community with a collection of audio samples from various speakers that can be used to learn a general representation for speech from healthy subjects, as well as complement other health-related speech datasets. We present a novel, language-agnostic approach for measuring the quality of repetition in a recording, a method that was inspired by the need to automatically quantify the impaired repetition abilities that characterize the speech of people with the logopenic variant of PPA (lvPPA). A subset of the CLAC corpus was used as healthy controls and we demonstrated the feasibility of our approach by using it to distinguish between healthy and lvPPA speakers with impaired repetition with 85.7% accuracy. Lastly, we compare standard linguistic features to more advanced sentence embeddings by using a variety of feature extraction methods to extract features from picture description and monologue data for four different FTD/PPA variants. We show that all variants can be distinguished from healthy controls with >= 90% accuracy using transformer-based sentence embeddings. We hope that the work presented in this thesis will contribute to the goal of using artificial intelligence to improve human health, clinical trial design, and drug development. Ph.D. 2023-07-31T20:00:14Z 2023-07-31T20:00:14Z 2023-06 2023-07-13T14:21:24.493Z Thesis https://hdl.handle.net/1721.1/151700 In Copyright - Educational Use Permitted Copyright retained by author(s) https://rightsstatements.org/page/InC-EDU/1.0/ application/pdf Massachusetts Institute of Technology |
| spellingShingle | Haulcy, R'mani AI-Based Speech Assessment of Cognitive Impairment Disorders |
| title | AI-Based Speech Assessment of Cognitive Impairment Disorders |
| title_full | AI-Based Speech Assessment of Cognitive Impairment Disorders |
| title_fullStr | AI-Based Speech Assessment of Cognitive Impairment Disorders |
| title_full_unstemmed | AI-Based Speech Assessment of Cognitive Impairment Disorders |
| title_short | AI-Based Speech Assessment of Cognitive Impairment Disorders |
| title_sort | ai based speech assessment of cognitive impairment disorders |
| url | https://hdl.handle.net/1721.1/151700 |
| work_keys_str_mv | AT haulcyrmani aibasedspeechassessmentofcognitiveimpairmentdisorders |