Multi-Model Fusion of CNNs for Identification of Parkinson’s Disease Using Handwritten Samples
When approximately seventy percent of dopamine-producing nerve cells cease to function normally, the symptoms of Parkinson’s disease (PD) manifest, marking an irreversible decline in nerve cell health. In clinical settings, neurologists assess individuals by observing their performance in...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2023-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/10335677/ |
| _version_ | 1827592986799636480 |
|---|---|
| author | Saeeda Naz Iqra Kamran Sarah Gul Fazle Hadi Fahmi Khalifa |
| author_facet | Saeeda Naz Iqra Kamran Sarah Gul Fazle Hadi Fahmi Khalifa |
| author_sort | Saeeda Naz |
| collection | DOAJ |
| description | When approximately seventy percent of dopamine-producing nerve cells cease to function normally, the symptoms of Parkinson’s disease (PD) manifest, marking an irreversible decline in nerve cell health. In clinical settings, neurologists assess individuals by observing their performance in carrying out certain tasks, including writing, drawing, walking, speaking, and assessing facial expressions for any difficulties. This paper focuses on the problem of early PD identification through handwriting and drawing tasks, and by using three well-known PD data-sets. Given the scarcity of handwriting samples and the wide spectrum of Parkinson’s disease symptoms, the challenge is known to be particularly difficult. To achieve reliable PD detection, we employ diverse data augmentation techniques to expand the dataset size. Then, we deploy and train the different architectures of deep Convolutional Neural Network (CNN) each of which extract different salient features and aspect of input data due to its unique layout and structure (i.e., number of layers, kernels, normalization, number of connected layers, etc.). After experimental analysis of the performance of individual CNNs, we selected the promising feature vectors and employed different early fusion strategies before final classification. This is a very useful technique that allows a classification model to learn and detect from various representations of data provided by multiple CNNs and improve the overall system performance. Experimental results show that the fusion of freeze features of multiple deep CNN models significantly achieves better exactness of 99.35% in comparison to uni model CNN and other state-of-the-art work. |
| first_indexed | 2024-03-09T02:03:37Z |
| format | Article |
| id | doaj.art-4598b9c2ad774c42b005e33cd3fcde79 |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-03-09T02:03:37Z |
| publishDate | 2023-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-4598b9c2ad774c42b005e33cd3fcde792023-12-08T00:04:17ZengIEEEIEEE Access2169-35362023-01-011113560013560810.1109/ACCESS.2023.333780410335677Multi-Model Fusion of CNNs for Identification of Parkinson’s Disease Using Handwritten SamplesSaeeda Naz0https://orcid.org/0000-0002-5665-4615Iqra Kamran1Sarah Gul2Fazle Hadi3Fahmi Khalifa4https://orcid.org/0000-0003-3318-2851Department of Computer Science, GGPGC No.1, Abbottabad, HED, Khyber Pakhtunkhwa, PakistanDepartment of Computer Science, GGPGC No.1, Abbottabad, HED, Khyber Pakhtunkhwa, PakistanDepartment of Biological Sciences, FBAS, International Islamic University, Islamabad, PakistanRegional Directorate of Higher Education South at Bannu, Khyber Pakhtunkhwa, PakistanElectronics and Communications Engineering, Mansoura University, Mansoura, EgyptWhen approximately seventy percent of dopamine-producing nerve cells cease to function normally, the symptoms of Parkinson’s disease (PD) manifest, marking an irreversible decline in nerve cell health. In clinical settings, neurologists assess individuals by observing their performance in carrying out certain tasks, including writing, drawing, walking, speaking, and assessing facial expressions for any difficulties. This paper focuses on the problem of early PD identification through handwriting and drawing tasks, and by using three well-known PD data-sets. Given the scarcity of handwriting samples and the wide spectrum of Parkinson’s disease symptoms, the challenge is known to be particularly difficult. To achieve reliable PD detection, we employ diverse data augmentation techniques to expand the dataset size. Then, we deploy and train the different architectures of deep Convolutional Neural Network (CNN) each of which extract different salient features and aspect of input data due to its unique layout and structure (i.e., number of layers, kernels, normalization, number of connected layers, etc.). After experimental analysis of the performance of individual CNNs, we selected the promising feature vectors and employed different early fusion strategies before final classification. This is a very useful technique that allows a classification model to learn and detect from various representations of data provided by multiple CNNs and improve the overall system performance. Experimental results show that the fusion of freeze features of multiple deep CNN models significantly achieves better exactness of 99.35% in comparison to uni model CNN and other state-of-the-art work.https://ieeexplore.ieee.org/document/10335677/Parkinson’s diseaseCNNensemble learningfeatures fusionSVM |
| spellingShingle | Saeeda Naz Iqra Kamran Sarah Gul Fazle Hadi Fahmi Khalifa Multi-Model Fusion of CNNs for Identification of Parkinson’s Disease Using Handwritten Samples IEEE Access Parkinson’s disease CNN ensemble learning features fusion SVM |
| title | Multi-Model Fusion of CNNs for Identification of Parkinson’s Disease Using Handwritten Samples |
| title_full | Multi-Model Fusion of CNNs for Identification of Parkinson’s Disease Using Handwritten Samples |
| title_fullStr | Multi-Model Fusion of CNNs for Identification of Parkinson’s Disease Using Handwritten Samples |
| title_full_unstemmed | Multi-Model Fusion of CNNs for Identification of Parkinson’s Disease Using Handwritten Samples |
| title_short | Multi-Model Fusion of CNNs for Identification of Parkinson’s Disease Using Handwritten Samples |
| title_sort | multi model fusion of cnns for identification of parkinson x2019 s disease using handwritten samples |
| topic | Parkinson’s disease CNN ensemble learning features fusion SVM |
| url | https://ieeexplore.ieee.org/document/10335677/ |
| work_keys_str_mv | AT saeedanaz multimodelfusionofcnnsforidentificationofparkinsonx2019sdiseaseusinghandwrittensamples AT iqrakamran multimodelfusionofcnnsforidentificationofparkinsonx2019sdiseaseusinghandwrittensamples AT sarahgul multimodelfusionofcnnsforidentificationofparkinsonx2019sdiseaseusinghandwrittensamples AT fazlehadi multimodelfusionofcnnsforidentificationofparkinsonx2019sdiseaseusinghandwrittensamples AT fahmikhalifa multimodelfusionofcnnsforidentificationofparkinsonx2019sdiseaseusinghandwrittensamples |