Bimodal CNN for cardiovascular disease classification by co-training ECG grayscale images and scalograms
Abstract This study aimed to develop a bimodal convolutional neural network (CNN) by co-training grayscale images and scalograms of ECG for cardiovascular disease classification. The bimodal CNN model was developed using a 12-lead ECG database collected from Chapman University and Shaoxing People�...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Nature Portfolio
2023-02-01
|
| Series: | Scientific Reports |
| Online Access: | https://doi.org/10.1038/s41598-023-30208-8 |
| _version_ | 1797865001098149888 |
|---|---|
| author | Taeyoung Yoon Daesung Kang |
| author_facet | Taeyoung Yoon Daesung Kang |
| author_sort | Taeyoung Yoon |
| collection | DOAJ |
| description | Abstract This study aimed to develop a bimodal convolutional neural network (CNN) by co-training grayscale images and scalograms of ECG for cardiovascular disease classification. The bimodal CNN model was developed using a 12-lead ECG database collected from Chapman University and Shaoxing People's Hospital. The preprocessed database contains 10,588 ECG data and 11 heart rhythms labeled by a specialist physician. The preprocessed one-dimensional ECG signals were converted into two-dimensional grayscale images and scalograms, which are fed simultaneously to the bimodal CNN model as dual input images. The proposed model aims to improve the performance of CVDs classification by making use of ECG grayscale images and scalograms. The bimodal CNN model consists of two identical Inception-v3 backbone models, which were pre-trained on the ImageNet database. The proposed model was fine-tuned with 6780 dual-input images, validated with 1694 dual-input images, and tested on 2114 dual-input images. The bimodal CNN model using two identical Inception-v3 backbones achieved best AUC (0.992), accuracy (95.08%), sensitivity (0.942), precision (0.946) and F1-score (0.944) in lead II. Ensemble model of all leads obtained AUC (0.994), accuracy (95.74%), sensitivity (0.950), precision (0.953), and F1-score (0.952). The bimodal CNN model showed better diagnostic performance than logistic regression, XGBoost, LSTM, single CNN model training with grayscale images alone or with scalograms alone. The proposed bimodal CNN model would be of great help in diagnosing cardiovascular diseases. |
| first_indexed | 2024-04-09T23:02:00Z |
| format | Article |
| id | doaj.art-abd02618f8b341ef80451f9efe5b4a11 |
| institution | Directory Open Access Journal |
| issn | 2045-2322 |
| language | English |
| last_indexed | 2024-04-09T23:02:00Z |
| publishDate | 2023-02-01 |
| publisher | Nature Portfolio |
| record_format | Article |
| series | Scientific Reports |
| spelling | doaj.art-abd02618f8b341ef80451f9efe5b4a112023-03-22T10:57:00ZengNature PortfolioScientific Reports2045-23222023-02-011311910.1038/s41598-023-30208-8Bimodal CNN for cardiovascular disease classification by co-training ECG grayscale images and scalogramsTaeyoung Yoon0Daesung Kang1Department of Healthcare Information Technology, Inje UniversityDepartment of Healthcare Information Technology, Inje UniversityAbstract This study aimed to develop a bimodal convolutional neural network (CNN) by co-training grayscale images and scalograms of ECG for cardiovascular disease classification. The bimodal CNN model was developed using a 12-lead ECG database collected from Chapman University and Shaoxing People's Hospital. The preprocessed database contains 10,588 ECG data and 11 heart rhythms labeled by a specialist physician. The preprocessed one-dimensional ECG signals were converted into two-dimensional grayscale images and scalograms, which are fed simultaneously to the bimodal CNN model as dual input images. The proposed model aims to improve the performance of CVDs classification by making use of ECG grayscale images and scalograms. The bimodal CNN model consists of two identical Inception-v3 backbone models, which were pre-trained on the ImageNet database. The proposed model was fine-tuned with 6780 dual-input images, validated with 1694 dual-input images, and tested on 2114 dual-input images. The bimodal CNN model using two identical Inception-v3 backbones achieved best AUC (0.992), accuracy (95.08%), sensitivity (0.942), precision (0.946) and F1-score (0.944) in lead II. Ensemble model of all leads obtained AUC (0.994), accuracy (95.74%), sensitivity (0.950), precision (0.953), and F1-score (0.952). The bimodal CNN model showed better diagnostic performance than logistic regression, XGBoost, LSTM, single CNN model training with grayscale images alone or with scalograms alone. The proposed bimodal CNN model would be of great help in diagnosing cardiovascular diseases.https://doi.org/10.1038/s41598-023-30208-8 |
| spellingShingle | Taeyoung Yoon Daesung Kang Bimodal CNN for cardiovascular disease classification by co-training ECG grayscale images and scalograms Scientific Reports |
| title | Bimodal CNN for cardiovascular disease classification by co-training ECG grayscale images and scalograms |
| title_full | Bimodal CNN for cardiovascular disease classification by co-training ECG grayscale images and scalograms |
| title_fullStr | Bimodal CNN for cardiovascular disease classification by co-training ECG grayscale images and scalograms |
| title_full_unstemmed | Bimodal CNN for cardiovascular disease classification by co-training ECG grayscale images and scalograms |
| title_short | Bimodal CNN for cardiovascular disease classification by co-training ECG grayscale images and scalograms |
| title_sort | bimodal cnn for cardiovascular disease classification by co training ecg grayscale images and scalograms |
| url | https://doi.org/10.1038/s41598-023-30208-8 |
| work_keys_str_mv | AT taeyoungyoon bimodalcnnforcardiovasculardiseaseclassificationbycotrainingecggrayscaleimagesandscalograms AT daesungkang bimodalcnnforcardiovasculardiseaseclassificationbycotrainingecggrayscaleimagesandscalograms |