Cardiologist-level interpretable knowledge-fused deep neural network for automatic arrhythmia diagnosis

Abstract Background Long-term monitoring of Electrocardiogram (ECG) recordings is crucial to diagnose arrhythmias. Clinicians can find it challenging to diagnose arrhythmias, and this is a particular issue in more remote and underdeveloped areas. The development of digital ECG and AI methods could a...

Full description

Bibliographic Details
Main Authors: Yanrui Jin, Zhiyuan Li, Mengxiao Wang, Jinlei Liu, Yuanyuan Tian, Yunqing Liu, Xiaoyang Wei, Liqun Zhao, Chengliang Liu
Format: Article
Language:English
Published: Nature Portfolio 2024-02-01
Series:Communications Medicine
Online Access:https://doi.org/10.1038/s43856-024-00464-4
_version_ 1797273493346189312
author Yanrui Jin
Zhiyuan Li
Mengxiao Wang
Jinlei Liu
Yuanyuan Tian
Yunqing Liu
Xiaoyang Wei
Liqun Zhao
Chengliang Liu
author_facet Yanrui Jin
Zhiyuan Li
Mengxiao Wang
Jinlei Liu
Yuanyuan Tian
Yunqing Liu
Xiaoyang Wei
Liqun Zhao
Chengliang Liu
author_sort Yanrui Jin
collection DOAJ
description Abstract Background Long-term monitoring of Electrocardiogram (ECG) recordings is crucial to diagnose arrhythmias. Clinicians can find it challenging to diagnose arrhythmias, and this is a particular issue in more remote and underdeveloped areas. The development of digital ECG and AI methods could assist clinicians who need to diagnose arrhythmias outside of the hospital setting. Methods We constructed a large-scale Chinese ECG benchmark dataset using data from 272,753 patients collected from January 2017 to December 2021. The dataset contains ECG recordings from all common arrhythmias present in the Chinese population. Several experienced cardiologists from Shanghai First People’s Hospital labeled the dataset. We then developed a deep learning-based multi-label interpretable diagnostic model from the ECG recordings. We utilized Accuracy, F1 score and AUC-ROC to compare the performance of our model with that of the cardiologists, as well as with six comparison models, using testing and hidden data sets. Results The results show that our approach achieves an F1 score of 83.51%, an average AUC ROC score of 0.977, and 93.74% mean accuracy for 6 common arrhythmias. Results from the hidden dataset demonstrate the performance of our approach exceeds that of cardiologists. Our approach also highlights the diagnostic process. Conclusions Our diagnosis system has superior diagnostic performance over that of clinicians. It also has the potential to help clinicians rapidly identify abnormal regions on ECG recordings, thus improving efficiency and accuracy of clinical ECG diagnosis in China. This approach could therefore potentially improve the productivity of out-of-hospital ECG diagnosis and provides a promising prospect for telemedicine.
first_indexed 2024-03-07T14:44:06Z
format Article
id doaj.art-d6a8b5c4d7a244de8dc2316120817c1f
institution Directory Open Access Journal
issn 2730-664X
language English
last_indexed 2024-03-07T14:44:06Z
publishDate 2024-02-01
publisher Nature Portfolio
record_format Article
series Communications Medicine
spelling doaj.art-d6a8b5c4d7a244de8dc2316120817c1f2024-03-05T20:05:40ZengNature PortfolioCommunications Medicine2730-664X2024-02-01411810.1038/s43856-024-00464-4Cardiologist-level interpretable knowledge-fused deep neural network for automatic arrhythmia diagnosisYanrui Jin0Zhiyuan Li1Mengxiao Wang2Jinlei Liu3Yuanyuan Tian4Yunqing Liu5Xiaoyang Wei6Liqun Zhao7Chengliang Liu8State Key Laboratory of Mechanical System and Vibration, School of Mechanical Engineering, Shanghai Jiao Tong UniversityState Key Laboratory of Mechanical System and Vibration, School of Mechanical Engineering, Shanghai Jiao Tong UniversityState Key Laboratory of Mechanical System and Vibration, School of Mechanical Engineering, Shanghai Jiao Tong UniversityState Key Laboratory of Mechanical System and Vibration, School of Mechanical Engineering, Shanghai Jiao Tong UniversityState Key Laboratory of Mechanical System and Vibration, School of Mechanical Engineering, Shanghai Jiao Tong UniversityState Key Laboratory of Mechanical System and Vibration, School of Mechanical Engineering, Shanghai Jiao Tong UniversityState Key Laboratory of Mechanical System and Vibration, School of Mechanical Engineering, Shanghai Jiao Tong UniversityDepartment of cardiology, Shanghai First People’s Hospital Affiliated to Shanghai Jiao Tong UniversityState Key Laboratory of Mechanical System and Vibration, School of Mechanical Engineering, Shanghai Jiao Tong UniversityAbstract Background Long-term monitoring of Electrocardiogram (ECG) recordings is crucial to diagnose arrhythmias. Clinicians can find it challenging to diagnose arrhythmias, and this is a particular issue in more remote and underdeveloped areas. The development of digital ECG and AI methods could assist clinicians who need to diagnose arrhythmias outside of the hospital setting. Methods We constructed a large-scale Chinese ECG benchmark dataset using data from 272,753 patients collected from January 2017 to December 2021. The dataset contains ECG recordings from all common arrhythmias present in the Chinese population. Several experienced cardiologists from Shanghai First People’s Hospital labeled the dataset. We then developed a deep learning-based multi-label interpretable diagnostic model from the ECG recordings. We utilized Accuracy, F1 score and AUC-ROC to compare the performance of our model with that of the cardiologists, as well as with six comparison models, using testing and hidden data sets. Results The results show that our approach achieves an F1 score of 83.51%, an average AUC ROC score of 0.977, and 93.74% mean accuracy for 6 common arrhythmias. Results from the hidden dataset demonstrate the performance of our approach exceeds that of cardiologists. Our approach also highlights the diagnostic process. Conclusions Our diagnosis system has superior diagnostic performance over that of clinicians. It also has the potential to help clinicians rapidly identify abnormal regions on ECG recordings, thus improving efficiency and accuracy of clinical ECG diagnosis in China. This approach could therefore potentially improve the productivity of out-of-hospital ECG diagnosis and provides a promising prospect for telemedicine.https://doi.org/10.1038/s43856-024-00464-4
spellingShingle Yanrui Jin
Zhiyuan Li
Mengxiao Wang
Jinlei Liu
Yuanyuan Tian
Yunqing Liu
Xiaoyang Wei
Liqun Zhao
Chengliang Liu
Cardiologist-level interpretable knowledge-fused deep neural network for automatic arrhythmia diagnosis
Communications Medicine
title Cardiologist-level interpretable knowledge-fused deep neural network for automatic arrhythmia diagnosis
title_full Cardiologist-level interpretable knowledge-fused deep neural network for automatic arrhythmia diagnosis
title_fullStr Cardiologist-level interpretable knowledge-fused deep neural network for automatic arrhythmia diagnosis
title_full_unstemmed Cardiologist-level interpretable knowledge-fused deep neural network for automatic arrhythmia diagnosis
title_short Cardiologist-level interpretable knowledge-fused deep neural network for automatic arrhythmia diagnosis
title_sort cardiologist level interpretable knowledge fused deep neural network for automatic arrhythmia diagnosis
url https://doi.org/10.1038/s43856-024-00464-4
work_keys_str_mv AT yanruijin cardiologistlevelinterpretableknowledgefuseddeepneuralnetworkforautomaticarrhythmiadiagnosis
AT zhiyuanli cardiologistlevelinterpretableknowledgefuseddeepneuralnetworkforautomaticarrhythmiadiagnosis
AT mengxiaowang cardiologistlevelinterpretableknowledgefuseddeepneuralnetworkforautomaticarrhythmiadiagnosis
AT jinleiliu cardiologistlevelinterpretableknowledgefuseddeepneuralnetworkforautomaticarrhythmiadiagnosis
AT yuanyuantian cardiologistlevelinterpretableknowledgefuseddeepneuralnetworkforautomaticarrhythmiadiagnosis
AT yunqingliu cardiologistlevelinterpretableknowledgefuseddeepneuralnetworkforautomaticarrhythmiadiagnosis
AT xiaoyangwei cardiologistlevelinterpretableknowledgefuseddeepneuralnetworkforautomaticarrhythmiadiagnosis
AT liqunzhao cardiologistlevelinterpretableknowledgefuseddeepneuralnetworkforautomaticarrhythmiadiagnosis
AT chengliangliu cardiologistlevelinterpretableknowledgefuseddeepneuralnetworkforautomaticarrhythmiadiagnosis