A clinical deep learning framework for continually learning from cardiac signals across diseases, time, modalities, and institutions.
Deep learning algorithms trained on instances that violate the assumption of being independent and identically distributed (i.i.d.) are known to experience destructive interference, a phenomenon characterized by a degradation in performance. Such a violation, however, is ubiquitous in clinical setti...
| Main Authors: | , , |
|---|---|
| Format: | Journal article |
| Language: | English |
| Published: |
Springer Nature
2021
|
| _version_ | 1797070577013358592 |
|---|---|
| author | Kiyasseh, D Zhu, T Clifton, D |
| author_facet | Kiyasseh, D Zhu, T Clifton, D |
| author_sort | Kiyasseh, D |
| collection | OXFORD |
| description | Deep learning algorithms trained on instances that violate the assumption of being independent and identically distributed (i.i.d.) are known to experience destructive interference, a phenomenon characterized by a degradation in performance. Such a violation, however, is ubiquitous in clinical settings where data are streamed temporally from different clinical sites and from a multitude of physiological sensors. To mitigate this interference, we propose a continual learning strategy, entitled CLOPS, that employs a replay buffer. To guide the storage of instances into the buffer, we propose end-to-end trainable parameters, termed task-instance parameters, that quantify the difficulty with which data points are classified by a deep-learning system. We validate the interpretation of these parameters via clinical domain knowledge. To replay instances from the buffer, we exploit uncertainty-based acquisition functions. In three of the four continual learning scenarios, reflecting transitions across diseases, time, data modalities, and healthcare institutions, we show that CLOPS outperforms the state-of-the-art methods, GEM1 and MIR2. We also conduct extensive ablation studies to demonstrate the necessity of the various components of our proposed strategy. Our framework has the potential to pave the way for diagnostic systems that remain robust over time. |
| first_indexed | 2024-03-06T22:40:52Z |
| format | Journal article |
| id | oxford-uuid:5b7eb25c-a488-47df-9f4f-aace97b4acd2 |
| institution | University of Oxford |
| language | English |
| last_indexed | 2024-03-06T22:40:52Z |
| publishDate | 2021 |
| publisher | Springer Nature |
| record_format | dspace |
| spelling | oxford-uuid:5b7eb25c-a488-47df-9f4f-aace97b4acd22022-03-26T17:22:28ZA clinical deep learning framework for continually learning from cardiac signals across diseases, time, modalities, and institutions.Journal articlehttp://purl.org/coar/resource_type/c_dcae04bcuuid:5b7eb25c-a488-47df-9f4f-aace97b4acd2EnglishSymplectic ElementsSpringer Nature2021Kiyasseh, DZhu, TClifton, DDeep learning algorithms trained on instances that violate the assumption of being independent and identically distributed (i.i.d.) are known to experience destructive interference, a phenomenon characterized by a degradation in performance. Such a violation, however, is ubiquitous in clinical settings where data are streamed temporally from different clinical sites and from a multitude of physiological sensors. To mitigate this interference, we propose a continual learning strategy, entitled CLOPS, that employs a replay buffer. To guide the storage of instances into the buffer, we propose end-to-end trainable parameters, termed task-instance parameters, that quantify the difficulty with which data points are classified by a deep-learning system. We validate the interpretation of these parameters via clinical domain knowledge. To replay instances from the buffer, we exploit uncertainty-based acquisition functions. In three of the four continual learning scenarios, reflecting transitions across diseases, time, data modalities, and healthcare institutions, we show that CLOPS outperforms the state-of-the-art methods, GEM1 and MIR2. We also conduct extensive ablation studies to demonstrate the necessity of the various components of our proposed strategy. Our framework has the potential to pave the way for diagnostic systems that remain robust over time. |
| spellingShingle | Kiyasseh, D Zhu, T Clifton, D A clinical deep learning framework for continually learning from cardiac signals across diseases, time, modalities, and institutions. |
| title | A clinical deep learning framework for continually learning from cardiac signals across diseases, time, modalities, and institutions. |
| title_full | A clinical deep learning framework for continually learning from cardiac signals across diseases, time, modalities, and institutions. |
| title_fullStr | A clinical deep learning framework for continually learning from cardiac signals across diseases, time, modalities, and institutions. |
| title_full_unstemmed | A clinical deep learning framework for continually learning from cardiac signals across diseases, time, modalities, and institutions. |
| title_short | A clinical deep learning framework for continually learning from cardiac signals across diseases, time, modalities, and institutions. |
| title_sort | clinical deep learning framework for continually learning from cardiac signals across diseases time modalities and institutions |
| work_keys_str_mv | AT kiyassehd aclinicaldeeplearningframeworkforcontinuallylearningfromcardiacsignalsacrossdiseasestimemodalitiesandinstitutions AT zhut aclinicaldeeplearningframeworkforcontinuallylearningfromcardiacsignalsacrossdiseasestimemodalitiesandinstitutions AT cliftond aclinicaldeeplearningframeworkforcontinuallylearningfromcardiacsignalsacrossdiseasestimemodalitiesandinstitutions AT kiyassehd clinicaldeeplearningframeworkforcontinuallylearningfromcardiacsignalsacrossdiseasestimemodalitiesandinstitutions AT zhut clinicaldeeplearningframeworkforcontinuallylearningfromcardiacsignalsacrossdiseasestimemodalitiesandinstitutions AT cliftond clinicaldeeplearningframeworkforcontinuallylearningfromcardiacsignalsacrossdiseasestimemodalitiesandinstitutions |