Self-aware SGD: reliable incremental adaptation framework for clinical AI models
Healthcare is dynamic as demographics, diseases, and therapeutics constantly evolve. This dynamic nature induces inevitable distribution shifts in populations targeted by clinical AI models, often rendering them ineffective. Incremental learning provides an effective method of adapting deployed clin...
| Main Authors: | , , , , |
|---|---|
| Format: | Journal article |
| Language: | English |
| Published: |
IEEE
2023
|
| _version_ | 1797109929481338880 |
|---|---|
| author | Thakur, A Armstrong, J Youssef, A Eyre, D Clifton, DA |
| author_facet | Thakur, A Armstrong, J Youssef, A Eyre, D Clifton, DA |
| author_sort | Thakur, A |
| collection | OXFORD |
| description | Healthcare is dynamic as demographics, diseases, and therapeutics constantly evolve. This dynamic nature induces inevitable distribution shifts in populations targeted by clinical AI models, often rendering them ineffective. Incremental learning provides an effective method of adapting deployed clinical models to accommodate these contemporary distribution shifts. However, since incremental learning involves modifying a deployed or in-use model, it can be considered unreliable as any adverse modification due to maliciously compromised or incorrectly labelled data can make the model unsuitable for the targeted application. This paper introduces self-aware stochastic gradient descent (SGD) , an incremental deep learning algorithm that utilises a contextual bandit-like sanity check to only allow reliable modifications to a model. The contextual bandit analyses incremental gradient updates to isolate and filter unreliable gradients. This behaviour allows self-aware SGD to balance incremental training and integrity of a deployed model. Experimental evaluations on the Oxford University Hospital datasets highlight that self-aware SGD can provide reliable incremental updates for overcoming distribution shifts in challenging conditions induced by label noise. |
| first_indexed | 2024-03-07T07:48:04Z |
| format | Journal article |
| id | oxford-uuid:2a2e0eb2-8eb4-4fc5-ad55-71b52d016487 |
| institution | University of Oxford |
| language | English |
| last_indexed | 2024-03-07T07:48:04Z |
| publishDate | 2023 |
| publisher | IEEE |
| record_format | dspace |
| spelling | oxford-uuid:2a2e0eb2-8eb4-4fc5-ad55-71b52d0164872023-06-23T17:07:42ZSelf-aware SGD: reliable incremental adaptation framework for clinical AI modelsJournal articlehttp://purl.org/coar/resource_type/c_dcae04bcuuid:2a2e0eb2-8eb4-4fc5-ad55-71b52d016487EnglishSymplectic ElementsIEEE2023Thakur, AArmstrong, JYoussef, AEyre, DClifton, DAHealthcare is dynamic as demographics, diseases, and therapeutics constantly evolve. This dynamic nature induces inevitable distribution shifts in populations targeted by clinical AI models, often rendering them ineffective. Incremental learning provides an effective method of adapting deployed clinical models to accommodate these contemporary distribution shifts. However, since incremental learning involves modifying a deployed or in-use model, it can be considered unreliable as any adverse modification due to maliciously compromised or incorrectly labelled data can make the model unsuitable for the targeted application. This paper introduces self-aware stochastic gradient descent (SGD) , an incremental deep learning algorithm that utilises a contextual bandit-like sanity check to only allow reliable modifications to a model. The contextual bandit analyses incremental gradient updates to isolate and filter unreliable gradients. This behaviour allows self-aware SGD to balance incremental training and integrity of a deployed model. Experimental evaluations on the Oxford University Hospital datasets highlight that self-aware SGD can provide reliable incremental updates for overcoming distribution shifts in challenging conditions induced by label noise. |
| spellingShingle | Thakur, A Armstrong, J Youssef, A Eyre, D Clifton, DA Self-aware SGD: reliable incremental adaptation framework for clinical AI models |
| title | Self-aware SGD: reliable incremental adaptation framework for clinical AI models |
| title_full | Self-aware SGD: reliable incremental adaptation framework for clinical AI models |
| title_fullStr | Self-aware SGD: reliable incremental adaptation framework for clinical AI models |
| title_full_unstemmed | Self-aware SGD: reliable incremental adaptation framework for clinical AI models |
| title_short | Self-aware SGD: reliable incremental adaptation framework for clinical AI models |
| title_sort | self aware sgd reliable incremental adaptation framework for clinical ai models |
| work_keys_str_mv | AT thakura selfawaresgdreliableincrementaladaptationframeworkforclinicalaimodels AT armstrongj selfawaresgdreliableincrementaladaptationframeworkforclinicalaimodels AT youssefa selfawaresgdreliableincrementaladaptationframeworkforclinicalaimodels AT eyred selfawaresgdreliableincrementaladaptationframeworkforclinicalaimodels AT cliftonda selfawaresgdreliableincrementaladaptationframeworkforclinicalaimodels |