Cross Data Set Generalization of Ultrasound Image Augmentation using Representation Learning: A Case Study

Data augmentation is a common method to make deep learning assessible on limited data sets. However, classical image augmentation methods result in highly unrealistic images on ultrasound data. Another approach is to utilize learning-based augmentation methods, e.g. based on variational autoencoders...

Full description

Bibliographic Details
Main Authors: Wulff Daniel, Mehdi Mohamad, Ernst Floris, Hagenah Jannis
Format: Article
Language:English
Published: De Gruyter 2021-10-01
Series:Current Directions in Biomedical Engineering
Subjects:
Online Access:https://doi.org/10.1515/cdbme-2021-2193
_version_ 1797989317618958336
author Wulff Daniel
Mehdi Mohamad
Ernst Floris
Hagenah Jannis
author_facet Wulff Daniel
Mehdi Mohamad
Ernst Floris
Hagenah Jannis
author_sort Wulff Daniel
collection DOAJ
description Data augmentation is a common method to make deep learning assessible on limited data sets. However, classical image augmentation methods result in highly unrealistic images on ultrasound data. Another approach is to utilize learning-based augmentation methods, e.g. based on variational autoencoders or generative adversarial networks. However, a large amount of data is necessary to train these models, which is typically not available in scenarios where data augmentation is needed. One solution for this problem could be a transfer of augmentation models between different medical imaging data sets. In this work, we present a qualitative study of the cross data set generalization performance of different learning-based augmentation methods for ultrasound image data. We could show that knowledge transfer is possible in ultrasound image augmentation and that the augmentation partially results in semantically meaningful transfers of structures, e.g. vessels, across domains.
first_indexed 2024-04-11T08:18:25Z
format Article
id doaj.art-a8dbfd825a6f4b0cb7e1018a3f68d09c
institution Directory Open Access Journal
issn 2364-5504
language English
last_indexed 2024-04-11T08:18:25Z
publishDate 2021-10-01
publisher De Gruyter
record_format Article
series Current Directions in Biomedical Engineering
spelling doaj.art-a8dbfd825a6f4b0cb7e1018a3f68d09c2022-12-22T04:35:04ZengDe GruyterCurrent Directions in Biomedical Engineering2364-55042021-10-017275575810.1515/cdbme-2021-2193Cross Data Set Generalization of Ultrasound Image Augmentation using Representation Learning: A Case StudyWulff Daniel0Mehdi Mohamad1Ernst Floris2Hagenah Jannis3Institute for Robotics and Cognitive Systems, University of Luebeck, Ratzeburger Allee 160, 23562Luebeck, GermanyInstitute for Robotics and Cognitive Systems, University of Luebeck, Ratzeburger Allee 160, 23562Luebeck, GermanyInstitute for Robotics and Cognitive Systems, University of Luebeck, Ratzeburger Allee 160, 23562Luebeck, GermanyComputational Health Informatics Lab, Institute of Biomedical Engineering, University of Oxford, Old Road Campus Research Building,OxfordOX3 7DQ, UKData augmentation is a common method to make deep learning assessible on limited data sets. However, classical image augmentation methods result in highly unrealistic images on ultrasound data. Another approach is to utilize learning-based augmentation methods, e.g. based on variational autoencoders or generative adversarial networks. However, a large amount of data is necessary to train these models, which is typically not available in scenarios where data augmentation is needed. One solution for this problem could be a transfer of augmentation models between different medical imaging data sets. In this work, we present a qualitative study of the cross data set generalization performance of different learning-based augmentation methods for ultrasound image data. We could show that knowledge transfer is possible in ultrasound image augmentation and that the augmentation partially results in semantically meaningful transfers of structures, e.g. vessels, across domains.https://doi.org/10.1515/cdbme-2021-21932d ultrasoundvariational autoencodergenerative adversarial networklatent space
spellingShingle Wulff Daniel
Mehdi Mohamad
Ernst Floris
Hagenah Jannis
Cross Data Set Generalization of Ultrasound Image Augmentation using Representation Learning: A Case Study
Current Directions in Biomedical Engineering
2d ultrasound
variational autoencoder
generative adversarial network
latent space
title Cross Data Set Generalization of Ultrasound Image Augmentation using Representation Learning: A Case Study
title_full Cross Data Set Generalization of Ultrasound Image Augmentation using Representation Learning: A Case Study
title_fullStr Cross Data Set Generalization of Ultrasound Image Augmentation using Representation Learning: A Case Study
title_full_unstemmed Cross Data Set Generalization of Ultrasound Image Augmentation using Representation Learning: A Case Study
title_short Cross Data Set Generalization of Ultrasound Image Augmentation using Representation Learning: A Case Study
title_sort cross data set generalization of ultrasound image augmentation using representation learning a case study
topic 2d ultrasound
variational autoencoder
generative adversarial network
latent space
url https://doi.org/10.1515/cdbme-2021-2193
work_keys_str_mv AT wulffdaniel crossdatasetgeneralizationofultrasoundimageaugmentationusingrepresentationlearningacasestudy
AT mehdimohamad crossdatasetgeneralizationofultrasoundimageaugmentationusingrepresentationlearningacasestudy
AT ernstfloris crossdatasetgeneralizationofultrasoundimageaugmentationusingrepresentationlearningacasestudy
AT hagenahjannis crossdatasetgeneralizationofultrasoundimageaugmentationusingrepresentationlearningacasestudy