Regularizing Label-Augmented Generative Adversarial Networks Under Limited Data
Training generative adversarial networks (GANs) using limited training data is challenging since the original discriminator is prone to overfitting. The recently proposed label augmentation technique complements categorical data augmentation approaches for discriminator, showing improved data effici...
| Main Author: | |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2023-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/10076457/ |
| _version_ | 1797859094899458048 |
|---|---|
| author | Liang Hou |
| author_facet | Liang Hou |
| author_sort | Liang Hou |
| collection | DOAJ |
| description | Training generative adversarial networks (GANs) using limited training data is challenging since the original discriminator is prone to overfitting. The recently proposed label augmentation technique complements categorical data augmentation approaches for discriminator, showing improved data efficiency in training GANs but lacks a theoretical basis. In this paper, we propose a novel regularization approach for the label-augmented discriminator to further improve the data efficiency of training GANs with a theoretical basis. Specifically, the proposed regularization adaptively constrains the predictions of the label-augmented discriminator on generated data to be close to the moving averages of its historical predictions on real data, and vice versa. We theoretically establish a connection between the objective function with the proposed regularization and a <inline-formula> <tex-math notation="LaTeX">$f$ </tex-math></inline-formula>-divergence that is more robust than the previous reversed Kullback-Leibler divergence. Experimental results on various datasets and diverse architectures show the significantly improved data efficiency of our proposed method compared to state-of-the-art data-efficient GAN training approaches for training GANs under limited training data regimes. |
| first_indexed | 2024-04-09T21:23:55Z |
| format | Article |
| id | doaj.art-87832c7edef54c00acab7a00609baae7 |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-04-09T21:23:55Z |
| publishDate | 2023-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-87832c7edef54c00acab7a00609baae72023-03-27T23:00:24ZengIEEEIEEE Access2169-35362023-01-0111289662897610.1109/ACCESS.2023.325906610076457Regularizing Label-Augmented Generative Adversarial Networks Under Limited DataLiang Hou0https://orcid.org/0000-0002-4904-5694Data Intelligence System Research Center, Institute of Computing Technology, Chinese Academy of Sciences, Beijing, ChinaTraining generative adversarial networks (GANs) using limited training data is challenging since the original discriminator is prone to overfitting. The recently proposed label augmentation technique complements categorical data augmentation approaches for discriminator, showing improved data efficiency in training GANs but lacks a theoretical basis. In this paper, we propose a novel regularization approach for the label-augmented discriminator to further improve the data efficiency of training GANs with a theoretical basis. Specifically, the proposed regularization adaptively constrains the predictions of the label-augmented discriminator on generated data to be close to the moving averages of its historical predictions on real data, and vice versa. We theoretically establish a connection between the objective function with the proposed regularization and a <inline-formula> <tex-math notation="LaTeX">$f$ </tex-math></inline-formula>-divergence that is more robust than the previous reversed Kullback-Leibler divergence. Experimental results on various datasets and diverse architectures show the significantly improved data efficiency of our proposed method compared to state-of-the-art data-efficient GAN training approaches for training GANs under limited training data regimes.https://ieeexplore.ieee.org/document/10076457/Generative adversarial networkslimited dataadaptive regularizationlabel augmentationdata augmentationself-supervised learning |
| spellingShingle | Liang Hou Regularizing Label-Augmented Generative Adversarial Networks Under Limited Data IEEE Access Generative adversarial networks limited data adaptive regularization label augmentation data augmentation self-supervised learning |
| title | Regularizing Label-Augmented Generative Adversarial Networks Under Limited Data |
| title_full | Regularizing Label-Augmented Generative Adversarial Networks Under Limited Data |
| title_fullStr | Regularizing Label-Augmented Generative Adversarial Networks Under Limited Data |
| title_full_unstemmed | Regularizing Label-Augmented Generative Adversarial Networks Under Limited Data |
| title_short | Regularizing Label-Augmented Generative Adversarial Networks Under Limited Data |
| title_sort | regularizing label augmented generative adversarial networks under limited data |
| topic | Generative adversarial networks limited data adaptive regularization label augmentation data augmentation self-supervised learning |
| url | https://ieeexplore.ieee.org/document/10076457/ |
| work_keys_str_mv | AT lianghou regularizinglabelaugmentedgenerativeadversarialnetworksunderlimiteddata |