A Generative Model for category text generation

The neural network model has been the fulcrum of the so-called AI revolution. Although very powerful for pattern-recognition tasks, however, the model has two main drawbacks: it tends to overfit when the training dataset is small, and it is unable to accurately capture category information when the...

Full description

Bibliographic Details
Main Authors: Li, Yang, Pan, Quan, Wang, Suhang, Yang, Tao, Cambria, Erik
Other Authors: School of Computer Science and Engineering
Format: Journal Article
Language:English
Published: 2020
Subjects:
Online Access:https://hdl.handle.net/10356/142638
_version_ 1811695701229305856
author Li, Yang
Pan, Quan
Wang, Suhang
Yang, Tao
Cambria, Erik
author2 School of Computer Science and Engineering
author_facet School of Computer Science and Engineering
Li, Yang
Pan, Quan
Wang, Suhang
Yang, Tao
Cambria, Erik
author_sort Li, Yang
collection NTU
description The neural network model has been the fulcrum of the so-called AI revolution. Although very powerful for pattern-recognition tasks, however, the model has two main drawbacks: it tends to overfit when the training dataset is small, and it is unable to accurately capture category information when the class number is large. In this paper, we combine reinforcement learning, generative adversarial networks, and recurrent neural networks to build a new model, termed category sentence generative adversarial network (CS-GAN). Not only the proposed model is able to generate category sentences that enlarge the original dataset, but also it helps improve its generalization capability during supervised training. We evaluate the performance of CS-GAN for the task of sentiment analysis. Quantitative evaluation exhibits the accuracy improvement in polarity detection on a small dataset with high category information.
first_indexed 2024-10-01T07:27:39Z
format Journal Article
id ntu-10356/142638
institution Nanyang Technological University
language English
last_indexed 2024-10-01T07:27:39Z
publishDate 2020
record_format dspace
spelling ntu-10356/1426382020-06-26T01:47:33Z A Generative Model for category text generation Li, Yang Pan, Quan Wang, Suhang Yang, Tao Cambria, Erik School of Computer Science and Engineering Engineering::Computer science and engineering Category Sentence Generation Generative Adversarial Networks The neural network model has been the fulcrum of the so-called AI revolution. Although very powerful for pattern-recognition tasks, however, the model has two main drawbacks: it tends to overfit when the training dataset is small, and it is unable to accurately capture category information when the class number is large. In this paper, we combine reinforcement learning, generative adversarial networks, and recurrent neural networks to build a new model, termed category sentence generative adversarial network (CS-GAN). Not only the proposed model is able to generate category sentences that enlarge the original dataset, but also it helps improve its generalization capability during supervised training. We evaluate the performance of CS-GAN for the task of sentiment analysis. Quantitative evaluation exhibits the accuracy improvement in polarity detection on a small dataset with high category information. 2020-06-26T01:47:33Z 2020-06-26T01:47:33Z 2018 Journal Article Li, Y., Pan, Q., Wang, S., Yang, T., & Cambria, E. (2018). A Generative Model for category text generation. Information Sciences, 450, 301-315. doi:10.1016/j.ins.2018.03.050 0020-0255 https://hdl.handle.net/10356/142638 10.1016/j.ins.2018.03.050 2-s2.0-85044670076 450 301 315 en Information Sciences © 2018 Elsevier Inc. All rights reserved.
spellingShingle Engineering::Computer science and engineering
Category Sentence Generation
Generative Adversarial Networks
Li, Yang
Pan, Quan
Wang, Suhang
Yang, Tao
Cambria, Erik
A Generative Model for category text generation
title A Generative Model for category text generation
title_full A Generative Model for category text generation
title_fullStr A Generative Model for category text generation
title_full_unstemmed A Generative Model for category text generation
title_short A Generative Model for category text generation
title_sort generative model for category text generation
topic Engineering::Computer science and engineering
Category Sentence Generation
Generative Adversarial Networks
url https://hdl.handle.net/10356/142638
work_keys_str_mv AT liyang agenerativemodelforcategorytextgeneration
AT panquan agenerativemodelforcategorytextgeneration
AT wangsuhang agenerativemodelforcategorytextgeneration
AT yangtao agenerativemodelforcategorytextgeneration
AT cambriaerik agenerativemodelforcategorytextgeneration
AT liyang generativemodelforcategorytextgeneration
AT panquan generativemodelforcategorytextgeneration
AT wangsuhang generativemodelforcategorytextgeneration
AT yangtao generativemodelforcategorytextgeneration
AT cambriaerik generativemodelforcategorytextgeneration