Knowledge-enhanced prototypical network with class cluster loss for few-shot relation classification.
Few-shot Relation Classification identifies the relation between target entity pairs in unstructured natural language texts by training on a small number of labeled samples. Recent prototype network-based studies have focused on enhancing the prototype representation capability of models by incorpor...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Public Library of Science (PLoS)
2023-01-01
|
| Series: | PLoS ONE |
| Online Access: | https://doi.org/10.1371/journal.pone.0286915 |
| _version_ | 1797394426478198784 |
|---|---|
| author | Tao Liu Zunwang Ke Yanbing Li Wushour Silamu |
| author_facet | Tao Liu Zunwang Ke Yanbing Li Wushour Silamu |
| author_sort | Tao Liu |
| collection | DOAJ |
| description | Few-shot Relation Classification identifies the relation between target entity pairs in unstructured natural language texts by training on a small number of labeled samples. Recent prototype network-based studies have focused on enhancing the prototype representation capability of models by incorporating external knowledge. However, the majority of these works constrain the representation of class prototypes implicitly through complex network structures, such as multi-attention mechanisms, graph neural networks, and contrastive learning, which constrict the model's ability to generalize. In addition, most models with triplet loss disregard intra-class compactness during model training, thereby limiting the model's ability to handle outlier samples with low semantic similarity. Therefore, this paper proposes a non-weighted prototype enhancement module that uses the feature-level similarity between prototypes and relation information as a gate to filter and complete features. Meanwhile, we design a class cluster loss that samples difficult positive and negative samples and explicitly constrains both intra-class compactness and inter-class separability to learn a metric space with high discriminability. Extensive experiments were done on the publicly available dataset FewRel 1.0 and 2.0, and the results show the effectiveness of the proposed model. |
| first_indexed | 2024-03-09T00:19:32Z |
| format | Article |
| id | doaj.art-ac6c6e68231a480e8f505b9afcc01714 |
| institution | Directory Open Access Journal |
| issn | 1932-6203 |
| language | English |
| last_indexed | 2024-03-09T00:19:32Z |
| publishDate | 2023-01-01 |
| publisher | Public Library of Science (PLoS) |
| record_format | Article |
| series | PLoS ONE |
| spelling | doaj.art-ac6c6e68231a480e8f505b9afcc017142023-12-12T05:36:39ZengPublic Library of Science (PLoS)PLoS ONE1932-62032023-01-01186e028691510.1371/journal.pone.0286915Knowledge-enhanced prototypical network with class cluster loss for few-shot relation classification.Tao LiuZunwang KeYanbing LiWushour SilamuFew-shot Relation Classification identifies the relation between target entity pairs in unstructured natural language texts by training on a small number of labeled samples. Recent prototype network-based studies have focused on enhancing the prototype representation capability of models by incorporating external knowledge. However, the majority of these works constrain the representation of class prototypes implicitly through complex network structures, such as multi-attention mechanisms, graph neural networks, and contrastive learning, which constrict the model's ability to generalize. In addition, most models with triplet loss disregard intra-class compactness during model training, thereby limiting the model's ability to handle outlier samples with low semantic similarity. Therefore, this paper proposes a non-weighted prototype enhancement module that uses the feature-level similarity between prototypes and relation information as a gate to filter and complete features. Meanwhile, we design a class cluster loss that samples difficult positive and negative samples and explicitly constrains both intra-class compactness and inter-class separability to learn a metric space with high discriminability. Extensive experiments were done on the publicly available dataset FewRel 1.0 and 2.0, and the results show the effectiveness of the proposed model.https://doi.org/10.1371/journal.pone.0286915 |
| spellingShingle | Tao Liu Zunwang Ke Yanbing Li Wushour Silamu Knowledge-enhanced prototypical network with class cluster loss for few-shot relation classification. PLoS ONE |
| title | Knowledge-enhanced prototypical network with class cluster loss for few-shot relation classification. |
| title_full | Knowledge-enhanced prototypical network with class cluster loss for few-shot relation classification. |
| title_fullStr | Knowledge-enhanced prototypical network with class cluster loss for few-shot relation classification. |
| title_full_unstemmed | Knowledge-enhanced prototypical network with class cluster loss for few-shot relation classification. |
| title_short | Knowledge-enhanced prototypical network with class cluster loss for few-shot relation classification. |
| title_sort | knowledge enhanced prototypical network with class cluster loss for few shot relation classification |
| url | https://doi.org/10.1371/journal.pone.0286915 |
| work_keys_str_mv | AT taoliu knowledgeenhancedprototypicalnetworkwithclassclusterlossforfewshotrelationclassification AT zunwangke knowledgeenhancedprototypicalnetworkwithclassclusterlossforfewshotrelationclassification AT yanbingli knowledgeenhancedprototypicalnetworkwithclassclusterlossforfewshotrelationclassification AT wushoursilamu knowledgeenhancedprototypicalnetworkwithclassclusterlossforfewshotrelationclassification |