Effect of Probabilistic Similarity Measure on Metric-Based Few-Shot Classification
In developing a few-shot classification model using deep networks, the limited number of samples in each class causes difficulty in utilizing statistical characteristics of the class distributions. In this paper, we propose a method to treat this difficulty by combining a probabilistic similarity ba...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2021-11-01
|
| Series: | Applied Sciences |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2076-3417/11/22/10977 |
| _version_ | 1827677386325360640 |
|---|---|
| author | Youngjae Lee Hyeyoung Park |
| author_facet | Youngjae Lee Hyeyoung Park |
| author_sort | Youngjae Lee |
| collection | DOAJ |
| description | In developing a few-shot classification model using deep networks, the limited number of samples in each class causes difficulty in utilizing statistical characteristics of the class distributions. In this paper, we propose a method to treat this difficulty by combining a probabilistic similarity based on intra-class statistics with a metric-based few-shot classification model. Noting that the probabilistic similarity estimated from intra-class statistics and the classifier of conventional few-shot classification models have a common assumption on the class distributions, we propose to apply the probabilistic similarity to obtain loss value for episodic learning of embedding network as well as to classify unseen test data. By defining the probabilistic similarity as the probability density of difference vectors between two samples with the same class label, it is possible to obtain a more reliable estimate of the similarity especially for the case of large number of classes. Through experiments on various benchmark data, we confirm that the probabilistic similarity can improve the classification performance, especially when the number of classes is large. |
| first_indexed | 2024-03-10T05:43:18Z |
| format | Article |
| id | doaj.art-7f50fb27736747cb881c6b3232758cdb |
| institution | Directory Open Access Journal |
| issn | 2076-3417 |
| language | English |
| last_indexed | 2024-03-10T05:43:18Z |
| publishDate | 2021-11-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Applied Sciences |
| spelling | doaj.art-7f50fb27736747cb881c6b3232758cdb2023-11-22T22:21:45ZengMDPI AGApplied Sciences2076-34172021-11-0111221097710.3390/app112210977Effect of Probabilistic Similarity Measure on Metric-Based Few-Shot ClassificationYoungjae Lee0Hyeyoung Park1School of Computer Science and Engineering, Kyungpook National University, Daegu 41566, KoreaSchool of Computer Science and Engineering, Kyungpook National University, Daegu 41566, KoreaIn developing a few-shot classification model using deep networks, the limited number of samples in each class causes difficulty in utilizing statistical characteristics of the class distributions. In this paper, we propose a method to treat this difficulty by combining a probabilistic similarity based on intra-class statistics with a metric-based few-shot classification model. Noting that the probabilistic similarity estimated from intra-class statistics and the classifier of conventional few-shot classification models have a common assumption on the class distributions, we propose to apply the probabilistic similarity to obtain loss value for episodic learning of embedding network as well as to classify unseen test data. By defining the probabilistic similarity as the probability density of difference vectors between two samples with the same class label, it is possible to obtain a more reliable estimate of the similarity especially for the case of large number of classes. Through experiments on various benchmark data, we confirm that the probabilistic similarity can improve the classification performance, especially when the number of classes is large.https://www.mdpi.com/2076-3417/11/22/10977few-shot classificationmetric-learningprobabilistic similarityintra-class statistics |
| spellingShingle | Youngjae Lee Hyeyoung Park Effect of Probabilistic Similarity Measure on Metric-Based Few-Shot Classification Applied Sciences few-shot classification metric-learning probabilistic similarity intra-class statistics |
| title | Effect of Probabilistic Similarity Measure on Metric-Based Few-Shot Classification |
| title_full | Effect of Probabilistic Similarity Measure on Metric-Based Few-Shot Classification |
| title_fullStr | Effect of Probabilistic Similarity Measure on Metric-Based Few-Shot Classification |
| title_full_unstemmed | Effect of Probabilistic Similarity Measure on Metric-Based Few-Shot Classification |
| title_short | Effect of Probabilistic Similarity Measure on Metric-Based Few-Shot Classification |
| title_sort | effect of probabilistic similarity measure on metric based few shot classification |
| topic | few-shot classification metric-learning probabilistic similarity intra-class statistics |
| url | https://www.mdpi.com/2076-3417/11/22/10977 |
| work_keys_str_mv | AT youngjaelee effectofprobabilisticsimilaritymeasureonmetricbasedfewshotclassification AT hyeyoungpark effectofprobabilisticsimilaritymeasureonmetricbasedfewshotclassification |