Improving Classification Performance with Statistically Weighted Dimensions and Dimensionality Reduction
In image classification, various techniques have been developed to enhance the performance of principal component analysis (PCA) dimension reduction techniques with guiding weighting features to remove redundant and irrelevant features. This study proposes the statistically weighted dimension techni...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2023-02-01
|
| Series: | Applied Sciences |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2076-3417/13/3/2005 |
| _version_ | 1797625032600453120 |
|---|---|
| author | Uraiwan Buatoom Muhammad Usman Jamil |
| author_facet | Uraiwan Buatoom Muhammad Usman Jamil |
| author_sort | Uraiwan Buatoom |
| collection | DOAJ |
| description | In image classification, various techniques have been developed to enhance the performance of principal component analysis (PCA) dimension reduction techniques with guiding weighting features to remove redundant and irrelevant features. This study proposes the statistically weighted dimension technique based on three distribution-related class behaviors; collection-class, inter-class, and intra-class to enhance the feature-extraction ability before using PCA for feature selection. The data from the statistics-weighted dimension spaces is utilized to reduce dimensionality by reducing the large index data into smaller index data using PCA. The new principal component from the weighted training part by an unlabeled dataset is constructed and then the image is classified efficiently. Additionally, the weighting direction investigates the pros and cons of promoting and demoting to determine the worst or best option utilizing the exponents of three proposed weighted scheme. The experiment is conducted using three datasets, MNIST, E-MNIST, and F-MNIST, along with three image classification algorithms, logistic Regression, KNN, and SVM (RBF). The results clearly demonstrate that the statistically weighted dimension feature can improve the conventional classification accuracy in lower dimensions with an appropriate combination of weighting nearly 3% for the best solution on dimensionality reduction by more than 50%. |
| first_indexed | 2024-03-11T09:51:06Z |
| format | Article |
| id | doaj.art-74fb706910fb41edbae804cd7f2fd41f |
| institution | Directory Open Access Journal |
| issn | 2076-3417 |
| language | English |
| last_indexed | 2024-03-11T09:51:06Z |
| publishDate | 2023-02-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Applied Sciences |
| spelling | doaj.art-74fb706910fb41edbae804cd7f2fd41f2023-11-16T16:13:25ZengMDPI AGApplied Sciences2076-34172023-02-01133200510.3390/app13032005Improving Classification Performance with Statistically Weighted Dimensions and Dimensionality ReductionUraiwan Buatoom0Muhammad Usman Jamil1Faculty of Science and Arts, Chanthaburi Campus, Burapha University, Chanthaburi 22170, ThailandDepartment of Electrical and Computer Engineering, Assumption University, Samut Prakan 10570, ThailandIn image classification, various techniques have been developed to enhance the performance of principal component analysis (PCA) dimension reduction techniques with guiding weighting features to remove redundant and irrelevant features. This study proposes the statistically weighted dimension technique based on three distribution-related class behaviors; collection-class, inter-class, and intra-class to enhance the feature-extraction ability before using PCA for feature selection. The data from the statistics-weighted dimension spaces is utilized to reduce dimensionality by reducing the large index data into smaller index data using PCA. The new principal component from the weighted training part by an unlabeled dataset is constructed and then the image is classified efficiently. Additionally, the weighting direction investigates the pros and cons of promoting and demoting to determine the worst or best option utilizing the exponents of three proposed weighted scheme. The experiment is conducted using three datasets, MNIST, E-MNIST, and F-MNIST, along with three image classification algorithms, logistic Regression, KNN, and SVM (RBF). The results clearly demonstrate that the statistically weighted dimension feature can improve the conventional classification accuracy in lower dimensions with an appropriate combination of weighting nearly 3% for the best solution on dimensionality reduction by more than 50%.https://www.mdpi.com/2076-3417/13/3/2005statistically weighted dimensionfeature weightingdimension reductionclass charactercollection-classinter-class |
| spellingShingle | Uraiwan Buatoom Muhammad Usman Jamil Improving Classification Performance with Statistically Weighted Dimensions and Dimensionality Reduction Applied Sciences statistically weighted dimension feature weighting dimension reduction class character collection-class inter-class |
| title | Improving Classification Performance with Statistically Weighted Dimensions and Dimensionality Reduction |
| title_full | Improving Classification Performance with Statistically Weighted Dimensions and Dimensionality Reduction |
| title_fullStr | Improving Classification Performance with Statistically Weighted Dimensions and Dimensionality Reduction |
| title_full_unstemmed | Improving Classification Performance with Statistically Weighted Dimensions and Dimensionality Reduction |
| title_short | Improving Classification Performance with Statistically Weighted Dimensions and Dimensionality Reduction |
| title_sort | improving classification performance with statistically weighted dimensions and dimensionality reduction |
| topic | statistically weighted dimension feature weighting dimension reduction class character collection-class inter-class |
| url | https://www.mdpi.com/2076-3417/13/3/2005 |
| work_keys_str_mv | AT uraiwanbuatoom improvingclassificationperformancewithstatisticallyweighteddimensionsanddimensionalityreduction AT muhammadusmanjamil improvingclassificationperformancewithstatisticallyweighteddimensionsanddimensionalityreduction |