An Enhancement to the Spatial Pyramid Matching for Image Classification and Retrieval
Spatial pyramid matching (SPM) is one of the widely used methods to incorporate spatial information into the image representation. Despite its effectiveness, the traditional SPM is not rotation invariant. A rotation invariant SPM has been proposed in the literature but it has many limitations regard...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2020-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/8970551/ |
| _version_ | 1818854666340925440 |
|---|---|
| author | Priyabrata Karmakar Shyh Wei Teng Guojun Lu Dengsheng Zhang |
| author_facet | Priyabrata Karmakar Shyh Wei Teng Guojun Lu Dengsheng Zhang |
| author_sort | Priyabrata Karmakar |
| collection | DOAJ |
| description | Spatial pyramid matching (SPM) is one of the widely used methods to incorporate spatial information into the image representation. Despite its effectiveness, the traditional SPM is not rotation invariant. A rotation invariant SPM has been proposed in the literature but it has many limitations regarding the effectiveness. In this paper, we investigate how to make SPM robust to rotation by addressing those limitations. In an SPM framework, an image is divided into an increasing number of partitions at different pyramid levels. In this paper, our main focus is on how to partition images in such a way that the resulting structure can deal with image-level rotations. To do that, we investigate three concentric ring partitioning schemes. Apart from image partitioning, another important component of the SPM framework is a weight function. To apportion the contribution of each pyramid level to the final matching between two images, the weight function is needed. In this paper, we propose a new weight function which is suitable for the rotation-invariant SPM structure. Experiments based on image classification and retrieval are performed on five image databases. The detailed result analysis shows that we are successful in enhancing the effectiveness of SPM for image classification and retrieval. |
| first_indexed | 2024-12-19T07:56:20Z |
| format | Article |
| id | doaj.art-a14568ca25d8457698dfe12736bdca7c |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-12-19T07:56:20Z |
| publishDate | 2020-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-a14568ca25d8457698dfe12736bdca7c2022-12-21T20:30:00ZengIEEEIEEE Access2169-35362020-01-018224632247210.1109/ACCESS.2020.29697838970551An Enhancement to the Spatial Pyramid Matching for Image Classification and RetrievalPriyabrata Karmakar0https://orcid.org/0000-0001-8015-1375Shyh Wei Teng1Guojun Lu2Dengsheng Zhang3School of Science, Engineering and Information Technology, Federation University Australia, Gippsland Campus, Churchill, VIC, AustraliaSchool of Science, Engineering and Information Technology, Federation University Australia, Gippsland Campus, Churchill, VIC, AustraliaSchool of Science, Engineering and Information Technology, Federation University Australia, Gippsland Campus, Churchill, VIC, AustraliaSchool of Science, Engineering and Information Technology, Federation University Australia, Gippsland Campus, Churchill, VIC, AustraliaSpatial pyramid matching (SPM) is one of the widely used methods to incorporate spatial information into the image representation. Despite its effectiveness, the traditional SPM is not rotation invariant. A rotation invariant SPM has been proposed in the literature but it has many limitations regarding the effectiveness. In this paper, we investigate how to make SPM robust to rotation by addressing those limitations. In an SPM framework, an image is divided into an increasing number of partitions at different pyramid levels. In this paper, our main focus is on how to partition images in such a way that the resulting structure can deal with image-level rotations. To do that, we investigate three concentric ring partitioning schemes. Apart from image partitioning, another important component of the SPM framework is a weight function. To apportion the contribution of each pyramid level to the final matching between two images, the weight function is needed. In this paper, we propose a new weight function which is suitable for the rotation-invariant SPM structure. Experiments based on image classification and retrieval are performed on five image databases. The detailed result analysis shows that we are successful in enhancing the effectiveness of SPM for image classification and retrieval.https://ieeexplore.ieee.org/document/8970551/Spatial pyramid matchingrotation invarianceimage classificationimage retrieval |
| spellingShingle | Priyabrata Karmakar Shyh Wei Teng Guojun Lu Dengsheng Zhang An Enhancement to the Spatial Pyramid Matching for Image Classification and Retrieval IEEE Access Spatial pyramid matching rotation invariance image classification image retrieval |
| title | An Enhancement to the Spatial Pyramid Matching for Image Classification and Retrieval |
| title_full | An Enhancement to the Spatial Pyramid Matching for Image Classification and Retrieval |
| title_fullStr | An Enhancement to the Spatial Pyramid Matching for Image Classification and Retrieval |
| title_full_unstemmed | An Enhancement to the Spatial Pyramid Matching for Image Classification and Retrieval |
| title_short | An Enhancement to the Spatial Pyramid Matching for Image Classification and Retrieval |
| title_sort | enhancement to the spatial pyramid matching for image classification and retrieval |
| topic | Spatial pyramid matching rotation invariance image classification image retrieval |
| url | https://ieeexplore.ieee.org/document/8970551/ |
| work_keys_str_mv | AT priyabratakarmakar anenhancementtothespatialpyramidmatchingforimageclassificationandretrieval AT shyhweiteng anenhancementtothespatialpyramidmatchingforimageclassificationandretrieval AT guojunlu anenhancementtothespatialpyramidmatchingforimageclassificationandretrieval AT dengshengzhang anenhancementtothespatialpyramidmatchingforimageclassificationandretrieval AT priyabratakarmakar enhancementtothespatialpyramidmatchingforimageclassificationandretrieval AT shyhweiteng enhancementtothespatialpyramidmatchingforimageclassificationandretrieval AT guojunlu enhancementtothespatialpyramidmatchingforimageclassificationandretrieval AT dengshengzhang enhancementtothespatialpyramidmatchingforimageclassificationandretrieval |