Efficient Image Matching with Distributions of Local Invariant Features
Sets of local features that are invariant to common image transformations are an effective representation to use when comparing images; current methods typically judge feature sets' similarity via a voting scheme (which ignores co-occurrence statistics) or by comparing histograms over a set of...
| Main Authors: | , |
|---|---|
| Language: | en_US |
| Published: |
2005
|
| Subjects: | |
| Online Access: | http://hdl.handle.net/1721.1/30505 |
| _version_ | 1811079427582328832 |
|---|---|
| author | Grauman, Kristen Darrell, Trevor |
| author_facet | Grauman, Kristen Darrell, Trevor |
| author_sort | Grauman, Kristen |
| collection | MIT |
| description | Sets of local features that are invariant to common image transformations are an effective representation to use when comparing images; current methods typically judge feature sets' similarity via a voting scheme (which ignores co-occurrence statistics) or by comparing histograms over a set of prototypes (which must be found by clustering). We present a method for efficiently comparing images based on their discrete distributions (bags) of distinctive local invariant features, without clustering descriptors. Similarity between images is measured with an approximation of the Earth Mover's Distance (EMD), which quickly computes the minimal-cost correspondence between two bags of features. Each image's feature distribution is mapped into a normed space with a low-distortion embedding of EMD. Examples most similar to a novel query image are retrieved in time sublinear in the number of examples via approximate nearest neighbor search in the embedded space. We also show how the feature representation may be extended to encode the distribution of geometric constraints between the invariant features appearing in each image.We evaluate our technique with scene recognition and texture classification tasks. |
| first_indexed | 2024-09-23T11:14:50Z |
| id | mit-1721.1/30505 |
| institution | Massachusetts Institute of Technology |
| language | en_US |
| last_indexed | 2024-09-23T11:14:50Z |
| publishDate | 2005 |
| record_format | dspace |
| spelling | mit-1721.1/305052019-04-12T08:37:52Z Efficient Image Matching with Distributions of Local Invariant Features Grauman, Kristen Darrell, Trevor AI image matching object recognition content-based image retrieval texture Sets of local features that are invariant to common image transformations are an effective representation to use when comparing images; current methods typically judge feature sets' similarity via a voting scheme (which ignores co-occurrence statistics) or by comparing histograms over a set of prototypes (which must be found by clustering). We present a method for efficiently comparing images based on their discrete distributions (bags) of distinctive local invariant features, without clustering descriptors. Similarity between images is measured with an approximation of the Earth Mover's Distance (EMD), which quickly computes the minimal-cost correspondence between two bags of features. Each image's feature distribution is mapped into a normed space with a low-distortion embedding of EMD. Examples most similar to a novel query image are retrieved in time sublinear in the number of examples via approximate nearest neighbor search in the embedded space. We also show how the feature representation may be extended to encode the distribution of geometric constraints between the invariant features appearing in each image.We evaluate our technique with scene recognition and texture classification tasks. 2005-12-22T02:16:07Z 2005-12-22T02:16:07Z 2004-11-22 MIT-CSAIL-TR-2004-075 AIM-2004-027 http://hdl.handle.net/1721.1/30505 en_US Massachusetts Institute of Technology Computer Science and Artificial Intelligence Laboratory 18 p. 78764149 bytes 16484168 bytes application/postscript application/pdf application/postscript application/pdf |
| spellingShingle | AI image matching object recognition content-based image retrieval texture Grauman, Kristen Darrell, Trevor Efficient Image Matching with Distributions of Local Invariant Features |
| title | Efficient Image Matching with Distributions of Local Invariant Features |
| title_full | Efficient Image Matching with Distributions of Local Invariant Features |
| title_fullStr | Efficient Image Matching with Distributions of Local Invariant Features |
| title_full_unstemmed | Efficient Image Matching with Distributions of Local Invariant Features |
| title_short | Efficient Image Matching with Distributions of Local Invariant Features |
| title_sort | efficient image matching with distributions of local invariant features |
| topic | AI image matching object recognition content-based image retrieval texture |
| url | http://hdl.handle.net/1721.1/30505 |
| work_keys_str_mv | AT graumankristen efficientimagematchingwithdistributionsoflocalinvariantfeatures AT darrelltrevor efficientimagematchingwithdistributionsoflocalinvariantfeatures |