Learning covariant feature detectors
Local covariant feature detection, namely the problem of extracting viewpoint invariant features from images, has so far largely resisted the application of machine learning techniques. In this paper, we propose the first fully general formulation for learning local covariant feature detectors. We p...
Main Authors: | , |
---|---|
Format: | Conference item |
Published: |
Springer, Cham
2016
|
_version_ | 1826267259241234432 |
---|---|
author | Lenc, K Vedaldi, A |
author_facet | Lenc, K Vedaldi, A |
author_sort | Lenc, K |
collection | OXFORD |
description | Local covariant feature detection, namely the problem of extracting viewpoint invariant features from images, has so far largely resisted the application of machine learning techniques. In this paper, we propose the first fully general formulation for learning local covariant feature detectors. We propose to cast detection as a regression problem, enabling the use of powerful regressors such as deep neural networks. We then derive a covariance constraint that can be used to automatically learn which visual structures provide stable anchors for local feature detection. We support these ideas theoretically, proposing a novel analysis of local features in term of geometric transformations, and we show that all common and many uncommon detectors can be derived in this framework. Finally, we present empirical results on translation and rotation covariant detectors on standard feature benchmarks, showing the power and flexibility of the framework. |
first_indexed | 2024-03-06T20:51:27Z |
format | Conference item |
id | oxford-uuid:37b8b819-83a9-4716-9e7d-68f73150ea9c |
institution | University of Oxford |
last_indexed | 2024-03-06T20:51:27Z |
publishDate | 2016 |
publisher | Springer, Cham |
record_format | dspace |
spelling | oxford-uuid:37b8b819-83a9-4716-9e7d-68f73150ea9c2022-03-26T13:45:47ZLearning covariant feature detectorsConference itemhttp://purl.org/coar/resource_type/c_5794uuid:37b8b819-83a9-4716-9e7d-68f73150ea9cSymplectic Elements at OxfordSpringer, Cham2016Lenc, KVedaldi, ALocal covariant feature detection, namely the problem of extracting viewpoint invariant features from images, has so far largely resisted the application of machine learning techniques. In this paper, we propose the first fully general formulation for learning local covariant feature detectors. We propose to cast detection as a regression problem, enabling the use of powerful regressors such as deep neural networks. We then derive a covariance constraint that can be used to automatically learn which visual structures provide stable anchors for local feature detection. We support these ideas theoretically, proposing a novel analysis of local features in term of geometric transformations, and we show that all common and many uncommon detectors can be derived in this framework. Finally, we present empirical results on translation and rotation covariant detectors on standard feature benchmarks, showing the power and flexibility of the framework. |
spellingShingle | Lenc, K Vedaldi, A Learning covariant feature detectors |
title | Learning covariant feature detectors |
title_full | Learning covariant feature detectors |
title_fullStr | Learning covariant feature detectors |
title_full_unstemmed | Learning covariant feature detectors |
title_short | Learning covariant feature detectors |
title_sort | learning covariant feature detectors |
work_keys_str_mv | AT lenck learningcovariantfeaturedetectors AT vedaldia learningcovariantfeaturedetectors |