Learning covariant feature detectors

Local covariant feature detection, namely the problem of extracting viewpoint invariant features from images, has so far largely resisted the application of machine learning techniques. In this paper, we propose the first fully general formulation for learning local covariant feature detectors. We p...

Full description

Bibliographic Details
Main Authors: Lenc, K, Vedaldi, A
Format: Conference item
Published: Springer, Cham 2016
_version_ 1826267259241234432
author Lenc, K
Vedaldi, A
author_facet Lenc, K
Vedaldi, A
author_sort Lenc, K
collection OXFORD
description Local covariant feature detection, namely the problem of extracting viewpoint invariant features from images, has so far largely resisted the application of machine learning techniques. In this paper, we propose the first fully general formulation for learning local covariant feature detectors. We propose to cast detection as a regression problem, enabling the use of powerful regressors such as deep neural networks. We then derive a covariance constraint that can be used to automatically learn which visual structures provide stable anchors for local feature detection. We support these ideas theoretically, proposing a novel analysis of local features in term of geometric transformations, and we show that all common and many uncommon detectors can be derived in this framework. Finally, we present empirical results on translation and rotation covariant detectors on standard feature benchmarks, showing the power and flexibility of the framework.
first_indexed 2024-03-06T20:51:27Z
format Conference item
id oxford-uuid:37b8b819-83a9-4716-9e7d-68f73150ea9c
institution University of Oxford
last_indexed 2024-03-06T20:51:27Z
publishDate 2016
publisher Springer, Cham
record_format dspace
spelling oxford-uuid:37b8b819-83a9-4716-9e7d-68f73150ea9c2022-03-26T13:45:47ZLearning covariant feature detectorsConference itemhttp://purl.org/coar/resource_type/c_5794uuid:37b8b819-83a9-4716-9e7d-68f73150ea9cSymplectic Elements at OxfordSpringer, Cham2016Lenc, KVedaldi, ALocal covariant feature detection, namely the problem of extracting viewpoint invariant features from images, has so far largely resisted the application of machine learning techniques. In this paper, we propose the first fully general formulation for learning local covariant feature detectors. We propose to cast detection as a regression problem, enabling the use of powerful regressors such as deep neural networks. We then derive a covariance constraint that can be used to automatically learn which visual structures provide stable anchors for local feature detection. We support these ideas theoretically, proposing a novel analysis of local features in term of geometric transformations, and we show that all common and many uncommon detectors can be derived in this framework. Finally, we present empirical results on translation and rotation covariant detectors on standard feature benchmarks, showing the power and flexibility of the framework.
spellingShingle Lenc, K
Vedaldi, A
Learning covariant feature detectors
title Learning covariant feature detectors
title_full Learning covariant feature detectors
title_fullStr Learning covariant feature detectors
title_full_unstemmed Learning covariant feature detectors
title_short Learning covariant feature detectors
title_sort learning covariant feature detectors
work_keys_str_mv AT lenck learningcovariantfeaturedetectors
AT vedaldia learningcovariantfeaturedetectors