Correlation Filters With Adaptive Multiple Contexts for Visual Tracking
The local contexts define the target and its surrounding background within a constrained region, and have been proved useful for visual tracking, but how to adaptively employ them for building robust models remains challenging. By using the spatial weight maps, the correlation filter (CF) methods wi...
Main Authors: | , , |
---|---|
Format: | Article |
Language: | English |
Published: |
IEEE
2020-01-01
|
Series: | IEEE Access |
Subjects: | |
Online Access: | https://ieeexplore.ieee.org/document/9096280/ |
_version_ | 1819276414974689280 |
---|---|
author | Feng Li Hongzhi Zhang Shan Liu |
author_facet | Feng Li Hongzhi Zhang Shan Liu |
author_sort | Feng Li |
collection | DOAJ |
description | The local contexts define the target and its surrounding background within a constrained region, and have been proved useful for visual tracking, but how to adaptively employ them for building robust models remains challenging. By using the spatial weight maps, the correlation filter (CF) methods with spatial regularization provide an alternative to exploit the local contexts for appearance modeling. However, they generally utilize naive spatial weight map functions, and fail to flexibly regulate the effects of the target and background on model learning, thereby restricting the tracking performance. In this paper, we address these issues by presenting an adaptive multiple contexts correlation filter (AMCCF) framework. In particular, a novel sigmoid spatial weight map is first proposed to control the impacts of local contexts for learning more effective CF models. Based on this, different levels of local contexts (multiple contexts) are further modeled by incorporating the spatial weight maps with different parameters into multiple CF models. To adaptively utilize the local contexts on the tracking stage, the minimal weighted confidence margin loss function with a weight prior constraint is adopted for jointly estimating the target position and adaptive fusion weights of response maps from different CF models. To validate the proposed method, extensive experiments are conducted on four tracking benchmarks. The results show that our AMCCF can adaptively leverage the local contexts for robust tracking, and performs favorably against the state-of-the-art trackers. |
first_indexed | 2024-12-23T23:39:51Z |
format | Article |
id | doaj.art-ab9a5fbe939a4ec8bbf25eb3cf9457f8 |
institution | Directory Open Access Journal |
issn | 2169-3536 |
language | English |
last_indexed | 2024-12-23T23:39:51Z |
publishDate | 2020-01-01 |
publisher | IEEE |
record_format | Article |
series | IEEE Access |
spelling | doaj.art-ab9a5fbe939a4ec8bbf25eb3cf9457f82022-12-21T17:25:43ZengIEEEIEEE Access2169-35362020-01-018945479455910.1109/ACCESS.2020.29956559096280Correlation Filters With Adaptive Multiple Contexts for Visual TrackingFeng Li0https://orcid.org/0000-0003-0469-0363Hongzhi Zhang1https://orcid.org/0000-0001-8025-346XShan Liu2https://orcid.org/0000-0001-8997-0908School of Computer Science and Technology, Harbin Institute of Technology, Harbin, ChinaSchool of Computer Science and Technology, Harbin Institute of Technology, Harbin, ChinaThe 962 Hospital of the PLA Joint Logistic Support Force, Harbin, ChinaThe local contexts define the target and its surrounding background within a constrained region, and have been proved useful for visual tracking, but how to adaptively employ them for building robust models remains challenging. By using the spatial weight maps, the correlation filter (CF) methods with spatial regularization provide an alternative to exploit the local contexts for appearance modeling. However, they generally utilize naive spatial weight map functions, and fail to flexibly regulate the effects of the target and background on model learning, thereby restricting the tracking performance. In this paper, we address these issues by presenting an adaptive multiple contexts correlation filter (AMCCF) framework. In particular, a novel sigmoid spatial weight map is first proposed to control the impacts of local contexts for learning more effective CF models. Based on this, different levels of local contexts (multiple contexts) are further modeled by incorporating the spatial weight maps with different parameters into multiple CF models. To adaptively utilize the local contexts on the tracking stage, the minimal weighted confidence margin loss function with a weight prior constraint is adopted for jointly estimating the target position and adaptive fusion weights of response maps from different CF models. To validate the proposed method, extensive experiments are conducted on four tracking benchmarks. The results show that our AMCCF can adaptively leverage the local contexts for robust tracking, and performs favorably against the state-of-the-art trackers.https://ieeexplore.ieee.org/document/9096280/Correlation filterlocal contextspatial regularizationvisual tracking |
spellingShingle | Feng Li Hongzhi Zhang Shan Liu Correlation Filters With Adaptive Multiple Contexts for Visual Tracking IEEE Access Correlation filter local context spatial regularization visual tracking |
title | Correlation Filters With Adaptive Multiple Contexts for Visual Tracking |
title_full | Correlation Filters With Adaptive Multiple Contexts for Visual Tracking |
title_fullStr | Correlation Filters With Adaptive Multiple Contexts for Visual Tracking |
title_full_unstemmed | Correlation Filters With Adaptive Multiple Contexts for Visual Tracking |
title_short | Correlation Filters With Adaptive Multiple Contexts for Visual Tracking |
title_sort | correlation filters with adaptive multiple contexts for visual tracking |
topic | Correlation filter local context spatial regularization visual tracking |
url | https://ieeexplore.ieee.org/document/9096280/ |
work_keys_str_mv | AT fengli correlationfilterswithadaptivemultiplecontextsforvisualtracking AT hongzhizhang correlationfilterswithadaptivemultiplecontextsforvisualtracking AT shanliu correlationfilterswithadaptivemultiplecontextsforvisualtracking |