Correlation Filters With Adaptive Multiple Contexts for Visual Tracking

The local contexts define the target and its surrounding background within a constrained region, and have been proved useful for visual tracking, but how to adaptively employ them for building robust models remains challenging. By using the spatial weight maps, the correlation filter (CF) methods wi...

Full description

Bibliographic Details
Main Authors: Feng Li, Hongzhi Zhang, Shan Liu
Format: Article
Language:English
Published: IEEE 2020-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/9096280/
_version_ 1819276414974689280
author Feng Li
Hongzhi Zhang
Shan Liu
author_facet Feng Li
Hongzhi Zhang
Shan Liu
author_sort Feng Li
collection DOAJ
description The local contexts define the target and its surrounding background within a constrained region, and have been proved useful for visual tracking, but how to adaptively employ them for building robust models remains challenging. By using the spatial weight maps, the correlation filter (CF) methods with spatial regularization provide an alternative to exploit the local contexts for appearance modeling. However, they generally utilize naive spatial weight map functions, and fail to flexibly regulate the effects of the target and background on model learning, thereby restricting the tracking performance. In this paper, we address these issues by presenting an adaptive multiple contexts correlation filter (AMCCF) framework. In particular, a novel sigmoid spatial weight map is first proposed to control the impacts of local contexts for learning more effective CF models. Based on this, different levels of local contexts (multiple contexts) are further modeled by incorporating the spatial weight maps with different parameters into multiple CF models. To adaptively utilize the local contexts on the tracking stage, the minimal weighted confidence margin loss function with a weight prior constraint is adopted for jointly estimating the target position and adaptive fusion weights of response maps from different CF models. To validate the proposed method, extensive experiments are conducted on four tracking benchmarks. The results show that our AMCCF can adaptively leverage the local contexts for robust tracking, and performs favorably against the state-of-the-art trackers.
first_indexed 2024-12-23T23:39:51Z
format Article
id doaj.art-ab9a5fbe939a4ec8bbf25eb3cf9457f8
institution Directory Open Access Journal
issn 2169-3536
language English
last_indexed 2024-12-23T23:39:51Z
publishDate 2020-01-01
publisher IEEE
record_format Article
series IEEE Access
spelling doaj.art-ab9a5fbe939a4ec8bbf25eb3cf9457f82022-12-21T17:25:43ZengIEEEIEEE Access2169-35362020-01-018945479455910.1109/ACCESS.2020.29956559096280Correlation Filters With Adaptive Multiple Contexts for Visual TrackingFeng Li0https://orcid.org/0000-0003-0469-0363Hongzhi Zhang1https://orcid.org/0000-0001-8025-346XShan Liu2https://orcid.org/0000-0001-8997-0908School of Computer Science and Technology, Harbin Institute of Technology, Harbin, ChinaSchool of Computer Science and Technology, Harbin Institute of Technology, Harbin, ChinaThe 962 Hospital of the PLA Joint Logistic Support Force, Harbin, ChinaThe local contexts define the target and its surrounding background within a constrained region, and have been proved useful for visual tracking, but how to adaptively employ them for building robust models remains challenging. By using the spatial weight maps, the correlation filter (CF) methods with spatial regularization provide an alternative to exploit the local contexts for appearance modeling. However, they generally utilize naive spatial weight map functions, and fail to flexibly regulate the effects of the target and background on model learning, thereby restricting the tracking performance. In this paper, we address these issues by presenting an adaptive multiple contexts correlation filter (AMCCF) framework. In particular, a novel sigmoid spatial weight map is first proposed to control the impacts of local contexts for learning more effective CF models. Based on this, different levels of local contexts (multiple contexts) are further modeled by incorporating the spatial weight maps with different parameters into multiple CF models. To adaptively utilize the local contexts on the tracking stage, the minimal weighted confidence margin loss function with a weight prior constraint is adopted for jointly estimating the target position and adaptive fusion weights of response maps from different CF models. To validate the proposed method, extensive experiments are conducted on four tracking benchmarks. The results show that our AMCCF can adaptively leverage the local contexts for robust tracking, and performs favorably against the state-of-the-art trackers.https://ieeexplore.ieee.org/document/9096280/Correlation filterlocal contextspatial regularizationvisual tracking
spellingShingle Feng Li
Hongzhi Zhang
Shan Liu
Correlation Filters With Adaptive Multiple Contexts for Visual Tracking
IEEE Access
Correlation filter
local context
spatial regularization
visual tracking
title Correlation Filters With Adaptive Multiple Contexts for Visual Tracking
title_full Correlation Filters With Adaptive Multiple Contexts for Visual Tracking
title_fullStr Correlation Filters With Adaptive Multiple Contexts for Visual Tracking
title_full_unstemmed Correlation Filters With Adaptive Multiple Contexts for Visual Tracking
title_short Correlation Filters With Adaptive Multiple Contexts for Visual Tracking
title_sort correlation filters with adaptive multiple contexts for visual tracking
topic Correlation filter
local context
spatial regularization
visual tracking
url https://ieeexplore.ieee.org/document/9096280/
work_keys_str_mv AT fengli correlationfilterswithadaptivemultiplecontextsforvisualtracking
AT hongzhizhang correlationfilterswithadaptivemultiplecontextsforvisualtracking
AT shanliu correlationfilterswithadaptivemultiplecontextsforvisualtracking