Distractor-Aware Visual Tracking by Online Siamese Network

The idea of most trackers based on Siamese network is off-line training and online tracking. In fact, online tracking is conducted in terms of deep features, which are extracted from the predefined network trained on a large amount of data off-line. However, these features are the general representa...

Full description

Bibliographic Details
Main Authors: Yufei Zha, Min Wu, Zhuling Qiu, Shuangyu Dong, Fei Yang, Peng Zhang
Format: Article
Language:English
Published: IEEE 2019-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/8756110/
_version_ 1818444310637445120
author Yufei Zha
Min Wu
Zhuling Qiu
Shuangyu Dong
Fei Yang
Peng Zhang
author_facet Yufei Zha
Min Wu
Zhuling Qiu
Shuangyu Dong
Fei Yang
Peng Zhang
author_sort Yufei Zha
collection DOAJ
description The idea of most trackers based on Siamese network is off-line training and online tracking. In fact, online tracking is conducted in terms of deep features, which are extracted from the predefined network trained on a large amount of data off-line. However, these features are the general representation for similar objects, and therefore, their discrimination ability is not enough to identify the current tracking target, particularly distractors, from the background. To tackle this problem, we propose to update the features extracted by a Siamese network online. These features can fit the target variations when tracking is on-the-fly. Especially, we extract the common features from the shallow convolutional layers trained off-line, and then, they are employed as inputs of the deep convolutional layers to learn the special features of the current target online. Besides, an integrated updating strategy is proposed to accelerate network convergence. It is beneficial to enhance the discrimination ability of the learned features to identify the current target from the background and distractors. We conducted abundant experiments on the OTB2015 and VOT2016 databases. And the results demonstrate that our tracker effectively improves the baseline algorithm and performs favorably against most of the state-of-the-art trackers in the comparison of accuracy and robustness.
first_indexed 2024-12-14T19:13:54Z
format Article
id doaj.art-b023e5d4cbbb42afb3b132eec7343d5d
institution Directory Open Access Journal
issn 2169-3536
language English
last_indexed 2024-12-14T19:13:54Z
publishDate 2019-01-01
publisher IEEE
record_format Article
series IEEE Access
spelling doaj.art-b023e5d4cbbb42afb3b132eec7343d5d2022-12-21T22:50:40ZengIEEEIEEE Access2169-35362019-01-017897778978810.1109/ACCESS.2019.29272118756110Distractor-Aware Visual Tracking by Online Siamese NetworkYufei Zha0https://orcid.org/0000-0001-5013-2501Min Wu1https://orcid.org/0000-0002-1658-6267Zhuling Qiu2Shuangyu Dong3Fei Yang4Peng Zhang5School of Computer Science, Northwestern Polytechnical University, Xi’an, ChinaSchool of Aeronautics Engineering, Air Force Engineering University, Xi’an, ChinaSchool of Aeronautics Engineering, Air Force Engineering University, Xi’an, ChinaSMZ Telecom Pty Ltd., Melbourne, VIC, AustraliaScience and Technology on Space Physics Laboratory, Beijing, ChinaSchool of Computer Science, Northwestern Polytechnical University, Xi’an, ChinaThe idea of most trackers based on Siamese network is off-line training and online tracking. In fact, online tracking is conducted in terms of deep features, which are extracted from the predefined network trained on a large amount of data off-line. However, these features are the general representation for similar objects, and therefore, their discrimination ability is not enough to identify the current tracking target, particularly distractors, from the background. To tackle this problem, we propose to update the features extracted by a Siamese network online. These features can fit the target variations when tracking is on-the-fly. Especially, we extract the common features from the shallow convolutional layers trained off-line, and then, they are employed as inputs of the deep convolutional layers to learn the special features of the current target online. Besides, an integrated updating strategy is proposed to accelerate network convergence. It is beneficial to enhance the discrimination ability of the learned features to identify the current target from the background and distractors. We conducted abundant experiments on the OTB2015 and VOT2016 databases. And the results demonstrate that our tracker effectively improves the baseline algorithm and performs favorably against most of the state-of-the-art trackers in the comparison of accuracy and robustness.https://ieeexplore.ieee.org/document/8756110/Target trackingSiamese networkoffline trainingonline tracking
spellingShingle Yufei Zha
Min Wu
Zhuling Qiu
Shuangyu Dong
Fei Yang
Peng Zhang
Distractor-Aware Visual Tracking by Online Siamese Network
IEEE Access
Target tracking
Siamese network
offline training
online tracking
title Distractor-Aware Visual Tracking by Online Siamese Network
title_full Distractor-Aware Visual Tracking by Online Siamese Network
title_fullStr Distractor-Aware Visual Tracking by Online Siamese Network
title_full_unstemmed Distractor-Aware Visual Tracking by Online Siamese Network
title_short Distractor-Aware Visual Tracking by Online Siamese Network
title_sort distractor aware visual tracking by online siamese network
topic Target tracking
Siamese network
offline training
online tracking
url https://ieeexplore.ieee.org/document/8756110/
work_keys_str_mv AT yufeizha distractorawarevisualtrackingbyonlinesiamesenetwork
AT minwu distractorawarevisualtrackingbyonlinesiamesenetwork
AT zhulingqiu distractorawarevisualtrackingbyonlinesiamesenetwork
AT shuangyudong distractorawarevisualtrackingbyonlinesiamesenetwork
AT feiyang distractorawarevisualtrackingbyonlinesiamesenetwork
AT pengzhang distractorawarevisualtrackingbyonlinesiamesenetwork