Distractor-Aware Visual Tracking by Online Siamese Network
The idea of most trackers based on Siamese network is off-line training and online tracking. In fact, online tracking is conducted in terms of deep features, which are extracted from the predefined network trained on a large amount of data off-line. However, these features are the general representa...
Main Authors: | , , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
IEEE
2019-01-01
|
Series: | IEEE Access |
Subjects: | |
Online Access: | https://ieeexplore.ieee.org/document/8756110/ |
_version_ | 1818444310637445120 |
---|---|
author | Yufei Zha Min Wu Zhuling Qiu Shuangyu Dong Fei Yang Peng Zhang |
author_facet | Yufei Zha Min Wu Zhuling Qiu Shuangyu Dong Fei Yang Peng Zhang |
author_sort | Yufei Zha |
collection | DOAJ |
description | The idea of most trackers based on Siamese network is off-line training and online tracking. In fact, online tracking is conducted in terms of deep features, which are extracted from the predefined network trained on a large amount of data off-line. However, these features are the general representation for similar objects, and therefore, their discrimination ability is not enough to identify the current tracking target, particularly distractors, from the background. To tackle this problem, we propose to update the features extracted by a Siamese network online. These features can fit the target variations when tracking is on-the-fly. Especially, we extract the common features from the shallow convolutional layers trained off-line, and then, they are employed as inputs of the deep convolutional layers to learn the special features of the current target online. Besides, an integrated updating strategy is proposed to accelerate network convergence. It is beneficial to enhance the discrimination ability of the learned features to identify the current target from the background and distractors. We conducted abundant experiments on the OTB2015 and VOT2016 databases. And the results demonstrate that our tracker effectively improves the baseline algorithm and performs favorably against most of the state-of-the-art trackers in the comparison of accuracy and robustness. |
first_indexed | 2024-12-14T19:13:54Z |
format | Article |
id | doaj.art-b023e5d4cbbb42afb3b132eec7343d5d |
institution | Directory Open Access Journal |
issn | 2169-3536 |
language | English |
last_indexed | 2024-12-14T19:13:54Z |
publishDate | 2019-01-01 |
publisher | IEEE |
record_format | Article |
series | IEEE Access |
spelling | doaj.art-b023e5d4cbbb42afb3b132eec7343d5d2022-12-21T22:50:40ZengIEEEIEEE Access2169-35362019-01-017897778978810.1109/ACCESS.2019.29272118756110Distractor-Aware Visual Tracking by Online Siamese NetworkYufei Zha0https://orcid.org/0000-0001-5013-2501Min Wu1https://orcid.org/0000-0002-1658-6267Zhuling Qiu2Shuangyu Dong3Fei Yang4Peng Zhang5School of Computer Science, Northwestern Polytechnical University, Xi’an, ChinaSchool of Aeronautics Engineering, Air Force Engineering University, Xi’an, ChinaSchool of Aeronautics Engineering, Air Force Engineering University, Xi’an, ChinaSMZ Telecom Pty Ltd., Melbourne, VIC, AustraliaScience and Technology on Space Physics Laboratory, Beijing, ChinaSchool of Computer Science, Northwestern Polytechnical University, Xi’an, ChinaThe idea of most trackers based on Siamese network is off-line training and online tracking. In fact, online tracking is conducted in terms of deep features, which are extracted from the predefined network trained on a large amount of data off-line. However, these features are the general representation for similar objects, and therefore, their discrimination ability is not enough to identify the current tracking target, particularly distractors, from the background. To tackle this problem, we propose to update the features extracted by a Siamese network online. These features can fit the target variations when tracking is on-the-fly. Especially, we extract the common features from the shallow convolutional layers trained off-line, and then, they are employed as inputs of the deep convolutional layers to learn the special features of the current target online. Besides, an integrated updating strategy is proposed to accelerate network convergence. It is beneficial to enhance the discrimination ability of the learned features to identify the current target from the background and distractors. We conducted abundant experiments on the OTB2015 and VOT2016 databases. And the results demonstrate that our tracker effectively improves the baseline algorithm and performs favorably against most of the state-of-the-art trackers in the comparison of accuracy and robustness.https://ieeexplore.ieee.org/document/8756110/Target trackingSiamese networkoffline trainingonline tracking |
spellingShingle | Yufei Zha Min Wu Zhuling Qiu Shuangyu Dong Fei Yang Peng Zhang Distractor-Aware Visual Tracking by Online Siamese Network IEEE Access Target tracking Siamese network offline training online tracking |
title | Distractor-Aware Visual Tracking by Online Siamese Network |
title_full | Distractor-Aware Visual Tracking by Online Siamese Network |
title_fullStr | Distractor-Aware Visual Tracking by Online Siamese Network |
title_full_unstemmed | Distractor-Aware Visual Tracking by Online Siamese Network |
title_short | Distractor-Aware Visual Tracking by Online Siamese Network |
title_sort | distractor aware visual tracking by online siamese network |
topic | Target tracking Siamese network offline training online tracking |
url | https://ieeexplore.ieee.org/document/8756110/ |
work_keys_str_mv | AT yufeizha distractorawarevisualtrackingbyonlinesiamesenetwork AT minwu distractorawarevisualtrackingbyonlinesiamesenetwork AT zhulingqiu distractorawarevisualtrackingbyonlinesiamesenetwork AT shuangyudong distractorawarevisualtrackingbyonlinesiamesenetwork AT feiyang distractorawarevisualtrackingbyonlinesiamesenetwork AT pengzhang distractorawarevisualtrackingbyonlinesiamesenetwork |