Cross-attention Guided Siamese Network Object Tracking Algorithm

Most traditional Siamese trackers cannot perform robust when facing the similar object,deformation,background clutters and other challenges.Accordingly,a cross-attention guided Siamese network (called SiamCAN) is proposed to solve the above problem in this paper.Firstly,different layers of ResNet50...

Full description

Bibliographic Details
Main Author: ZHAO Yue, YU Zhi-bin, LI Yong-chun
Format: Article
Language:zho
Published: Editorial office of Computer Science 2022-03-01
Series:Jisuanji kexue
Subjects:
Online Access:https://www.jsjkx.com/fileup/1002-137X/PDF/1002-137X-2022-3-163.pdf
_version_ 1818338514456018944
author ZHAO Yue, YU Zhi-bin, LI Yong-chun
author_facet ZHAO Yue, YU Zhi-bin, LI Yong-chun
author_sort ZHAO Yue, YU Zhi-bin, LI Yong-chun
collection DOAJ
description Most traditional Siamese trackers cannot perform robust when facing the similar object,deformation,background clutters and other challenges.Accordingly,a cross-attention guided Siamese network (called SiamCAN) is proposed to solve the above problem in this paper.Firstly,different layers of ResNet50 are used to get various revolutions of object feature and a cross-attention module is designed to bridge the information flow between search branch and template branch.After that,each feature from different layers of backbone is sent to CNNs to update parameters and combined with each other,in classification network and regression network.Finally,the predicted location and target size are calculated according to the max response on response map.Simulation experimental results on the UAV123 tracking dataset show that the tracking precision is improved by 1.7% and the tracking accuracy is improved by 0.7%,compared to the mainstream algorithm SiamBAN.Moreover,on the VOT2018 benchmark,the EAO of our method outperforms 2.5 than the mainstream algorithm SiamRPN++,and the tracking speed of our method maintains 35FPS.
first_indexed 2024-12-13T15:12:19Z
format Article
id doaj.art-ec637f365569487097c1126322968aa2
institution Directory Open Access Journal
issn 1002-137X
language zho
last_indexed 2024-12-13T15:12:19Z
publishDate 2022-03-01
publisher Editorial office of Computer Science
record_format Article
series Jisuanji kexue
spelling doaj.art-ec637f365569487097c1126322968aa22022-12-21T23:40:50ZzhoEditorial office of Computer ScienceJisuanji kexue1002-137X2022-03-0149316316910.11896/jsjkx.210300066Cross-attention Guided Siamese Network Object Tracking AlgorithmZHAO Yue, YU Zhi-bin, LI Yong-chun0College of Electronic Engineering,Southwest Jiaotong University,Chengdu 611756,ChinaMost traditional Siamese trackers cannot perform robust when facing the similar object,deformation,background clutters and other challenges.Accordingly,a cross-attention guided Siamese network (called SiamCAN) is proposed to solve the above problem in this paper.Firstly,different layers of ResNet50 are used to get various revolutions of object feature and a cross-attention module is designed to bridge the information flow between search branch and template branch.After that,each feature from different layers of backbone is sent to CNNs to update parameters and combined with each other,in classification network and regression network.Finally,the predicted location and target size are calculated according to the max response on response map.Simulation experimental results on the UAV123 tracking dataset show that the tracking precision is improved by 1.7% and the tracking accuracy is improved by 0.7%,compared to the mainstream algorithm SiamBAN.Moreover,on the VOT2018 benchmark,the EAO of our method outperforms 2.5 than the mainstream algorithm SiamRPN++,and the tracking speed of our method maintains 35FPS.https://www.jsjkx.com/fileup/1002-137X/PDF/1002-137X-2022-3-163.pdfvisual object tracking|siamese network|similar object distractor|cross-attention module|anchor-free regression
spellingShingle ZHAO Yue, YU Zhi-bin, LI Yong-chun
Cross-attention Guided Siamese Network Object Tracking Algorithm
Jisuanji kexue
visual object tracking|siamese network|similar object distractor|cross-attention module|anchor-free regression
title Cross-attention Guided Siamese Network Object Tracking Algorithm
title_full Cross-attention Guided Siamese Network Object Tracking Algorithm
title_fullStr Cross-attention Guided Siamese Network Object Tracking Algorithm
title_full_unstemmed Cross-attention Guided Siamese Network Object Tracking Algorithm
title_short Cross-attention Guided Siamese Network Object Tracking Algorithm
title_sort cross attention guided siamese network object tracking algorithm
topic visual object tracking|siamese network|similar object distractor|cross-attention module|anchor-free regression
url https://www.jsjkx.com/fileup/1002-137X/PDF/1002-137X-2022-3-163.pdf
work_keys_str_mv AT zhaoyueyuzhibinliyongchun crossattentionguidedsiamesenetworkobjecttrackingalgorithm