Global-Local and Occlusion Awareness Network for Object Tracking in UAVs

Multiobject tracking in unmanned aerial vehicle (UAV) scenes is a crucial task with numerous applications across various domains. The goal of this task is to track multiple objects such as people and vehicles over time as they move through the scene, often captured by cameras mounted on UAV. However...

Full description

Bibliographic Details
Main Authors: Lukui Shi, Qingrui Zhang, Bin Pan, Jun Zhang, Yuanchao Su
Format: Article
Language:English
Published: IEEE 2023-01-01
Series:IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
Subjects:
Online Access:https://ieeexplore.ieee.org/document/10227510/
_version_ 1827803691414978560
author Lukui Shi
Qingrui Zhang
Bin Pan
Jun Zhang
Yuanchao Su
author_facet Lukui Shi
Qingrui Zhang
Bin Pan
Jun Zhang
Yuanchao Su
author_sort Lukui Shi
collection DOAJ
description Multiobject tracking in unmanned aerial vehicle (UAV) scenes is a crucial task with numerous applications across various domains. The goal of this task is to track multiple objects such as people and vehicles over time as they move through the scene, often captured by cameras mounted on UAV. However, tracking objects in UAV scenes can be challenging due to several factors, including the scale variance of objects as they move through the scene and the frequent occlusions caused by complex scenes. To address these issues, we propose a global-local and occlusion awareness (GLOA) tracking network for UAVs. It comprises two main components: global-local awareness detector (GLA-D) and the occlusion awareness data association (OADA). The GLA-D uses our specially designed global-local awareness block to extract scale variance feature information from the input frames. It then outputs more discriminative identity information by adding identity embedding branches to the prediction head. The GLA-D is designed to better handle scale variance issues and improve object tracking accuracy. The OADA method used different metrics for high- and low-scoring detection frames was to alleviate occlusion problems in tracking scenarios. By combining these two components, the GLOA provides a more robust and effective solution for multiobject tracking in UAV scenes. Experiments on two public datasets may indicate the effectiveness of the proposed method.
first_indexed 2024-03-11T20:59:06Z
format Article
id doaj.art-c408a4e110b8469d8eedebe7ba6ae5c2
institution Directory Open Access Journal
issn 2151-1535
language English
last_indexed 2024-03-11T20:59:06Z
publishDate 2023-01-01
publisher IEEE
record_format Article
series IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
spelling doaj.art-c408a4e110b8469d8eedebe7ba6ae5c22023-09-29T23:00:20ZengIEEEIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing2151-15352023-01-01168834884410.1109/JSTARS.2023.330804210227510Global-Local and Occlusion Awareness Network for Object Tracking in UAVsLukui Shi0https://orcid.org/0000-0002-7906-6349Qingrui Zhang1https://orcid.org/0009-0007-9726-3366Bin Pan2https://orcid.org/0000-0003-3063-1762Jun Zhang3https://orcid.org/0000-0003-4345-454XYuanchao Su4https://orcid.org/0000-0002-4776-0862School of Artificial Intelligence, Hebei University of Technology, Tianjin, ChinaSchool of Artificial Intelligence, Hebei University of Technology, Tianjin, ChinaSchool of Statistics and Data Science, KLMDASR, LEBPS, and LPMC, Nankai University, Tianjin, ChinaSchool of Artificial Intelligence, Hebei University of Technology, Tianjin, ChinaDepartment of Remote Sensing, College of Geomatics, Xi'an University of Science and Technology, Xi'an, ChinaMultiobject tracking in unmanned aerial vehicle (UAV) scenes is a crucial task with numerous applications across various domains. The goal of this task is to track multiple objects such as people and vehicles over time as they move through the scene, often captured by cameras mounted on UAV. However, tracking objects in UAV scenes can be challenging due to several factors, including the scale variance of objects as they move through the scene and the frequent occlusions caused by complex scenes. To address these issues, we propose a global-local and occlusion awareness (GLOA) tracking network for UAVs. It comprises two main components: global-local awareness detector (GLA-D) and the occlusion awareness data association (OADA). The GLA-D uses our specially designed global-local awareness block to extract scale variance feature information from the input frames. It then outputs more discriminative identity information by adding identity embedding branches to the prediction head. The GLA-D is designed to better handle scale variance issues and improve object tracking accuracy. The OADA method used different metrics for high- and low-scoring detection frames was to alleviate occlusion problems in tracking scenarios. By combining these two components, the GLOA provides a more robust and effective solution for multiobject tracking in UAV scenes. Experiments on two public datasets may indicate the effectiveness of the proposed method.https://ieeexplore.ieee.org/document/10227510/Multiobject trackingocclusion awarenessunmanned aerial vehicle (UAV)
spellingShingle Lukui Shi
Qingrui Zhang
Bin Pan
Jun Zhang
Yuanchao Su
Global-Local and Occlusion Awareness Network for Object Tracking in UAVs
IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
Multiobject tracking
occlusion awareness
unmanned aerial vehicle (UAV)
title Global-Local and Occlusion Awareness Network for Object Tracking in UAVs
title_full Global-Local and Occlusion Awareness Network for Object Tracking in UAVs
title_fullStr Global-Local and Occlusion Awareness Network for Object Tracking in UAVs
title_full_unstemmed Global-Local and Occlusion Awareness Network for Object Tracking in UAVs
title_short Global-Local and Occlusion Awareness Network for Object Tracking in UAVs
title_sort global local and occlusion awareness network for object tracking in uavs
topic Multiobject tracking
occlusion awareness
unmanned aerial vehicle (UAV)
url https://ieeexplore.ieee.org/document/10227510/
work_keys_str_mv AT lukuishi globallocalandocclusionawarenessnetworkforobjecttrackinginuavs
AT qingruizhang globallocalandocclusionawarenessnetworkforobjecttrackinginuavs
AT binpan globallocalandocclusionawarenessnetworkforobjecttrackinginuavs
AT junzhang globallocalandocclusionawarenessnetworkforobjecttrackinginuavs
AT yuanchaosu globallocalandocclusionawarenessnetworkforobjecttrackinginuavs