Detection, Tracking, and Geolocation of Moving Vehicle From UAV Using Monocular Camera

Unmanned aerial vehicles (UAVs) have been widely used in urban traffic supervision in recent years. However, the detection, tracking, and geolocation of moving vehicle based on the airborne platform suffer from small object sizes, complex scenes, and low-accuracy sensors. To address these problems,...

Full description

Bibliographic Details
Main Authors: Xiaoyue Zhao, Fangling Pu, Zhihang Wang, Hongyu Chen, Zhaozhuo Xu
Format: Article
Language:English
Published: IEEE 2019-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/8766100/
_version_ 1831636262801375232
author Xiaoyue Zhao
Fangling Pu
Zhihang Wang
Hongyu Chen
Zhaozhuo Xu
author_facet Xiaoyue Zhao
Fangling Pu
Zhihang Wang
Hongyu Chen
Zhaozhuo Xu
author_sort Xiaoyue Zhao
collection DOAJ
description Unmanned aerial vehicles (UAVs) have been widely used in urban traffic supervision in recent years. However, the detection, tracking, and geolocation of moving vehicle based on the airborne platform suffer from small object sizes, complex scenes, and low-accuracy sensors. To address these problems, this paper develops a framework for moving vehicle detecting, tracking, and geolocating based on a monocular camera, a GPS receiver, and inertial measurement units (IMUs) sensors. First, the method based on YOLOv3 was employed for vehicle detection due to its effectiveness and efficiency for small object detection in complex scenes. Then, a visual tracking method based on correlation filters is introduced, and a passive geolocation method is presented to calculate the GPS coordinates of the moving vehicle. Finally, a flight control method in terms of the previous image processing results is introduced to lead the UAV that is following the interesting moving vehicle. The proposed scheme has been built on a DJI M100 platform on which a monocular camera and a microcomputer Jetson TX1 are added. The experimental results show that this scheme is capable of detecting, tracking, and geolocating the interesting moving vehicle with high precision. The framework demonstrates its capacity in automatic supervision on target vehicles in real-world experiments, which suggests its potential applications in urban traffic, logistics, and security.
first_indexed 2024-12-19T06:30:01Z
format Article
id doaj.art-6ff545654c4941469e34f26d856eb631
institution Directory Open Access Journal
issn 2169-3536
language English
last_indexed 2024-12-19T06:30:01Z
publishDate 2019-01-01
publisher IEEE
record_format Article
series IEEE Access
spelling doaj.art-6ff545654c4941469e34f26d856eb6312022-12-21T20:32:26ZengIEEEIEEE Access2169-35362019-01-01710116010117010.1109/ACCESS.2019.29297608766100Detection, Tracking, and Geolocation of Moving Vehicle From UAV Using Monocular CameraXiaoyue Zhao0Fangling Pu1https://orcid.org/0000-0002-1490-0347Zhihang Wang2Hongyu Chen3Zhaozhuo Xu4School of Electronic Information, Wuhan University, Wuhan, ChinaSchool of Electronic Information, Wuhan University, Wuhan, ChinaSchool of Electronic Information, Wuhan University, Wuhan, ChinaSchool of Electronic Information, Wuhan University, Wuhan, ChinaElectrical Engineering Department, Stanford University, Stanford, CA, USAUnmanned aerial vehicles (UAVs) have been widely used in urban traffic supervision in recent years. However, the detection, tracking, and geolocation of moving vehicle based on the airborne platform suffer from small object sizes, complex scenes, and low-accuracy sensors. To address these problems, this paper develops a framework for moving vehicle detecting, tracking, and geolocating based on a monocular camera, a GPS receiver, and inertial measurement units (IMUs) sensors. First, the method based on YOLOv3 was employed for vehicle detection due to its effectiveness and efficiency for small object detection in complex scenes. Then, a visual tracking method based on correlation filters is introduced, and a passive geolocation method is presented to calculate the GPS coordinates of the moving vehicle. Finally, a flight control method in terms of the previous image processing results is introduced to lead the UAV that is following the interesting moving vehicle. The proposed scheme has been built on a DJI M100 platform on which a monocular camera and a microcomputer Jetson TX1 are added. The experimental results show that this scheme is capable of detecting, tracking, and geolocating the interesting moving vehicle with high precision. The framework demonstrates its capacity in automatic supervision on target vehicles in real-world experiments, which suggests its potential applications in urban traffic, logistics, and security.https://ieeexplore.ieee.org/document/8766100/Unmanned aerial vehicleYOLOv3object geolocationmoving vehicle tracking
spellingShingle Xiaoyue Zhao
Fangling Pu
Zhihang Wang
Hongyu Chen
Zhaozhuo Xu
Detection, Tracking, and Geolocation of Moving Vehicle From UAV Using Monocular Camera
IEEE Access
Unmanned aerial vehicle
YOLOv3
object geolocation
moving vehicle tracking
title Detection, Tracking, and Geolocation of Moving Vehicle From UAV Using Monocular Camera
title_full Detection, Tracking, and Geolocation of Moving Vehicle From UAV Using Monocular Camera
title_fullStr Detection, Tracking, and Geolocation of Moving Vehicle From UAV Using Monocular Camera
title_full_unstemmed Detection, Tracking, and Geolocation of Moving Vehicle From UAV Using Monocular Camera
title_short Detection, Tracking, and Geolocation of Moving Vehicle From UAV Using Monocular Camera
title_sort detection tracking and geolocation of moving vehicle from uav using monocular camera
topic Unmanned aerial vehicle
YOLOv3
object geolocation
moving vehicle tracking
url https://ieeexplore.ieee.org/document/8766100/
work_keys_str_mv AT xiaoyuezhao detectiontrackingandgeolocationofmovingvehiclefromuavusingmonocularcamera
AT fanglingpu detectiontrackingandgeolocationofmovingvehiclefromuavusingmonocularcamera
AT zhihangwang detectiontrackingandgeolocationofmovingvehiclefromuavusingmonocularcamera
AT hongyuchen detectiontrackingandgeolocationofmovingvehiclefromuavusingmonocularcamera
AT zhaozhuoxu detectiontrackingandgeolocationofmovingvehiclefromuavusingmonocularcamera