Multiple Aerial Targets Re-Identification by 2D- and 3D- Kinematics-Based Matching
This paper presents two techniques in the matching and re-identification of multiple aerial target detections from multiple electro-optical devices: 2-dimensional and 3-dimensional kinematics-based matching. The main advantage of these methods over traditional image-based methods is that no prior im...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2022-01-01
|
| Series: | Journal of Imaging |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2313-433X/8/2/26 |
| _version_ | 1797479019132747776 |
|---|---|
| author | Shao Xuan Seah Yan Han Lau Sutthiphong Srigrarom |
| author_facet | Shao Xuan Seah Yan Han Lau Sutthiphong Srigrarom |
| author_sort | Shao Xuan Seah |
| collection | DOAJ |
| description | This paper presents two techniques in the matching and re-identification of multiple aerial target detections from multiple electro-optical devices: 2-dimensional and 3-dimensional kinematics-based matching. The main advantage of these methods over traditional image-based methods is that no prior image-based training is required; instead, relatively simpler graph matching algorithms are used. The first 2-dimensional method relies solely on the kinematic and geometric projections of the detected targets onto the images captured by the various cameras. Matching and re-identification across frames were performed using a series of correlation-based methods. This method is suitable for all targets with distinct motion observed by the camera. The second 3-dimensional method relies on the change in the size of detected targets to estimate motion in the focal axis by constructing an instantaneous direction vector in 3D space that is independent of camera pose. Matching and re-identification were achieved by directly comparing these vectors across frames under a global coordinate system. Such a method is suitable for targets in near to medium range where changes in detection sizes may be observed. While no overlapping field of view requirements were explicitly imposed, it is necessary for the aerial target to be detected in both cameras before matching can be carried out. Preliminary flight tests were conducted using 2–3 drones at varying ranges, and the effectiveness of these techniques was tested and compared. Using these proposed techniques, an MOTA score of more than 80% was achieved. |
| first_indexed | 2024-03-09T21:39:54Z |
| format | Article |
| id | doaj.art-21a8c58a32a64d9e81f8703b52268457 |
| institution | Directory Open Access Journal |
| issn | 2313-433X |
| language | English |
| last_indexed | 2024-03-09T21:39:54Z |
| publishDate | 2022-01-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Journal of Imaging |
| spelling | doaj.art-21a8c58a32a64d9e81f8703b522684572023-11-23T20:33:09ZengMDPI AGJournal of Imaging2313-433X2022-01-01822610.3390/jimaging8020026Multiple Aerial Targets Re-Identification by 2D- and 3D- Kinematics-Based MatchingShao Xuan Seah0Yan Han Lau1Sutthiphong Srigrarom2Department of Mechanical Engineering, Faculty of Engineering, National University of Singapore, 9 Engineering Drive 1, Singapore 117575, SingaporeDepartment of Electrical and Computer Engineering, Faculty of Engineering, National University of Singapore, 4 Engineering Drive 3, Singapore 117583, SingaporeDepartment of Mechanical Engineering, Faculty of Engineering, National University of Singapore, 9 Engineering Drive 1, Singapore 117575, SingaporeThis paper presents two techniques in the matching and re-identification of multiple aerial target detections from multiple electro-optical devices: 2-dimensional and 3-dimensional kinematics-based matching. The main advantage of these methods over traditional image-based methods is that no prior image-based training is required; instead, relatively simpler graph matching algorithms are used. The first 2-dimensional method relies solely on the kinematic and geometric projections of the detected targets onto the images captured by the various cameras. Matching and re-identification across frames were performed using a series of correlation-based methods. This method is suitable for all targets with distinct motion observed by the camera. The second 3-dimensional method relies on the change in the size of detected targets to estimate motion in the focal axis by constructing an instantaneous direction vector in 3D space that is independent of camera pose. Matching and re-identification were achieved by directly comparing these vectors across frames under a global coordinate system. Such a method is suitable for targets in near to medium range where changes in detection sizes may be observed. While no overlapping field of view requirements were explicitly imposed, it is necessary for the aerial target to be detected in both cameras before matching can be carried out. Preliminary flight tests were conducted using 2–3 drones at varying ranges, and the effectiveness of these techniques was tested and compared. Using these proposed techniques, an MOTA score of more than 80% was achieved.https://www.mdpi.com/2313-433X/8/2/26kinematics-based matchingmulti-camera multi-target tracking (MCMTT)target re-identificationgraph matchingdrone detection and trackinginstantaneous velocity vector |
| spellingShingle | Shao Xuan Seah Yan Han Lau Sutthiphong Srigrarom Multiple Aerial Targets Re-Identification by 2D- and 3D- Kinematics-Based Matching Journal of Imaging kinematics-based matching multi-camera multi-target tracking (MCMTT) target re-identification graph matching drone detection and tracking instantaneous velocity vector |
| title | Multiple Aerial Targets Re-Identification by 2D- and 3D- Kinematics-Based Matching |
| title_full | Multiple Aerial Targets Re-Identification by 2D- and 3D- Kinematics-Based Matching |
| title_fullStr | Multiple Aerial Targets Re-Identification by 2D- and 3D- Kinematics-Based Matching |
| title_full_unstemmed | Multiple Aerial Targets Re-Identification by 2D- and 3D- Kinematics-Based Matching |
| title_short | Multiple Aerial Targets Re-Identification by 2D- and 3D- Kinematics-Based Matching |
| title_sort | multiple aerial targets re identification by 2d and 3d kinematics based matching |
| topic | kinematics-based matching multi-camera multi-target tracking (MCMTT) target re-identification graph matching drone detection and tracking instantaneous velocity vector |
| url | https://www.mdpi.com/2313-433X/8/2/26 |
| work_keys_str_mv | AT shaoxuanseah multipleaerialtargetsreidentificationby2dand3dkinematicsbasedmatching AT yanhanlau multipleaerialtargetsreidentificationby2dand3dkinematicsbasedmatching AT sutthiphongsrigrarom multipleaerialtargetsreidentificationby2dand3dkinematicsbasedmatching |