NCA-Net for Tracking Multiple Objects across Multiple Cameras
Tracking multiple pedestrians across multi-camera scenarios is an important part of intelligent video surveillance and has great potential application for public security, which has been an attractive topic in the literature in recent years. In most previous methods, artificial features such as colo...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2018-10-01
|
| Series: | Sensors |
| Subjects: | |
| Online Access: | http://www.mdpi.com/1424-8220/18/10/3400 |
| _version_ | 1798039732384432128 |
|---|---|
| author | Yihua Tan Yuan Tai Shengzhou Xiong |
| author_facet | Yihua Tan Yuan Tai Shengzhou Xiong |
| author_sort | Yihua Tan |
| collection | DOAJ |
| description | Tracking multiple pedestrians across multi-camera scenarios is an important part of intelligent video surveillance and has great potential application for public security, which has been an attractive topic in the literature in recent years. In most previous methods, artificial features such as color histograms, HOG descriptors and Haar-like feature were adopted to associate objects among different cameras. But there are still many challenges caused by low resolution, variation of illumination, complex background and posture change. In this paper, a feature extraction network named NCA-Net is designed to improve the performance of multiple objects tracking across multiple cameras by avoiding the problem of insufficient robustness caused by hand-crafted features. The network combines features learning and metric learning via a Convolutional Neural Network (CNN) model and the loss function similar to neighborhood components analysis (NCA). The loss function is adapted from the probability loss of NCA aiming at object tracking. The experiments conducted on the NLPR_MCT dataset show that we obtain satisfactory results even with a simple matching operation. In addition, we embed the proposed NCA-Net with two existing tracking systems. The experimental results on the corresponding datasets demonstrate that the extracted features using NCA-net can effectively make improvement on the tracking performance. |
| first_indexed | 2024-04-11T21:57:48Z |
| format | Article |
| id | doaj.art-ac1ee29b28a440eda73a63caeb384b93 |
| institution | Directory Open Access Journal |
| issn | 1424-8220 |
| language | English |
| last_indexed | 2024-04-11T21:57:48Z |
| publishDate | 2018-10-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Sensors |
| spelling | doaj.art-ac1ee29b28a440eda73a63caeb384b932022-12-22T04:01:03ZengMDPI AGSensors1424-82202018-10-011810340010.3390/s18103400s18103400NCA-Net for Tracking Multiple Objects across Multiple CamerasYihua Tan0Yuan Tai1Shengzhou Xiong2National Key Laboratory of Science & Technology on Multi-Spectral Information Processing, School of Automation, Huazhong University of Science and Technology, Luoyu Road 1037, Hongshan District, Wuhan 430074, ChinaNational Key Laboratory of Science & Technology on Multi-Spectral Information Processing, School of Automation, Huazhong University of Science and Technology, Luoyu Road 1037, Hongshan District, Wuhan 430074, ChinaNational Key Laboratory of Science & Technology on Multi-Spectral Information Processing, School of Automation, Huazhong University of Science and Technology, Luoyu Road 1037, Hongshan District, Wuhan 430074, ChinaTracking multiple pedestrians across multi-camera scenarios is an important part of intelligent video surveillance and has great potential application for public security, which has been an attractive topic in the literature in recent years. In most previous methods, artificial features such as color histograms, HOG descriptors and Haar-like feature were adopted to associate objects among different cameras. But there are still many challenges caused by low resolution, variation of illumination, complex background and posture change. In this paper, a feature extraction network named NCA-Net is designed to improve the performance of multiple objects tracking across multiple cameras by avoiding the problem of insufficient robustness caused by hand-crafted features. The network combines features learning and metric learning via a Convolutional Neural Network (CNN) model and the loss function similar to neighborhood components analysis (NCA). The loss function is adapted from the probability loss of NCA aiming at object tracking. The experiments conducted on the NLPR_MCT dataset show that we obtain satisfactory results even with a simple matching operation. In addition, we embed the proposed NCA-Net with two existing tracking systems. The experimental results on the corresponding datasets demonstrate that the extracted features using NCA-net can effectively make improvement on the tracking performance.http://www.mdpi.com/1424-8220/18/10/3400multi-object trackingmulti-camerametric learningdeep learning |
| spellingShingle | Yihua Tan Yuan Tai Shengzhou Xiong NCA-Net for Tracking Multiple Objects across Multiple Cameras Sensors multi-object tracking multi-camera metric learning deep learning |
| title | NCA-Net for Tracking Multiple Objects across Multiple Cameras |
| title_full | NCA-Net for Tracking Multiple Objects across Multiple Cameras |
| title_fullStr | NCA-Net for Tracking Multiple Objects across Multiple Cameras |
| title_full_unstemmed | NCA-Net for Tracking Multiple Objects across Multiple Cameras |
| title_short | NCA-Net for Tracking Multiple Objects across Multiple Cameras |
| title_sort | nca net for tracking multiple objects across multiple cameras |
| topic | multi-object tracking multi-camera metric learning deep learning |
| url | http://www.mdpi.com/1424-8220/18/10/3400 |
| work_keys_str_mv | AT yihuatan ncanetfortrackingmultipleobjectsacrossmultiplecameras AT yuantai ncanetfortrackingmultipleobjectsacrossmultiplecameras AT shengzhouxiong ncanetfortrackingmultipleobjectsacrossmultiplecameras |