SNS-CF: Siamese Network with Spatially Semantic Correlation Features for Object Tracking
Recent advances in object tracking based on deep Siamese networks shifted the attention away from correlation filters. However, the Siamese network alone does not have as high accuracy as state-of-the-art correlation filter-based trackers, whereas correlation filter-based trackers alone have a frame...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2020-08-01
|
| Series: | Sensors |
| Subjects: | |
| Online Access: | https://www.mdpi.com/1424-8220/20/17/4881 |
| _version_ | 1797555245462585344 |
|---|---|
| author | Thierry Ntwari Hasil Park Joongchol Shin Joonki Paik |
| author_facet | Thierry Ntwari Hasil Park Joongchol Shin Joonki Paik |
| author_sort | Thierry Ntwari |
| collection | DOAJ |
| description | Recent advances in object tracking based on deep Siamese networks shifted the attention away from correlation filters. However, the Siamese network alone does not have as high accuracy as state-of-the-art correlation filter-based trackers, whereas correlation filter-based trackers alone have a frame update problem. In this paper, we present a Siamese network with spatially semantic correlation features (SNS-CF) for accurate, robust object tracking. To deal with various types of features spread in many regions of the input image frame, the proposed SNS-CF consists of—(1) a Siamese feature extractor, (2) a spatially semantic feature extractor, and (3) an adaptive correlation filter. To the best of authors knowledge, the proposed SNS-CF is the first attempt to fuse the Siamese network and the correlation filter to provide high frame rate, real-time visual tracking with a favorable tracking performance to the state-of-the-art methods in multiple benchmarks. |
| first_indexed | 2024-03-10T16:43:41Z |
| format | Article |
| id | doaj.art-38c4dc70b7e64a4ca860522d1a5291f7 |
| institution | Directory Open Access Journal |
| issn | 1424-8220 |
| language | English |
| last_indexed | 2024-03-10T16:43:41Z |
| publishDate | 2020-08-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Sensors |
| spelling | doaj.art-38c4dc70b7e64a4ca860522d1a5291f72023-11-20T11:44:59ZengMDPI AGSensors1424-82202020-08-012017488110.3390/s20174881SNS-CF: Siamese Network with Spatially Semantic Correlation Features for Object TrackingThierry Ntwari0Hasil Park1Joongchol Shin2Joonki Paik3Graduate School of Advanced Imaging Science, Multimedia and Film, Chung-Ang University, Seoul 06974, KoreaGraduate School of Advanced Imaging Science, Multimedia and Film, Chung-Ang University, Seoul 06974, KoreaGraduate School of Advanced Imaging Science, Multimedia and Film, Chung-Ang University, Seoul 06974, KoreaGraduate School of Advanced Imaging Science, Multimedia and Film, Chung-Ang University, Seoul 06974, KoreaRecent advances in object tracking based on deep Siamese networks shifted the attention away from correlation filters. However, the Siamese network alone does not have as high accuracy as state-of-the-art correlation filter-based trackers, whereas correlation filter-based trackers alone have a frame update problem. In this paper, we present a Siamese network with spatially semantic correlation features (SNS-CF) for accurate, robust object tracking. To deal with various types of features spread in many regions of the input image frame, the proposed SNS-CF consists of—(1) a Siamese feature extractor, (2) a spatially semantic feature extractor, and (3) an adaptive correlation filter. To the best of authors knowledge, the proposed SNS-CF is the first attempt to fuse the Siamese network and the correlation filter to provide high frame rate, real-time visual tracking with a favorable tracking performance to the state-of-the-art methods in multiple benchmarks.https://www.mdpi.com/1424-8220/20/17/4881object trackingsiamese networkcorrelation filterspatially semantic correlation features |
| spellingShingle | Thierry Ntwari Hasil Park Joongchol Shin Joonki Paik SNS-CF: Siamese Network with Spatially Semantic Correlation Features for Object Tracking Sensors object tracking siamese network correlation filter spatially semantic correlation features |
| title | SNS-CF: Siamese Network with Spatially Semantic Correlation Features for Object Tracking |
| title_full | SNS-CF: Siamese Network with Spatially Semantic Correlation Features for Object Tracking |
| title_fullStr | SNS-CF: Siamese Network with Spatially Semantic Correlation Features for Object Tracking |
| title_full_unstemmed | SNS-CF: Siamese Network with Spatially Semantic Correlation Features for Object Tracking |
| title_short | SNS-CF: Siamese Network with Spatially Semantic Correlation Features for Object Tracking |
| title_sort | sns cf siamese network with spatially semantic correlation features for object tracking |
| topic | object tracking siamese network correlation filter spatially semantic correlation features |
| url | https://www.mdpi.com/1424-8220/20/17/4881 |
| work_keys_str_mv | AT thierryntwari snscfsiamesenetworkwithspatiallysemanticcorrelationfeaturesforobjecttracking AT hasilpark snscfsiamesenetworkwithspatiallysemanticcorrelationfeaturesforobjecttracking AT joongcholshin snscfsiamesenetworkwithspatiallysemanticcorrelationfeaturesforobjecttracking AT joonkipaik snscfsiamesenetworkwithspatiallysemanticcorrelationfeaturesforobjecttracking |