Adaptive response maps fusion of correlation filters with anti-occlusion mechanism for visual object tracking
Abstract Despite the impressive performance of correlation filter-based trackers in terms of robustness and accuracy, the trackers have room for improvement. The majority of existing trackers use a single feature or fixed fusion weights, which makes it possible for tracking to fail in the case of de...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
SpringerOpen
2022-03-01
|
| Series: | EURASIP Journal on Image and Video Processing |
| Subjects: | |
| Online Access: | https://doi.org/10.1186/s13640-022-00582-w |
| _version_ | 1818571728401465344 |
|---|---|
| author | Jianming Zhang Hehua Liu Yaoqi He Li-Dan Kuang Xi Chen |
| author_facet | Jianming Zhang Hehua Liu Yaoqi He Li-Dan Kuang Xi Chen |
| author_sort | Jianming Zhang |
| collection | DOAJ |
| description | Abstract Despite the impressive performance of correlation filter-based trackers in terms of robustness and accuracy, the trackers have room for improvement. The majority of existing trackers use a single feature or fixed fusion weights, which makes it possible for tracking to fail in the case of deformation or severe occlusion. In this paper, we propose a multi-feature response map adaptive fusion strategy based on the consistency of individual features and fused feature. It is able to improve the robustness and accuracy by building the better object appearance model. Moreover, since the response map has multiple local peaks when the target is occluded, we propose an anti-occlusion mechanism. Specifically, if the nonmaximal local peak is satisfied with our proposed conditions, we generate a new response map which is obtained by moving the center of the region of interest to the nonmaximal local peak position of the response map and re-extracting features. We then select the response map with the largest response value as the final response map. This proposed anti-occlusion mechanism can effectively cope with the problem of tracking failure caused by occlusion. Finally, by adjusting the learning rate in different scenes, we designed a high-confidence model update strategy to deal with the problem of model pollution. Besides, we conducted experiments on OTB2013, OTB2015, TC128 and UAV123 datasets and compared them with the current state-of-the-art algorithms, and the proposed algorithms have impressive advantages in terms of accuracy and robustness. |
| first_indexed | 2024-12-14T18:48:11Z |
| format | Article |
| id | doaj.art-55fc257031664146b7879dceec7c175d |
| institution | Directory Open Access Journal |
| issn | 1687-5281 |
| language | English |
| last_indexed | 2024-12-14T18:48:11Z |
| publishDate | 2022-03-01 |
| publisher | SpringerOpen |
| record_format | Article |
| series | EURASIP Journal on Image and Video Processing |
| spelling | doaj.art-55fc257031664146b7879dceec7c175d2022-12-21T22:51:20ZengSpringerOpenEURASIP Journal on Image and Video Processing1687-52812022-03-012022111910.1186/s13640-022-00582-wAdaptive response maps fusion of correlation filters with anti-occlusion mechanism for visual object trackingJianming Zhang0Hehua Liu1Yaoqi He2Li-Dan Kuang3Xi Chen4School of Computer and Communication Engineering, Changsha University of Science and TechnologySchool of Computer and Communication Engineering, Changsha University of Science and TechnologySchool of Computer and Communication Engineering, Changsha University of Science and TechnologySchool of Computer and Communication Engineering, Changsha University of Science and TechnologySchool of Computer and Communication Engineering, Changsha University of Science and TechnologyAbstract Despite the impressive performance of correlation filter-based trackers in terms of robustness and accuracy, the trackers have room for improvement. The majority of existing trackers use a single feature or fixed fusion weights, which makes it possible for tracking to fail in the case of deformation or severe occlusion. In this paper, we propose a multi-feature response map adaptive fusion strategy based on the consistency of individual features and fused feature. It is able to improve the robustness and accuracy by building the better object appearance model. Moreover, since the response map has multiple local peaks when the target is occluded, we propose an anti-occlusion mechanism. Specifically, if the nonmaximal local peak is satisfied with our proposed conditions, we generate a new response map which is obtained by moving the center of the region of interest to the nonmaximal local peak position of the response map and re-extracting features. We then select the response map with the largest response value as the final response map. This proposed anti-occlusion mechanism can effectively cope with the problem of tracking failure caused by occlusion. Finally, by adjusting the learning rate in different scenes, we designed a high-confidence model update strategy to deal with the problem of model pollution. Besides, we conducted experiments on OTB2013, OTB2015, TC128 and UAV123 datasets and compared them with the current state-of-the-art algorithms, and the proposed algorithms have impressive advantages in terms of accuracy and robustness.https://doi.org/10.1186/s13640-022-00582-wObject trackingMultiple featuresCorrelation filterAnti-occlusionResponse maps fusion |
| spellingShingle | Jianming Zhang Hehua Liu Yaoqi He Li-Dan Kuang Xi Chen Adaptive response maps fusion of correlation filters with anti-occlusion mechanism for visual object tracking EURASIP Journal on Image and Video Processing Object tracking Multiple features Correlation filter Anti-occlusion Response maps fusion |
| title | Adaptive response maps fusion of correlation filters with anti-occlusion mechanism for visual object tracking |
| title_full | Adaptive response maps fusion of correlation filters with anti-occlusion mechanism for visual object tracking |
| title_fullStr | Adaptive response maps fusion of correlation filters with anti-occlusion mechanism for visual object tracking |
| title_full_unstemmed | Adaptive response maps fusion of correlation filters with anti-occlusion mechanism for visual object tracking |
| title_short | Adaptive response maps fusion of correlation filters with anti-occlusion mechanism for visual object tracking |
| title_sort | adaptive response maps fusion of correlation filters with anti occlusion mechanism for visual object tracking |
| topic | Object tracking Multiple features Correlation filter Anti-occlusion Response maps fusion |
| url | https://doi.org/10.1186/s13640-022-00582-w |
| work_keys_str_mv | AT jianmingzhang adaptiveresponsemapsfusionofcorrelationfilterswithantiocclusionmechanismforvisualobjecttracking AT hehualiu adaptiveresponsemapsfusionofcorrelationfilterswithantiocclusionmechanismforvisualobjecttracking AT yaoqihe adaptiveresponsemapsfusionofcorrelationfilterswithantiocclusionmechanismforvisualobjecttracking AT lidankuang adaptiveresponsemapsfusionofcorrelationfilterswithantiocclusionmechanismforvisualobjecttracking AT xichen adaptiveresponsemapsfusionofcorrelationfilterswithantiocclusionmechanismforvisualobjecttracking |