GOMT: Multispectral video tracking based on genetic optimization and multi‐features integration
Abstract Traditional visual tracking algorithms on RGB cannot effectively distinguish an object from background with similar colour feature, resulting in the migration problem in the tracking process. In order to solve this problem, a tracking algorithm with spectral information is proposed by using...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Wiley
2023-04-01
|
| Series: | IET Image Processing |
| Subjects: | |
| Online Access: | https://doi.org/10.1049/ipr2.12739 |
| _version_ | 1797852206349680640 |
|---|---|
| author | Kun Qian Peng Chen Dong Zhao |
| author_facet | Kun Qian Peng Chen Dong Zhao |
| author_sort | Kun Qian |
| collection | DOAJ |
| description | Abstract Traditional visual tracking algorithms on RGB cannot effectively distinguish an object from background with similar colour feature, resulting in the migration problem in the tracking process. In order to solve this problem, a tracking algorithm with spectral information is proposed by using band selection, information fusion, and deep features. Firstly, the correlation analysis of 16 spectral band information is carried out, and genetic optimization method is introduced to obtain two bands with low correlation coefficient and abundant information. Moreover, under the framework of kernel correlation filtering tracking, guided filtering is adopted to fuse the information referring to the target region of the two bands. Besides, the feature maps are generated by histogram of gradient and pretrained visual geometry group network. Finally, target is detected via finding the maximum value of a strong response. The proposed genetic optimization based multifeature tracker is compared with multiple tracking methods including correlation filtering and deep learning. Experimental results with multiple groups of spectral videos and corresponding RGB videos demonstrate that the genetic optimization based multifeature tracker method achieves good results in subjective vision and objective evaluation. |
| first_indexed | 2024-04-09T19:30:08Z |
| format | Article |
| id | doaj.art-8e34a684f1fc4ad38dd3667eb5e2d55f |
| institution | Directory Open Access Journal |
| issn | 1751-9659 1751-9667 |
| language | English |
| last_indexed | 2024-04-09T19:30:08Z |
| publishDate | 2023-04-01 |
| publisher | Wiley |
| record_format | Article |
| series | IET Image Processing |
| spelling | doaj.art-8e34a684f1fc4ad38dd3667eb5e2d55f2023-04-05T04:26:02ZengWileyIET Image Processing1751-96591751-96672023-04-011751578158910.1049/ipr2.12739GOMT: Multispectral video tracking based on genetic optimization and multi‐features integrationKun Qian0Peng Chen1Dong Zhao2School of Artificial Intelligence and Computer Science Jiangnan University Wuxi Jiangsu P. R. ChinaSchool of Artificial Intelligence and Computer Science Jiangnan University Wuxi Jiangsu P. R. ChinaSchool of Electronic Information Engineering Wuxi University Wuxi Jiangsu P. R. ChinaAbstract Traditional visual tracking algorithms on RGB cannot effectively distinguish an object from background with similar colour feature, resulting in the migration problem in the tracking process. In order to solve this problem, a tracking algorithm with spectral information is proposed by using band selection, information fusion, and deep features. Firstly, the correlation analysis of 16 spectral band information is carried out, and genetic optimization method is introduced to obtain two bands with low correlation coefficient and abundant information. Moreover, under the framework of kernel correlation filtering tracking, guided filtering is adopted to fuse the information referring to the target region of the two bands. Besides, the feature maps are generated by histogram of gradient and pretrained visual geometry group network. Finally, target is detected via finding the maximum value of a strong response. The proposed genetic optimization based multifeature tracker is compared with multiple tracking methods including correlation filtering and deep learning. Experimental results with multiple groups of spectral videos and corresponding RGB videos demonstrate that the genetic optimization based multifeature tracker method achieves good results in subjective vision and objective evaluation.https://doi.org/10.1049/ipr2.12739computer visioncorrelation methodsfast Fourier transformsfeature extractionfeature selectionimage classification |
| spellingShingle | Kun Qian Peng Chen Dong Zhao GOMT: Multispectral video tracking based on genetic optimization and multi‐features integration IET Image Processing computer vision correlation methods fast Fourier transforms feature extraction feature selection image classification |
| title | GOMT: Multispectral video tracking based on genetic optimization and multi‐features integration |
| title_full | GOMT: Multispectral video tracking based on genetic optimization and multi‐features integration |
| title_fullStr | GOMT: Multispectral video tracking based on genetic optimization and multi‐features integration |
| title_full_unstemmed | GOMT: Multispectral video tracking based on genetic optimization and multi‐features integration |
| title_short | GOMT: Multispectral video tracking based on genetic optimization and multi‐features integration |
| title_sort | gomt multispectral video tracking based on genetic optimization and multi features integration |
| topic | computer vision correlation methods fast Fourier transforms feature extraction feature selection image classification |
| url | https://doi.org/10.1049/ipr2.12739 |
| work_keys_str_mv | AT kunqian gomtmultispectralvideotrackingbasedongeneticoptimizationandmultifeaturesintegration AT pengchen gomtmultispectralvideotrackingbasedongeneticoptimizationandmultifeaturesintegration AT dongzhao gomtmultispectralvideotrackingbasedongeneticoptimizationandmultifeaturesintegration |