Research on Multi-Ship Target Detection and Tracking Method Based on Camera in Complex Scenes
Aiming at the problem that multi-ship target detection and tracking based on cameras is difficult to meet the accuracy and speed requirements at the same time in some complex scenes, an improved YOLOv4 algorithm is proposed, which simplified the network of the feature extraction layer to obtain more...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2022-07-01
|
| Series: | Journal of Marine Science and Engineering |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2077-1312/10/7/978 |
| _version_ | 1797405946120503296 |
|---|---|
| author | Xiaobin Hong Bin Cui Weiguo Chen Yinhui Rao Yuanming Chen |
| author_facet | Xiaobin Hong Bin Cui Weiguo Chen Yinhui Rao Yuanming Chen |
| author_sort | Xiaobin Hong |
| collection | DOAJ |
| description | Aiming at the problem that multi-ship target detection and tracking based on cameras is difficult to meet the accuracy and speed requirements at the same time in some complex scenes, an improved YOLOv4 algorithm is proposed, which simplified the network of the feature extraction layer to obtain more shallow feature information and avoid the disappearance of small ship target features, and uses the residual network to replace the continuous convolution operation to solve the problems of network degradation and gradient disappearance. In addition, a nonlinear target tracking model based on the UKF method is constructed to solve the problem of low real-time performance and low precision in multi-ship target tracking. Multi-ship target detection and tracking experiments were carried out in many scenes with large differences in ship sizes, strong background interference, tilted images, backlight, insufficient illumination, and rain. Experimental results show that the average precision of the detection algorithm of this paper is 0.945, and the processing speed is about 34.5 frame per second, where the real-time performance is much better than other algorithms while maintaining high precision. Furthermore, the multiple object tracking accuracy (MOTA) and the multiple object tracking precision (MOTP) of this paper algorithm are 76.4 and 80.6, respectively, which are both better than other algorithms. The method proposed in this paper can realize the ship target detection and tracking well, with less missing detection and false detection, and also has good accuracy and real-time performance. The experimental results provide a valuable theoretical reference for the further practical application of the method. |
| first_indexed | 2024-03-09T03:17:37Z |
| format | Article |
| id | doaj.art-13f631520abe41ed9e2ab10795d23ea2 |
| institution | Directory Open Access Journal |
| issn | 2077-1312 |
| language | English |
| last_indexed | 2024-03-09T03:17:37Z |
| publishDate | 2022-07-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Journal of Marine Science and Engineering |
| spelling | doaj.art-13f631520abe41ed9e2ab10795d23ea22023-12-03T15:15:11ZengMDPI AGJournal of Marine Science and Engineering2077-13122022-07-0110797810.3390/jmse10070978Research on Multi-Ship Target Detection and Tracking Method Based on Camera in Complex ScenesXiaobin Hong0Bin Cui1Weiguo Chen2Yinhui Rao3Yuanming Chen4School of Mechanical & Automotive Engineering, South China University of Technology, Guangzhou 510641, ChinaSchool of Mechanical & Automotive Engineering, South China University of Technology, Guangzhou 510641, ChinaSchool of Mechanical & Automotive Engineering, South China University of Technology, Guangzhou 510641, ChinaGuangzhou Shipyard International Company Limited, Guangzhou 511462, ChinaSchool of Civil Engineering & Transportation, South China University of Technology, Guangzhou 510641, ChinaAiming at the problem that multi-ship target detection and tracking based on cameras is difficult to meet the accuracy and speed requirements at the same time in some complex scenes, an improved YOLOv4 algorithm is proposed, which simplified the network of the feature extraction layer to obtain more shallow feature information and avoid the disappearance of small ship target features, and uses the residual network to replace the continuous convolution operation to solve the problems of network degradation and gradient disappearance. In addition, a nonlinear target tracking model based on the UKF method is constructed to solve the problem of low real-time performance and low precision in multi-ship target tracking. Multi-ship target detection and tracking experiments were carried out in many scenes with large differences in ship sizes, strong background interference, tilted images, backlight, insufficient illumination, and rain. Experimental results show that the average precision of the detection algorithm of this paper is 0.945, and the processing speed is about 34.5 frame per second, where the real-time performance is much better than other algorithms while maintaining high precision. Furthermore, the multiple object tracking accuracy (MOTA) and the multiple object tracking precision (MOTP) of this paper algorithm are 76.4 and 80.6, respectively, which are both better than other algorithms. The method proposed in this paper can realize the ship target detection and tracking well, with less missing detection and false detection, and also has good accuracy and real-time performance. The experimental results provide a valuable theoretical reference for the further practical application of the method.https://www.mdpi.com/2077-1312/10/7/978multi-ship targettarget detectiontarget trackingcomplex scenes |
| spellingShingle | Xiaobin Hong Bin Cui Weiguo Chen Yinhui Rao Yuanming Chen Research on Multi-Ship Target Detection and Tracking Method Based on Camera in Complex Scenes Journal of Marine Science and Engineering multi-ship target target detection target tracking complex scenes |
| title | Research on Multi-Ship Target Detection and Tracking Method Based on Camera in Complex Scenes |
| title_full | Research on Multi-Ship Target Detection and Tracking Method Based on Camera in Complex Scenes |
| title_fullStr | Research on Multi-Ship Target Detection and Tracking Method Based on Camera in Complex Scenes |
| title_full_unstemmed | Research on Multi-Ship Target Detection and Tracking Method Based on Camera in Complex Scenes |
| title_short | Research on Multi-Ship Target Detection and Tracking Method Based on Camera in Complex Scenes |
| title_sort | research on multi ship target detection and tracking method based on camera in complex scenes |
| topic | multi-ship target target detection target tracking complex scenes |
| url | https://www.mdpi.com/2077-1312/10/7/978 |
| work_keys_str_mv | AT xiaobinhong researchonmultishiptargetdetectionandtrackingmethodbasedoncameraincomplexscenes AT bincui researchonmultishiptargetdetectionandtrackingmethodbasedoncameraincomplexscenes AT weiguochen researchonmultishiptargetdetectionandtrackingmethodbasedoncameraincomplexscenes AT yinhuirao researchonmultishiptargetdetectionandtrackingmethodbasedoncameraincomplexscenes AT yuanmingchen researchonmultishiptargetdetectionandtrackingmethodbasedoncameraincomplexscenes |