Improvement of Non-Maximum Suppression in RGB-D Object Detection
Currently, the non-maximum suppression (NMS) algorithm is a commonly used method in the post-processing stage of object detection. However, the NMS algorithm cannot effectively eliminate missing and false object detection results because of the simple constraint condition. To solve the problem of th...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2019-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/8863938/ |
| _version_ | 1811210625739653120 |
|---|---|
| author | Decheng Wang Xiangning Chen Hui Yi Feng Zhao |
| author_facet | Decheng Wang Xiangning Chen Hui Yi Feng Zhao |
| author_sort | Decheng Wang |
| collection | DOAJ |
| description | Currently, the non-maximum suppression (NMS) algorithm is a commonly used method in the post-processing stage of object detection. However, the NMS algorithm cannot effectively eliminate missing and false object detection results because of the simple constraint condition. To solve the problem of the poor detection effect in highly overlapping dense object scenes in the traditional NMS algorithm, we design an RGB-D object detection network model based on the YOLO v3 framework, and using level-by-level metaphase fusion on the RGB and depth information, we propose an improved NMS algorithm which fuses depth characteristics. According to the depth of the object in the detection boxes, it is determined whether another object is the same object in highly overlapping detection boxes, and the average depth of the internal pixels in the detection boxes is calculated as a penalty term, then the penalty term is added to the detection box score to obtain a new constraint condition for non-maximum suppression. The experimental results on the NYU Depth V2 dataset show that the mean average precision (mAP) of the Depth Fusion NMS algorithm proposed in this paper is 0.8%, 0.5% and 0.3% higher than those of the Greedy-NMS, Soft NMS-L and Soft NMS-G methods, respectively. After comparison and analysis, our method can not only detect more overlapping objects but also achieve a better object localization accuracy. |
| first_indexed | 2024-04-12T04:57:59Z |
| format | Article |
| id | doaj.art-5dc9e8b87c2e422aabfc099d9610bd2b |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-04-12T04:57:59Z |
| publishDate | 2019-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-5dc9e8b87c2e422aabfc099d9610bd2b2022-12-22T03:47:03ZengIEEEIEEE Access2169-35362019-01-01714413414414310.1109/ACCESS.2019.29458348863938Improvement of Non-Maximum Suppression in RGB-D Object DetectionDecheng Wang0https://orcid.org/0000-0003-4424-1589Xiangning Chen1Hui Yi2Feng Zhao3Academic of Space Information, University of Space Engineering, Beijing, ChinaAcademic of Space Information, University of Space Engineering, Beijing, ChinaAcademic of Space Information, University of Space Engineering, Beijing, ChinaAcademic of Space Information, University of Space Engineering, Beijing, ChinaCurrently, the non-maximum suppression (NMS) algorithm is a commonly used method in the post-processing stage of object detection. However, the NMS algorithm cannot effectively eliminate missing and false object detection results because of the simple constraint condition. To solve the problem of the poor detection effect in highly overlapping dense object scenes in the traditional NMS algorithm, we design an RGB-D object detection network model based on the YOLO v3 framework, and using level-by-level metaphase fusion on the RGB and depth information, we propose an improved NMS algorithm which fuses depth characteristics. According to the depth of the object in the detection boxes, it is determined whether another object is the same object in highly overlapping detection boxes, and the average depth of the internal pixels in the detection boxes is calculated as a penalty term, then the penalty term is added to the detection box score to obtain a new constraint condition for non-maximum suppression. The experimental results on the NYU Depth V2 dataset show that the mean average precision (mAP) of the Depth Fusion NMS algorithm proposed in this paper is 0.8%, 0.5% and 0.3% higher than those of the Greedy-NMS, Soft NMS-L and Soft NMS-G methods, respectively. After comparison and analysis, our method can not only detect more overlapping objects but also achieve a better object localization accuracy.https://ieeexplore.ieee.org/document/8863938/Non-maximum suppressionRGB-D object detectionintersection-over-uniondetection boxesmultimodal fusion |
| spellingShingle | Decheng Wang Xiangning Chen Hui Yi Feng Zhao Improvement of Non-Maximum Suppression in RGB-D Object Detection IEEE Access Non-maximum suppression RGB-D object detection intersection-over-union detection boxes multimodal fusion |
| title | Improvement of Non-Maximum Suppression in RGB-D Object Detection |
| title_full | Improvement of Non-Maximum Suppression in RGB-D Object Detection |
| title_fullStr | Improvement of Non-Maximum Suppression in RGB-D Object Detection |
| title_full_unstemmed | Improvement of Non-Maximum Suppression in RGB-D Object Detection |
| title_short | Improvement of Non-Maximum Suppression in RGB-D Object Detection |
| title_sort | improvement of non maximum suppression in rgb d object detection |
| topic | Non-maximum suppression RGB-D object detection intersection-over-union detection boxes multimodal fusion |
| url | https://ieeexplore.ieee.org/document/8863938/ |
| work_keys_str_mv | AT dechengwang improvementofnonmaximumsuppressioninrgbdobjectdetection AT xiangningchen improvementofnonmaximumsuppressioninrgbdobjectdetection AT huiyi improvementofnonmaximumsuppressioninrgbdobjectdetection AT fengzhao improvementofnonmaximumsuppressioninrgbdobjectdetection |