Multi-Path Minimum Spanning Tree and Superpixel Based Cost Aggregation for Stereo Matching
Cost aggregation is a key step in stereo matching algorithms. Despite more than a decade of development, most algorithms still encounter challenges such as high error rates in low-texture regions and blurred edges. To improve matching accuracy, we propose a novel cost aggregation method based on mul...
| Main Author: | |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2023-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/10298207/ |
| _version_ | 1797635450026852352 |
|---|---|
| author | Longhao Sun |
| author_facet | Longhao Sun |
| author_sort | Longhao Sun |
| collection | DOAJ |
| description | Cost aggregation is a key step in stereo matching algorithms. Despite more than a decade of development, most algorithms still encounter challenges such as high error rates in low-texture regions and blurred edges. To improve matching accuracy, we propose a novel cost aggregation method based on multi-path minimum spanning tree (mPMST) and superpixel in this paper. The mPMST offers more optional paths for cost aggregation than the original MST by treating the reference image as an eight-connected graph. To improve both accuracy and computational efficiency, we innovatively run the mPMST for cost aggregation at the inside-superpixel level and superpixel level, which can obtain high accuracy in high-texture regions and low-texture regions respectively. In order to effectively fuse the two-level aggregated costs, we propose a novel adaptive weight based on calculating image entropy for each superpixel. This method can distinguish between regions with high and low texture and quantify texture complexity. Additionally, a novel disparity map refinement method is proposed to improve the quality of disparity maps using the novel cost aggregation structure proposed. In the experimental studies, we test our method on Middlebury and KITTI benchmarks. Average error rates of 5.94% for Middlebury 2006 and 24.51% for KITTI 2015 are achieved. Our experiments show improvement in accuracy compared with other state-of-the-art approaches. |
| first_indexed | 2024-03-11T12:22:09Z |
| format | Article |
| id | doaj.art-cfa47c897fca41d8ace82f700d4e9251 |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-03-11T12:22:09Z |
| publishDate | 2023-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-cfa47c897fca41d8ace82f700d4e92512023-11-07T00:01:06ZengIEEEIEEE Access2169-35362023-01-011112109612110810.1109/ACCESS.2023.332824610298207Multi-Path Minimum Spanning Tree and Superpixel Based Cost Aggregation for Stereo MatchingLonghao Sun0https://orcid.org/0009-0006-3231-5244College of Computer Science and Technology, Harbin Engineering University, Harbin, ChinaCost aggregation is a key step in stereo matching algorithms. Despite more than a decade of development, most algorithms still encounter challenges such as high error rates in low-texture regions and blurred edges. To improve matching accuracy, we propose a novel cost aggregation method based on multi-path minimum spanning tree (mPMST) and superpixel in this paper. The mPMST offers more optional paths for cost aggregation than the original MST by treating the reference image as an eight-connected graph. To improve both accuracy and computational efficiency, we innovatively run the mPMST for cost aggregation at the inside-superpixel level and superpixel level, which can obtain high accuracy in high-texture regions and low-texture regions respectively. In order to effectively fuse the two-level aggregated costs, we propose a novel adaptive weight based on calculating image entropy for each superpixel. This method can distinguish between regions with high and low texture and quantify texture complexity. Additionally, a novel disparity map refinement method is proposed to improve the quality of disparity maps using the novel cost aggregation structure proposed. In the experimental studies, we test our method on Middlebury and KITTI benchmarks. Average error rates of 5.94% for Middlebury 2006 and 24.51% for KITTI 2015 are achieved. Our experiments show improvement in accuracy compared with other state-of-the-art approaches.https://ieeexplore.ieee.org/document/10298207/Stereo matchingminimum spanning treedisparity map refinementcost aggregationsimple linear iterative clustering superpixel segmentation |
| spellingShingle | Longhao Sun Multi-Path Minimum Spanning Tree and Superpixel Based Cost Aggregation for Stereo Matching IEEE Access Stereo matching minimum spanning tree disparity map refinement cost aggregation simple linear iterative clustering superpixel segmentation |
| title | Multi-Path Minimum Spanning Tree and Superpixel Based Cost Aggregation for Stereo Matching |
| title_full | Multi-Path Minimum Spanning Tree and Superpixel Based Cost Aggregation for Stereo Matching |
| title_fullStr | Multi-Path Minimum Spanning Tree and Superpixel Based Cost Aggregation for Stereo Matching |
| title_full_unstemmed | Multi-Path Minimum Spanning Tree and Superpixel Based Cost Aggregation for Stereo Matching |
| title_short | Multi-Path Minimum Spanning Tree and Superpixel Based Cost Aggregation for Stereo Matching |
| title_sort | multi path minimum spanning tree and superpixel based cost aggregation for stereo matching |
| topic | Stereo matching minimum spanning tree disparity map refinement cost aggregation simple linear iterative clustering superpixel segmentation |
| url | https://ieeexplore.ieee.org/document/10298207/ |
| work_keys_str_mv | AT longhaosun multipathminimumspanningtreeandsuperpixelbasedcostaggregationforstereomatching |