Neural Network-Based Stereo Vision Outlier Removal
Stereo vision systems rely on accurate feature matching to provide valid stereo reconstruction and pose estimation. This accuracy is achieved through outlier removal techniques, such as RANSAC. However, images also contain semantic information, which can be extracted using neural networks. This pape...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
EDP Sciences
2022-01-01
|
| Series: | MATEC Web of Conferences |
| Online Access: | https://www.matec-conferences.org/articles/matecconf/pdf/2022/17/matecconf_rapdasa2022_07009.pdf |
| _version_ | 1811301445395283968 |
|---|---|
| author | Strauss March van Daalen Corné E. |
| author_facet | Strauss March van Daalen Corné E. |
| author_sort | Strauss March |
| collection | DOAJ |
| description | Stereo vision systems rely on accurate feature matching to provide valid stereo reconstruction and pose estimation. This accuracy is achieved through outlier removal techniques, such as RANSAC. However, images also contain semantic information, which can be extracted using neural networks. This paper proposes an additional outlier removal method, where the images are semantically segmented using a neural network, before the features identified are assigned semantic identifiers using a probabilistic data association technique, and matches are evaluated based on this added semantic information. This blending of feature-based techniques with dense semantic maps allows for more information to be tied to each feature, not just its position in the image. This opens paths to applications like class-based clustering. The approach proposed is compared to a traditional outlier removal system by comparing the produced disparity values to known ground truth measurements, and assessed for accuracy and execution speed. It is shown how the addition of semantic segmentation does improve the accuracy of disparity measurements in stereo images, with a loss in processing speed. However, this loss can be mitigated by utilising more specialised hardware. |
| first_indexed | 2024-04-13T07:08:58Z |
| format | Article |
| id | doaj.art-41838d5488ff41f085a7d971e9d470ed |
| institution | Directory Open Access Journal |
| issn | 2261-236X |
| language | English |
| last_indexed | 2024-04-13T07:08:58Z |
| publishDate | 2022-01-01 |
| publisher | EDP Sciences |
| record_format | Article |
| series | MATEC Web of Conferences |
| spelling | doaj.art-41838d5488ff41f085a7d971e9d470ed2022-12-22T02:56:56ZengEDP SciencesMATEC Web of Conferences2261-236X2022-01-013700700910.1051/matecconf/202237007009matecconf_rapdasa2022_07009Neural Network-Based Stereo Vision Outlier RemovalStrauss March0van Daalen Corné E.1Stellenbosch University, Department of Electrical and Electronic EngineeringStellenbosch University, Department of Electrical and Electronic EngineeringStereo vision systems rely on accurate feature matching to provide valid stereo reconstruction and pose estimation. This accuracy is achieved through outlier removal techniques, such as RANSAC. However, images also contain semantic information, which can be extracted using neural networks. This paper proposes an additional outlier removal method, where the images are semantically segmented using a neural network, before the features identified are assigned semantic identifiers using a probabilistic data association technique, and matches are evaluated based on this added semantic information. This blending of feature-based techniques with dense semantic maps allows for more information to be tied to each feature, not just its position in the image. This opens paths to applications like class-based clustering. The approach proposed is compared to a traditional outlier removal system by comparing the produced disparity values to known ground truth measurements, and assessed for accuracy and execution speed. It is shown how the addition of semantic segmentation does improve the accuracy of disparity measurements in stereo images, with a loss in processing speed. However, this loss can be mitigated by utilising more specialised hardware.https://www.matec-conferences.org/articles/matecconf/pdf/2022/17/matecconf_rapdasa2022_07009.pdf |
| spellingShingle | Strauss March van Daalen Corné E. Neural Network-Based Stereo Vision Outlier Removal MATEC Web of Conferences |
| title | Neural Network-Based Stereo Vision Outlier Removal |
| title_full | Neural Network-Based Stereo Vision Outlier Removal |
| title_fullStr | Neural Network-Based Stereo Vision Outlier Removal |
| title_full_unstemmed | Neural Network-Based Stereo Vision Outlier Removal |
| title_short | Neural Network-Based Stereo Vision Outlier Removal |
| title_sort | neural network based stereo vision outlier removal |
| url | https://www.matec-conferences.org/articles/matecconf/pdf/2022/17/matecconf_rapdasa2022_07009.pdf |
| work_keys_str_mv | AT straussmarch neuralnetworkbasedstereovisionoutlierremoval AT vandaalencornee neuralnetworkbasedstereovisionoutlierremoval |