Filter-based mean-field inference for random fields with higher-order terms and product label-spaces

Recently, a number of cross bilateral filtering methods have been proposed for solving multi-label problems in computer vision, such as stereo, optical flow and object class segmentation that show an order of magnitude improvement in speed over previous methods. These methods have achieved good resu...

Full description

Bibliographic Details
Main Authors: Vineet, V, Warrell, J, Torr, PHS
Format: Conference item
Language:English
Published: Springer 2012
_version_ 1811141021416816640
author Vineet, V
Warrell, J
Torr, PHS
author_facet Vineet, V
Warrell, J
Torr, PHS
author_sort Vineet, V
collection OXFORD
description Recently, a number of cross bilateral filtering methods have been proposed for solving multi-label problems in computer vision, such as stereo, optical flow and object class segmentation that show an order of magnitude improvement in speed over previous methods. These methods have achieved good results despite using models with only unary and/or pairwise terms. However, previous work has shown the value of using models with higher-order terms e.g. to represent label consistency over large regions, or global co-occurrence relations. We show how these higher-order terms can be formulated such that filter-based inference remains possible. We demonstrate our techniques on joint stereo and object labeling problems, as well as object class segmentation, showing in addition for joint object-stereo labeling how our method provides an efficient approach to inference in product label-spaces. We show that we are able to speed up inference in these models around 10-30 times with respect to competing graph-cut/move-making methods, as well as maintaining or improving accuracy in all cases. We show results on PascalVOC-10 for object class segmentation, and Leuven for joint object-stereo labeling.
first_indexed 2024-09-25T04:31:15Z
format Conference item
id oxford-uuid:04fd5d66-0d9d-4193-86fe-e579961d4fd0
institution University of Oxford
language English
last_indexed 2024-09-25T04:31:15Z
publishDate 2012
publisher Springer
record_format dspace
spelling oxford-uuid:04fd5d66-0d9d-4193-86fe-e579961d4fd02024-09-03T16:32:20ZFilter-based mean-field inference for random fields with higher-order terms and product label-spacesConference itemhttp://purl.org/coar/resource_type/c_5794uuid:04fd5d66-0d9d-4193-86fe-e579961d4fd0EnglishSymplectic ElementsSpringer2012Vineet, VWarrell, JTorr, PHSRecently, a number of cross bilateral filtering methods have been proposed for solving multi-label problems in computer vision, such as stereo, optical flow and object class segmentation that show an order of magnitude improvement in speed over previous methods. These methods have achieved good results despite using models with only unary and/or pairwise terms. However, previous work has shown the value of using models with higher-order terms e.g. to represent label consistency over large regions, or global co-occurrence relations. We show how these higher-order terms can be formulated such that filter-based inference remains possible. We demonstrate our techniques on joint stereo and object labeling problems, as well as object class segmentation, showing in addition for joint object-stereo labeling how our method provides an efficient approach to inference in product label-spaces. We show that we are able to speed up inference in these models around 10-30 times with respect to competing graph-cut/move-making methods, as well as maintaining or improving accuracy in all cases. We show results on PascalVOC-10 for object class segmentation, and Leuven for joint object-stereo labeling.
spellingShingle Vineet, V
Warrell, J
Torr, PHS
Filter-based mean-field inference for random fields with higher-order terms and product label-spaces
title Filter-based mean-field inference for random fields with higher-order terms and product label-spaces
title_full Filter-based mean-field inference for random fields with higher-order terms and product label-spaces
title_fullStr Filter-based mean-field inference for random fields with higher-order terms and product label-spaces
title_full_unstemmed Filter-based mean-field inference for random fields with higher-order terms and product label-spaces
title_short Filter-based mean-field inference for random fields with higher-order terms and product label-spaces
title_sort filter based mean field inference for random fields with higher order terms and product label spaces
work_keys_str_mv AT vineetv filterbasedmeanfieldinferenceforrandomfieldswithhigherordertermsandproductlabelspaces
AT warrellj filterbasedmeanfieldinferenceforrandomfieldswithhigherordertermsandproductlabelspaces
AT torrphs filterbasedmeanfieldinferenceforrandomfieldswithhigherordertermsandproductlabelspaces