Video segmentation by detection for the 2019 Unsupervised DAVIS Challenge

In this work, we present a new framework, video segmentation by detection (VSD), for tackling the problem of unsupervised video multi-object segmentation. Our model employs an object detector for automatic target discovery and a set of single-object trackers for the simultaneous tracking of all targ...

সম্পূর্ণ বিবরণ

গ্রন্থ-পঞ্জীর বিবরন
প্রধান লেখক: Yang, Z, Wang, Q, Bai, S, Hu, W, Torr, P
বিন্যাস: Conference item
প্রকাশিত: DAVIS: Densely Annotated VIdeo Segmentation 2019
_version_ 1826264976033054720
author Yang, Z
Wang, Q
Bai, S
Hu, W
Torr, P
author_facet Yang, Z
Wang, Q
Bai, S
Hu, W
Torr, P
author_sort Yang, Z
collection OXFORD
description In this work, we present a new framework, video segmentation by detection (VSD), for tackling the problem of unsupervised video multi-object segmentation. Our model employs an object detector for automatic target discovery and a set of single-object trackers for the simultaneous tracking of all targets. While addressing the object re-identification problem, we observe that many of the objects of interest in the dataset are humans or human centric such as bicycles. As such, following a design philosophy that special purpose algorithms will always be better than general purpose ones, we explore whether we can leverage the rich existing research efforts on re-identifying humans to improve the results or exploit the spatial relations of human-centric objects to humans. The proposed method achieves the highest J -Mean of 0.535 and an overall second place in the unsupervised track of the 2019 DAVIS Challenge.
first_indexed 2024-03-06T20:16:25Z
format Conference item
id oxford-uuid:2c4aea29-c1b8-4ae2-8fe9-88c95bcb242c
institution University of Oxford
last_indexed 2024-03-06T20:16:25Z
publishDate 2019
publisher DAVIS: Densely Annotated VIdeo Segmentation
record_format dspace
spelling oxford-uuid:2c4aea29-c1b8-4ae2-8fe9-88c95bcb242c2022-03-26T12:36:08ZVideo segmentation by detection for the 2019 Unsupervised DAVIS ChallengeConference itemhttp://purl.org/coar/resource_type/c_5794uuid:2c4aea29-c1b8-4ae2-8fe9-88c95bcb242cSymplectic Elements at OxfordDAVIS: Densely Annotated VIdeo Segmentation2019Yang, ZWang, QBai, SHu, WTorr, PIn this work, we present a new framework, video segmentation by detection (VSD), for tackling the problem of unsupervised video multi-object segmentation. Our model employs an object detector for automatic target discovery and a set of single-object trackers for the simultaneous tracking of all targets. While addressing the object re-identification problem, we observe that many of the objects of interest in the dataset are humans or human centric such as bicycles. As such, following a design philosophy that special purpose algorithms will always be better than general purpose ones, we explore whether we can leverage the rich existing research efforts on re-identifying humans to improve the results or exploit the spatial relations of human-centric objects to humans. The proposed method achieves the highest J -Mean of 0.535 and an overall second place in the unsupervised track of the 2019 DAVIS Challenge.
spellingShingle Yang, Z
Wang, Q
Bai, S
Hu, W
Torr, P
Video segmentation by detection for the 2019 Unsupervised DAVIS Challenge
title Video segmentation by detection for the 2019 Unsupervised DAVIS Challenge
title_full Video segmentation by detection for the 2019 Unsupervised DAVIS Challenge
title_fullStr Video segmentation by detection for the 2019 Unsupervised DAVIS Challenge
title_full_unstemmed Video segmentation by detection for the 2019 Unsupervised DAVIS Challenge
title_short Video segmentation by detection for the 2019 Unsupervised DAVIS Challenge
title_sort video segmentation by detection for the 2019 unsupervised davis challenge
work_keys_str_mv AT yangz videosegmentationbydetectionforthe2019unsuperviseddavischallenge
AT wangq videosegmentationbydetectionforthe2019unsuperviseddavischallenge
AT bais videosegmentationbydetectionforthe2019unsuperviseddavischallenge
AT huw videosegmentationbydetectionforthe2019unsuperviseddavischallenge
AT torrp videosegmentationbydetectionforthe2019unsuperviseddavischallenge