Multimotion visual odometry (MVO): Simultaneous estimation of camera and third-party motions

Estimating motion from images is a well-studied problem in computer vision and robotics. Previous work has developed techniques to estimate the motion of a moving camera in a largely static environment (e.g., visual odometry) and to segment or track motions in a dynamic scene using known camera moti...

Full description

Bibliographic Details
Main Authors: Judd, K, Gammell, J, Newman, P
Format: Conference item
Published: IEEE 2019
_version_ 1797085272427462656
author Judd, K
Gammell, J
Newman, P
author_facet Judd, K
Gammell, J
Newman, P
author_sort Judd, K
collection OXFORD
description Estimating motion from images is a well-studied problem in computer vision and robotics. Previous work has developed techniques to estimate the motion of a moving camera in a largely static environment (e.g., visual odometry) and to segment or track motions in a dynamic scene using known camera motions (e.g., multiple object tracking). It is more challenging to estimate the unknown motion of the camera and the dynamic scene simultaneously. Most previous work requires a priori object models (e.g., trackingby-detection), motion constraints (e.g., planar motion), or fails to estimate the full SE (3) motions of the scene (e.g., scene flow). While these approaches work well in specific application domains, they are not generalizable to unconstrained motions. This paper extends the traditional visual odometry (VO) pipeline to estimate the full SE (3) motion of both a stereo/RGBD camera and the dynamic scene. This multimotion visual odometry (MVO) pipeline requires no a priori knowledge of the environment or the dynamic objects. Its performance is evaluated on a real-world dynamic dataset with ground truth for all motions from a motion capture system.
first_indexed 2024-03-07T02:06:33Z
format Conference item
id oxford-uuid:9f33f183-1901-4134-bd40-7cfbc97c8c60
institution University of Oxford
last_indexed 2024-03-07T02:06:33Z
publishDate 2019
publisher IEEE
record_format dspace
spelling oxford-uuid:9f33f183-1901-4134-bd40-7cfbc97c8c602022-03-27T00:55:36ZMultimotion visual odometry (MVO): Simultaneous estimation of camera and third-party motionsConference itemhttp://purl.org/coar/resource_type/c_5794uuid:9f33f183-1901-4134-bd40-7cfbc97c8c60Symplectic Elements at OxfordIEEE2019Judd, KGammell, JNewman, PEstimating motion from images is a well-studied problem in computer vision and robotics. Previous work has developed techniques to estimate the motion of a moving camera in a largely static environment (e.g., visual odometry) and to segment or track motions in a dynamic scene using known camera motions (e.g., multiple object tracking). It is more challenging to estimate the unknown motion of the camera and the dynamic scene simultaneously. Most previous work requires a priori object models (e.g., trackingby-detection), motion constraints (e.g., planar motion), or fails to estimate the full SE (3) motions of the scene (e.g., scene flow). While these approaches work well in specific application domains, they are not generalizable to unconstrained motions. This paper extends the traditional visual odometry (VO) pipeline to estimate the full SE (3) motion of both a stereo/RGBD camera and the dynamic scene. This multimotion visual odometry (MVO) pipeline requires no a priori knowledge of the environment or the dynamic objects. Its performance is evaluated on a real-world dynamic dataset with ground truth for all motions from a motion capture system.
spellingShingle Judd, K
Gammell, J
Newman, P
Multimotion visual odometry (MVO): Simultaneous estimation of camera and third-party motions
title Multimotion visual odometry (MVO): Simultaneous estimation of camera and third-party motions
title_full Multimotion visual odometry (MVO): Simultaneous estimation of camera and third-party motions
title_fullStr Multimotion visual odometry (MVO): Simultaneous estimation of camera and third-party motions
title_full_unstemmed Multimotion visual odometry (MVO): Simultaneous estimation of camera and third-party motions
title_short Multimotion visual odometry (MVO): Simultaneous estimation of camera and third-party motions
title_sort multimotion visual odometry mvo simultaneous estimation of camera and third party motions
work_keys_str_mv AT juddk multimotionvisualodometrymvosimultaneousestimationofcameraandthirdpartymotions
AT gammellj multimotionvisualodometrymvosimultaneousestimationofcameraandthirdpartymotions
AT newmanp multimotionvisualodometrymvosimultaneousestimationofcameraandthirdpartymotions