Geometry-aware video object detection for static cameras
In this paper we propose a geometry-aware model for video object detection. Specifically, we consider the setting that cameras can be well approximated as static, e.g. in video surveillance scenarios, and scene pseudo depth maps can therefore be inferred easily from the object scale on the image pla...
| Main Authors: | , , |
|---|---|
| Format: | Conference item |
| Language: | English |
| Published: |
British Machine Vision Association
2019
|
| _version_ | 1826293327177187328 |
|---|---|
| author | Xu, D Xie, W Zisserman, A |
| author_facet | Xu, D Xie, W Zisserman, A |
| author_sort | Xu, D |
| collection | OXFORD |
| description | In this paper we propose a geometry-aware model for video object detection. Specifically, we consider the setting that cameras can be well approximated as static, e.g. in video surveillance scenarios, and scene pseudo depth maps can therefore be inferred easily from the object scale on the image plane.
We make the following contributions: First, we extend the recent anchor-free detector (CornerNet [17]) to video object detections. In order to exploit the spatial-temporal information while maintaining high efficiency, the proposed model accepts video clips as input, and only makes predictions for the starting and the ending frames, i.e. heatmaps of object bounding box corners and the corresponding embeddings for grouping. Second, to tackle the challenge from scale variations in object detection, scene geometry information, e.g. derived depth maps, is explicitly incorporated into deep networks for multiscale feature selection and for the network prediction. Third, we validate the proposed architectures on an autonomous driving dataset generated from the Carla simulator [5], and on a real dataset for human detection (DukeMTMC dataset [28]). When comparing with the existing competitive single-stage or two-stage detectors, the proposed geometry-aware spatio-temporal network achieves significantly better results. |
| first_indexed | 2024-03-07T03:28:24Z |
| format | Conference item |
| id | oxford-uuid:b9d42da3-8cfa-4020-a6ad-675b17dcafcc |
| institution | University of Oxford |
| language | English |
| last_indexed | 2024-03-07T03:28:24Z |
| publishDate | 2019 |
| publisher | British Machine Vision Association |
| record_format | dspace |
| spelling | oxford-uuid:b9d42da3-8cfa-4020-a6ad-675b17dcafcc2022-03-27T05:05:53ZGeometry-aware video object detection for static camerasConference itemhttp://purl.org/coar/resource_type/c_5794uuid:b9d42da3-8cfa-4020-a6ad-675b17dcafccEnglishSymplectic Elements at OxfordBritish Machine Vision Association2019Xu, DXie, WZisserman, AIn this paper we propose a geometry-aware model for video object detection. Specifically, we consider the setting that cameras can be well approximated as static, e.g. in video surveillance scenarios, and scene pseudo depth maps can therefore be inferred easily from the object scale on the image plane. We make the following contributions: First, we extend the recent anchor-free detector (CornerNet [17]) to video object detections. In order to exploit the spatial-temporal information while maintaining high efficiency, the proposed model accepts video clips as input, and only makes predictions for the starting and the ending frames, i.e. heatmaps of object bounding box corners and the corresponding embeddings for grouping. Second, to tackle the challenge from scale variations in object detection, scene geometry information, e.g. derived depth maps, is explicitly incorporated into deep networks for multiscale feature selection and for the network prediction. Third, we validate the proposed architectures on an autonomous driving dataset generated from the Carla simulator [5], and on a real dataset for human detection (DukeMTMC dataset [28]). When comparing with the existing competitive single-stage or two-stage detectors, the proposed geometry-aware spatio-temporal network achieves significantly better results. |
| spellingShingle | Xu, D Xie, W Zisserman, A Geometry-aware video object detection for static cameras |
| title | Geometry-aware video object detection for static cameras |
| title_full | Geometry-aware video object detection for static cameras |
| title_fullStr | Geometry-aware video object detection for static cameras |
| title_full_unstemmed | Geometry-aware video object detection for static cameras |
| title_short | Geometry-aware video object detection for static cameras |
| title_sort | geometry aware video object detection for static cameras |
| work_keys_str_mv | AT xud geometryawarevideoobjectdetectionforstaticcameras AT xiew geometryawarevideoobjectdetectionforstaticcameras AT zissermana geometryawarevideoobjectdetectionforstaticcameras |