ESPEE: Event-Based Sensor Pose Estimation Using an Extended Kalman Filter

Event-based vision sensors show great promise for use in embedded applications requiring low-latency passive sensing at a low computational cost. In this paper, we present an event-based algorithm that relies on an Extended Kalman Filter for 6-Degree of Freedom sensor pose estimation. The algorithm...

Full description

Bibliographic Details
Main Authors: Fabien Colonnier, Luca Della Vedova, Garrick Orchard
Format: Article
Language:English
Published: MDPI AG 2021-11-01
Series:Sensors
Subjects:
Online Access:https://www.mdpi.com/1424-8220/21/23/7840
_version_ 1827674679883595776
author Fabien Colonnier
Luca Della Vedova
Garrick Orchard
author_facet Fabien Colonnier
Luca Della Vedova
Garrick Orchard
author_sort Fabien Colonnier
collection DOAJ
description Event-based vision sensors show great promise for use in embedded applications requiring low-latency passive sensing at a low computational cost. In this paper, we present an event-based algorithm that relies on an Extended Kalman Filter for 6-Degree of Freedom sensor pose estimation. The algorithm updates the sensor pose event-by-event with low latency (worst case of less than 2 μs on an FPGA). Using a single handheld sensor, we test the algorithm on multiple recordings, ranging from a high contrast printed planar scene to a more natural scene consisting of objects viewed from above. The pose is accurately estimated under rapid motions, up to 2.7 m/s. Thereafter, an extension to multiple sensors is described and tested, highlighting the improved performance of such a setup, as well as the integration with an off-the-shelf mapping algorithm to allow point cloud updates with a 3D scene and enhance the potential applications of this visual odometry solution.
first_indexed 2024-03-10T04:45:42Z
format Article
id doaj.art-b47a0d79e208448887b11f30b50237a0
institution Directory Open Access Journal
issn 1424-8220
language English
last_indexed 2024-03-10T04:45:42Z
publishDate 2021-11-01
publisher MDPI AG
record_format Article
series Sensors
spelling doaj.art-b47a0d79e208448887b11f30b50237a02023-11-23T03:00:05ZengMDPI AGSensors1424-82202021-11-012123784010.3390/s21237840ESPEE: Event-Based Sensor Pose Estimation Using an Extended Kalman FilterFabien Colonnier0Luca Della Vedova1Garrick Orchard2Temasek Laboratories, National University of Singapore, Singapore 117411, SingaporeOpen Source Robotics Corporation, Singapore 138633, SingaporeTemasek Laboratories, National University of Singapore, Singapore 117411, SingaporeEvent-based vision sensors show great promise for use in embedded applications requiring low-latency passive sensing at a low computational cost. In this paper, we present an event-based algorithm that relies on an Extended Kalman Filter for 6-Degree of Freedom sensor pose estimation. The algorithm updates the sensor pose event-by-event with low latency (worst case of less than 2 μs on an FPGA). Using a single handheld sensor, we test the algorithm on multiple recordings, ranging from a high contrast printed planar scene to a more natural scene consisting of objects viewed from above. The pose is accurately estimated under rapid motions, up to 2.7 m/s. Thereafter, an extension to multiple sensors is described and tested, highlighting the improved performance of such a setup, as well as the integration with an off-the-shelf mapping algorithm to allow point cloud updates with a 3D scene and enhance the potential applications of this visual odometry solution.https://www.mdpi.com/1424-8220/21/23/7840event-based sensorvisual odometryextended Kalman filtercomputer visionstructureless measurement model
spellingShingle Fabien Colonnier
Luca Della Vedova
Garrick Orchard
ESPEE: Event-Based Sensor Pose Estimation Using an Extended Kalman Filter
Sensors
event-based sensor
visual odometry
extended Kalman filter
computer vision
structureless measurement model
title ESPEE: Event-Based Sensor Pose Estimation Using an Extended Kalman Filter
title_full ESPEE: Event-Based Sensor Pose Estimation Using an Extended Kalman Filter
title_fullStr ESPEE: Event-Based Sensor Pose Estimation Using an Extended Kalman Filter
title_full_unstemmed ESPEE: Event-Based Sensor Pose Estimation Using an Extended Kalman Filter
title_short ESPEE: Event-Based Sensor Pose Estimation Using an Extended Kalman Filter
title_sort espee event based sensor pose estimation using an extended kalman filter
topic event-based sensor
visual odometry
extended Kalman filter
computer vision
structureless measurement model
url https://www.mdpi.com/1424-8220/21/23/7840
work_keys_str_mv AT fabiencolonnier espeeeventbasedsensorposeestimationusinganextendedkalmanfilter
AT lucadellavedova espeeeventbasedsensorposeestimationusinganextendedkalmanfilter
AT garrickorchard espeeeventbasedsensorposeestimationusinganextendedkalmanfilter