Sepia, Tarsier, and Chameleon: A Modular C++ Framework for Event-Based Computer Vision
This paper introduces an new open-source, header-only and modular C++ framework to facilitate the implementation of event-driven algorithms. The framework relies on three independent components: sepia (file IO), tarsier (algorithms), and chameleon (display). Our benchmarks show that algorithms imple...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Frontiers Media S.A.
2020-01-01
|
| Series: | Frontiers in Neuroscience |
| Subjects: | |
| Online Access: | https://www.frontiersin.org/article/10.3389/fnins.2019.01338/full |
| _version_ | 1818325689662701568 |
|---|---|
| author | Alexandre Marcireau Sio-Hoi Ieng Ryad Benosman Ryad Benosman Ryad Benosman |
| author_facet | Alexandre Marcireau Sio-Hoi Ieng Ryad Benosman Ryad Benosman Ryad Benosman |
| author_sort | Alexandre Marcireau |
| collection | DOAJ |
| description | This paper introduces an new open-source, header-only and modular C++ framework to facilitate the implementation of event-driven algorithms. The framework relies on three independent components: sepia (file IO), tarsier (algorithms), and chameleon (display). Our benchmarks show that algorithms implemented with tarsier are faster and have a lower latency than identical implementations in other state-of-the-art frameworks, thanks to static polymorphism (compile-time pipeline assembly). The observer pattern used throughout the framework encourages implementations that better reflect the event-driven nature of the algorithms and the way they process events, easing future translation to neuromorphic hardware. The framework integrates drivers to communicate with the DVS, the DAVIS, the Opal Kelly ATIS, and the CCam ATIS. |
| first_indexed | 2024-12-13T11:48:29Z |
| format | Article |
| id | doaj.art-61da59b2454f454488b0be842543e93b |
| institution | Directory Open Access Journal |
| issn | 1662-453X |
| language | English |
| last_indexed | 2024-12-13T11:48:29Z |
| publishDate | 2020-01-01 |
| publisher | Frontiers Media S.A. |
| record_format | Article |
| series | Frontiers in Neuroscience |
| spelling | doaj.art-61da59b2454f454488b0be842543e93b2022-12-21T23:47:27ZengFrontiers Media S.A.Frontiers in Neuroscience1662-453X2020-01-011310.3389/fnins.2019.01338482840Sepia, Tarsier, and Chameleon: A Modular C++ Framework for Event-Based Computer VisionAlexandre Marcireau0Sio-Hoi Ieng1Ryad Benosman2Ryad Benosman3Ryad Benosman4INSERM UMRI S 968, Sorbonne Universites, UPMC Univ Paris 06, UMR S 968, CNRS, UMR 7210, Institut de la Vision, Paris, FranceINSERM UMRI S 968, Sorbonne Universites, UPMC Univ Paris 06, UMR S 968, CNRS, UMR 7210, Institut de la Vision, Paris, FranceINSERM UMRI S 968, Sorbonne Universites, UPMC Univ Paris 06, UMR S 968, CNRS, UMR 7210, Institut de la Vision, Paris, FranceUniversity of Pittsburgh Medical Center, Pittsburgh, PA, United StatesRobotics Institute, Carnegie Mellon University, Pittsburgh, PA, United StatesThis paper introduces an new open-source, header-only and modular C++ framework to facilitate the implementation of event-driven algorithms. The framework relies on three independent components: sepia (file IO), tarsier (algorithms), and chameleon (display). Our benchmarks show that algorithms implemented with tarsier are faster and have a lower latency than identical implementations in other state-of-the-art frameworks, thanks to static polymorphism (compile-time pipeline assembly). The observer pattern used throughout the framework encourages implementations that better reflect the event-driven nature of the algorithms and the way they process events, easing future translation to neuromorphic hardware. The framework integrates drivers to communicate with the DVS, the DAVIS, the Opal Kelly ATIS, and the CCam ATIS.https://www.frontiersin.org/article/10.3389/fnins.2019.01338/fullsilicon retinasevent-based sensingdevelopment frameworkevent-based processingasynchronous computation |
| spellingShingle | Alexandre Marcireau Sio-Hoi Ieng Ryad Benosman Ryad Benosman Ryad Benosman Sepia, Tarsier, and Chameleon: A Modular C++ Framework for Event-Based Computer Vision Frontiers in Neuroscience silicon retinas event-based sensing development framework event-based processing asynchronous computation |
| title | Sepia, Tarsier, and Chameleon: A Modular C++ Framework for Event-Based Computer Vision |
| title_full | Sepia, Tarsier, and Chameleon: A Modular C++ Framework for Event-Based Computer Vision |
| title_fullStr | Sepia, Tarsier, and Chameleon: A Modular C++ Framework for Event-Based Computer Vision |
| title_full_unstemmed | Sepia, Tarsier, and Chameleon: A Modular C++ Framework for Event-Based Computer Vision |
| title_short | Sepia, Tarsier, and Chameleon: A Modular C++ Framework for Event-Based Computer Vision |
| title_sort | sepia tarsier and chameleon a modular c framework for event based computer vision |
| topic | silicon retinas event-based sensing development framework event-based processing asynchronous computation |
| url | https://www.frontiersin.org/article/10.3389/fnins.2019.01338/full |
| work_keys_str_mv | AT alexandremarcireau sepiatarsierandchameleonamodularcframeworkforeventbasedcomputervision AT siohoiieng sepiatarsierandchameleonamodularcframeworkforeventbasedcomputervision AT ryadbenosman sepiatarsierandchameleonamodularcframeworkforeventbasedcomputervision AT ryadbenosman sepiatarsierandchameleonamodularcframeworkforeventbasedcomputervision AT ryadbenosman sepiatarsierandchameleonamodularcframeworkforeventbasedcomputervision |