Model-Based Tracking of Fruit Flies in Free Flight
Insect flight is a complex interdisciplinary phenomenon. Understanding its multiple aspects, such as flight control, sensory integration, physiology and genetics, often requires the analysis of large amounts of free flight kinematic data. Yet, one of the main bottlenecks in this field is automatical...
Main Authors: | , |
---|---|
Format: | Article |
Language: | English |
Published: |
MDPI AG
2022-11-01
|
Series: | Insects |
Subjects: | |
Online Access: | https://www.mdpi.com/2075-4450/13/11/1018 |
_version_ | 1797467786844307456 |
---|---|
author | Omri Ben-Dov Tsevi Beatus |
author_facet | Omri Ben-Dov Tsevi Beatus |
author_sort | Omri Ben-Dov |
collection | DOAJ |
description | Insect flight is a complex interdisciplinary phenomenon. Understanding its multiple aspects, such as flight control, sensory integration, physiology and genetics, often requires the analysis of large amounts of free flight kinematic data. Yet, one of the main bottlenecks in this field is automatically and accurately extracting such data from multi-view videos. Here, we present a model-based method for the pose estimation of free-flying fruit flies from multi-view high-speed videos. To obtain a faithful representation of the fly with minimum free parameters, our method uses a 3D model that includes two new aspects of wing deformation: A non-fixed wing hinge and a twisting wing surface. The method is demonstrated for free and perturbed flight. Our method does not use prior assumptions on the kinematics apart from the continuity of the wing pitch angle. Hence, this method can be readily adjusted for other insect species. |
first_indexed | 2024-03-09T18:58:40Z |
format | Article |
id | doaj.art-7209433a7512430b8103dc1718da199e |
institution | Directory Open Access Journal |
issn | 2075-4450 |
language | English |
last_indexed | 2024-03-09T18:58:40Z |
publishDate | 2022-11-01 |
publisher | MDPI AG |
record_format | Article |
series | Insects |
spelling | doaj.art-7209433a7512430b8103dc1718da199e2023-11-24T05:13:34ZengMDPI AGInsects2075-44502022-11-011311101810.3390/insects13111018Model-Based Tracking of Fruit Flies in Free FlightOmri Ben-Dov0Tsevi Beatus1The Institute of Life Science, The Hebrew University of Jerusalem, Jerusalem 9190401, IsraelThe Institute of Life Science, The Hebrew University of Jerusalem, Jerusalem 9190401, IsraelInsect flight is a complex interdisciplinary phenomenon. Understanding its multiple aspects, such as flight control, sensory integration, physiology and genetics, often requires the analysis of large amounts of free flight kinematic data. Yet, one of the main bottlenecks in this field is automatically and accurately extracting such data from multi-view videos. Here, we present a model-based method for the pose estimation of free-flying fruit flies from multi-view high-speed videos. To obtain a faithful representation of the fly with minimum free parameters, our method uses a 3D model that includes two new aspects of wing deformation: A non-fixed wing hinge and a twisting wing surface. The method is demonstrated for free and perturbed flight. Our method does not use prior assumptions on the kinematics apart from the continuity of the wing pitch angle. Hence, this method can be readily adjusted for other insect species.https://www.mdpi.com/2075-4450/13/11/1018insect flighttrackingpose estimationdrosophila |
spellingShingle | Omri Ben-Dov Tsevi Beatus Model-Based Tracking of Fruit Flies in Free Flight Insects insect flight tracking pose estimation drosophila |
title | Model-Based Tracking of Fruit Flies in Free Flight |
title_full | Model-Based Tracking of Fruit Flies in Free Flight |
title_fullStr | Model-Based Tracking of Fruit Flies in Free Flight |
title_full_unstemmed | Model-Based Tracking of Fruit Flies in Free Flight |
title_short | Model-Based Tracking of Fruit Flies in Free Flight |
title_sort | model based tracking of fruit flies in free flight |
topic | insect flight tracking pose estimation drosophila |
url | https://www.mdpi.com/2075-4450/13/11/1018 |
work_keys_str_mv | AT omribendov modelbasedtrackingoffruitfliesinfreeflight AT tsevibeatus modelbasedtrackingoffruitfliesinfreeflight |