Model-Based Tracking of Fruit Flies in Free Flight

Insect flight is a complex interdisciplinary phenomenon. Understanding its multiple aspects, such as flight control, sensory integration, physiology and genetics, often requires the analysis of large amounts of free flight kinematic data. Yet, one of the main bottlenecks in this field is automatical...

Full description

Bibliographic Details
Main Authors: Omri Ben-Dov, Tsevi Beatus
Format: Article
Language:English
Published: MDPI AG 2022-11-01
Series:Insects
Subjects:
Online Access:https://www.mdpi.com/2075-4450/13/11/1018
_version_ 1797467786844307456
author Omri Ben-Dov
Tsevi Beatus
author_facet Omri Ben-Dov
Tsevi Beatus
author_sort Omri Ben-Dov
collection DOAJ
description Insect flight is a complex interdisciplinary phenomenon. Understanding its multiple aspects, such as flight control, sensory integration, physiology and genetics, often requires the analysis of large amounts of free flight kinematic data. Yet, one of the main bottlenecks in this field is automatically and accurately extracting such data from multi-view videos. Here, we present a model-based method for the pose estimation of free-flying fruit flies from multi-view high-speed videos. To obtain a faithful representation of the fly with minimum free parameters, our method uses a 3D model that includes two new aspects of wing deformation: A non-fixed wing hinge and a twisting wing surface. The method is demonstrated for free and perturbed flight. Our method does not use prior assumptions on the kinematics apart from the continuity of the wing pitch angle. Hence, this method can be readily adjusted for other insect species.
first_indexed 2024-03-09T18:58:40Z
format Article
id doaj.art-7209433a7512430b8103dc1718da199e
institution Directory Open Access Journal
issn 2075-4450
language English
last_indexed 2024-03-09T18:58:40Z
publishDate 2022-11-01
publisher MDPI AG
record_format Article
series Insects
spelling doaj.art-7209433a7512430b8103dc1718da199e2023-11-24T05:13:34ZengMDPI AGInsects2075-44502022-11-011311101810.3390/insects13111018Model-Based Tracking of Fruit Flies in Free FlightOmri Ben-Dov0Tsevi Beatus1The Institute of Life Science, The Hebrew University of Jerusalem, Jerusalem 9190401, IsraelThe Institute of Life Science, The Hebrew University of Jerusalem, Jerusalem 9190401, IsraelInsect flight is a complex interdisciplinary phenomenon. Understanding its multiple aspects, such as flight control, sensory integration, physiology and genetics, often requires the analysis of large amounts of free flight kinematic data. Yet, one of the main bottlenecks in this field is automatically and accurately extracting such data from multi-view videos. Here, we present a model-based method for the pose estimation of free-flying fruit flies from multi-view high-speed videos. To obtain a faithful representation of the fly with minimum free parameters, our method uses a 3D model that includes two new aspects of wing deformation: A non-fixed wing hinge and a twisting wing surface. The method is demonstrated for free and perturbed flight. Our method does not use prior assumptions on the kinematics apart from the continuity of the wing pitch angle. Hence, this method can be readily adjusted for other insect species.https://www.mdpi.com/2075-4450/13/11/1018insect flighttrackingpose estimationdrosophila
spellingShingle Omri Ben-Dov
Tsevi Beatus
Model-Based Tracking of Fruit Flies in Free Flight
Insects
insect flight
tracking
pose estimation
drosophila
title Model-Based Tracking of Fruit Flies in Free Flight
title_full Model-Based Tracking of Fruit Flies in Free Flight
title_fullStr Model-Based Tracking of Fruit Flies in Free Flight
title_full_unstemmed Model-Based Tracking of Fruit Flies in Free Flight
title_short Model-Based Tracking of Fruit Flies in Free Flight
title_sort model based tracking of fruit flies in free flight
topic insect flight
tracking
pose estimation
drosophila
url https://www.mdpi.com/2075-4450/13/11/1018
work_keys_str_mv AT omribendov modelbasedtrackingoffruitfliesinfreeflight
AT tsevibeatus modelbasedtrackingoffruitfliesinfreeflight