3D zebrafish tracking with topology association

Abstract Recently, zebrafish has received more and more attention due to its wide range of applications such as regeneration promoting therapeutics and drug discovery. Therefore, vision‐based trackers are utilized to record the swimming trajectory of zebrafish. In this paper, a re‐association method...

Full description

Bibliographic Details
Main Authors: Yuan Xu, Yichao Jin, Yang Zhang, Qunxiong Zhu, Yanlin He, Hao Sheng
Format: Article
Language:English
Published: Wiley 2023-03-01
Series:IET Image Processing
Subjects:
Online Access:https://doi.org/10.1049/ipr2.12694
Description
Summary:Abstract Recently, zebrafish has received more and more attention due to its wide range of applications such as regeneration promoting therapeutics and drug discovery. Therefore, vision‐based trackers are utilized to record the swimming trajectory of zebrafish. In this paper, a re‐association method is introduced in the 3D reconstruction process to generate missed targets caused by occlusion. Since the variation of the overall tracking targets has the property of continuity and stability, a topology association model (TAM) is proposed by point group similarity into the tracking framework. TAM describes the movement of zebrafish from the macroscopic level and utilizes the changes of the point group structure for tracking. Experimental results show that the tracking framework enhances the overall performance and promotes the trajectory integrity. On the latest 3D‐ZeF20 benchmark, state‐of‐the‐art results are achieved. In addition, TAM tracking framework is applied to 2D general tracking to prove that the method is useful and have great advantage in other scenarios with relatively stable amount of targets as well.
ISSN:1751-9659
1751-9667