Enhance Fluorescence Imaging and Remove Motion Artifacts by Combining Pixel Tracking, Interleaved Acquisition, and Temporal Gating

Fluorescence imaging has been applied to improving many medical sub-specialties. In a clinical setting, there are motions of the imaging system and patients, as well as a high ambient light background. This presents a challenge for widely using fluorescence imaging systems clinically. In this paper,...

Full description

Bibliographic Details
Main Authors: Christopher Mela, Francis Papay, Yang Liu
Format: Article
Language:English
Published: IEEE 2021-01-01
Series:IEEE Photonics Journal
Subjects:
Online Access:https://ieeexplore.ieee.org/document/9343706/
_version_ 1818457997113819136
author Christopher Mela
Francis Papay
Yang Liu
author_facet Christopher Mela
Francis Papay
Yang Liu
author_sort Christopher Mela
collection DOAJ
description Fluorescence imaging has been applied to improving many medical sub-specialties. In a clinical setting, there are motions of the imaging system and patients, as well as a high ambient light background. This presents a challenge for widely using fluorescence imaging systems clinically. In this paper, we present a novel approach combining computer vision and pulsed imaging system for enhanced fluorescence Imaging and motion artifacts removal. Specifically, we use a dense optical flow point tracking regime in conjunction with pulsed fluorescence excitation and interleaved acquisition. The system was characterized with respect to fluorescent detection sensitivity, using a clinically relevant fluorescent environment, and the results were compared to conventional steady-state (DC) fluorescence imaging. We also characterized the system with respect to fluorescence detection accuracy. We demonstrated a 45-fold reduction of motion artifacts by combining pixel tracking and fluorescence pixel identification with pulsed light imaging. Furthermore, the fluorescence imaging signal-to-background ratio is also improved for more than 2-fold. Our results indicate that pixel tracking, temporal gating, and interleaved acquisition can improve fluorescence imaging, especially for uses in realistic clinical settings where there is a high ambient light background.
first_indexed 2024-12-14T22:51:27Z
format Article
id doaj.art-b2fc9e4ebf7e4d5392a317184e2c5d99
institution Directory Open Access Journal
issn 1943-0655
language English
last_indexed 2024-12-14T22:51:27Z
publishDate 2021-01-01
publisher IEEE
record_format Article
series IEEE Photonics Journal
spelling doaj.art-b2fc9e4ebf7e4d5392a317184e2c5d992022-12-21T22:44:43ZengIEEEIEEE Photonics Journal1943-06552021-01-0113111310.1109/JPHOT.2021.30558099343706Enhance Fluorescence Imaging and Remove Motion Artifacts by Combining Pixel Tracking, Interleaved Acquisition, and Temporal GatingChristopher Mela0Francis Papay1Yang Liu2https://orcid.org/0000-0002-3893-3215Department of Biomedical Engineering, The University of Akron, Akron, OH, USADermatology & Plastic Surgery Institute, Cleveland Clinic, Cleveland, OH, USADepartment of Electrical and Computer Engineering, The University of Iowa, IA City, IA, USAFluorescence imaging has been applied to improving many medical sub-specialties. In a clinical setting, there are motions of the imaging system and patients, as well as a high ambient light background. This presents a challenge for widely using fluorescence imaging systems clinically. In this paper, we present a novel approach combining computer vision and pulsed imaging system for enhanced fluorescence Imaging and motion artifacts removal. Specifically, we use a dense optical flow point tracking regime in conjunction with pulsed fluorescence excitation and interleaved acquisition. The system was characterized with respect to fluorescent detection sensitivity, using a clinically relevant fluorescent environment, and the results were compared to conventional steady-state (DC) fluorescence imaging. We also characterized the system with respect to fluorescence detection accuracy. We demonstrated a 45-fold reduction of motion artifacts by combining pixel tracking and fluorescence pixel identification with pulsed light imaging. Furthermore, the fluorescence imaging signal-to-background ratio is also improved for more than 2-fold. Our results indicate that pixel tracking, temporal gating, and interleaved acquisition can improve fluorescence imaging, especially for uses in realistic clinical settings where there is a high ambient light background.https://ieeexplore.ieee.org/document/9343706/Biophotonicsmedical photonicsfluorescence imagingcomputer visionoptical imagingimage-guided surgery
spellingShingle Christopher Mela
Francis Papay
Yang Liu
Enhance Fluorescence Imaging and Remove Motion Artifacts by Combining Pixel Tracking, Interleaved Acquisition, and Temporal Gating
IEEE Photonics Journal
Biophotonics
medical photonics
fluorescence imaging
computer vision
optical imaging
image-guided surgery
title Enhance Fluorescence Imaging and Remove Motion Artifacts by Combining Pixel Tracking, Interleaved Acquisition, and Temporal Gating
title_full Enhance Fluorescence Imaging and Remove Motion Artifacts by Combining Pixel Tracking, Interleaved Acquisition, and Temporal Gating
title_fullStr Enhance Fluorescence Imaging and Remove Motion Artifacts by Combining Pixel Tracking, Interleaved Acquisition, and Temporal Gating
title_full_unstemmed Enhance Fluorescence Imaging and Remove Motion Artifacts by Combining Pixel Tracking, Interleaved Acquisition, and Temporal Gating
title_short Enhance Fluorescence Imaging and Remove Motion Artifacts by Combining Pixel Tracking, Interleaved Acquisition, and Temporal Gating
title_sort enhance fluorescence imaging and remove motion artifacts by combining pixel tracking interleaved acquisition and temporal gating
topic Biophotonics
medical photonics
fluorescence imaging
computer vision
optical imaging
image-guided surgery
url https://ieeexplore.ieee.org/document/9343706/
work_keys_str_mv AT christophermela enhancefluorescenceimagingandremovemotionartifactsbycombiningpixeltrackinginterleavedacquisitionandtemporalgating
AT francispapay enhancefluorescenceimagingandremovemotionartifactsbycombiningpixeltrackinginterleavedacquisitionandtemporalgating
AT yangliu enhancefluorescenceimagingandremovemotionartifactsbycombiningpixeltrackinginterleavedacquisitionandtemporalgating