Single-pixel imaging of dynamic objects using multi-frame motion estimation

Abstract Single-pixel imaging (SPI) enables the visualization of objects with a single detector by using a sequence of spatially modulated illumination patterns. For natural images, the number of illumination patterns may be smaller than the number of pixels when compressed-sensing algorithms are us...

Full description

Bibliographic Details
Main Authors: Sagi Monin, Evgeny Hahamovich, Amir Rosenthal
Format: Article
Language:English
Published: Nature Portfolio 2021-04-01
Series:Scientific Reports
Online Access:https://doi.org/10.1038/s41598-021-83810-z
_version_ 1818425714343411712
author Sagi Monin
Evgeny Hahamovich
Amir Rosenthal
author_facet Sagi Monin
Evgeny Hahamovich
Amir Rosenthal
author_sort Sagi Monin
collection DOAJ
description Abstract Single-pixel imaging (SPI) enables the visualization of objects with a single detector by using a sequence of spatially modulated illumination patterns. For natural images, the number of illumination patterns may be smaller than the number of pixels when compressed-sensing algorithms are used. Nonetheless, the sequential nature of the SPI measurement requires that the object remains static until the signals from all the required patterns have been collected. In this paper, we present a new approach to SPI that enables imaging scenarios in which the imaged object, or parts thereof, moves within the imaging plane during data acquisition. Our algorithms estimate the motion direction from inter-frame cross-correlations and incorporate it in the reconstruction model. Moreover, when the illumination pattern is cyclic, the motion may be estimated directly from the raw data, further increasing the numerical efficiency of the algorithm. A demonstration of our approach is presented for both numerically simulated and measured data.
first_indexed 2024-12-14T14:18:20Z
format Article
id doaj.art-3f041409de4143afb9cac842bfc915b8
institution Directory Open Access Journal
issn 2045-2322
language English
last_indexed 2024-12-14T14:18:20Z
publishDate 2021-04-01
publisher Nature Portfolio
record_format Article
series Scientific Reports
spelling doaj.art-3f041409de4143afb9cac842bfc915b82022-12-21T22:58:09ZengNature PortfolioScientific Reports2045-23222021-04-0111111110.1038/s41598-021-83810-zSingle-pixel imaging of dynamic objects using multi-frame motion estimationSagi Monin0Evgeny Hahamovich1Amir Rosenthal2Department of Electrical Engineering, Technion – Israel Institute of TechnologyDepartment of Electrical Engineering, Technion – Israel Institute of TechnologyDepartment of Electrical Engineering, Technion – Israel Institute of TechnologyAbstract Single-pixel imaging (SPI) enables the visualization of objects with a single detector by using a sequence of spatially modulated illumination patterns. For natural images, the number of illumination patterns may be smaller than the number of pixels when compressed-sensing algorithms are used. Nonetheless, the sequential nature of the SPI measurement requires that the object remains static until the signals from all the required patterns have been collected. In this paper, we present a new approach to SPI that enables imaging scenarios in which the imaged object, or parts thereof, moves within the imaging plane during data acquisition. Our algorithms estimate the motion direction from inter-frame cross-correlations and incorporate it in the reconstruction model. Moreover, when the illumination pattern is cyclic, the motion may be estimated directly from the raw data, further increasing the numerical efficiency of the algorithm. A demonstration of our approach is presented for both numerically simulated and measured data.https://doi.org/10.1038/s41598-021-83810-z
spellingShingle Sagi Monin
Evgeny Hahamovich
Amir Rosenthal
Single-pixel imaging of dynamic objects using multi-frame motion estimation
Scientific Reports
title Single-pixel imaging of dynamic objects using multi-frame motion estimation
title_full Single-pixel imaging of dynamic objects using multi-frame motion estimation
title_fullStr Single-pixel imaging of dynamic objects using multi-frame motion estimation
title_full_unstemmed Single-pixel imaging of dynamic objects using multi-frame motion estimation
title_short Single-pixel imaging of dynamic objects using multi-frame motion estimation
title_sort single pixel imaging of dynamic objects using multi frame motion estimation
url https://doi.org/10.1038/s41598-021-83810-z
work_keys_str_mv AT sagimonin singlepixelimagingofdynamicobjectsusingmultiframemotionestimation
AT evgenyhahamovich singlepixelimagingofdynamicobjectsusingmultiframemotionestimation
AT amirrosenthal singlepixelimagingofdynamicobjectsusingmultiframemotionestimation