CASPI: collaborative photon processing for active single-photon imaging
Abstract Image sensors capable of capturing individual photons have made tremendous progress in recent years. However, this technology faces a major limitation. Because they capture scene information at the individual photon level, the raw data is sparse and noisy. Here we propose CASPI: Collaborati...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Nature Portfolio
2023-05-01
|
| Series: | Nature Communications |
| Online Access: | https://doi.org/10.1038/s41467-023-38893-9 |
| _version_ | 1827933249400209408 |
|---|---|
| author | Jongho Lee Atul Ingle Jenu V. Chacko Kevin W. Eliceiri Mohit Gupta |
| author_facet | Jongho Lee Atul Ingle Jenu V. Chacko Kevin W. Eliceiri Mohit Gupta |
| author_sort | Jongho Lee |
| collection | DOAJ |
| description | Abstract Image sensors capable of capturing individual photons have made tremendous progress in recent years. However, this technology faces a major limitation. Because they capture scene information at the individual photon level, the raw data is sparse and noisy. Here we propose CASPI: Collaborative Photon Processing for Active Single-Photon Imaging, a technology-agnostic, application-agnostic, and training-free photon processing pipeline for emerging high-resolution single-photon cameras. By collaboratively exploiting both local and non-local correlations in the spatio-temporal photon data cubes, CASPI estimates scene properties reliably even under very challenging lighting conditions. We demonstrate the versatility of CASPI with two applications: LiDAR imaging over a wide range of photon flux levels, from a sub-photon to high ambient regimes, and live-cell autofluorescence FLIM in low photon count regimes. We envision CASPI as a basic building block of general-purpose photon processing units that will be implemented on-chip in future single-photon cameras. |
| first_indexed | 2024-03-13T07:22:09Z |
| format | Article |
| id | doaj.art-56a5658d04fb4fa1833285f7abfdb9e4 |
| institution | Directory Open Access Journal |
| issn | 2041-1723 |
| language | English |
| last_indexed | 2024-03-13T07:22:09Z |
| publishDate | 2023-05-01 |
| publisher | Nature Portfolio |
| record_format | Article |
| series | Nature Communications |
| spelling | doaj.art-56a5658d04fb4fa1833285f7abfdb9e42023-06-04T11:33:55ZengNature PortfolioNature Communications2041-17232023-05-0114111510.1038/s41467-023-38893-9CASPI: collaborative photon processing for active single-photon imagingJongho Lee0Atul Ingle1Jenu V. Chacko2Kevin W. Eliceiri3Mohit Gupta4Department of Computer Sciences, University of Wisconsin-MadisonDepartment of Computer Science, Portland State UniversityLaboratory for Optical and Computational Instrumentation, University of Wisconsin-MadisonLaboratory for Optical and Computational Instrumentation, University of Wisconsin-MadisonDepartment of Computer Sciences, University of Wisconsin-MadisonAbstract Image sensors capable of capturing individual photons have made tremendous progress in recent years. However, this technology faces a major limitation. Because they capture scene information at the individual photon level, the raw data is sparse and noisy. Here we propose CASPI: Collaborative Photon Processing for Active Single-Photon Imaging, a technology-agnostic, application-agnostic, and training-free photon processing pipeline for emerging high-resolution single-photon cameras. By collaboratively exploiting both local and non-local correlations in the spatio-temporal photon data cubes, CASPI estimates scene properties reliably even under very challenging lighting conditions. We demonstrate the versatility of CASPI with two applications: LiDAR imaging over a wide range of photon flux levels, from a sub-photon to high ambient regimes, and live-cell autofluorescence FLIM in low photon count regimes. We envision CASPI as a basic building block of general-purpose photon processing units that will be implemented on-chip in future single-photon cameras.https://doi.org/10.1038/s41467-023-38893-9 |
| spellingShingle | Jongho Lee Atul Ingle Jenu V. Chacko Kevin W. Eliceiri Mohit Gupta CASPI: collaborative photon processing for active single-photon imaging Nature Communications |
| title | CASPI: collaborative photon processing for active single-photon imaging |
| title_full | CASPI: collaborative photon processing for active single-photon imaging |
| title_fullStr | CASPI: collaborative photon processing for active single-photon imaging |
| title_full_unstemmed | CASPI: collaborative photon processing for active single-photon imaging |
| title_short | CASPI: collaborative photon processing for active single-photon imaging |
| title_sort | caspi collaborative photon processing for active single photon imaging |
| url | https://doi.org/10.1038/s41467-023-38893-9 |
| work_keys_str_mv | AT jongholee caspicollaborativephotonprocessingforactivesinglephotonimaging AT atulingle caspicollaborativephotonprocessingforactivesinglephotonimaging AT jenuvchacko caspicollaborativephotonprocessingforactivesinglephotonimaging AT kevinweliceiri caspicollaborativephotonprocessingforactivesinglephotonimaging AT mohitgupta caspicollaborativephotonprocessingforactivesinglephotonimaging |