Coded Strobing Photography: Compressive Sensing of High Speed Periodic Videos
We show that, via temporal modulation, one can observe and capture a high-speed periodic video well beyond the abilities of a low-frame-rate camera. By strobing the exposure with unique sequences within the integration time of each frame, we take coded projections of dynamic events. From a sequence...
| Main Authors: | , , |
|---|---|
| Other Authors: | |
| Format: | Article |
| Language: | en_US |
| Published: |
Institute of Electrical and Electronics Engineers
2012
|
| Online Access: | http://hdl.handle.net/1721.1/73075 https://orcid.org/0000-0002-3254-3224 |
| _version_ | 1811098062247952384 |
|---|---|
| author | Veeraraghavan, Ashok Reddy, Dikpal Raskar, Ramesh |
| author2 | Program in Media Arts and Sciences (Massachusetts Institute of Technology) |
| author_facet | Program in Media Arts and Sciences (Massachusetts Institute of Technology) Veeraraghavan, Ashok Reddy, Dikpal Raskar, Ramesh |
| author_sort | Veeraraghavan, Ashok |
| collection | MIT |
| description | We show that, via temporal modulation, one can observe and capture a high-speed periodic video well beyond the abilities of a low-frame-rate camera. By strobing the exposure with unique sequences within the integration time of each frame, we take coded projections of dynamic events. From a sequence of such frames, we reconstruct a high-speed video of the high-frequency periodic process. Strobing is used in entertainment, medical imaging, and industrial inspection to generate lower beat frequencies. But this is limited to scenes with a detectable single dominant frequency and requires high-intensity lighting. In this paper, we address the problem of sub-Nyquist sampling of periodic signals and show designs to capture and reconstruct such signals. The key result is that for such signals, the Nyquist rate constraint can be imposed on the strobe rate rather than the sensor rate. The technique is based on intentional aliasing of the frequency components of the periodic signal while the reconstruction algorithm exploits recent advances in sparse representations and compressive sensing. We exploit the sparsity of periodic signals in the Fourier domain to develop reconstruction algorithms that are inspired by compressive sensing. |
| first_indexed | 2024-09-23T17:09:22Z |
| format | Article |
| id | mit-1721.1/73075 |
| institution | Massachusetts Institute of Technology |
| language | en_US |
| last_indexed | 2024-09-23T17:09:22Z |
| publishDate | 2012 |
| publisher | Institute of Electrical and Electronics Engineers |
| record_format | dspace |
| spelling | mit-1721.1/730752022-10-03T10:48:01Z Coded Strobing Photography: Compressive Sensing of High Speed Periodic Videos Veeraraghavan, Ashok Reddy, Dikpal Raskar, Ramesh Program in Media Arts and Sciences (Massachusetts Institute of Technology) Raskar, Ramesh We show that, via temporal modulation, one can observe and capture a high-speed periodic video well beyond the abilities of a low-frame-rate camera. By strobing the exposure with unique sequences within the integration time of each frame, we take coded projections of dynamic events. From a sequence of such frames, we reconstruct a high-speed video of the high-frequency periodic process. Strobing is used in entertainment, medical imaging, and industrial inspection to generate lower beat frequencies. But this is limited to scenes with a detectable single dominant frequency and requires high-intensity lighting. In this paper, we address the problem of sub-Nyquist sampling of periodic signals and show designs to capture and reconstruct such signals. The key result is that for such signals, the Nyquist rate constraint can be imposed on the strobe rate rather than the sensor rate. The technique is based on intentional aliasing of the frequency components of the periodic signal while the reconstruction algorithm exploits recent advances in sparse representations and compressive sensing. We exploit the sparsity of periodic signals in the Fourier domain to develop reconstruction algorithms that are inspired by compressive sensing. 2012-09-20T17:35:49Z 2012-09-20T17:35:49Z 2011-04 2009-11 Article http://purl.org/eprint/type/JournalArticle 0162-8828 2160-9292 INSPEC Accession Number: 11832498 http://hdl.handle.net/1721.1/73075 Veeraraghavan, A, D Reddy, and R Raskar. “Coded Strobing Photography: Compressive Sensing of High Speed Periodic Videos.” IEEE Transactions on Pattern Analysis and Machine Intelligence 33.4 (2011): 671–686. Web. ©2011 IEEE. 20421670 https://orcid.org/0000-0002-3254-3224 en_US http://dx.doi.org/10.1109/TPAMI.2010.87 IEEE Transactions on Pattern Analysis and Machine Intelligence Article is made available in accordance with the publisher's policy and may be subject to US copyright law. Please refer to the publisher's site for terms of use. application/pdf Institute of Electrical and Electronics Engineers IEEE |
| spellingShingle | Veeraraghavan, Ashok Reddy, Dikpal Raskar, Ramesh Coded Strobing Photography: Compressive Sensing of High Speed Periodic Videos |
| title | Coded Strobing Photography: Compressive Sensing of High Speed Periodic Videos |
| title_full | Coded Strobing Photography: Compressive Sensing of High Speed Periodic Videos |
| title_fullStr | Coded Strobing Photography: Compressive Sensing of High Speed Periodic Videos |
| title_full_unstemmed | Coded Strobing Photography: Compressive Sensing of High Speed Periodic Videos |
| title_short | Coded Strobing Photography: Compressive Sensing of High Speed Periodic Videos |
| title_sort | coded strobing photography compressive sensing of high speed periodic videos |
| url | http://hdl.handle.net/1721.1/73075 https://orcid.org/0000-0002-3254-3224 |
| work_keys_str_mv | AT veeraraghavanashok codedstrobingphotographycompressivesensingofhighspeedperiodicvideos AT reddydikpal codedstrobingphotographycompressivesensingofhighspeedperiodicvideos AT raskarramesh codedstrobingphotographycompressivesensingofhighspeedperiodicvideos |