Riesz pyramids for fast phase-based video magnification
We present a new compact image pyramid representation, the Riesz pyramid, that can be used for real-time phase-based motion magnification. Our new representation is less overcomplete than even the smallest two orientation, octave-bandwidth complex steerable pyramid, and can be implemented using comp...
| Main Authors: | , , , |
|---|---|
| Other Authors: | |
| Format: | Article |
| Language: | en_US |
| Published: |
Institute of Electrical and Electronics Engineers (IEEE)
2015
|
| Online Access: | http://hdl.handle.net/1721.1/100016 https://orcid.org/0000-0002-3707-3807 https://orcid.org/0000-0002-2902-6752 https://orcid.org/0000-0001-9919-069X https://orcid.org/0000-0002-2231-7995 |
| _version_ | 1811086160764600320 |
|---|---|
| author | Wadhwa, Neal Rubinstein, Michael Durand, Fredo Freeman, William T. |
| author2 | Massachusetts Institute of Technology. Computer Science and Artificial Intelligence Laboratory |
| author_facet | Massachusetts Institute of Technology. Computer Science and Artificial Intelligence Laboratory Wadhwa, Neal Rubinstein, Michael Durand, Fredo Freeman, William T. |
| author_sort | Wadhwa, Neal |
| collection | MIT |
| description | We present a new compact image pyramid representation, the Riesz pyramid, that can be used for real-time phase-based motion magnification. Our new representation is less overcomplete than even the smallest two orientation, octave-bandwidth complex steerable pyramid, and can be implemented using compact, efficient linear filters in the spatial domain. Motion-magnified videos produced with this new representation are of comparable quality to those produced with the complex steerable pyramid. When used with phase-based video magnification, the Riesz pyramid phase-shifts image features along only their dominant orientation rather than every orientation like the complex steerable pyramid. |
| first_indexed | 2024-09-23T13:21:46Z |
| format | Article |
| id | mit-1721.1/100016 |
| institution | Massachusetts Institute of Technology |
| language | en_US |
| last_indexed | 2024-09-23T13:21:46Z |
| publishDate | 2015 |
| publisher | Institute of Electrical and Electronics Engineers (IEEE) |
| record_format | dspace |
| spelling | mit-1721.1/1000162022-10-01T14:47:08Z Riesz pyramids for fast phase-based video magnification Wadhwa, Neal Rubinstein, Michael Durand, Fredo Freeman, William T. Massachusetts Institute of Technology. Computer Science and Artificial Intelligence Laboratory Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science Massachusetts Institute of Technology. Department of Mathematics Wadhwa, Neal Rubinstein, Michael Durand, Fredo Freeman, William T. We present a new compact image pyramid representation, the Riesz pyramid, that can be used for real-time phase-based motion magnification. Our new representation is less overcomplete than even the smallest two orientation, octave-bandwidth complex steerable pyramid, and can be implemented using compact, efficient linear filters in the spatial domain. Motion-magnified videos produced with this new representation are of comparable quality to those produced with the complex steerable pyramid. When used with phase-based video magnification, the Riesz pyramid phase-shifts image features along only their dominant orientation rather than every orientation like the complex steerable pyramid. Quanta Computer (Firm) Shell Research National Science Foundation (U.S.) (CGV-1111415) Microsoft Research (PhD Fellowship) Massachusetts Institute of Technology. Department of Mathematics National Science Foundation (U.S.). Graduate Research Fellowship (Grant 1122374) 2015-11-24T13:27:34Z 2015-11-24T13:27:34Z 2014-05 Article http://purl.org/eprint/type/ConferencePaper 978-1-4799-5188-8 http://hdl.handle.net/1721.1/100016 Wadhwa, Neal, Michael Rubinstein, Fredo Durand, and William T. Freeman. “Riesz Pyramids for Fast Phase-Based Video Magnification.” 2014 IEEE International Conference on Computational Photography (ICCP) (May 2014). https://orcid.org/0000-0002-3707-3807 https://orcid.org/0000-0002-2902-6752 https://orcid.org/0000-0001-9919-069X https://orcid.org/0000-0002-2231-7995 en_US http://dx.doi.org/10.1109/ICCPHOT.2014.6831820 Proceedings of the 2014 IEEE International Conference on Computational Photography (ICCP) Creative Commons Attribution-Noncommercial-Share Alike http://creativecommons.org/licenses/by-nc-sa/4.0/ application/pdf Institute of Electrical and Electronics Engineers (IEEE) MIT web domain |
| spellingShingle | Wadhwa, Neal Rubinstein, Michael Durand, Fredo Freeman, William T. Riesz pyramids for fast phase-based video magnification |
| title | Riesz pyramids for fast phase-based video magnification |
| title_full | Riesz pyramids for fast phase-based video magnification |
| title_fullStr | Riesz pyramids for fast phase-based video magnification |
| title_full_unstemmed | Riesz pyramids for fast phase-based video magnification |
| title_short | Riesz pyramids for fast phase-based video magnification |
| title_sort | riesz pyramids for fast phase based video magnification |
| url | http://hdl.handle.net/1721.1/100016 https://orcid.org/0000-0002-3707-3807 https://orcid.org/0000-0002-2902-6752 https://orcid.org/0000-0001-9919-069X https://orcid.org/0000-0002-2231-7995 |
| work_keys_str_mv | AT wadhwaneal rieszpyramidsforfastphasebasedvideomagnification AT rubinsteinmichael rieszpyramidsforfastphasebasedvideomagnification AT durandfredo rieszpyramidsforfastphasebasedvideomagnification AT freemanwilliamt rieszpyramidsforfastphasebasedvideomagnification |