Motion microscopy for visualizing and quantifying small motions
Although the human visual system is remarkable at perceiving and interpreting motions, it has limited sensitivity, and we cannot see motions that are smaller than some threshold. Although difficult to visualize, tiny motions below this threshold are important and can reveal physical mechanisms, or b...
| Main Authors: | , , , , , , , , , , , , , |
|---|---|
| Other Authors: | |
| Format: | Article |
| Published: |
National Academy of Sciences (U.S.)
2018
|
| Online Access: | http://hdl.handle.net/1721.1/114895 https://orcid.org/0000-0002-2902-6752 https://orcid.org/0000-0002-2634-6689 https://orcid.org/0000-0003-0622-1333 https://orcid.org/0000-0002-2329-5484 https://orcid.org/0000-0003-3369-5067 https://orcid.org/0000-0001-6309-0910 https://orcid.org/0000-0002-7712-7478 https://orcid.org/0000-0001-9919-069X https://orcid.org/0000-0002-2231-7995 |
| _version_ | 1826196161967423488 |
|---|---|
| author | Wang, Pai Sun, Sijie Bertoldi, Katia Wadhwa, Neal Sellon, Jonathan Blake Wei, Donglai Freeman, Dennis M. Buyukozturk, Oral Durand, Frederic Freeman, William T. Rubinstein, Michael, Ph. D. Massachusetts Institute of Technology Kang, Sung Hoon, 1974- Chen, Justin, Ph. D. Massachusetts Institute of Technology Ghaffari, Roozbeh, 1979- |
| author2 | Harvard University--MIT Division of Health Sciences and Technology |
| author_facet | Harvard University--MIT Division of Health Sciences and Technology Wang, Pai Sun, Sijie Bertoldi, Katia Wadhwa, Neal Sellon, Jonathan Blake Wei, Donglai Freeman, Dennis M. Buyukozturk, Oral Durand, Frederic Freeman, William T. Rubinstein, Michael, Ph. D. Massachusetts Institute of Technology Kang, Sung Hoon, 1974- Chen, Justin, Ph. D. Massachusetts Institute of Technology Ghaffari, Roozbeh, 1979- |
| author_sort | Wang, Pai |
| collection | MIT |
| description | Although the human visual system is remarkable at perceiving and interpreting motions, it has limited sensitivity, and we cannot see motions that are smaller than some threshold. Although difficult to visualize, tiny motions below this threshold are important and can reveal physical mechanisms, or be precursors to large motions in the case of mechanical failure. Here, we present a “motion microscope,” a computational tool that quantifies tiny motions in videos and then visualizes them by producing a new video in which the motions are made large enough to see. Three scientific visualizations are shown, spanning macroscopic to nanoscopic length scales. They are the resonant vibrations of a bridge demonstrating simultaneous spatial and temporal modal analysis, micrometer vibrations of a metamaterial demonstrating wave propagation through an elastic matrix with embedded resonating units, and nanometer motions of an extracellular tissue found in the inner ear demonstrating a mechanism of frequency separation in hearing. In these instances, the motion microscope uncovers hidden dynamics over a variety of length scales, leading to the discovery of previously unknown phenomena. Keywords: visualization; motion; image processing |
| first_indexed | 2024-09-23T10:22:30Z |
| format | Article |
| id | mit-1721.1/114895 |
| institution | Massachusetts Institute of Technology |
| last_indexed | 2024-09-23T10:22:30Z |
| publishDate | 2018 |
| publisher | National Academy of Sciences (U.S.) |
| record_format | dspace |
| spelling | mit-1721.1/1148952022-09-30T20:41:58Z Motion microscopy for visualizing and quantifying small motions Wang, Pai Sun, Sijie Bertoldi, Katia Wadhwa, Neal Sellon, Jonathan Blake Wei, Donglai Freeman, Dennis M. Buyukozturk, Oral Durand, Frederic Freeman, William T. Rubinstein, Michael, Ph. D. Massachusetts Institute of Technology Kang, Sung Hoon, 1974- Chen, Justin, Ph. D. Massachusetts Institute of Technology Ghaffari, Roozbeh, 1979- Harvard University--MIT Division of Health Sciences and Technology Massachusetts Institute of Technology. Computer Science and Artificial Intelligence Laboratory Massachusetts Institute of Technology. Department of Biology Massachusetts Institute of Technology. Department of Civil and Environmental Engineering Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science Massachusetts Institute of Technology. Research Laboratory of Electronics Wadhwa, Neal Chen, Justin Sellon, Jonathan Blake Wei, Donglai Ghaffari, Roozbeh Freeman, Dennis M. Buyukozturk, Oral Durand, Frederic Freeman, William T. Although the human visual system is remarkable at perceiving and interpreting motions, it has limited sensitivity, and we cannot see motions that are smaller than some threshold. Although difficult to visualize, tiny motions below this threshold are important and can reveal physical mechanisms, or be precursors to large motions in the case of mechanical failure. Here, we present a “motion microscope,” a computational tool that quantifies tiny motions in videos and then visualizes them by producing a new video in which the motions are made large enough to see. Three scientific visualizations are shown, spanning macroscopic to nanoscopic length scales. They are the resonant vibrations of a bridge demonstrating simultaneous spatial and temporal modal analysis, micrometer vibrations of a metamaterial demonstrating wave propagation through an elastic matrix with embedded resonating units, and nanometer motions of an extracellular tissue found in the inner ear demonstrating a mechanism of frequency separation in hearing. In these instances, the motion microscope uncovers hidden dynamics over a variety of length scales, leading to the discovery of previously unknown phenomena. Keywords: visualization; motion; image processing National Science Foundation (U.S.) (Grant CGV-1111415) National Science Foundation (U.S.) (Grant CGV-1122374) National Institutes of Health (U.S.) (Grant R01-DC00238) 2018-04-23T19:09:02Z 2018-04-23T19:09:02Z 2017-10 2017-03 2018-04-20T14:08:41Z Article http://purl.org/eprint/type/ConferencePaper 0027-8424 1091-6490 http://hdl.handle.net/1721.1/114895 Wadhwa, Neal et al. “Motion Microscopy for Visualizing and Quantifying Small Motions.” Proceedings of the National Academy of Sciences 114, 44 (October 2017): 11639–11644 © 2017 National Academy of Sciences https://orcid.org/0000-0002-2902-6752 https://orcid.org/0000-0002-2634-6689 https://orcid.org/0000-0003-0622-1333 https://orcid.org/0000-0002-2329-5484 https://orcid.org/0000-0003-3369-5067 https://orcid.org/0000-0001-6309-0910 https://orcid.org/0000-0002-7712-7478 https://orcid.org/0000-0001-9919-069X https://orcid.org/0000-0002-2231-7995 http://dx.doi.org/10.1073/PNAS.1703715114 Proceedings of the National Academy of Sciences Article is made available in accordance with the publisher's policy and may be subject to US copyright law. Please refer to the publisher's site for terms of use. application/pdf National Academy of Sciences (U.S.) National Academy of Sciences |
| spellingShingle | Wang, Pai Sun, Sijie Bertoldi, Katia Wadhwa, Neal Sellon, Jonathan Blake Wei, Donglai Freeman, Dennis M. Buyukozturk, Oral Durand, Frederic Freeman, William T. Rubinstein, Michael, Ph. D. Massachusetts Institute of Technology Kang, Sung Hoon, 1974- Chen, Justin, Ph. D. Massachusetts Institute of Technology Ghaffari, Roozbeh, 1979- Motion microscopy for visualizing and quantifying small motions |
| title | Motion microscopy for visualizing and quantifying small motions |
| title_full | Motion microscopy for visualizing and quantifying small motions |
| title_fullStr | Motion microscopy for visualizing and quantifying small motions |
| title_full_unstemmed | Motion microscopy for visualizing and quantifying small motions |
| title_short | Motion microscopy for visualizing and quantifying small motions |
| title_sort | motion microscopy for visualizing and quantifying small motions |
| url | http://hdl.handle.net/1721.1/114895 https://orcid.org/0000-0002-2902-6752 https://orcid.org/0000-0002-2634-6689 https://orcid.org/0000-0003-0622-1333 https://orcid.org/0000-0002-2329-5484 https://orcid.org/0000-0003-3369-5067 https://orcid.org/0000-0001-6309-0910 https://orcid.org/0000-0002-7712-7478 https://orcid.org/0000-0001-9919-069X https://orcid.org/0000-0002-2231-7995 |
| work_keys_str_mv | AT wangpai motionmicroscopyforvisualizingandquantifyingsmallmotions AT sunsijie motionmicroscopyforvisualizingandquantifyingsmallmotions AT bertoldikatia motionmicroscopyforvisualizingandquantifyingsmallmotions AT wadhwaneal motionmicroscopyforvisualizingandquantifyingsmallmotions AT sellonjonathanblake motionmicroscopyforvisualizingandquantifyingsmallmotions AT weidonglai motionmicroscopyforvisualizingandquantifyingsmallmotions AT freemandennism motionmicroscopyforvisualizingandquantifyingsmallmotions AT buyukozturkoral motionmicroscopyforvisualizingandquantifyingsmallmotions AT durandfrederic motionmicroscopyforvisualizingandquantifyingsmallmotions AT freemanwilliamt motionmicroscopyforvisualizingandquantifyingsmallmotions AT rubinsteinmichaelphdmassachusettsinstituteoftechnology motionmicroscopyforvisualizingandquantifyingsmallmotions AT kangsunghoon1974 motionmicroscopyforvisualizingandquantifyingsmallmotions AT chenjustinphdmassachusettsinstituteoftechnology motionmicroscopyforvisualizingandquantifyingsmallmotions AT ghaffariroozbeh1979 motionmicroscopyforvisualizingandquantifyingsmallmotions |