A High-Speed Imaging Method Based on Compressive Sensing for Sound Extraction Using a Low-Speed Camera
This paper reports an efficient method for sound extraction from high-speed light spot videos reconstructed from the coded light spot images captured with a low-speed camera based on compressive sensing, but at the expense of consuming time. The proposed method first gets the high-speed video of the...
| Main Authors: | , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2018-05-01
|
| Series: | Sensors |
| Subjects: | |
| Online Access: | http://www.mdpi.com/1424-8220/18/5/1524 |
| _version_ | 1828112625361223680 |
|---|---|
| author | Ge Zhu Xu-Ri Yao Zhi-Bin Sun Peng Qiu Chao Wang Guang-Jie Zhai Qing Zhao |
| author_facet | Ge Zhu Xu-Ri Yao Zhi-Bin Sun Peng Qiu Chao Wang Guang-Jie Zhai Qing Zhao |
| author_sort | Ge Zhu |
| collection | DOAJ |
| description | This paper reports an efficient method for sound extraction from high-speed light spot videos reconstructed from the coded light spot images captured with a low-speed camera based on compressive sensing, but at the expense of consuming time. The proposed method first gets the high-speed video of the light spot that is illuminated on the vibrating target caused by sound. Then the centroid of the light spot is used to recover the sound. Simulations of the proposed method are carried out and experimental results are demonstrated. The results show that high-speed videos with a frame rate of 2000 Hz can be reconstructed with a low-speed (100 Hz) charge-coupled device (CCD) camera, which is randomly modulated by a digital micro-mirror device (DMD) 20 times during each exposure time. This means a speed improvement of 20 times is achieved. The effects of synchronization between CCD image recording and DMD modulation, the optimal sampling patterns of DMD, and sound vibration amplitudes on the performance of the proposed method are evaluated. Using this compressive camera, speech (counting from one to four in Chinese) was recovered well. This has been confirmed by directly listening to the recovered sound, and the intelligibility value (0–1) that evaluated the similarity between them was 0.8185. Although we use this compressive camera for sound detection, we expect it to be useful in applications related to vibration and motion. |
| first_indexed | 2024-04-11T11:53:15Z |
| format | Article |
| id | doaj.art-a1ed7471e68b46a1bde372a7bfd45062 |
| institution | Directory Open Access Journal |
| issn | 1424-8220 |
| language | English |
| last_indexed | 2024-04-11T11:53:15Z |
| publishDate | 2018-05-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Sensors |
| spelling | doaj.art-a1ed7471e68b46a1bde372a7bfd450622022-12-22T04:25:15ZengMDPI AGSensors1424-82202018-05-01185152410.3390/s18051524s18051524A High-Speed Imaging Method Based on Compressive Sensing for Sound Extraction Using a Low-Speed CameraGe Zhu0Xu-Ri Yao1Zhi-Bin Sun2Peng Qiu3Chao Wang4Guang-Jie Zhai5Qing Zhao6Center for Quantum Technology Research, School of Physics, Beijing Institute of Technology, Beijing 100081, ChinaKey Laboratory of Electronics and Information Technology for Space Systems, National Space Science Center, Chinese Academy of Sciences, Beijing 100190, ChinaKey Laboratory of Electronics and Information Technology for Space Systems, National Space Science Center, Chinese Academy of Sciences, Beijing 100190, ChinaKey Laboratory of Electronics and Information Technology for Space Systems, National Space Science Center, Chinese Academy of Sciences, Beijing 100190, ChinaKey Laboratory of Electronics and Information Technology for Space Systems, National Space Science Center, Chinese Academy of Sciences, Beijing 100190, ChinaKey Laboratory of Electronics and Information Technology for Space Systems, National Space Science Center, Chinese Academy of Sciences, Beijing 100190, ChinaCenter for Quantum Technology Research, School of Physics, Beijing Institute of Technology, Beijing 100081, ChinaThis paper reports an efficient method for sound extraction from high-speed light spot videos reconstructed from the coded light spot images captured with a low-speed camera based on compressive sensing, but at the expense of consuming time. The proposed method first gets the high-speed video of the light spot that is illuminated on the vibrating target caused by sound. Then the centroid of the light spot is used to recover the sound. Simulations of the proposed method are carried out and experimental results are demonstrated. The results show that high-speed videos with a frame rate of 2000 Hz can be reconstructed with a low-speed (100 Hz) charge-coupled device (CCD) camera, which is randomly modulated by a digital micro-mirror device (DMD) 20 times during each exposure time. This means a speed improvement of 20 times is achieved. The effects of synchronization between CCD image recording and DMD modulation, the optimal sampling patterns of DMD, and sound vibration amplitudes on the performance of the proposed method are evaluated. Using this compressive camera, speech (counting from one to four in Chinese) was recovered well. This has been confirmed by directly listening to the recovered sound, and the intelligibility value (0–1) that evaluated the similarity between them was 0.8185. Although we use this compressive camera for sound detection, we expect it to be useful in applications related to vibration and motion.http://www.mdpi.com/1424-8220/18/5/1524sound recoveryhigh-speed imagingcompressive sensingcomputational imagingremote sensingvibration analysis |
| spellingShingle | Ge Zhu Xu-Ri Yao Zhi-Bin Sun Peng Qiu Chao Wang Guang-Jie Zhai Qing Zhao A High-Speed Imaging Method Based on Compressive Sensing for Sound Extraction Using a Low-Speed Camera Sensors sound recovery high-speed imaging compressive sensing computational imaging remote sensing vibration analysis |
| title | A High-Speed Imaging Method Based on Compressive Sensing for Sound Extraction Using a Low-Speed Camera |
| title_full | A High-Speed Imaging Method Based on Compressive Sensing for Sound Extraction Using a Low-Speed Camera |
| title_fullStr | A High-Speed Imaging Method Based on Compressive Sensing for Sound Extraction Using a Low-Speed Camera |
| title_full_unstemmed | A High-Speed Imaging Method Based on Compressive Sensing for Sound Extraction Using a Low-Speed Camera |
| title_short | A High-Speed Imaging Method Based on Compressive Sensing for Sound Extraction Using a Low-Speed Camera |
| title_sort | high speed imaging method based on compressive sensing for sound extraction using a low speed camera |
| topic | sound recovery high-speed imaging compressive sensing computational imaging remote sensing vibration analysis |
| url | http://www.mdpi.com/1424-8220/18/5/1524 |
| work_keys_str_mv | AT gezhu ahighspeedimagingmethodbasedoncompressivesensingforsoundextractionusingalowspeedcamera AT xuriyao ahighspeedimagingmethodbasedoncompressivesensingforsoundextractionusingalowspeedcamera AT zhibinsun ahighspeedimagingmethodbasedoncompressivesensingforsoundextractionusingalowspeedcamera AT pengqiu ahighspeedimagingmethodbasedoncompressivesensingforsoundextractionusingalowspeedcamera AT chaowang ahighspeedimagingmethodbasedoncompressivesensingforsoundextractionusingalowspeedcamera AT guangjiezhai ahighspeedimagingmethodbasedoncompressivesensingforsoundextractionusingalowspeedcamera AT qingzhao ahighspeedimagingmethodbasedoncompressivesensingforsoundextractionusingalowspeedcamera AT gezhu highspeedimagingmethodbasedoncompressivesensingforsoundextractionusingalowspeedcamera AT xuriyao highspeedimagingmethodbasedoncompressivesensingforsoundextractionusingalowspeedcamera AT zhibinsun highspeedimagingmethodbasedoncompressivesensingforsoundextractionusingalowspeedcamera AT pengqiu highspeedimagingmethodbasedoncompressivesensingforsoundextractionusingalowspeedcamera AT chaowang highspeedimagingmethodbasedoncompressivesensingforsoundextractionusingalowspeedcamera AT guangjiezhai highspeedimagingmethodbasedoncompressivesensingforsoundextractionusingalowspeedcamera AT qingzhao highspeedimagingmethodbasedoncompressivesensingforsoundextractionusingalowspeedcamera |