Vibration Detection and Degraded Image Restoration of Space Camera Based on Correlation Imaging of Rolling-Shutter CMOS
To mitigate the influence of satellite platform vibrations on space camera imaging quality, a novel approach is proposed to detect vibration parameters based on correlation imaging of rolling-shutter CMOS. In the meantime, a restoration method to address the image degradation of rolling-shutter CMOS...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2023-06-01
|
| Series: | Sensors |
| Subjects: | |
| Online Access: | https://www.mdpi.com/1424-8220/23/13/5953 |
| _version_ | 1797590853879857152 |
|---|---|
| author | Hailong Liu Hengyi Lv Chengshan Han Yuchen Zhao |
| author_facet | Hailong Liu Hengyi Lv Chengshan Han Yuchen Zhao |
| author_sort | Hailong Liu |
| collection | DOAJ |
| description | To mitigate the influence of satellite platform vibrations on space camera imaging quality, a novel approach is proposed to detect vibration parameters based on correlation imaging of rolling-shutter CMOS. In the meantime, a restoration method to address the image degradation of rolling-shutter CMOS caused by such vibrations is proposed. The vibration parameter detection method utilizes the time-sharing and row-by-row imaging principle of rolling-shutter CMOS to obtain relative offset by comparing two frames of correlation images from continuous imaging. Then, the space camera’s vibration parameters are derived from the fitting curve parameters of the relative offset. According to the detected vibration parameters, the discrete point spread function is obtained, and the rolling-shutter CMOS image degradation caused by vibration is restored row by row. The verification experiments demonstrate that the proposed detection method for two-dimensional vibration achieves a relative accuracy of less than 1% in period detection and less than 2% in amplitude detection. Additionally, the proposed restoration method can enhance the MTF index by over 20%. The experimental results demonstrate that the detection method is capable of detecting high-frequency vibrations through low-frame-frequency image sequences, and it exhibits excellent applicability in both push-scan cameras and staring cameras. The restoration method effectively enhances the evaluation parameters of image quality and yields a remarkable restorative effect on degraded images. |
| first_indexed | 2024-03-11T01:29:23Z |
| format | Article |
| id | doaj.art-6aa0c702fc5044bf915abe7e55a4950d |
| institution | Directory Open Access Journal |
| issn | 1424-8220 |
| language | English |
| last_indexed | 2024-03-11T01:29:23Z |
| publishDate | 2023-06-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Sensors |
| spelling | doaj.art-6aa0c702fc5044bf915abe7e55a4950d2023-11-18T17:29:12ZengMDPI AGSensors1424-82202023-06-012313595310.3390/s23135953Vibration Detection and Degraded Image Restoration of Space Camera Based on Correlation Imaging of Rolling-Shutter CMOSHailong Liu0Hengyi Lv1Chengshan Han2Yuchen Zhao3Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun 130033, ChinaChangchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun 130033, ChinaChangchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun 130033, ChinaChangchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun 130033, ChinaTo mitigate the influence of satellite platform vibrations on space camera imaging quality, a novel approach is proposed to detect vibration parameters based on correlation imaging of rolling-shutter CMOS. In the meantime, a restoration method to address the image degradation of rolling-shutter CMOS caused by such vibrations is proposed. The vibration parameter detection method utilizes the time-sharing and row-by-row imaging principle of rolling-shutter CMOS to obtain relative offset by comparing two frames of correlation images from continuous imaging. Then, the space camera’s vibration parameters are derived from the fitting curve parameters of the relative offset. According to the detected vibration parameters, the discrete point spread function is obtained, and the rolling-shutter CMOS image degradation caused by vibration is restored row by row. The verification experiments demonstrate that the proposed detection method for two-dimensional vibration achieves a relative accuracy of less than 1% in period detection and less than 2% in amplitude detection. Additionally, the proposed restoration method can enhance the MTF index by over 20%. The experimental results demonstrate that the detection method is capable of detecting high-frequency vibrations through low-frame-frequency image sequences, and it exhibits excellent applicability in both push-scan cameras and staring cameras. The restoration method effectively enhances the evaluation parameters of image quality and yields a remarkable restorative effect on degraded images.https://www.mdpi.com/1424-8220/23/13/5953space camerarolling-shutter CMOScorrelation imagingvibration parameter detectiondegraded image restoration |
| spellingShingle | Hailong Liu Hengyi Lv Chengshan Han Yuchen Zhao Vibration Detection and Degraded Image Restoration of Space Camera Based on Correlation Imaging of Rolling-Shutter CMOS Sensors space camera rolling-shutter CMOS correlation imaging vibration parameter detection degraded image restoration |
| title | Vibration Detection and Degraded Image Restoration of Space Camera Based on Correlation Imaging of Rolling-Shutter CMOS |
| title_full | Vibration Detection and Degraded Image Restoration of Space Camera Based on Correlation Imaging of Rolling-Shutter CMOS |
| title_fullStr | Vibration Detection and Degraded Image Restoration of Space Camera Based on Correlation Imaging of Rolling-Shutter CMOS |
| title_full_unstemmed | Vibration Detection and Degraded Image Restoration of Space Camera Based on Correlation Imaging of Rolling-Shutter CMOS |
| title_short | Vibration Detection and Degraded Image Restoration of Space Camera Based on Correlation Imaging of Rolling-Shutter CMOS |
| title_sort | vibration detection and degraded image restoration of space camera based on correlation imaging of rolling shutter cmos |
| topic | space camera rolling-shutter CMOS correlation imaging vibration parameter detection degraded image restoration |
| url | https://www.mdpi.com/1424-8220/23/13/5953 |
| work_keys_str_mv | AT hailongliu vibrationdetectionanddegradedimagerestorationofspacecamerabasedoncorrelationimagingofrollingshuttercmos AT hengyilv vibrationdetectionanddegradedimagerestorationofspacecamerabasedoncorrelationimagingofrollingshuttercmos AT chengshanhan vibrationdetectionanddegradedimagerestorationofspacecamerabasedoncorrelationimagingofrollingshuttercmos AT yuchenzhao vibrationdetectionanddegradedimagerestorationofspacecamerabasedoncorrelationimagingofrollingshuttercmos |