Photometric Calibration and Image Stitching for a Large Field of View Multi-Camera System
A new compact large field of view (FOV) multi-camera system is introduced. The camera is based on seven tiny complementary metal-oxide-semiconductor sensor modules covering over 160° × 160° FOV. Although image stitching has been studied extensively, sensor and lens differences have not been consider...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2016-04-01
|
| Series: | Sensors |
| Subjects: | |
| Online Access: | http://www.mdpi.com/1424-8220/16/4/516 |
| _version_ | 1828155176517632000 |
|---|---|
| author | Yu Lu Keyi Wang Gongshu Fan |
| author_facet | Yu Lu Keyi Wang Gongshu Fan |
| author_sort | Yu Lu |
| collection | DOAJ |
| description | A new compact large field of view (FOV) multi-camera system is introduced. The camera is based on seven tiny complementary metal-oxide-semiconductor sensor modules covering over 160° × 160° FOV. Although image stitching has been studied extensively, sensor and lens differences have not been considered in previous multi-camera devices. In this study, we have calibrated the photometric characteristics of the multi-camera device. Lenses were not mounted on the sensor in the process of radiometric response calibration to eliminate the influence of the focusing effect of uniform light from an integrating sphere. Linearity range of the radiometric response, non-linearity response characteristics, sensitivity, and dark current of the camera response function are presented. The R, G, and B channels have different responses for the same illuminance. Vignetting artifact patterns have been tested. The actual luminance of the object is retrieved by sensor calibration results, and is used to blend images to make panoramas reflect the objective luminance more objectively. This compensates for the limitation of stitching images that are more realistic only through the smoothing method. The dynamic range limitation of can be resolved by using multiple cameras that cover a large field of view instead of a single image sensor with a wide-angle lens. The dynamic range is expanded by 48-fold in this system. We can obtain seven images in one shot with this multi-camera system, at 13 frames per second. |
| first_indexed | 2024-04-11T22:50:25Z |
| format | Article |
| id | doaj.art-07605d74f9bc4c98b79ac4a8945b2c25 |
| institution | Directory Open Access Journal |
| issn | 1424-8220 |
| language | English |
| last_indexed | 2024-04-11T22:50:25Z |
| publishDate | 2016-04-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Sensors |
| spelling | doaj.art-07605d74f9bc4c98b79ac4a8945b2c252022-12-22T03:58:36ZengMDPI AGSensors1424-82202016-04-0116451610.3390/s16040516s16040516Photometric Calibration and Image Stitching for a Large Field of View Multi-Camera SystemYu Lu0Keyi Wang1Gongshu Fan2Department of Precision Machinery & Precision Instrumentation, University of Science and Technology of China, Hefei 230022, ChinaDepartment of Precision Machinery & Precision Instrumentation, University of Science and Technology of China, Hefei 230022, ChinaDepartment of Precision Machinery & Precision Instrumentation, University of Science and Technology of China, Hefei 230022, ChinaA new compact large field of view (FOV) multi-camera system is introduced. The camera is based on seven tiny complementary metal-oxide-semiconductor sensor modules covering over 160° × 160° FOV. Although image stitching has been studied extensively, sensor and lens differences have not been considered in previous multi-camera devices. In this study, we have calibrated the photometric characteristics of the multi-camera device. Lenses were not mounted on the sensor in the process of radiometric response calibration to eliminate the influence of the focusing effect of uniform light from an integrating sphere. Linearity range of the radiometric response, non-linearity response characteristics, sensitivity, and dark current of the camera response function are presented. The R, G, and B channels have different responses for the same illuminance. Vignetting artifact patterns have been tested. The actual luminance of the object is retrieved by sensor calibration results, and is used to blend images to make panoramas reflect the objective luminance more objectively. This compensates for the limitation of stitching images that are more realistic only through the smoothing method. The dynamic range limitation of can be resolved by using multiple cameras that cover a large field of view instead of a single image sensor with a wide-angle lens. The dynamic range is expanded by 48-fold in this system. We can obtain seven images in one shot with this multi-camera system, at 13 frames per second.http://www.mdpi.com/1424-8220/16/4/516large field of viewmulti-camera systemcamera response function (CRF)lens vignetting modeldynamic range |
| spellingShingle | Yu Lu Keyi Wang Gongshu Fan Photometric Calibration and Image Stitching for a Large Field of View Multi-Camera System Sensors large field of view multi-camera system camera response function (CRF) lens vignetting model dynamic range |
| title | Photometric Calibration and Image Stitching for a Large Field of View Multi-Camera System |
| title_full | Photometric Calibration and Image Stitching for a Large Field of View Multi-Camera System |
| title_fullStr | Photometric Calibration and Image Stitching for a Large Field of View Multi-Camera System |
| title_full_unstemmed | Photometric Calibration and Image Stitching for a Large Field of View Multi-Camera System |
| title_short | Photometric Calibration and Image Stitching for a Large Field of View Multi-Camera System |
| title_sort | photometric calibration and image stitching for a large field of view multi camera system |
| topic | large field of view multi-camera system camera response function (CRF) lens vignetting model dynamic range |
| url | http://www.mdpi.com/1424-8220/16/4/516 |
| work_keys_str_mv | AT yulu photometriccalibrationandimagestitchingforalargefieldofviewmulticamerasystem AT keyiwang photometriccalibrationandimagestitchingforalargefieldofviewmulticamerasystem AT gongshufan photometriccalibrationandimagestitchingforalargefieldofviewmulticamerasystem |