A Novel Multi-Projection Correction Method Based on Binocular Vision
In order to improve the accuracy of multi-projection correction fusion, a multi-projection correction method based on binocular vision is proposed. To date, most of the existing methods are based on the single-camera mode, which may lose the depth information of the display wall and may not accurate...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2023-02-01
|
| Series: | Electronics |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2079-9292/12/4/910 |
| _version_ | 1797621329059381248 |
|---|---|
| author | Sheng Wang Zhisheng You Yuxi Zhang |
| author_facet | Sheng Wang Zhisheng You Yuxi Zhang |
| author_sort | Sheng Wang |
| collection | DOAJ |
| description | In order to improve the accuracy of multi-projection correction fusion, a multi-projection correction method based on binocular vision is proposed. To date, most of the existing methods are based on the single-camera mode, which may lose the depth information of the display wall and may not accurately obtain the details of the geometric structure of the display wall. The proposed method uses the depth information of a binocular camera to build a high-precision 3D display wall model; thus, there is no need to know the specific CAD size of the display wall in advance. Meanwhile, this method can be applied to display walls of any shape. By calibrating the binocular vision camera, the radial and eccentric aberration of the camera can be reduced. The projector projects the encoded structured light stripes, and the high-precision 3D structural information of the projection screen can be reconstructed according to the phase relationship after collecting the deformation stripes on the projection screen with the binocular camera. Thus, the screen-projector sub-pixel-level mapping relationship is established, and a high-precision geometric correction is achieved. In addition, by means of the one-to-one mapping relation between the phase information and the three-dimensional space points, accurate point cloud matching among multiple binocular phase sets could be established, so that such method can be applied to any quantity of projectors. The experimental results based on various special-shaped projection screens show that, comparing to the single-camera-based method, the proposed method improves the geometric correction accuracy of multi-projection stitching by more than 20%. This method also has many advantages, such as strong universality, high measurement accuracy, and rapid measurement speed, which indicate its wide application potential in many different fields. |
| first_indexed | 2024-03-11T08:55:25Z |
| format | Article |
| id | doaj.art-e2c90f10616a417b94632767944ddd26 |
| institution | Directory Open Access Journal |
| issn | 2079-9292 |
| language | English |
| last_indexed | 2024-03-11T08:55:25Z |
| publishDate | 2023-02-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Electronics |
| spelling | doaj.art-e2c90f10616a417b94632767944ddd262023-11-16T20:11:51ZengMDPI AGElectronics2079-92922023-02-0112491010.3390/electronics12040910A Novel Multi-Projection Correction Method Based on Binocular VisionSheng Wang0Zhisheng You1Yuxi Zhang2College of Computer Science, Sichuan University, Chengdu 610065, ChinaCollege of Computer Science, Sichuan University, Chengdu 610065, ChinaWisesoft Co., Ltd., Chengdu 610045, ChinaIn order to improve the accuracy of multi-projection correction fusion, a multi-projection correction method based on binocular vision is proposed. To date, most of the existing methods are based on the single-camera mode, which may lose the depth information of the display wall and may not accurately obtain the details of the geometric structure of the display wall. The proposed method uses the depth information of a binocular camera to build a high-precision 3D display wall model; thus, there is no need to know the specific CAD size of the display wall in advance. Meanwhile, this method can be applied to display walls of any shape. By calibrating the binocular vision camera, the radial and eccentric aberration of the camera can be reduced. The projector projects the encoded structured light stripes, and the high-precision 3D structural information of the projection screen can be reconstructed according to the phase relationship after collecting the deformation stripes on the projection screen with the binocular camera. Thus, the screen-projector sub-pixel-level mapping relationship is established, and a high-precision geometric correction is achieved. In addition, by means of the one-to-one mapping relation between the phase information and the three-dimensional space points, accurate point cloud matching among multiple binocular phase sets could be established, so that such method can be applied to any quantity of projectors. The experimental results based on various special-shaped projection screens show that, comparing to the single-camera-based method, the proposed method improves the geometric correction accuracy of multi-projection stitching by more than 20%. This method also has many advantages, such as strong universality, high measurement accuracy, and rapid measurement speed, which indicate its wide application potential in many different fields.https://www.mdpi.com/2079-9292/12/4/910multi-projection stitchinggeometric correctionbinocular visionpoint cloud matching |
| spellingShingle | Sheng Wang Zhisheng You Yuxi Zhang A Novel Multi-Projection Correction Method Based on Binocular Vision Electronics multi-projection stitching geometric correction binocular vision point cloud matching |
| title | A Novel Multi-Projection Correction Method Based on Binocular Vision |
| title_full | A Novel Multi-Projection Correction Method Based on Binocular Vision |
| title_fullStr | A Novel Multi-Projection Correction Method Based on Binocular Vision |
| title_full_unstemmed | A Novel Multi-Projection Correction Method Based on Binocular Vision |
| title_short | A Novel Multi-Projection Correction Method Based on Binocular Vision |
| title_sort | novel multi projection correction method based on binocular vision |
| topic | multi-projection stitching geometric correction binocular vision point cloud matching |
| url | https://www.mdpi.com/2079-9292/12/4/910 |
| work_keys_str_mv | AT shengwang anovelmultiprojectioncorrectionmethodbasedonbinocularvision AT zhishengyou anovelmultiprojectioncorrectionmethodbasedonbinocularvision AT yuxizhang anovelmultiprojectioncorrectionmethodbasedonbinocularvision AT shengwang novelmultiprojectioncorrectionmethodbasedonbinocularvision AT zhishengyou novelmultiprojectioncorrectionmethodbasedonbinocularvision AT yuxizhang novelmultiprojectioncorrectionmethodbasedonbinocularvision |