Overcoming spatio-angular trade-off in light field acquisition using compressive sensing
In contrast to conventional cameras which capture a 2D projection of a 3D scene by integrating the angular domain, light field cameras preserve the angular information of individual light rays by capturing a 4D light field of a scene. On the one hand, light field photography enables powerful post-ca...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Taylor & Francis Group
2020-04-01
|
| Series: | Automatika |
| Subjects: | |
| Online Access: | http://dx.doi.org/10.1080/00051144.2020.1715582 |
| _version_ | 1819088518405685248 |
|---|---|
| author | Nicol Dlab Filip Cimermančić Ivan Ralašić Damir Seršić |
| author_facet | Nicol Dlab Filip Cimermančić Ivan Ralašić Damir Seršić |
| author_sort | Nicol Dlab |
| collection | DOAJ |
| description | In contrast to conventional cameras which capture a 2D projection of a 3D scene by integrating the angular domain, light field cameras preserve the angular information of individual light rays by capturing a 4D light field of a scene. On the one hand, light field photography enables powerful post-capture capabilities such as refocusing, virtual aperture, depth sensing and perspective shift. On the other hand, it has several drawbacks, namely, high-dimensionality of the captured light fields and a fundamental trade-off between spatial and angular resolution in the camera design. In this paper, we propose a compressive sensing approach to light field acquisition from a sub-Nyquist number of samples. Using an off-the-shelf measurement setup consisting of a digital projector and a Lytro Illum light field camera, we demonstrate the efficiency of the compressive sensing approach by improving the spatial resolution of the acquired light field. This paper presents a proof of concept with a simplified 3D scene as the scene of interest. Results obtained by the proposed method show significant improvement in the spatial resolution of the light field as well as preserved post-capture capabilities. |
| first_indexed | 2024-12-21T21:53:19Z |
| format | Article |
| id | doaj.art-8773f89298de47999d0e95b37d88c5ac |
| institution | Directory Open Access Journal |
| issn | 0005-1144 1848-3380 |
| language | English |
| last_indexed | 2024-12-21T21:53:19Z |
| publishDate | 2020-04-01 |
| publisher | Taylor & Francis Group |
| record_format | Article |
| series | Automatika |
| spelling | doaj.art-8773f89298de47999d0e95b37d88c5ac2022-12-21T18:49:02ZengTaylor & Francis GroupAutomatika0005-11441848-33802020-04-0161225025910.1080/00051144.2020.17155821715582Overcoming spatio-angular trade-off in light field acquisition using compressive sensingNicol Dlab0Filip Cimermančić1Ivan Ralašić2Damir Seršić3University of Zagreb Faculty of Electrical Engineering and ComputingUniversity of Zagreb Faculty of Electrical Engineering and ComputingUniversity of Zagreb Faculty of Electrical Engineering and ComputingUniversity of Zagreb Faculty of Electrical Engineering and ComputingIn contrast to conventional cameras which capture a 2D projection of a 3D scene by integrating the angular domain, light field cameras preserve the angular information of individual light rays by capturing a 4D light field of a scene. On the one hand, light field photography enables powerful post-capture capabilities such as refocusing, virtual aperture, depth sensing and perspective shift. On the other hand, it has several drawbacks, namely, high-dimensionality of the captured light fields and a fundamental trade-off between spatial and angular resolution in the camera design. In this paper, we propose a compressive sensing approach to light field acquisition from a sub-Nyquist number of samples. Using an off-the-shelf measurement setup consisting of a digital projector and a Lytro Illum light field camera, we demonstrate the efficiency of the compressive sensing approach by improving the spatial resolution of the acquired light field. This paper presents a proof of concept with a simplified 3D scene as the scene of interest. Results obtained by the proposed method show significant improvement in the spatial resolution of the light field as well as preserved post-capture capabilities.http://dx.doi.org/10.1080/00051144.2020.1715582compressive sensing (cs)light fieldcameraprojectormeasurement setupsparse optimization |
| spellingShingle | Nicol Dlab Filip Cimermančić Ivan Ralašić Damir Seršić Overcoming spatio-angular trade-off in light field acquisition using compressive sensing Automatika compressive sensing (cs) light field camera projector measurement setup sparse optimization |
| title | Overcoming spatio-angular trade-off in light field acquisition using compressive sensing |
| title_full | Overcoming spatio-angular trade-off in light field acquisition using compressive sensing |
| title_fullStr | Overcoming spatio-angular trade-off in light field acquisition using compressive sensing |
| title_full_unstemmed | Overcoming spatio-angular trade-off in light field acquisition using compressive sensing |
| title_short | Overcoming spatio-angular trade-off in light field acquisition using compressive sensing |
| title_sort | overcoming spatio angular trade off in light field acquisition using compressive sensing |
| topic | compressive sensing (cs) light field camera projector measurement setup sparse optimization |
| url | http://dx.doi.org/10.1080/00051144.2020.1715582 |
| work_keys_str_mv | AT nicoldlab overcomingspatioangulartradeoffinlightfieldacquisitionusingcompressivesensing AT filipcimermancic overcomingspatioangulartradeoffinlightfieldacquisitionusingcompressivesensing AT ivanralasic overcomingspatioangulartradeoffinlightfieldacquisitionusingcompressivesensing AT damirsersic overcomingspatioangulartradeoffinlightfieldacquisitionusingcompressivesensing |