Supporting Wider Baseline Light Fields in JPEG Pleno With a Novel Slanted 4D-DCT Coding Mode
Light fields are one of the emerging 3D representation formats with an effective potential to offer very realistic and immersive visual experiences. This capability comes at the cost of a very large amount of acquired data which practical use requires efficient coding solutions. This need was alread...
| Main Authors: | , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2023-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/10077367/ |
| _version_ | 1797859119730786304 |
|---|---|
| author | Murilo Bresciani de Carvalho Carla L. Pagliari Gustavo de O. E. Alves Colas Schretter Peter Schelkens Fernando Pereira Eduardo A. B. da Silva |
| author_facet | Murilo Bresciani de Carvalho Carla L. Pagliari Gustavo de O. E. Alves Colas Schretter Peter Schelkens Fernando Pereira Eduardo A. B. da Silva |
| author_sort | Murilo Bresciani de Carvalho |
| collection | DOAJ |
| description | Light fields are one of the emerging 3D representation formats with an effective potential to offer very realistic and immersive visual experiences. This capability comes at the cost of a very large amount of acquired data which practical use requires efficient coding solutions. This need was already addressed by the JPEG Pleno Light Field Coding standard for static light fields, which has specified two coding modes, named 4D-Transform and 4D-Prediction. While the first offers better compression performance for smaller baseline light fields, the second excels for larger baseline light fields. This paper intends to propose a novel light field coding mode, the Slanted 4D-Transform coding mode, which extends the 4D-Transform coding mode based on the conventional 4D-DCT, to offer better compression performance than both the available JPEG Pleno coding modes, independently of the baseline. The key idea is to apply first to each 4D block in the light field an adaptive, hierarchical geometric transformation, which makes the data in the block more energy-compaction friendly for the following 4D-DCT. The rate-distortion performance results show that the proposed Slanted 4D-Transform codec is able to outperform both the already standardized JPEG Pleno coding modes, showing BD-Rates gains of 31.03% and 28.30% for the 4D-Transform and 4D-Prediction modes, respectively, thus implying that a single coding mode can efficiently code all types of light fields. |
| first_indexed | 2024-04-09T21:24:20Z |
| format | Article |
| id | doaj.art-ea97e66a17a048f7a27ef5861538fdaa |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-04-09T21:24:20Z |
| publishDate | 2023-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-ea97e66a17a048f7a27ef5861538fdaa2023-03-27T23:00:37ZengIEEEIEEE Access2169-35362023-01-0111282942831710.1109/ACCESS.2023.325989910077367Supporting Wider Baseline Light Fields in JPEG Pleno With a Novel Slanted 4D-DCT Coding ModeMurilo Bresciani de Carvalho0https://orcid.org/0000-0002-7964-1876Carla L. Pagliari1https://orcid.org/0000-0002-7759-9598Gustavo de O. E. Alves2https://orcid.org/0000-0002-5831-2109Colas Schretter3https://orcid.org/0000-0002-3938-3227Peter Schelkens4https://orcid.org/0000-0003-0908-1655Fernando Pereira5https://orcid.org/0000-0001-6100-947XEduardo A. B. da Silva6https://orcid.org/0000-0001-7755-6988TET/CTC, Universidade Federal Fluminense, Niteroi, BrazilPEE/PGED/IME, Instituto Militar de Engenharia, Rio de Janeiro, BrazilPEE/COPPE/DEL/POLI/UFRJ, Universidade Federal do Rio de Janeiro, Rio de Janeiro, BrazilDepartment of Electronics and Informatics, Vrije Universiteit Brussel, Brussels, BelgiumDepartment of Electronics and Informatics, Vrije Universiteit Brussel, Brussels, BelgiumInstituto Superior Técnico, Universidade de Lisboa, Lisboa, PortugalPEE/COPPE/DEL/POLI/UFRJ, Universidade Federal do Rio de Janeiro, Rio de Janeiro, BrazilLight fields are one of the emerging 3D representation formats with an effective potential to offer very realistic and immersive visual experiences. This capability comes at the cost of a very large amount of acquired data which practical use requires efficient coding solutions. This need was already addressed by the JPEG Pleno Light Field Coding standard for static light fields, which has specified two coding modes, named 4D-Transform and 4D-Prediction. While the first offers better compression performance for smaller baseline light fields, the second excels for larger baseline light fields. This paper intends to propose a novel light field coding mode, the Slanted 4D-Transform coding mode, which extends the 4D-Transform coding mode based on the conventional 4D-DCT, to offer better compression performance than both the available JPEG Pleno coding modes, independently of the baseline. The key idea is to apply first to each 4D block in the light field an adaptive, hierarchical geometric transformation, which makes the data in the block more energy-compaction friendly for the following 4D-DCT. The rate-distortion performance results show that the proposed Slanted 4D-Transform codec is able to outperform both the already standardized JPEG Pleno coding modes, showing BD-Rates gains of 31.03% and 28.30% for the 4D-Transform and 4D-Prediction modes, respectively, thus implying that a single coding mode can efficiently code all types of light fields.https://ieeexplore.ieee.org/document/10077367/JPEG Pleno standardlight field coding4D transform mode4D-DCTslant transform |
| spellingShingle | Murilo Bresciani de Carvalho Carla L. Pagliari Gustavo de O. E. Alves Colas Schretter Peter Schelkens Fernando Pereira Eduardo A. B. da Silva Supporting Wider Baseline Light Fields in JPEG Pleno With a Novel Slanted 4D-DCT Coding Mode IEEE Access JPEG Pleno standard light field coding 4D transform mode 4D-DCT slant transform |
| title | Supporting Wider Baseline Light Fields in JPEG Pleno With a Novel Slanted 4D-DCT Coding Mode |
| title_full | Supporting Wider Baseline Light Fields in JPEG Pleno With a Novel Slanted 4D-DCT Coding Mode |
| title_fullStr | Supporting Wider Baseline Light Fields in JPEG Pleno With a Novel Slanted 4D-DCT Coding Mode |
| title_full_unstemmed | Supporting Wider Baseline Light Fields in JPEG Pleno With a Novel Slanted 4D-DCT Coding Mode |
| title_short | Supporting Wider Baseline Light Fields in JPEG Pleno With a Novel Slanted 4D-DCT Coding Mode |
| title_sort | supporting wider baseline light fields in jpeg pleno with a novel slanted 4d dct coding mode |
| topic | JPEG Pleno standard light field coding 4D transform mode 4D-DCT slant transform |
| url | https://ieeexplore.ieee.org/document/10077367/ |
| work_keys_str_mv | AT murilobrescianidecarvalho supportingwiderbaselinelightfieldsinjpegplenowithanovelslanted4ddctcodingmode AT carlalpagliari supportingwiderbaselinelightfieldsinjpegplenowithanovelslanted4ddctcodingmode AT gustavodeoealves supportingwiderbaselinelightfieldsinjpegplenowithanovelslanted4ddctcodingmode AT colasschretter supportingwiderbaselinelightfieldsinjpegplenowithanovelslanted4ddctcodingmode AT peterschelkens supportingwiderbaselinelightfieldsinjpegplenowithanovelslanted4ddctcodingmode AT fernandopereira supportingwiderbaselinelightfieldsinjpegplenowithanovelslanted4ddctcodingmode AT eduardoabdasilva supportingwiderbaselinelightfieldsinjpegplenowithanovelslanted4ddctcodingmode |