Image Segmentation Methods for Subpicture Partitioning in the VVC Video Encoder
The emergence of the new generation video coding standard, Versatile Video Coding (VVC), has brought along novel features rendering the new standard more efficient and flexible than its predecessors. Aside from efficient compression of 8 k or higher camera-captured content, VVC also supports a wide...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2022-07-01
|
| Series: | Electronics |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2079-9292/11/13/2070 |
| _version_ | 1797480434337054720 |
|---|---|
| author | Natalia Panagou Panagiotis Belememis Maria Koziri |
| author_facet | Natalia Panagou Panagiotis Belememis Maria Koziri |
| author_sort | Natalia Panagou |
| collection | DOAJ |
| description | The emergence of the new generation video coding standard, Versatile Video Coding (VVC), has brought along novel features rendering the new standard more efficient and flexible than its predecessors. Aside from efficient compression of 8 k or higher camera-captured content, VVC also supports a wide range of applications, including computer-generated content, high dynamic range (HDR) content, multilayer and multi-view coding, video region extraction, as well as 360° video. One of the newly introduced coding tools in VVC, offering extraction and independent coding of rectangular sub-areas within a frame, is called Subpicture. In this work, we turn our attention to frame partitioning using Subpictures in VVC, and more particularly, a content-aware partitioning is considered. To achieve that, we make use of image segmentation algorithms and properly modify them to operate on a per Coding Tree Unit (CTU) basis in order to render them compliant with the standard’s restrictions. Additionally, since subpicture boundaries need to comply with slice boundaries, we propose two methods for properly partitioning a frame using tiles/slices aiming to avoid over-partitioning of a frame. The proposed algorithms are evaluated regarding both compression efficiency and image segmentation effectiveness. Our evaluation results indicate that the proposed partitioning schemes have a negligible impact on compression efficiency and video quality |
| first_indexed | 2024-03-09T21:59:57Z |
| format | Article |
| id | doaj.art-cf827d5b2b0642ca8b8db46a7f80dc7a |
| institution | Directory Open Access Journal |
| issn | 2079-9292 |
| language | English |
| last_indexed | 2024-03-09T21:59:57Z |
| publishDate | 2022-07-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Electronics |
| spelling | doaj.art-cf827d5b2b0642ca8b8db46a7f80dc7a2023-11-23T19:52:23ZengMDPI AGElectronics2079-92922022-07-011113207010.3390/electronics11132070Image Segmentation Methods for Subpicture Partitioning in the VVC Video EncoderNatalia Panagou0Panagiotis Belememis1Maria Koziri2Department of Informatics and Telecommunications, School of Science, University of Thessaly, 35100 Lamia, GreeceDepartment of Informatics and Telecommunications, School of Science, University of Thessaly, 35100 Lamia, GreeceDepartment of Informatics and Telecommunications, School of Science, University of Thessaly, 35100 Lamia, GreeceThe emergence of the new generation video coding standard, Versatile Video Coding (VVC), has brought along novel features rendering the new standard more efficient and flexible than its predecessors. Aside from efficient compression of 8 k or higher camera-captured content, VVC also supports a wide range of applications, including computer-generated content, high dynamic range (HDR) content, multilayer and multi-view coding, video region extraction, as well as 360° video. One of the newly introduced coding tools in VVC, offering extraction and independent coding of rectangular sub-areas within a frame, is called Subpicture. In this work, we turn our attention to frame partitioning using Subpictures in VVC, and more particularly, a content-aware partitioning is considered. To achieve that, we make use of image segmentation algorithms and properly modify them to operate on a per Coding Tree Unit (CTU) basis in order to render them compliant with the standard’s restrictions. Additionally, since subpicture boundaries need to comply with slice boundaries, we propose two methods for properly partitioning a frame using tiles/slices aiming to avoid over-partitioning of a frame. The proposed algorithms are evaluated regarding both compression efficiency and image segmentation effectiveness. Our evaluation results indicate that the proposed partitioning schemes have a negligible impact on compression efficiency and video qualityhttps://www.mdpi.com/2079-9292/11/13/2070VVCvideo codingframe partitioningsubpicturesimage segmentationotsu thresholding |
| spellingShingle | Natalia Panagou Panagiotis Belememis Maria Koziri Image Segmentation Methods for Subpicture Partitioning in the VVC Video Encoder Electronics VVC video coding frame partitioning subpictures image segmentation otsu thresholding |
| title | Image Segmentation Methods for Subpicture Partitioning in the VVC Video Encoder |
| title_full | Image Segmentation Methods for Subpicture Partitioning in the VVC Video Encoder |
| title_fullStr | Image Segmentation Methods for Subpicture Partitioning in the VVC Video Encoder |
| title_full_unstemmed | Image Segmentation Methods for Subpicture Partitioning in the VVC Video Encoder |
| title_short | Image Segmentation Methods for Subpicture Partitioning in the VVC Video Encoder |
| title_sort | image segmentation methods for subpicture partitioning in the vvc video encoder |
| topic | VVC video coding frame partitioning subpictures image segmentation otsu thresholding |
| url | https://www.mdpi.com/2079-9292/11/13/2070 |
| work_keys_str_mv | AT nataliapanagou imagesegmentationmethodsforsubpicturepartitioninginthevvcvideoencoder AT panagiotisbelememis imagesegmentationmethodsforsubpicturepartitioninginthevvcvideoencoder AT mariakoziri imagesegmentationmethodsforsubpicturepartitioninginthevvcvideoencoder |