Integration of Multisensorial Effects in Synchronised Immersive Hybrid TV Scenarios
Traditionally, TV media content has exclusively involved 2D or 3D audiovisual streams consumed by using a simple TV device. However, in order to generate more immersive media consumption experiences, other new types of content (e.g., omnidirectional video), consumption devices (e.g., Head Mounted Di...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2022-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/9841574/ |
| _version_ | 1828367753721937920 |
|---|---|
| author | Daniel Marfil Fernando Boronat Juan Gonzalez Almanzor Sapena |
| author_facet | Daniel Marfil Fernando Boronat Juan Gonzalez Almanzor Sapena |
| author_sort | Daniel Marfil |
| collection | DOAJ |
| description | Traditionally, TV media content has exclusively involved 2D or 3D audiovisual streams consumed by using a simple TV device. However, in order to generate more immersive media consumption experiences, other new types of content (e.g., omnidirectional video), consumption devices (e.g., Head Mounted Displays or HMD) and solutions to stimulate other senses beyond the traditional ones of sight and hearing, can be used. Multi-sensorial media content (a.k.a. mulsemedia) facilitates additional sensory effects that stimulate other senses during the media consumption, with the aim of providing the consumers with a more immersive and realistic experience. They provide the users with a greater degree of realism and immersion, but can also provide greater social integration (e.g., people with AV deficiencies or attention span problems) and even contribute to creating better educational programs (e.g., for learning through the senses in educational content or scientific divulgation). Examples of sensory effects that can be used are olfactory effects (scents), tactile effects (e.g., vibration, wind or pressure effects), and ambient effects (e.g., temperature or lighting). In this paper, a solution for providing multi-sensorial and immersive hybrid (broadcast/broadband) TV content consumption experiences, including omnidirectional video and sensory effects, is presented. It has been designed, implemented, and subjectively evaluated (by 32 participants) in an end-to-end platform for hybrid content generation, delivery and synchronised consumption. The satisfactory results which were obtained regarding the perception of fine synchronisation between sensory effects and multimedia content, and regarding the users’ perceived QoE, are summarised and discussed. |
| first_indexed | 2024-04-14T06:02:17Z |
| format | Article |
| id | doaj.art-053298227a0940b09b85af09a5912be1 |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-04-14T06:02:17Z |
| publishDate | 2022-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-053298227a0940b09b85af09a5912be12022-12-22T02:08:42ZengIEEEIEEE Access2169-35362022-01-0110790717908910.1109/ACCESS.2022.31941709841574Integration of Multisensorial Effects in Synchronised Immersive Hybrid TV ScenariosDaniel Marfil0https://orcid.org/0000-0002-7918-3342Fernando Boronat1https://orcid.org/0000-0001-5525-3441Juan Gonzalez2Almanzor Sapena3https://orcid.org/0000-0001-8473-6063Department of Communications, Universitat Politècnica de València, Gandia Campus, Grao de Gandia, SpainDepartment of Communications, Universitat Politècnica de València, Gandia Campus, Grao de Gandia, SpainDepartment of Communications, Universitat Politècnica de València, Gandia Campus, Grao de Gandia, SpainDepartment of Mathematics, Universitat Politècnica de València, Gandia Campus, Grao de Gandia, SpainTraditionally, TV media content has exclusively involved 2D or 3D audiovisual streams consumed by using a simple TV device. However, in order to generate more immersive media consumption experiences, other new types of content (e.g., omnidirectional video), consumption devices (e.g., Head Mounted Displays or HMD) and solutions to stimulate other senses beyond the traditional ones of sight and hearing, can be used. Multi-sensorial media content (a.k.a. mulsemedia) facilitates additional sensory effects that stimulate other senses during the media consumption, with the aim of providing the consumers with a more immersive and realistic experience. They provide the users with a greater degree of realism and immersion, but can also provide greater social integration (e.g., people with AV deficiencies or attention span problems) and even contribute to creating better educational programs (e.g., for learning through the senses in educational content or scientific divulgation). Examples of sensory effects that can be used are olfactory effects (scents), tactile effects (e.g., vibration, wind or pressure effects), and ambient effects (e.g., temperature or lighting). In this paper, a solution for providing multi-sensorial and immersive hybrid (broadcast/broadband) TV content consumption experiences, including omnidirectional video and sensory effects, is presented. It has been designed, implemented, and subjectively evaluated (by 32 participants) in an end-to-end platform for hybrid content generation, delivery and synchronised consumption. The satisfactory results which were obtained regarding the perception of fine synchronisation between sensory effects and multimedia content, and regarding the users’ perceived QoE, are summarised and discussed.https://ieeexplore.ieee.org/document/9841574/Advanced TVdigital TVHbbTV standardshybrid TVimmersive TVmulsemedia |
| spellingShingle | Daniel Marfil Fernando Boronat Juan Gonzalez Almanzor Sapena Integration of Multisensorial Effects in Synchronised Immersive Hybrid TV Scenarios IEEE Access Advanced TV digital TV HbbTV standards hybrid TV immersive TV mulsemedia |
| title | Integration of Multisensorial Effects in Synchronised Immersive Hybrid TV Scenarios |
| title_full | Integration of Multisensorial Effects in Synchronised Immersive Hybrid TV Scenarios |
| title_fullStr | Integration of Multisensorial Effects in Synchronised Immersive Hybrid TV Scenarios |
| title_full_unstemmed | Integration of Multisensorial Effects in Synchronised Immersive Hybrid TV Scenarios |
| title_short | Integration of Multisensorial Effects in Synchronised Immersive Hybrid TV Scenarios |
| title_sort | integration of multisensorial effects in synchronised immersive hybrid tv scenarios |
| topic | Advanced TV digital TV HbbTV standards hybrid TV immersive TV mulsemedia |
| url | https://ieeexplore.ieee.org/document/9841574/ |
| work_keys_str_mv | AT danielmarfil integrationofmultisensorialeffectsinsynchronisedimmersivehybridtvscenarios AT fernandoboronat integrationofmultisensorialeffectsinsynchronisedimmersivehybridtvscenarios AT juangonzalez integrationofmultisensorialeffectsinsynchronisedimmersivehybridtvscenarios AT almanzorsapena integrationofmultisensorialeffectsinsynchronisedimmersivehybridtvscenarios |