Design and Implementation of Two Immersive Audio and Video Communication Systems Based on Virtual Reality
Due to the impact of the COVID-19 pandemic in recent years, remote communication has become increasingly common, which has also spawned many online solutions. Compared with an in-person scenario, the feeling of immersion and participation is lacking in these solutions, and the effect is thus not ide...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2023-02-01
|
| Series: | Electronics |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2079-9292/12/5/1134 |
| _version_ | 1797615496274640896 |
|---|---|
| author | Hanqi Zhang Jing Wang Zhuoran Li Jingxin Li |
| author_facet | Hanqi Zhang Jing Wang Zhuoran Li Jingxin Li |
| author_sort | Hanqi Zhang |
| collection | DOAJ |
| description | Due to the impact of the COVID-19 pandemic in recent years, remote communication has become increasingly common, which has also spawned many online solutions. Compared with an in-person scenario, the feeling of immersion and participation is lacking in these solutions, and the effect is thus not ideal. In this study, we focus on two typical virtual reality (VR) application scenarios with immersive audio and video experience: VR conferencing and panoramic live broadcast. We begin by introducing the core principles of traditional video conferencing, followed by the existing research results of VR conferencing along with the similarities, differences, pros, and cons of each solution. Then, we outline our view about what elements a virtual conferencing room should have. After that, a simple implementation scheme for VR conferencing is provided. Regarding panoramic video, we introduce the steps to produce and transmit a panoramic live broadcast and analyze several current mainstream encoding optimization schemes. By comparing traditional video streams, the various development bottlenecks of panoramic live broadcast are identified and summarized. A simple implementation of a panoramic live broadcast is presented in this paper. To conclude, the main points are illustrated along with the possible future directions of the two systems. The simple implementation of two immersive systems provides a research and application reference for VR audio and video transmission, which can guide subsequent relevant research studies. |
| first_indexed | 2024-03-11T07:27:19Z |
| format | Article |
| id | doaj.art-112683e8c3e14be88d051a7218414634 |
| institution | Directory Open Access Journal |
| issn | 2079-9292 |
| language | English |
| last_indexed | 2024-03-11T07:27:19Z |
| publishDate | 2023-02-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Electronics |
| spelling | doaj.art-112683e8c3e14be88d051a72184146342023-11-17T07:32:08ZengMDPI AGElectronics2079-92922023-02-01125113410.3390/electronics12051134Design and Implementation of Two Immersive Audio and Video Communication Systems Based on Virtual RealityHanqi Zhang0Jing Wang1Zhuoran Li2Jingxin Li3School of Information and Electronics, Beijing Institute of Technology, Beijing 100811, ChinaSchool of Information and Electronics, Beijing Institute of Technology, Beijing 100811, ChinaAerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100045, ChinaChina Electronics Standardization Institute, Beijing 101102, ChinaDue to the impact of the COVID-19 pandemic in recent years, remote communication has become increasingly common, which has also spawned many online solutions. Compared with an in-person scenario, the feeling of immersion and participation is lacking in these solutions, and the effect is thus not ideal. In this study, we focus on two typical virtual reality (VR) application scenarios with immersive audio and video experience: VR conferencing and panoramic live broadcast. We begin by introducing the core principles of traditional video conferencing, followed by the existing research results of VR conferencing along with the similarities, differences, pros, and cons of each solution. Then, we outline our view about what elements a virtual conferencing room should have. After that, a simple implementation scheme for VR conferencing is provided. Regarding panoramic video, we introduce the steps to produce and transmit a panoramic live broadcast and analyze several current mainstream encoding optimization schemes. By comparing traditional video streams, the various development bottlenecks of panoramic live broadcast are identified and summarized. A simple implementation of a panoramic live broadcast is presented in this paper. To conclude, the main points are illustrated along with the possible future directions of the two systems. The simple implementation of two immersive systems provides a research and application reference for VR audio and video transmission, which can guide subsequent relevant research studies.https://www.mdpi.com/2079-9292/12/5/1134virtual realityimmersive communicationVR conference roompanoramic live broadcastspatial audio |
| spellingShingle | Hanqi Zhang Jing Wang Zhuoran Li Jingxin Li Design and Implementation of Two Immersive Audio and Video Communication Systems Based on Virtual Reality Electronics virtual reality immersive communication VR conference room panoramic live broadcast spatial audio |
| title | Design and Implementation of Two Immersive Audio and Video Communication Systems Based on Virtual Reality |
| title_full | Design and Implementation of Two Immersive Audio and Video Communication Systems Based on Virtual Reality |
| title_fullStr | Design and Implementation of Two Immersive Audio and Video Communication Systems Based on Virtual Reality |
| title_full_unstemmed | Design and Implementation of Two Immersive Audio and Video Communication Systems Based on Virtual Reality |
| title_short | Design and Implementation of Two Immersive Audio and Video Communication Systems Based on Virtual Reality |
| title_sort | design and implementation of two immersive audio and video communication systems based on virtual reality |
| topic | virtual reality immersive communication VR conference room panoramic live broadcast spatial audio |
| url | https://www.mdpi.com/2079-9292/12/5/1134 |
| work_keys_str_mv | AT hanqizhang designandimplementationoftwoimmersiveaudioandvideocommunicationsystemsbasedonvirtualreality AT jingwang designandimplementationoftwoimmersiveaudioandvideocommunicationsystemsbasedonvirtualreality AT zhuoranli designandimplementationoftwoimmersiveaudioandvideocommunicationsystemsbasedonvirtualreality AT jingxinli designandimplementationoftwoimmersiveaudioandvideocommunicationsystemsbasedonvirtualreality |