Audio and Video Mixing Method to Enhance WebRTC
The WebRTC protocol can provide live streaming of peer-to-peer connections via JavaScript (JS) application programming interface (API) calls to a web browser. However, the protocol is restricted to a small number of peers because there is no simple way to mix real-time streams from multiple peers an...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2020-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/9056474/ |
| _version_ | 1828890516594360320 |
|---|---|
| author | Dongming Tang Liqun Zhang |
| author_facet | Dongming Tang Liqun Zhang |
| author_sort | Dongming Tang |
| collection | DOAJ |
| description | The WebRTC protocol can provide live streaming of peer-to-peer connections via JavaScript (JS) application programming interface (API) calls to a web browser. However, the protocol is restricted to a small number of peers because there is no simple way to mix real-time streams from multiple peers and then distribute the mixed stream to a large number of audiences. For example, it is necessary to mix audio and video streams from peers in a conversation and broadcast the real-time mixed stream to more than 10k audiences who only watch the video. It is also necessary to blend synchronous content (e.g., logos, music) to the live conversation stream. WebRTC does not currently provide a mechanism to easily support these cases. This paper proposes a method for the synchronized mixing of real-time audio/video streams from multiple peers while minimizing latency. This method enables the implementation of an online live conversation system that is able to mix live conversation streams from multiple peers and then rebroadcast the mixed stream to a large number of audiences. |
| first_indexed | 2024-12-13T13:00:20Z |
| format | Article |
| id | doaj.art-1f92101b768a40b5a2616c2aefce87b7 |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-12-13T13:00:20Z |
| publishDate | 2020-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-1f92101b768a40b5a2616c2aefce87b72022-12-21T23:45:03ZengIEEEIEEE Access2169-35362020-01-018672286724110.1109/ACCESS.2020.29854129056474Audio and Video Mixing Method to Enhance WebRTCDongming Tang0https://orcid.org/0000-0002-6167-1292Liqun Zhang1https://orcid.org/0000-0002-2760-3034The Key Laboratory for Computer Systems of State Ethnic Affairs Commission, Southwest Minzu University, Chengdu, ChinaMonstar Lab Inc., Tokyo, JapanThe WebRTC protocol can provide live streaming of peer-to-peer connections via JavaScript (JS) application programming interface (API) calls to a web browser. However, the protocol is restricted to a small number of peers because there is no simple way to mix real-time streams from multiple peers and then distribute the mixed stream to a large number of audiences. For example, it is necessary to mix audio and video streams from peers in a conversation and broadcast the real-time mixed stream to more than 10k audiences who only watch the video. It is also necessary to blend synchronous content (e.g., logos, music) to the live conversation stream. WebRTC does not currently provide a mechanism to easily support these cases. This paper proposes a method for the synchronized mixing of real-time audio/video streams from multiple peers while minimizing latency. This method enables the implementation of an online live conversation system that is able to mix live conversation streams from multiple peers and then rebroadcast the mixed stream to a large number of audiences.https://ieeexplore.ieee.org/document/9056474/WebRTCreal-time multimedia communicationslive streamingsynchronization mechanismmedia synchronization |
| spellingShingle | Dongming Tang Liqun Zhang Audio and Video Mixing Method to Enhance WebRTC IEEE Access WebRTC real-time multimedia communications live streaming synchronization mechanism media synchronization |
| title | Audio and Video Mixing Method to Enhance WebRTC |
| title_full | Audio and Video Mixing Method to Enhance WebRTC |
| title_fullStr | Audio and Video Mixing Method to Enhance WebRTC |
| title_full_unstemmed | Audio and Video Mixing Method to Enhance WebRTC |
| title_short | Audio and Video Mixing Method to Enhance WebRTC |
| title_sort | audio and video mixing method to enhance webrtc |
| topic | WebRTC real-time multimedia communications live streaming synchronization mechanism media synchronization |
| url | https://ieeexplore.ieee.org/document/9056474/ |
| work_keys_str_mv | AT dongmingtang audioandvideomixingmethodtoenhancewebrtc AT liqunzhang audioandvideomixingmethodtoenhancewebrtc |