Convolutional Neural Networks for Continuous QoE Prediction in Video Streaming Services
In video streaming services, predicting the continuous user's quality of experience (QoE) plays a crucial role in delivering high quality streaming contents to the user. However, the complexity caused by the temporal dependencies in QoE data and the non-linear relationships among QoE influence...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2020-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/9122485/ |
| _version_ | 1831559137990803456 |
|---|---|
| author | Tho Nguyen Duc Chanh Tran Minh Tan Phan Xuan Eiji Kamioka |
| author_facet | Tho Nguyen Duc Chanh Tran Minh Tan Phan Xuan Eiji Kamioka |
| author_sort | Tho Nguyen Duc |
| collection | DOAJ |
| description | In video streaming services, predicting the continuous user's quality of experience (QoE) plays a crucial role in delivering high quality streaming contents to the user. However, the complexity caused by the temporal dependencies in QoE data and the non-linear relationships among QoE influence factors has introduced challenges to continuous QoE prediction. To deal with that, existing studies have utilized the Long Short-Term Memory model (LSTM) to effectively capture such complex dependencies, resulting in excellent QoE prediction accuracy. However, the high computational complexity of LSTM, caused by the sequential processing characteristic in its architecture, raises a serious question about its performance on devices with limited computational power. Meanwhile, Temporal Convolutional Network (TCN), a variation of convolutional neural networks, has recently been proposed for sequence modeling tasks (e.g., speech enhancement), providing a superior prediction performance over baseline methods including LSTM in terms of prediction accuracy and computational complexity. Being inspired of that, in this paper, an improved TCN-based model, namely CNN-QoE, is proposed for continuously predicting the QoE, which poses characteristics of sequential data. The proposed model leverages the advantages of TCN to overcome the computational complexity drawbacks of LSTM-based QoE models, while at the same time introducing the improvements to its architecture to improve QoE prediction accuracy. Based on a comprehensive evaluation, we demonstrate that the proposed CNN-QoE model can provide a high QoE prediction performance on both personal computers and mobile devices, outperforming the existing approaches. |
| first_indexed | 2024-12-17T05:23:54Z |
| format | Article |
| id | doaj.art-8046198a2b264db295cd0359185c4416 |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-12-17T05:23:54Z |
| publishDate | 2020-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-8046198a2b264db295cd0359185c44162022-12-21T22:01:56ZengIEEEIEEE Access2169-35362020-01-01811626811627810.1109/ACCESS.2020.30041259122485Convolutional Neural Networks for Continuous QoE Prediction in Video Streaming ServicesTho Nguyen Duc0https://orcid.org/0000-0002-7152-4915Chanh Tran Minh1Tan Phan Xuan2https://orcid.org/0000-0002-9592-0226Eiji Kamioka3Graduate School of Engineering and Science, Shibaura Institute of Technology, Tokyo, JapanGraduate School of Engineering and Science, Shibaura Institute of Technology, Tokyo, JapanDepartment of Information and Communications Engineering, Shibaura Institute of Technology, Tokyo, JapanGraduate School of Engineering and Science, Shibaura Institute of Technology, Tokyo, JapanIn video streaming services, predicting the continuous user's quality of experience (QoE) plays a crucial role in delivering high quality streaming contents to the user. However, the complexity caused by the temporal dependencies in QoE data and the non-linear relationships among QoE influence factors has introduced challenges to continuous QoE prediction. To deal with that, existing studies have utilized the Long Short-Term Memory model (LSTM) to effectively capture such complex dependencies, resulting in excellent QoE prediction accuracy. However, the high computational complexity of LSTM, caused by the sequential processing characteristic in its architecture, raises a serious question about its performance on devices with limited computational power. Meanwhile, Temporal Convolutional Network (TCN), a variation of convolutional neural networks, has recently been proposed for sequence modeling tasks (e.g., speech enhancement), providing a superior prediction performance over baseline methods including LSTM in terms of prediction accuracy and computational complexity. Being inspired of that, in this paper, an improved TCN-based model, namely CNN-QoE, is proposed for continuously predicting the QoE, which poses characteristics of sequential data. The proposed model leverages the advantages of TCN to overcome the computational complexity drawbacks of LSTM-based QoE models, while at the same time introducing the improvements to its architecture to improve QoE prediction accuracy. Based on a comprehensive evaluation, we demonstrate that the proposed CNN-QoE model can provide a high QoE prediction performance on both personal computers and mobile devices, outperforming the existing approaches.https://ieeexplore.ieee.org/document/9122485/Convolutional neural networkstemporal convolutional networkquality of experiencevideo streaming |
| spellingShingle | Tho Nguyen Duc Chanh Tran Minh Tan Phan Xuan Eiji Kamioka Convolutional Neural Networks for Continuous QoE Prediction in Video Streaming Services IEEE Access Convolutional neural networks temporal convolutional network quality of experience video streaming |
| title | Convolutional Neural Networks for Continuous QoE Prediction in Video Streaming Services |
| title_full | Convolutional Neural Networks for Continuous QoE Prediction in Video Streaming Services |
| title_fullStr | Convolutional Neural Networks for Continuous QoE Prediction in Video Streaming Services |
| title_full_unstemmed | Convolutional Neural Networks for Continuous QoE Prediction in Video Streaming Services |
| title_short | Convolutional Neural Networks for Continuous QoE Prediction in Video Streaming Services |
| title_sort | convolutional neural networks for continuous qoe prediction in video streaming services |
| topic | Convolutional neural networks temporal convolutional network quality of experience video streaming |
| url | https://ieeexplore.ieee.org/document/9122485/ |
| work_keys_str_mv | AT thonguyenduc convolutionalneuralnetworksforcontinuousqoepredictioninvideostreamingservices AT chanhtranminh convolutionalneuralnetworksforcontinuousqoepredictioninvideostreamingservices AT tanphanxuan convolutionalneuralnetworksforcontinuousqoepredictioninvideostreamingservices AT eijikamioka convolutionalneuralnetworksforcontinuousqoepredictioninvideostreamingservices |