IMIS 2017: Innovative Mobile and Internet Services in Ubiquitous Computing pp 374-384 | Cite as
A Prospect of Interdisciplinary Methodology of QoE Assessment
Abstract
With the development of streaming media service, Quality of Experience (QoE) has become the key competency for those content providers to attract customers. Many researches on QoE assessment have been conducted, but most of them had problems that those subjective experiments are difficult to be regulated and the data is not collected uniformly because of long tail effect. The purpose of this paper is to give a review of QoE assessment, which includes the concept of QoE, the influential factors, the approaches of experiment and QoE analysis and evaluation. Through the survey which shows the development of the QoE assessment, this paper indicates the future trends and challenges. Based on such current challenges and future analysis, an experiment-oriented methodology of QoE assessment is raised by conceptual model description. Also, those technologies which are based on different subjects including communication study and psychology study for supporting the methodology are described. The problems of small data volume, long tail phenomenon in QoE experiments and influence of malicious feedback will be solved by implementation of the personal QoE assessment methodology.
Notes
Acknowledgements
This work was supported by the National Nature Science Foundation of China (61372113) and the 863 Project No. 2014AA01A706.
References
- 1.eMarketer Newsletter: 2 Billion Consumers Worldwide to Get Smart (Phones) by 2016 (2014). http://www.emarketer.com/Article/2-Billion-Consumers-Worldwide-Smartphones-by-2016/
- 2.Definition of Quality of Experience (QoE), Rec. TD 109rev2 (PLEN/12)ITU-T, Geneva, Switzerland (2007)Google Scholar
- 3.Kilkki, K.: Quality of experience in communications ecosystem. J. Univers. Comput. Sci. 14(5), 615–624 (2008)Google Scholar
- 4.Tsompanidis, I., Fortetsanakis, G., Hirvonen, T., et al.: Analyzing the impact of various wireless network conditions on the perceived quality of VoIP. In: IEEE Workshop on Local & Metropolitan Area Networks, pp. 1–6 (2010)Google Scholar
- 5.Kim, S.J., Chae, C.B., Lee, J.S.: Subjective and objective quality assessment of videos in error-prone network environments. Multimedia Tools Appl. 75(12), 1–22 (2015) Google Scholar
- 6.Su, G.M., Su, X., Bai, Y., et al.: QoE in video streaming over wireless networks: perspectives and research challenges. Wireless Netw. 22(5), 1–23 (2015) Google Scholar
- 7.Casas, P., Seufert, M., Wamser, F., et al.: Next to you: monitoring quality of experience in cellular networks from the end-devices. IEEE Trans. Netw. Serv. Manage. 13(2), 181–196 (2016). Nicole, R. (ed.)CrossRefGoogle Scholar
- 8.Mok, R.K.P., Chan, E.W.W., Chang, R.K.C.: Measuring the quality of experience of HTTP video streaming. In: 12th IFIP/IEEE International Symposium on Integrated Network Management (IM 2011) and Workshops, pp. 485–492. IEEE (2011)Google Scholar
- 9.Cermak, G., Pinson, M., Wolf, S.: The relationship among video quality, screen resolution, and bit rate. IEEE Trans. Broadcast. 57(2), 258–262 (2011)CrossRefGoogle Scholar
- 10.Trestian, R., Vien, Q.T., Nguyen, H.X., et al.: On the impact of video content type on the mobile video quality assessment and energy consumption. In: 2015 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting, pp. 1–6. IEEE (2015)Google Scholar
- 11.Mushtaq, M.S., Augustin, B., Mellouk, A.: QoE: user profile analysis for multimedia services. In: 2014 IEEE International Conference on Communications (ICC), pp. 2289–2294. IEEE (2014)Google Scholar
- 12.Ding, Y., Geng, Y., Wang, R., et al.: QoE-oriented resource management strategy by considering user preference for video content. In: Network Operations and Management Symposium (APNOMS), 2014 16th Asia-Pacific, pp. 1–4. IEEE (2014)Google Scholar
- 13.He, Y., Wei, A., Zhang, W., et al.: Understanding user behavior in large scale internet video service. In: 2015 International Conference on Cyber-Enabled Distributed Computing and Knowledge Discovery (CyberC), pp. 261–267. IEEE (2015)Google Scholar
- 14.Huang, Y., Zhou, W., Du, Y.: Research on the user behavior-based QoE evaluation method for HTTP mobile streaming. In: 2014 Ninth International Conference on Broadband and Wireless Computing, Communication and Applications (BWCCA), pp. 47–51. IEEE (2014)Google Scholar
- 15.Yu, S., Tao, R., Hou, Y.: Modeling for short-form HTTP adaptive streaming considering memory effect. In: 2015 10th International Conference on Broadband and Wireless Computing, Communication and Applications (BWCCA), pp. 82–87. IEEE (2015)Google Scholar
- 16.Pinson, M.H., Janowski, L., Pépion, R., et al.: The influence of subjects and environment on audiovisual subjective tests: an international study. IEEE J. Sel. Top. Sig. Process. 6(6), 640–651 (2012)CrossRefGoogle Scholar
- 17.You, L., Zhou, W., Chen, Z., Wu, W.: A novel method to calculate QoE-oriented dynamic weights of indicators for telecommunication service. In: IEEE Tencon 2013, 22–25 October 2013, Xi’an (2013)Google Scholar
- 18.Bao, Y., Lei, W., Zhang, W., et al.: QoE collaborative evaluation method based on fuzzy clustering heuristic algorithm. SpringerPlus 5(1), 1–29 (2016)CrossRefGoogle Scholar
- 19.Jain, R.: Quality of experience. IEEE Multimedia Mag. 11(1), 95–96 (2004)CrossRefGoogle Scholar
- 20.Volk, T., Keimel, C., Moosmeier, M., et al.: Crowdsourcing vs. laboratory experiments–QoE evaluation of binaural playback in a teleconference scenario. Comput. Netw. 90, 99–109 (2015)CrossRefGoogle Scholar
- 21.Rodríguez, D.Z., Rosa, R.L., Costa, E.A., et al.: Video quality assessment in video streaming services considering user preference for video content. IEEE Trans. Consum. Electron. 60(3), 436–444 (2014)CrossRefGoogle Scholar
- 22.Charonyktakis, P., Plakia, M., Tsamardinos, I., et al.: On user-centric modular QoE prediction for VoIP based on machine-learning algorithms. IEEE Trans. Mob. Comput. 15(6), 1443–1456 (2016)CrossRefGoogle Scholar
- 23.Amatriain, X., Basilico, J.: System architectures for personalization and recommendation. The Netflix Techblog (2013). http://techblog.netflix.com/2013/03/system-architectures-for.html