{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,7,23]],"date-time":"2024-07-23T05:55:45Z","timestamp":1721714145071},"reference-count":38,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2020,6,23]],"date-time":"2020-06-23T00:00:00Z","timestamp":1592870400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,6,23]],"date-time":"2020-06-23T00:00:00Z","timestamp":1592870400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"DFG","award":["316878574"]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Qual User Exp"],"published-print":{"date-parts":[[2020,12]]},"abstract":"Abstract<\/jats:title>With Quality of Experience (QoE) research having made significant advances over the years, service and network providers aim at user-centric evaluation of the services provided in their system. The question arises how to derive QoE in systems. In the context of subjective user studies conducted to derive relationships between influence factors and QoE, user diversity leads to varying distributions of user rating scores for different test conditions. Such models are commonly exploited by providers to derive various QoE metrics in their system, such as expected QoE, or the percentage of users rating above a certain threshold. The question then becomes how to combine (a) user rating distributions obtained from subjective studies, and (b) system parameter distributions, so as to obtain the actual observed QoE distribution in the system? Moreover, how can various QoE metrics of interest in the system be derived? We prove fundamental relationships for the derivation of QoE in systems, thus providing an important link between the QoE community and the systems community. In our numerical examples, we focus mainly on QoE metrics. We furthermore provide a more generalized view on quantifying the quality of systems by defining a QoE-based Service-level Quality Index. This index exploits the fact that quality can be seen as a proxy measure for utility. Following the assumption that not all user sessions should be weighted equally, we aim to provide a generic framework that can be utilized to quantify the overall utility of a service delivered by a system.<\/jats:p>","DOI":"10.1007\/s41233-020-00035-0","type":"journal-article","created":{"date-parts":[[2020,6,23]],"date-time":"2020-06-23T12:03:18Z","timestamp":1592913798000},"update-policy":"http:\/\/dx.doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Deriving QoE in systems: from fundamental relationships to a QoE-based Service-level Quality Index"],"prefix":"10.1007","volume":"5","author":[{"ORCID":"http:\/\/orcid.org\/0000-0003-0173-595X","authenticated-orcid":false,"given":"Tobias","family":"Ho\u00dffeld","sequence":"first","affiliation":[]},{"given":"Poul E.","family":"Heegaard","sequence":"additional","affiliation":[]},{"given":"Lea","family":"Skorin-Kapov","sequence":"additional","affiliation":[]},{"given":"Mart\u00edn","family":"Varela","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2020,6,23]]},"reference":[{"key":"35_CR1","doi-asserted-by":"crossref","unstructured":"Zeithaml VA (1988) Consumer perceptions of price, quality, and value: a means-end model and synthesis of evidence. J Mark 52(3):2\u201322","DOI":"10.1177\/002224298805200302"},{"key":"35_CR2","doi-asserted-by":"crossref","unstructured":"Janowski L, Papir Z (2009) Modeling subjective tests of quality of experience with a generalized linear model. In: Quality of multimedia experience (QoMEx 2009). IEEE","DOI":"10.1109\/QOMEX.2009.5246979"},{"key":"35_CR3","doi-asserted-by":"crossref","unstructured":"Ho\u00dffeld T, Heegaard PE, Varela M, M\u00f6ller S (2016) QoE beyond the MOS: an in-depth look at QoE via better metrics and their relation to MOS. Qual User Exp 1(1). https:\/\/link.springer.com\/article\/10.1007\/s41233-016-0002-1#citeas","DOI":"10.1007\/s41233-016-0002-1"},{"key":"35_CR4","doi-asserted-by":"crossref","unstructured":"Xu J, Xing L, Perkis A, Jiang Y (2011) On the properties of mean opinion scores for quality of experience management. In: 2011 IEEE international symposium on multimedia, pp 500\u2013505","DOI":"10.1109\/ISM.2011.88"},{"issue":"2","key":"35_CR5","doi-asserted-by":"publisher","first-page":"213","DOI":"10.1007\/s00530-014-0446-1","volume":"22","author":"RC Streijl","year":"2016","unstructured":"Streijl RC, Winkler S, Hands DS (2016) Mean opinion score (MOS) revisited: methods and applications, limitations and alternatives. Multimedia Syst 22(2):213\u2013227","journal-title":"Multimedia Syst"},{"key":"35_CR6","doi-asserted-by":"crossref","unstructured":"M\u00f6ller S (2000) Models for predicting speech communication quality and service-related models. In: Assessment and prediction of speech quality in telecommunications. Springer, Berlin, pp 89\u2013114","DOI":"10.1007\/978-1-4757-3117-0_5"},{"key":"35_CR7","doi-asserted-by":"crossref","unstructured":"Ho\u00dffeld T, Heegaard PE, Skorin-Kapov L, Varela M (2017) No silver bullet: QoE metrics, QoE fairness, and user diversity in the context of QoE management. In: Quality of multimedia experience (QoMEX 2017). IEEE","DOI":"10.1109\/QoMEX.2017.7965671"},{"key":"35_CR8","doi-asserted-by":"crossref","unstructured":"Ho\u00dffeld T, Heegaard PE, Skorin-Kapov L, Varela M (2019) Fundamental relationships for deriving QoE in systems. In: 2019 eleventh international conference on quality of multimedia experience (QoMEX). IEEE, pp 1\u20136","DOI":"10.1109\/QoMEX.2019.8743339"},{"key":"35_CR9","volume-title":"An introduction to communications ecosystems","author":"K Kilkki","year":"2012","unstructured":"Kilkki K (2012) An introduction to communications ecosystems. CreateSpace Independent Publishing Platform, Scotts Valley"},{"key":"35_CR10","unstructured":"Le Callet P, M\u00f6ller S, Perkis A et al (2012) Qualinet white paper on definitions of quality of experience. European network on quality of experience in multimedia systems and services (COST Action IC 1003) 3(2012)"},{"issue":"1","key":"35_CR11","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1007\/s41233-016-0004-z","volume":"2","author":"A Sackl","year":"2017","unstructured":"Sackl A, Schatz R, Raake A (2017) More than I ever wanted or just good enough? User expectations and subjective quality perception in the context of networked multimedia services. Qual User Exp 2(1):3","journal-title":"Qual User Exp"},{"issue":"7","key":"35_CR12","doi-asserted-by":"publisher","first-page":"1176","DOI":"10.1109\/49.414637","volume":"13","author":"S Shenker","year":"1995","unstructured":"Shenker S (1995) Fundamental design issues for the future internet. IEEE J Sel Areas Commun 13(7):1176\u20131188","journal-title":"IEEE J Sel Areas Commun"},{"issue":"2","key":"35_CR13","first-page":"587","volume":"52","author":"P Reichl","year":"2013","unstructured":"Reichl P, Tuffin B, Schatz R (2013) Logarithmic laws in service quality perception: where microeconomics meets psychophysics and quality of experience. Telecommun Syst 52(2):587\u2013600","journal-title":"Telecommun Syst"},{"key":"35_CR14","doi-asserted-by":"crossref","unstructured":"Skorin-Kapov L, Ivesic K, Aristomenopoulos G, Papavassiliou S (2013) Approaches for utility-based QoE-driven optimization of network resource allocation for multimedia services. In: Data traffic monitoring and analysis. Springer, Berlin, pp 337\u2013358","DOI":"10.1007\/978-3-642-36784-7_14"},{"key":"35_CR15","doi-asserted-by":"crossref","unstructured":"Fiedler M, Ho\u00dffeld T, Tran-Gia P (2010) A generic quantitative relationship between quality of experience and quality of service. IEEE Netw 24(2):36\u201341","DOI":"10.1109\/MNET.2010.5430142"},{"key":"35_CR16","doi-asserted-by":"crossref","unstructured":"Ahmad A, Floris A, Atzori L (2016) Qoe-centric service delivery: a collaborative approach among OTTS and ISPS. Comput Netw 110:168\u2013179","DOI":"10.1016\/j.comnet.2016.09.022"},{"key":"35_CR17","doi-asserted-by":"crossref","unstructured":"Varela M, Zwickl P, Reichl P, Xie M, Schulzrinne H (2015) From service level agreements (SLA) to experience level agreements (ELA): the challenges of selling QoE to the user. In: 2015 IEEE international conference on communication workshop (ICCW). IEEE","DOI":"10.1109\/ICCW.2015.7247432"},{"key":"35_CR18","doi-asserted-by":"crossref","unstructured":"Ho\u00dffeld T, Fiedler M, Gustafsson J (2017) Betas: Deriving quantiles from MOS-QOS relations of IQX models for qoe management. In: 2017 IFIP\/IEEE Symposium on integrated network and service management (IM). IEEE, pp 1011\u20131016","DOI":"10.23919\/INM.2017.7987430"},{"key":"35_CR19","doi-asserted-by":"crossref","unstructured":"Ho\u00dffeld T, Metzger F, Rossi D (May 2018) Speed index: relating the industrial standard for user perceived web performance to web QoE. In: Quality of multimedia experience (QoMEX 2018), pp 1\u20136","DOI":"10.1109\/QoMEX.2018.8463430"},{"key":"35_CR20","doi-asserted-by":"crossref","unstructured":"Ho\u00dffeld T, Schatz R, Biersack E, Plissonneau L (2013) Internet video delivery in youtube: from traffic measurements to quality of experience. In: Data traffic monitoring and analysis. Springer, Berlin","DOI":"10.1007\/978-3-642-36784-7_11"},{"issue":"12","key":"35_CR21","doi-asserted-by":"publisher","first-page":"3337","DOI":"10.1109\/TMM.2018.2831639","volume":"20","author":"H-S Chang","year":"2018","unstructured":"Chang H-S, Hsu C-F, Ho\u00dffeld T, Chen K-T (2018) Active learning for crowdsourced qoe modeling. IEEE Trans Multimed 20(12):3337\u20133352","journal-title":"IEEE Trans Multimed"},{"key":"35_CR22","doi-asserted-by":"crossref","unstructured":"Ye P, Doermann D (2014) Active sampling for subjective image quality assessment. In: Proceedings of the IEEE conference on computer vision and pattern recognition","DOI":"10.1109\/CVPR.2014.541"},{"key":"35_CR23","doi-asserted-by":"crossref","unstructured":"Osting B, Xiong J, Xu Q, Yao Y (2016) Analysis of crowdsourced sampling strategies for hodgerank with sparse random graphs. Appl Comput Harmon Anal 41(2):540\u2013560","DOI":"10.1016\/j.acha.2016.03.007"},{"key":"35_CR24","doi-asserted-by":"crossref","unstructured":"Khokhar MJ, Saber NA, Spetebroot T, Barakat C (2017) On active sampling of controlled experiments for QoE modeling. In: Proceedings of the workshop on QoE-based analysis and management of data communication networks. ACM, pp 31\u201336","DOI":"10.1145\/3098603.3098609"},{"key":"35_CR25","doi-asserted-by":"crossref","unstructured":"Ho\u00dffeld T, Skorin-Kapov L, Heegaard PE, Varela M, Chen K-T (2016) On additive and multiplicative qos-qoe models for multiple qos parameters. In: 5th ISCA\/DEGA workshop on perceptual quality of systems, PQS 2016","DOI":"10.21437\/PQS.2016-10"},{"key":"35_CR26","doi-asserted-by":"publisher","first-page":"314","DOI":"10.1016\/j.chb.2015.03.071","volume":"50","author":"S Barakovi\u0107","year":"2015","unstructured":"Barakovi\u0107 S, Skorin-Kapov L (2015) Multidimensional modelling of quality of experience for mobile web browsing. Comput Hum Behav 50:314\u2013332","journal-title":"Comput Hum Behav"},{"key":"35_CR27","unstructured":"ITU-T Recommendation G. 107 (2015) The e-model, a computational model for use in transmission planning"},{"issue":"4","key":"35_CR28","first-page":"437","volume":"34","author":"N Osaka","year":"1986","unstructured":"Osaka N, Kakehi K (1986) Objective model for evaluating telephone transmission performance. Rev Electr Commun Lab 34(4):437\u2013444","journal-title":"Rev Electr Commun Lab"},{"key":"35_CR29","unstructured":"ITU-T Recommendation P.1202.2 (2013) Parametric non-intrusive bitstream assessment of video media streaming quality-higher resolution application area"},{"issue":"1","key":"35_CR30","doi-asserted-by":"publisher","first-page":"24","DOI":"10.1186\/1687-4722-2013-24","volume":"2013","author":"B Belmudez","year":"2013","unstructured":"Belmudez B, M\u00f6ller S (2013) Audiovisual quality integration for interactive communications. EURASIP J Audio Speech Music Process 2013(1):24","journal-title":"EURASIP J Audio Speech Music Process"},{"issue":"6","key":"35_CR31","doi-asserted-by":"publisher","first-page":"60","DOI":"10.1109\/MSP.2011.942470","volume":"28","author":"MH Pinson","year":"2011","unstructured":"Pinson MH, Ingram W, Webster A (2011) Audiovisual quality components. IEEE Signal Process Mag 28(6):60\u201367","journal-title":"IEEE Signal Process Mag"},{"key":"35_CR32","doi-asserted-by":"crossref","unstructured":"Robitza W, G\u00f6ring S, Raake A, Lindegren D, Heikkil\u00e4 G, Gustafsson J, List P, Feiten B, W\u00fcstenhagen U, Garcia M-N et\u00a0al. (2018) Http adaptive streaming qoe estimation with itu-t rec. p. 1203: Open databases and software. In: Proceedings of the 9th ACM multimedia systems conference. ACM, pp 466\u2013471","DOI":"10.1145\/3204949.3208124"},{"key":"35_CR33","unstructured":"Hoffman DL, Novak TP (2000) Advertising pricing models for the world wide web. In: Internet publishing and beyond: the economics of digital information and intellectual property, vol 5, p 2"},{"issue":"8","key":"35_CR34","doi-asserted-by":"publisher","first-page":"4153","DOI":"10.1109\/TWC.2013.071113.122037","volume":"12","author":"R Imran","year":"2013","unstructured":"Imran R, Odeh M, Zorba N, Verikoukis C (2013) Quality of experience for spatial cognitive systems within multiple antenna scenarios. IEEE Trans Wirel Commun 12(8):4153\u20134161","journal-title":"IEEE Trans Wirel Commun"},{"key":"35_CR35","doi-asserted-by":"crossref","unstructured":"Tang P, Wang P, Wang N, Ngoc VN (2014) QoE-based resource allocation algorithm for multi-applications in downlink LTE systems. In: International conference on computer, communications and information technology (CCIT 2014), pp 1011\u20131016","DOI":"10.2991\/ccit-14.2014.25"},{"key":"35_CR36","doi-asserted-by":"crossref","unstructured":"Yusuf-Asaju AW, Dahalin ZM, Ta\u2019a A (2018) Framework for modelling mobile network quality of experience through big data analytics approach. J Inf Commun Technol (JICT) 17(1):79\u2013113","DOI":"10.32890\/jict2018.17.1.5"},{"key":"35_CR37","doi-asserted-by":"crossref","unstructured":"Varela M, M\u00e4ki T (2017) Embracing uncertainty: A probabilistic view of HTTP video quality. In: First IFIP\/IEEE international workshop on quality of experience management (QoE-Management 2017), Lisbon, Portugal","DOI":"10.23919\/INM.2017.7987427"},{"key":"35_CR38","doi-asserted-by":"crossref","unstructured":"Liotou E, Elshaer H, Schatz R, Irmer R, Dohler M, Passas N, Merakos L (2015) Shaping QoE in the 5G ecosystem. In: Quality of multimedia experience (QoMEX 2015). IEEE, pp 1\u20136","DOI":"10.1109\/QoMEX.2015.7148089"}],"container-title":["Quality and User Experience"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s41233-020-00035-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s41233-020-00035-0\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s41233-020-00035-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,6,23]],"date-time":"2021-06-23T00:08:26Z","timestamp":1624406906000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s41233-020-00035-0"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,6,23]]},"references-count":38,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2020,12]]}},"alternative-id":["35"],"URL":"https:\/\/doi.org\/10.1007\/s41233-020-00035-0","relation":{},"ISSN":["2366-0139","2366-0147"],"issn-type":[{"value":"2366-0139","type":"print"},{"value":"2366-0147","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,6,23]]},"assertion":[{"value":"29 November 2019","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"23 June 2020","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Compliance with ethical standards"}},{"value":"On behalf of all authors, the corresponding author, Tobias Ho\u00dffeld (University of W\u00fcrzburg, Germany), states that there is no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}],"article-number":"7"}}