{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,2,21]],"date-time":"2025-02-21T16:50:39Z","timestamp":1740156639010,"version":"3.37.3"},"reference-count":51,"publisher":"MDPI AG","issue":"8","license":[{"start":{"date-parts":[[2019,8,11]],"date-time":"2019-08-11T00:00:00Z","timestamp":1565481600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Future Internet"],"abstract":"The exorbitant increase in the computational complexity of modern video coding standards, such as High Efficiency Video Coding (HEVC), is a compelling challenge for resource-constrained consumer electronic devices. For instance, the brute force evaluation of all possible combinations of available coding modes and quadtree-based coding structure in HEVC to determine the optimum set of coding parameters for a given content demand a substantial amount of computational and energy resources. Thus, the resource requirements for real time operation of HEVC has become a contributing factor towards the Quality of Experience (QoE) of the end users of emerging multimedia and future internet applications. In this context, this paper proposes a content-adaptive Coding Unit (CU) size selection algorithm for HEVC intra-prediction. The proposed algorithm builds content-specific weighted Support Vector Machine (SVM) models in real time during the encoding process, to provide an early estimate of CU size for a given content, avoiding the brute force evaluation of all possible coding mode combinations in HEVC. The experimental results demonstrate an average encoding time reduction of 52.38%, with an average Bj\u00f8ntegaard Delta Bit Rate (BDBR) increase of 1.19% compared to the HM16.1 reference encoder. Furthermore, the perceptual visual quality assessments conducted through Video Quality Metric (VQM) show minimal visual quality impact on the reconstructed videos of the proposed algorithm compared to state-of-the-art approaches.<\/jats:p>","DOI":"10.3390\/fi11080175","type":"journal-article","created":{"date-parts":[[2019,8,12]],"date-time":"2019-08-12T10:38:02Z","timestamp":1565606282000},"page":"175","source":"Crossref","is-referenced-by-count":3,"title":["Quality of Experience (QoE)-Aware Fast Coding Unit Size Selection for HEVC Intra-Prediction"],"prefix":"10.3390","volume":"11","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4401-7149","authenticated-orcid":false,"given":"Buddhiprabha","family":"Erabadda","sequence":"first","affiliation":[{"name":"Centre for Vision Speech and Signal Processing, University of Surrey, Guildford GU2 7XH, UK"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9817-927X","authenticated-orcid":false,"given":"Thanuja","family":"Mallikarachchi","sequence":"additional","affiliation":[{"name":"Cardiff School of Technologies, Cardiff Metropolitan University, Cardiff CF5 2YB, UK"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7593-6661","authenticated-orcid":false,"given":"Chaminda","family":"Hewage","sequence":"additional","affiliation":[{"name":"Cardiff School of Technologies, Cardiff Metropolitan University, Cardiff CF5 2YB, UK"}]},{"given":"Anil","family":"Fernando","sequence":"additional","affiliation":[{"name":"Centre for Vision Speech and Signal Processing, University of Surrey, Guildford GU2 7XH, UK"}]}],"member":"1968","published-online":{"date-parts":[[2019,8,11]]},"reference":[{"key":"ref_1","unstructured":"Cisco (2017). Cisco Visual Networking Index: Global Mobile Data Traffic Forecast Update 2014\u20132019, Cisco. White Paper."},{"key":"ref_2","unstructured":"Segall, A., Wien, M., Baroncini, V., Boyce, J., and Suzuki, T. (2017, January 13\u201321). Draft Joint Call for Proposals on Video Compression with Capability beyond HEVC. Proceedings of the Joint Video Exploration Team (on Future Video Coding) of ITU-T VCEG and ISO\/IEC MPEG, 7th Meeting, Torino, IT, USA."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1649","DOI":"10.1109\/TCSVT.2012.2221191","article-title":"Overview of the High Efficiency Video Coding (HEVC) Standard","volume":"22","author":"Sullivan","year":"2012","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1669","DOI":"10.1109\/TCSVT.2012.2221192","article-title":"Comparison of the coding efficiency of video coding standards\u2014Including high efficiency video coding (HEVC)","volume":"22","author":"Ohm","year":"2012","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1685","DOI":"10.1109\/TCSVT.2012.2221255","article-title":"HEVC complexity and implementation analysis","volume":"22","author":"Bossen","year":"2012","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1697","DOI":"10.1109\/TCSVT.2012.2223011","article-title":"Block Partitioning Structure in the HEVC Standard","volume":"22","author":"Kim","year":"2012","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"693","DOI":"10.1109\/TCSVT.2016.2619499","article-title":"Content-Adaptive Feature-Based CU Size Prediction for Fast Low-Delay Video Encoding in HEVC","volume":"28","author":"Mallikarachchi","year":"2016","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_8","unstructured":"Baroncini, V., Ferrara, S., and Ye, Y. (2018). Call for Proposals for Low Complexity Video Coding Enhancements, International Organization for Standardization, Coding of Moving Pictures and Audio, ISO\/IEC JTC1\/SC29\/WG11\/ N17944; International Organization for Standardization."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1555","DOI":"10.1109\/TCSVT.2013.2249017","article-title":"Fast CU splitting and pruning for suboptimal CU partitioning in HEVC intra coding","volume":"23","author":"Cho","year":"2013","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"3208","DOI":"10.1109\/TCSVT.2017.2747659","article-title":"Effective Data Driven Coding Unit Size Decision Approaches for HEVC INTRA Coding","volume":"28","author":"Zhang","year":"2017","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Khan, M.U.K., Shafique, M., and Henkel, J. (2013, January 15\u201318). An adaptive complexity reduction scheme with fast prediction unit decision for HEVC intra encoding. Proceedings of the IEEE International Conference on Image Processing (ICIP), Melbourne, VIC, Australia.","DOI":"10.1109\/ICIP.2013.6738325"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"2225","DOI":"10.1109\/TIP.2015.2417498","article-title":"Machine learning-based coding unit depth decisions for flexible complexity allocation in high efficiency video coding","volume":"24","author":"Zhang","year":"2015","journal-title":"IEEE Trans. Image Process."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"660","DOI":"10.1109\/TCSVT.2014.2363753","article-title":"Fast HEVC encoding decisions using data mining","volume":"25","author":"Correa","year":"2015","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1186\/1687-5281-2013-4","article-title":"CU splitting early termination based on weighted SVM","volume":"2013","author":"Shen","year":"2013","journal-title":"EURASIP J. Image Video Process."},{"key":"ref_15","unstructured":"(2019, January 15). HM 16.1. Available online: https:\/\/hevc.hhi.fraunhofer.de\/trac\/hevc\/browser\/tags\/HM-16.1."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1792","DOI":"10.1109\/TCSVT.2012.2221525","article-title":"Intra coding of the HEVC standard","volume":"22","author":"Lainema","year":"2012","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_17","unstructured":"Kim, J., Choe, Y., and Kim, Y.G. (2013, January 11\u201314). Fast coding unit size decision algorithm for intra coding in HEVC. Proceedings of the IEEE International Conference on Consumer Electronics (ICCE), Las Vegas, NV, USA."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"207","DOI":"10.1109\/TCE.2013.6490261","article-title":"Fast CU Size Decision and Mode Decision Algorithm for HEVC Intra Prediction","volume":"59","author":"Shen","year":"2013","journal-title":"IEEE Trans. Consum. Electron."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1492","DOI":"10.1109\/TII.2015.2491646","article-title":"Low complexity HEVC INTRA coding for high-quality mobile video communication","volume":"11","author":"Zhang","year":"2015","journal-title":"IEEE Trans. Ind. Inf."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Zuo, X., and Yu, L. (2014, January 7\u201310). Fast mode decision method for all intra spatial scalability in SHVC. Proceedings of the 2014 IEEE Visual Communications and Image Processing Conference, Valletta, Malta.","DOI":"10.1109\/VCIP.2014.7051589"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1686","DOI":"10.1109\/TCSVT.2013.2255398","article-title":"Novel adaptive algorithm for intra prediction with compromised modes skipping and signaling processes in HEVC","volume":"23","author":"Wang","year":"2013","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"660","DOI":"10.1109\/TCSVT.2013.2290578","article-title":"Fast intra mode decision for High Efficiency Video Coding (HEVC)","volume":"24","author":"Zhang","year":"2014","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_23","unstructured":"Zhang, H., and Ma, Z. (2013, January 19\u201323). Early Termination Schemes for Fast Intra Mode Decision in High Efficiency Video Coding. Proceedings of the IEEE International Symposium on Circuits and Systems (ISCAS), Beijing, China."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"116","DOI":"10.1504\/IJSNET.2019.099473","article-title":"Low complexity versatile video coding for traffic surveillance system","volume":"30","author":"Pan","year":"2019","journal-title":"Int. J. Sens. Netw."},{"key":"ref_25","first-page":"12","article-title":"Adaptive fractional-pixel motion estimation skipped algorithm for efficient HEVC motion estimation","volume":"14","author":"Pan","year":"2018","journal-title":"ACM Trans. Multimed. Comput. Commun. Appl. (TOMM)"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Lokkoju, S., and Reddy, D. (2012, January 12\u201315). Fast coding unit partition search. Proceedings of the IEEE International Symposium on Signal Processing and Information Technology (ISSPIT), Ho Chi Minh City, Vietnam.","DOI":"10.1109\/ISSPIT.2012.6621307"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Zhang, Y., Li, Z., and Li, B. (2012, January 27\u201330). Gradient based fast decision for intra prediction. Proceedings of the IEEE Visual Communications and Image Processing (VCIP), San Diego, CA, USA.","DOI":"10.1109\/VCIP.2012.6410739"},{"key":"ref_28","unstructured":"Tian, G., and Goto, S. (2012, January 7\u20139). Content Adaptive Prediction Unit Size Decision Algorithm for HEVC Intra Coding. Proceedings of the Picture Coding Symposium (PCS), Krakow, Poland."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"4232","DOI":"10.1109\/TIP.2014.2341927","article-title":"Effective CU size decision for HEVC intra coding","volume":"23","author":"Shen","year":"2014","journal-title":"IEEE Trans. Image Process."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"892","DOI":"10.1109\/TCSVT.2014.2363739","article-title":"A fast CU size decision algorithm for the HEVC intra encoder","volume":"25","author":"Min","year":"2015","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"756","DOI":"10.1049\/el.2014.3874","article-title":"Efficient intra-mode decision algorithm skipping unnecessary depth-modelling modes in 3D-HEVC","volume":"51","author":"Park","year":"2015","journal-title":"Electron. Lett."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"81","DOI":"10.14257\/ijmue.2015.10.9.09","article-title":"A fast intra mode decision algorithm for HEVC using sobel operator in edge detection","volume":"10","author":"Zhang","year":"2015","journal-title":"Int. J. Multimed. Ubiquitous Eng."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Mallikarachchi, T., Fernando, A., and Arachchi, H.K. (2014, January 14\u201318). Efficient coding unit size selection based on texture analysis for HEVC intra prediction. Proceedings of the IEEE International Conference on Multimedia and Expo (ICME), Chengdu, China.","DOI":"10.1109\/ICME.2014.6890319"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"5088","DOI":"10.1109\/TIP.2016.2601264","article-title":"CU Partition Mode Decision for HEVC Hardwired Intra Encoder Using Convolution Neural Network","volume":"25","author":"Liu","year":"2016","journal-title":"IEEE Trans. Image Process."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"1521","DOI":"10.1109\/TCSVT.2015.2395772","article-title":"Fast mode selection for HEVC intra-frame coding with entropy coding refinement based on a transparent composite model","volume":"25","author":"Hu","year":"2015","journal-title":"IEEE IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Chen, J., and Yu, L. (2016, January 11\u201315). Effective HEVC intra coding unit size decision based on online progressive Bayesian classification. Proceedings of the IEEE International Conference on Multimedia and Expo (ICME), Seattle, WA, USA.","DOI":"10.1109\/ICME.2016.7552970"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Du, B., Siu, W.C., and Yang, X. (2015, January 16\u201319). Fast CU partition strategy for HEVC intra-frame coding using learning approach via random forests. Proceedings of the 2015 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA), Hong Kong, China.","DOI":"10.1109\/APSIPA.2015.7415439"},{"key":"ref_38","unstructured":"Coll, D.R., Adzic, V., Escribano, G.F., Kalva, H., Mart\u00ednez, J.L., and Cuenca, P. (2014, January 27\u201330). Fast partitioning algorithm for HEVC intra frame coding using machine learning. Proceedings of the 2014 IEEE International Conference on Image Processing (ICIP), Paris, France."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"1714","DOI":"10.1109\/TCSVT.2016.2556518","article-title":"Fast intra-mode and CU size decision for HEVC","volume":"27","author":"Zhang","year":"2016","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Shawe-Taylor, J., and Cristianini, N. (2000). An Introduction to Support Vector Machines and Other Kernel-Based Learning Methods, Cambridge University Press.","DOI":"10.1017\/CBO9780511801389"},{"key":"ref_41","unstructured":"Kecman, V. (2001). Learning and Soft Computing: Support Vector Machines, Neural Networks, and Fuzzy Logic Models, The MIT Press."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Sch\u00f6lkopf, B., and Smola, A.J. (2002). Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond, The MIT Press.","DOI":"10.7551\/mitpress\/4175.001.0001"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"273","DOI":"10.1007\/BF00994018","article-title":"Support-Vector Networks","volume":"20","author":"Cortes","year":"1995","journal-title":"Mach. Learn."},{"key":"ref_44","unstructured":"Zhang, X.G. (1999, January 25). Using class-center vectors to build support vector machines. Proceedings of the Neural Networks for Signal Processing IX: Proceedings in IEEE Signal Processing Society Workshop, Madison, WI, USA."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"961","DOI":"10.1142\/S0218001407005703","article-title":"A weighted Support Vector Machines for data classification","volume":"2007","author":"Yang","year":"2007","journal-title":"Int. J. Pattern Recognit. Artif. Intell."},{"key":"ref_46","first-page":"27","article-title":"LIBSVM: A library for support vector machines","volume":"2","author":"Chang","year":"2011","journal-title":"ACM Trans. Intell. Syst. Technol. (TIST)"},{"key":"ref_47","unstructured":"Bossen, F. (2013, January 14\u201323). Common Test Conditions and Software Reference Configurations. Proceedings of the Joint Collaborative Team on Video Coding, 10th Meeting, Stockholm, Sweden."},{"key":"ref_48","unstructured":"Bjontegarrd, G. (2001, January 2\u20134). Calculation of Average PSNR Differences Between RD-Curves. Proceedings of the ITU\u2013Telecommunications Standardization Sector STUDY GROUP 16 Video Coding Experts Group (VCEG), 13th Meeting, Austin, TX, USA."},{"key":"ref_49","first-page":"322","article-title":"A New Standardized Method for Objectively Measuring Video Quality","volume":"50","author":"Pinson","year":"2004","journal-title":"Electron. Lett."},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Richardson, I.E. (2004). H. 264 and MPEG-4 Video Compression: Video Coding For Next-Generation Multimedia, John Wiley & Sons.","DOI":"10.1002\/0470869615"},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Okarma, K. (2014). Adaptation of the Combined Image Similarity Index for Video Sequences, Springer.","DOI":"10.1007\/978-3-319-01622-1_10"}],"container-title":["Future Internet"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-5903\/11\/8\/175\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,7,21]],"date-time":"2024-07-21T22:40:42Z","timestamp":1721601642000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-5903\/11\/8\/175"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,8,11]]},"references-count":51,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2019,8]]}},"alternative-id":["fi11080175"],"URL":"https:\/\/doi.org\/10.3390\/fi11080175","relation":{},"ISSN":["1999-5903"],"issn-type":[{"type":"electronic","value":"1999-5903"}],"subject":[],"published":{"date-parts":[[2019,8,11]]}}}