Transfer learning of Bayesian network for measuring QoS of virtual machines | Applied Intelligence Skip to main content
Springer Nature Link
Log in

Transfer learning of Bayesian network for measuring QoS of virtual machines

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

The Quality of Service (QoS) of virtual machines (VMs) are ensured through the Service Level Agreements (SLAs) signed between the consumers and the cloud providers. A main way to avoid the SLAs violation is to analyze the relationships among the multiple VM-related features and then measure the QoS of VMs accurately. Therefore, we first propose to construct a QoS Bayesian Network (QBN), so as to quantify the uncertain dependencies among the VM-related features and then measure the QoS of VMs effectively. Moreover, we show that the dynamical changes of hardware\software setting or the different types of loads will affect the measurement decisions of QBN. Thus, we further resort to the instance-based transfer learning and then propose a novel QBN updating method (QBNtransfer). QBNtransfer re-weights the constantly updated data instances, and then combine the Maximum Likelihood Estimation and the hill-climbing methods to revise the parameters and structures of QBN accordingly. The experiments conducted on the Alibaba published datasets and the benchmark running results on our simulated platform have shown that the QBN can measure the QoS of VMs accurately and QBNtransfer can update the QBN effectively.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
¥17,985 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price includes VAT (Japan)

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

Notes

  1. https://github.com/alibaba/clusterdata/blob/master/cluster-trace-v2018/trace_2018.md

  2. www.kaggle.com/jiahaoynu/benchmark-result

  3. The PARSEC Benchmark Suite, https://parsec.cs.princeton.edu/

  4. Student’s t distribution: https://byjus.com/maths/t-distribution/

References

  1. Danilov A, Andersen J, Molodkina J (2011) The NIST definition of cloud computing. Commun ACM 53:50–50

    Google Scholar 

  2. Barham P, Dragovic B, Fraser K, Hand S, Harris T, Ho A (2003) R Neugebauer. Xen and the art of virtualization ACM Symposium on Operating Systems Principles 164-177

  3. Gandhi A, Dube P, Karve A, Kochut A, Zhang L (2020) Providing performance guarantees for cloud-deployed applications. IEEE Trans Cloud Comput 8(1):269–281

    Article  Google Scholar 

  4. Syu Y, Wang C, Fanjiang Y (2019) Modeling and forecasting of time-aware dynamic QoS attributes for cloud services. IEEE Trans Netw Serv Manag 16(1):56–71

    Article  Google Scholar 

  5. Ghobaei-Arani M, Jabbehdari S, Pourmina MA (2018) An autonomic resource provisioning approach for service-based cloud applications: a hybrid approach. Futur Gener Comput Syst 78:191–210

    Article  Google Scholar 

  6. Mapetu J, Chen Z, Kong L (2019) Low-time complexity and low-cost binary particle swarm optimization algorithm for task scheduling and load balancing in cloud computing. Appl Intell 49(9):3308–3330

    Article  Google Scholar 

  7. Kuang W, Brown L, Wang Z (2015) Selective switching mechanism in virtual machines via support vector machines and transfer learning. Mach Learn 101(1–3):137–161

    Article  MathSciNet  Google Scholar 

  8. Cortez E, Bonde A, Muzio A, Russinovich M, Fontoura M, Bianchini R (2017) Resource central: understanding and predicting workloads for improved resource management in large cloud platforms. ACM Symp Oper Syst Princ:153–167

  9. Kumar J, Singh A (2018) Workload prediction in cloud using artificial neural network and adaptive differential evolution. Futur Gener Comput Syst 81:41–52

    Article  Google Scholar 

  10. Gavvala S, Jatoth C, Gangadharan G, Buyya R (2019) QoS-aware cloud service composition using eagle strategy. Futur Gener Comput Syst 90:273–290

    Article  Google Scholar 

  11. Hao J, Zhang B, Yue K (2018) Measuring performance degradation of virtual machines based on the Bayesian Network with hidden variables. Int J Commun Syst 31(13):e3732. https://doi.org/10.1002/dac.3732

    Article  Google Scholar 

  12. Wang Y, Qian W, Zhang S, Liang X, Yuan B (2016) A learning algorithm for Bayesian networks and its efficient implementation on GPUs. IEEE Trans Parallel Distributed Syst 27(1):17–30

    Article  Google Scholar 

  13. Yue K, Fang Q, Wang X, Li J, Liu W (2015) A parallel and incremental approach for data-intensive learning of Bayesian networks. IEEE Trans Cybernetics 45(12):2890–2904

    Article  Google Scholar 

  14. Pan S, Yang Q (2010) A survey on transfer learning. IEEE Trans Knowl Data Eng 22(10):1345–1359

    Article  Google Scholar 

  15. Dai W, Yang Q (2007) Boosting for transfer learning. Int Conf Mach Learn:193–200

  16. Baimuratov IR, Shichkina YA, Stankova EN, Zhukova N, Than N (2019) A Bayesian information criterion for unsupervised learning based on an objective prior. Int Conf Comput Sci Its Appl:707–176

  17. Cheng J, Greiner R, Kelly J, Bell D, Liu W (2002) Learning Bayesian networks from data: an information-theory based approach. Artif Intell 137(1–2):43–90

    Article  MathSciNet  Google Scholar 

  18. Guo J, Chang Z, Wang S, Ding H, Feng Y, Mao L, Bao Y (2019) Who limits the resource efficiency of my datacenter: an analysis of Alibaba datacenter traces. Int Symp Qual Service:1–10

  19. Li B, Guo S, Wu Y, Liu D (2017) Construction and resource allocation of cost-efficient clustered virtual network in software defined networks. J Grid Comput 15(4):457–473

    Article  Google Scholar 

  20. Li F, Yang D, Zhou P (2015) Modeling application performance in a virtualized environment. Comput Syst Appl 24:9–15

    Google Scholar 

  21. Oh YK (2019) A resource recommendation method based on dynamic cluster analysis of application characteristics. Cluster Comput 22(1):175–184

    Article  Google Scholar 

  22. Hu C, Deng Y, Min G (2018) QoS Promotion in energy-efficient datacenters through peak load scheduling. IEEE Trans Cloud Comput:2886187. https://doi.org/10.1109/TCC.2018

  23. Hammer L, Yazidi A, Begnum K (2017) An inhomogeneous hidden markov model for efficient virtual machine placement in cloud computing environments. J Forecast 36(4):407–420

    MathSciNet  MATH  Google Scholar 

  24. Shyam G, Manvi S (2016) Virtual resource prediction in cloud environment: a Bayesian approach. J Network Comp Appl 65:144–154

    Article  Google Scholar 

  25. Li Z, Yan C, Yu X (2017) Bayesian network-based virtual machines consolidation method. Futur Gener Comput Syst 69:75–87

    Article  Google Scholar 

  26. F. Zhuang, Z. Qi, K. Duan, D. Xi, Y. Zhu, H. Zhu, H. Xiong, Q. He. A Comprehensive Survey on Transfer Learning. CoRR abs/1911.02685, 2019

  27. Karbalayghareh A, Qian X, Dougherty E (2018) Optimal Bayesian transfer learning. IEEE Trans Signal Process 66(14):3724–3739

    Article  MathSciNet  Google Scholar 

  28. Dai W, Xue G, Yang Q, Yu Y (2007) Transferring naive Bayes classifiers for text classification. AAAI Conf Artif Intell:540–545

  29. Liu W, Yue K, Yue M, Yin Z, Zhang B (2018) A Bayesian Network-based approach for incremental learning of uncertain knowledge. Int J Uncertain, Fuzziness and Knowl-Based Syst 26(01):87–108

    Article  MathSciNet  Google Scholar 

  30. Yao Y, Doretto G (2010) Boosting for transfer learning with multiple sources. IEEE Conf Comput Vision Pattern Recog:1855–1862

  31. Pan SJ, Tsang IW, Kwok JT, Yang Q (2011) Domain adaptation via transfer component analysis. IEEE Trans Neural Netw 22(2):199–210

    Article  Google Scholar 

  32. Long M, Wang J, Ding G, Sun J, Yu P (2014) Transfer joint matching for unsupervised domain adaptation. IEEE Conf Comput Vision Patt Recog:1410–1417

  33. He Y, Jin X, Ding G, Guo Y, Han J, Zhang J, Zhao S (2020) Heterogeneous transfer learning with weighted instance-correspondence data. AAAI Conf Artif Intell:4099–4106

  34. Sanodiya R, Mathew J, Saha S, Tripathi P (2020) Particle swarm optimization based parameter selection technique for unsupervised discriminant analysis in transfer learning framework. Appl Intell 50(10):3071–3089

    Article  Google Scholar 

  35. Liu Q, Yu Z (2018) The elasticity and plasticity in semi-containerized co-locating cloud workload: a view from alibaba trace. ACM Symp Cloud Comput:347–360

  36. Shang C, Hao J, Zhang B, Yue K (2019) Performance prediction of virtual machines via the class parameter augmented Bayesian network. J Chin Comput Syst 40(7):1416–1422

    Google Scholar 

  37. Liu Y, Liu S, Wang Y, Lombardi F, Han J (2018) A stochastic computational multi-layer perceptron with backward propagation. IEEE Trans Comput 67(9):1273–1286

    Article  MathSciNet  Google Scholar 

  38. Yue K, Wei M, Tian K, Liu W (2009) Representing and inferring causalities among classes of multidimensional data. Adv Data Web Manag:223–234

  39. Su T, Mu S, Dong M, Sun W, Shi A (2019) An improved TrAdaBoost for image recognition of unbalanced plant leaf disease. Proceed 8th Int Conf Comput Pattern Recog:374–379

  40. Antunes J, Bernardino A, Smailagic A, Siewiorionek D (2019) Weighted Multisource Tradaboost. Lecture Notes Comput Sci 11867. https://doi.org/10.1007/978-3-030-31332-6_17

Download references

Acknowledgements

This paper was supported by the National Natural Science Foundation of China (U1802271, 62002311, 61962030), the Science Foundation for Distinguished Young Scholars of Yunnan Province (2019FJ011), and the Cultivation Project of Donglu Scholar of Yunnan University.

Author information

Authors and Affiliations

  1. School of Information Science and Engineering, Yunnan University, Kunming, China

    Jia Hao, Kun Yue, Binbin Zhang & Liang Duan

  2. Key Laboratory of Education Informatization for Nationalities, Ministry of Education, Yunnan Normal University, Kunming, China

    Jia Hao

  3. Faculty of Information Engineering and Automation, Kunming University of Science and Technology, Kunming, China

    Xiaodong Fu

Authors
  1. Jia Hao
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Kun Yue
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Binbin Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Liang Duan
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Xiaodong Fu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Kun Yue.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hao, J., Yue, K., Zhang, B. et al. Transfer learning of Bayesian network for measuring QoS of virtual machines. Appl Intell 51, 8641–8660 (2021). https://doi.org/10.1007/s10489-021-02362-x

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10489-021-02362-x

Keywords

Search

Navigation