Cost-based job scheduling strategy in cloud computing environments | Distributed and Parallel Databases Skip to main content

Advertisement

Springer Nature Link
Log in

Cost-based job scheduling strategy in cloud computing environments

  • Published:
Distributed and Parallel Databases Aims and scope Submit manuscript

Abstract

Cloud computing is one of the important approach for business actions in nowadays industry. The different characteristics of cloud such as on-demand capabilities, measured service, virtualization and rapid elasticity make the cloud more interesting in scientific organizations. With increasing number of users and jobs, optimal job scheduling becomes a strenuous process. Most available scheduling techniques in cloud only concentrate on one job type that can be data-intensive or computation-intensive. But, job scheduling based on one job type does not appropriate in the viewpoint of all environments, and sometimes may lead to wasting of resources on the other side. To discuss the problem of simultaneously taking into account both job types, Cost-based job scheduling (CJS) algorithm is proposed in this paper. The CJS algorithm uses data, processing power and network characteristics in job allocation process. Finally, we conducted simulations using CloudSim toolkit and compared CJS with other existing algorithms, like FUGE, Berger, MQS, and HPSO algorithms. CJS method can reduce the response time of submitted jobs, which may consist of data-intensive and computing -intensive jobs.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
¥17,985 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price includes VAT (Japan)

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16

Similar content being viewed by others

References

  1. Jakóbik, A., Grzonk, D., Palmieri, F.: Non-deterministic security driven meta scheduler for distributed cloud organizations. Simul. Model. Pract. Theory 76, 67–81 (2017)

    Article  Google Scholar 

  2. Douglas, O., Balen, C.B.W., Westphall, C.M: Experimental assessment of routing for grid and cloud. In: Tenth International Conference on Networks, pp. 341–346 (2011)

  3. Alhakami, H., Aldabbas, H., Alwada, T.: Comparison between cloud and grid computing: review paper. Int. J. Cloud Comput. 2(4), 1–21 (2012)

    Google Scholar 

  4. Hao, Y., Wang, L., Zheng, M.: An adaptive algorithm for scheduling parallel jobs in meteorological Cloud. Knowl.-Based Syst. 98, 226–240 (2016)

    Article  Google Scholar 

  5. Khorandi, S.M., Sharifi, M.: Scheduling of online compute-intensive synchronized jobs on high performance virtual clusters. J. Comput. Syst. Sci. 85, 1–17 (2017)

    Article  MathSciNet  Google Scholar 

  6. Chongdarakul, W., Sophatsathit, P., Lursinsap, C.: Efficient task scheduling based on theoretical scheduling pattern constrained on single I/O port collision avoidance. Simul. Model. Pract. Theory 67, 171–190 (2016)

    Article  Google Scholar 

  7. Cao, Q., Wei, Z., Gong, W.: An optimized algorithm for task scheduling based on activity based costing in cloud computing. In: The 3rd International Conference on Bioinformatics and Biomedical Engineering, pp. 34–37 (2009)

  8. Guo, L., Zhao, S., Shen, S., Jiang, C.: Task scheduling optimization in cloud computing based on heuristic algorithm. J. Netw. 7(3), 547–553 (2012)

    Google Scholar 

  9. Buyya, R., Murshed, M.: GridSim: a toolkit for the modeling and simulation of distributed resource management and scheduling for grid computing. J. Concurr. Comput. 14, 13–15 (2002)

    MATH  Google Scholar 

  10. Calheiros, R.N, Ranjan, R., De Rose, C.A.F, Buyya, R.: CloudSim: a novel framework for modeling and simulation of cloud computing infrastructures and services. Technical report, GRIDS-TR-2009-1, Grid Computing and Distributed Systems Laboratory, The University of Melbourne (2009)

  11. Buyya, R., Ranjan, R., Rodrigo, N.: Calheiros, Modeling and simulation of scalable cloud computing environments and the CloudSim toolkit: challenges and opportunities. High Perform. Comput. Simul. 9, 1–11 (2009)

    Google Scholar 

  12. Zhong-wen, G., Kai, Z.H.: The Research on cloud computing resource scheduling method based on Time-Cost-Trust model. In: 2nd International Conference on Computer Science and Network Technology (ICCSNT), p. 10 (2009)

  13. Wu, H., Tang, Z., Li, R.: A priority constrained scheduling strategy of multiple workflows for cloud computing. In: 14th International Conference on Advanced Communication Technology (2012)

  14. Zhang, X., Tong, Y., Chen, L., Wang, M., Feng, S.: Locality-aware allocation of multi-dimensional correlated files on the cloud platform. Distrib. Parallel Databases 33(3), 353–380 (2015)

    Article  Google Scholar 

  15. Mukundan, R., Madria, S., Linderman, M.: Efficient integrity verification of replicated data in cloud using homomorphic encryption. Distrib. Parallel Databases 32(4), 507–534 (2014)

    Article  Google Scholar 

  16. Yi, M., Wang, L., Wei, J.: Distributed data possession provable in cloud. Distrib. Parallel Databases 35, 1–21 (2016)

    Article  Google Scholar 

  17. Qian, L., Luo, Z., Du, Y., Guo, L.: Cloud computing: An overview. Beijing, China (2007)

    Google Scholar 

  18. Abraham, A., Lloret Mauri, J., Buford, J., Suzuki, J., Thampi, S.M.: Advances in computing and communications. In: First International Conference Proceedings Part III, Kochi, India (2011)

  19. Heindl, E., Saurabh Sardana, B.: Cloud computing. Hochschule Furtwangen University, Furtwangen im Schwarzwald (2011)

    Google Scholar 

  20. Sheikhalishahi, M., Wallace, R.M., Grandinetti, L., Vazquez-Poletti, J.L., Guerriero, F.: A multi-dimensional job scheduling. Future Gener. Comput. Syst. 54, 123–131 (2015)

    Article  Google Scholar 

  21. Mathew, T., Chandra Sekaran, K., Jose, J.: Study and analysis of various task scheduling algorithms in the cloud computing environment. In: International Conference on Advances in Computing, Communications and Informatics (2014)

  22. Mansouri, N.: A threshold-based dynamic data replication and parallel job scheduling strategy to enhance data grid. Clust. Comput. 17(3), 957–977 (2012)

    Article  Google Scholar 

  23. Moschakis, I., Karatza, H.: A meta-heuristic optimization approach to the scheduling of bag-of-tasks applications on heterogeneous clouds with multi-level arrivals and critical jobs. Simul. Model. Pract. Theory 57, 1–25 (2015)

    Article  Google Scholar 

  24. Mansouri, N.: Network and data location aware approach for simultaneous job scheduling and data replication in large-scale data grid environments. Front. Comput. Sci. 8(3), 391–408 (2014)

    Article  MathSciNet  Google Scholar 

  25. Mansouri, N., Dastghaibyfard, G.H.: A dynamic replica management strategy in data grid. J. Netw. Comput. Appl. 35(4), 1297–1303 (2012)

    Article  Google Scholar 

  26. Wong, H.M., Bharadwaj, V., Dantong, Y., Robertazzi, T.G.: Data intensive grid scheduling: multiple sources with capacity constraints. In: Proceedings of the 15th International Conference on Parallel and Distributed Computing Systems (PDCS), pp. 163–170 (2004)

  27. Li, K., Tong, Z., Liu, D., Tesfazghi, T., Liao, X.: PTS-PGATS based approach for data-intensive scheduling in data grids. Front. Comput. Sci. 5(4), 513–525 (2011)

    Article  MathSciNet  Google Scholar 

  28. Liu, W., Kettimuthu, R., Li, B., Foster, I.: An adaptive strategy for scheduling data-intensive applications in grid environments. In: 17th international conference on telecommunication, pp. 642–649 (2010)

  29. Khorandia, S.M., Sharifib, M.: Scheduling of online compute-intensive synchronized jobs on high performance virtual clusters. J. Comput. Syst. Sci. 85, 1–17 (2017)

    Article  MathSciNet  Google Scholar 

  30. Priya, V., Kennedy Babu, C.N.: Moving average fuzzy resource scheduling for virtualized cloud data services. Comput. Stand. Interfaces 50, 251–257 (2017)

    Article  Google Scholar 

  31. Agnetisa, A., Detti, P., Martineau, P.: Scheduling non-preemptive jobs on parallel machines subject to exponential unrecoverable interruptions. Comput. Oper. Res. 79, 109–118 (2017)

    Article  MathSciNet  Google Scholar 

  32. Li, Z., Ge, J., Yang, H., Huang, L., Hu, H., Hu, H., Luo, B.: A security and cost aware scheduling algorithm for heterogeneous tasks of scientific workflow in clouds. Future Gener. Comput. Syst. 65, 140–152 (2016)

    Article  Google Scholar 

  33. Henzinger, AT., Singh, V.A., Singh, V., Wies, T., Zufferey, D.: Static scheduling in clouds. In: HotCloud’11 Proceedings of the 3rd USENIX conference on Hot topics in cloud computing (2011)

  34. Nasr, A.A., El-Bahnasawy, N.A., El-Sayed, A.: Task scheduling algorithm for high performance heterogeneous distributed computing systems. Int. J. Comput. Appl. 110(16), 23–29 (2015)

    Google Scholar 

  35. Tang, Zh, Qi, L., Cheng, Zh, Li, K., Khan, S.U., Li, K.: An energy-efficient task scheduling algorithm in DVFS-enabled cloud environment. J. Grid Comput. 14(1), 55–74 (2016)

    Article  Google Scholar 

  36. Moganarangan, N., Babukarthikb, R.G., Bhuvaneswari, S., Saleem Basha, M.S., Dhavachelvan, P.: A novel algorithm for reducing energy-consumption in cloud computing environment: web service computing approach. J. King Saud Univ. Comput. Inf. Sci. 28(1), 55–67 (2016)

    Article  Google Scholar 

  37. Shojafar, M., Javanmardi, S., Abolfazli, S., Cordeschi, N.: FUGE: a joint meta-heuristic approach to cloud job scheduling algorithm using fuzzy theory and a genetic method. Clust. Comput. 18(2), 829–844 (2015)

    Article  Google Scholar 

  38. Parthasarathy, S., Venkateswaran, C.J.: Scheduling jobs using oppositional-GSO algorithm in cloud computing environment. Wirel. Netw. 23(8), 2335–2345 (2016)

    Article  Google Scholar 

  39. Xu, B., Zhao, C., Hua, E., Hu, B.: Job scheduling algorithm based on Berger model in cloud environment. Adv. Eng. Softw. 42, 419–425 (2011)

    Article  Google Scholar 

  40. Kim, S.S., Byeon, J.H., Yu, H., Liu, H.: Biogeography-based optimization for optimal job scheduling in cloud computing. Appl. Math. Comput. 247, 266–280 (2014)

    MathSciNet  MATH  Google Scholar 

  41. Sheikhalishahi, M., Wallace, R.M., Grandinettia, L., Luis Vazquez-Polettib, J., Guerriero, F.: A multi-dimensional job scheduling. Future Gener. Comput. Syst. 54, 123–131 (2016)

    Article  Google Scholar 

  42. Karthick, A.V., Ramaraj, E., Subramanian, R.: An efficient multi queue job scheduling for cloud computing. In: World Congress on Computing and Communication Technologies, pp. 164–166 (2014)

  43. Patel, S.J., Bhoi, U.R.: Improved priority based job scheduling algorithm in cloud computing using iterative method. In: Fourth International Conference on Advances in Computing and Communications, pp. 199–202 (2014)

  44. Tareghaian, S., Bornaee, Z.: Algorithm to improve job scheduling problem in cloud computing environment. In: International conference on knowledge based engineering and Innovation, pp. 684–688 (2015)

  45. Hu, Z., Wu, K., Huang, J.: An utility-based job scheduling algorithm for current computing cloud considering reliability factor. In: IEEE International Conference on Computer Science and Automation Engineering, pp. 296–299 (2012)

  46. Liu, X., Zh, Y., Yin, Q., Peng, Y., Qin, L.: Scheduling parallel jobs with tentative runs and consolidation in the cloud. J. Syst. Softw. 104, 141–151 (2015)

    Article  Google Scholar 

  47. Babu, G., Krishnasamy, K.S.: Task scheduling algorithm based on hybrid particle swarm optimization in cloud computing environment. J. Theor. Appl. Inf. Technol. 55, 33–38 (2013)

    Google Scholar 

  48. Vicat-Blanc Primet, P., Harakaly, R., Bonnassieux, F.: Grid network monitoring in the European grid project. Int. J. High Perform. Comput. Appl. 18(3), 293–304 (2004)

    Article  Google Scholar 

  49. Park, S., Kim, J.: Chameleon: a resource scheduler in a data grid environment. In: Proceedings of the 3rd IEEE/ACM International Symposium on Cluster Computing and the Grid, Tokyo (2003)

  50. Calheiros, R.N., Ranjan, R., Beloglazov, A., De Rose, C.A.F., Buyya, R.: CloudSim: a toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms. Wiley, New York (2010)

    Google Scholar 

  51. Loganathan, S., Mukherjee, S.: Job scheduling with efficient resource monitoring in cloud datacenter. Sci. World J. (2015). https://doi.org/10.1155/2015/983018

    Article  Google Scholar 

  52. Blazewicz, J., Ecker, K.H., Pesch, E., Schmidt, G., Weglarz, J.: Scheduling Computer and Manufacturing Processes. Springer, Berlin (2001)

    Book  Google Scholar 

  53. Tawfeek, M., El-Sisi, A., Keshk, A., Torkey, F.: Cloud task scheduling based on ant colony optimization. Int. Arab J. Inf. Technol. 12, 129–137 (2015)

    Google Scholar 

  54. Hamad, S.A., Omara, F.A.: Genetic-based task scheduling algorithm in cloud computing environment. Int. J. Adv. Comput. Sci. Appl. 7, 550–556 (2016)

    Google Scholar 

  55. Wen, Y., Xu, H., Yang, J.: A heuristic-based hybrid genetic-variable neighborhood search algorithm for task scheduling in heterogeneous multiprocessor system. Inf. Sci. 181, 567–581 (2011)

    Article  Google Scholar 

  56. Mamdani, E.H.: Application of fuzzy algorithms for control of simple dynamic plant. Proc. Inst. Electr. Eng. 121, 1585–1588 (1974)

    Article  Google Scholar 

  57. Yu, H.: Optimizing task schedules using an artificial immune system approach. In: Proceedings of the 10th Annual Conference on Genetic and Evolutionary Computation, USA, pp. 151–158 (2008)

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science, Shahid Bahonar University of Kerman, Box No 76135-133, Kerman, Iran

    N. Mansouri & M. M. Javidi

Authors
  1. N. Mansouri
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. M. M. Javidi
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to N. Mansouri.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Mansouri, N., Javidi, M.M. Cost-based job scheduling strategy in cloud computing environments. Distrib Parallel Databases 38, 365–400 (2020). https://doi.org/10.1007/s10619-019-07273-y

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10619-019-07273-y

Keywords