This work presents the design and architecture of a decentralized grid scheduler named MaGate, which is developed within the SmartGRID project and focuses on grid scheduler interoperation. The MaGate scheduler is modular structured, and emphasizes the functionality, procedure and policy of delegating local unsuited jobs to appropriate remote MaGates within the same grid system. To avoid an isolated solution, web services and several existing and emerging grid standards are adopted, as well as a series of interfaces to both publish MaGate capabilities and integrate functionalities from external grid components. Meanwhile, a specific swarm intelligence solution is employed as a critical complementary service for MaGate to maintain an optimized peer-to-peer overlay that supports efficient resource discovery. Regarding evaluation, the effectiveness brought by job sharing within a physically connected grid community with the use of the MaGate has been illustrated by means of experiments on communities of different scale, and under various scenarios.<\/p>","DOI":"10.4018\/jdst.2010070102","type":"journal-article","created":{"date-parts":[[2010,9,7]],"date-time":"2010-09-07T23:37:32Z","timestamp":1283902652000},"page":"24-39","source":"Crossref","is-referenced-by-count":3,"title":["MaGate"],"prefix":"10.4018","volume":"1","author":[{"given":"Ye","family":"Huang","sequence":"first","affiliation":[{"name":"University of Fribourg, Switzerland"}]},{"given":"Amos","family":"Brocco","sequence":"additional","affiliation":[{"name":"University of Fribourg, Switzerland"}]},{"given":"Michele","family":"Courant","sequence":"additional","affiliation":[{"name":"University of Fribourg, Switzerland"}]},{"given":"Beat","family":"Hirsbrunne","sequence":"additional","affiliation":[{"name":"University of Fribourg, Switzerland"}]},{"given":"Pierre","family":"Kuonen","sequence":"additional","affiliation":[{"name":"University of Applied Sciences of Western Switzerland, Switzerland"}]}],"member":"2432","reference":[{"key":"jdst.2010070102-0","author":"A.Andrieux","year":"2004","journal-title":"Web Services Agreement Specification (WS-Agreement) (Tech. Rep.)"},{"key":"jdst.2010070102-1","author":"A.Anjomshoaa","year":"2005","journal-title":"Job submission description language (JSDL) specification (Tech. Rep.)"},{"key":"jdst.2010070102-2","doi-asserted-by":"crossref","DOI":"10.1093\/oso\/9780195131581.001.0001","author":"E.Bonabeau","year":"1999","journal-title":"Swarm intelligence: from natural to artificial systems"},{"key":"jdst.2010070102-3","unstructured":"Brocco, A., Frapolli, F., & Hirsbrunner, B. (2008, September). BlatAnt: Bounding Networks\u2019 Diameter with a Collaborative Distributed Algorithm. In Proceedings of the Sixth International Conference on Ant Colony Optimization and Swarm Intelligence, Bruxelles, Belgium. New York: Springer."},{"key":"jdst.2010070102-4","doi-asserted-by":"crossref","unstructured":"Brocco, A., Frapolli, F., & Hirsbrunner, B. (2009, April). Bounded Diameter Overlay Construction: A Self Organized Approach. In Proceedings of the IEEE Swarm Intelligence Symposium, Nashville, TN. Washington, DC: IEEE.","DOI":"10.1109\/SIS.2009.4937853"},{"key":"jdst.2010070102-5","doi-asserted-by":"crossref","unstructured":"Brocco, A., Hirsbrunner, B., & Courant, M. (2007, April). Solenopsis: A Framework for the Development of Ant Algorithms. In Proceedings of the Swarm Intelligence Symposium, Honolulu, HI (pp. 316-323). Washington, DC: IEEE.","DOI":"10.1109\/SIS.2007.367954"},{"key":"jdst.2010070102-6","doi-asserted-by":"publisher","DOI":"10.1002\/cpe.710"},{"issue":"2","key":"jdst.2010070102-7","doi-asserted-by":"crossref","first-page":"317","DOI":"10.1613\/jair.530","article-title":"AntNet: Distributed stigmergetic control for communications networks.","volume":"9","author":"G.Di Caro","year":"1998","journal-title":"Journal of Artificial Intelligence Research"},{"key":"jdst.2010070102-8","doi-asserted-by":"publisher","DOI":"10.1177\/109434209701100205"},{"issue":"1","key":"jdst.2010070102-9","doi-asserted-by":"crossref","first-page":"7","DOI":"10.12921\/cmst.2006.12.01.07-20","article-title":"SAGA: A Simple API for Grid Applications. High-level application programming on the Grid.","volume":"12","author":"T.Goodale","year":"2006","journal-title":"Computational Methods in Science and Technology"},{"key":"jdst.2010070102-10","doi-asserted-by":"crossref","unstructured":"Huang, Y., Brocco, A., Courant, M., Hirsbrunner, B., & Kuonen, P. (2009). MaGate Simulator: a simulation environment for a decentralized grid scheduler. In Proceedings of the International Conference on Advanced Parallel Processing Technologies (APPT\u201909), Rapperswil, Switzerland. New York: Springer.","DOI":"10.1007\/978-3-642-03644-6_21"},{"key":"jdst.2010070102-11","doi-asserted-by":"crossref","unstructured":"Huang, Y., Brocco, A., Kuonen, P., Courant, M., & Hirsbrunner, B. (2008). SmartGRID: A Fully Decentralized Grid Schedul- ing Framework Supported by Swarm Intelligence. In Proceedings of the Seventh International Conference on Grid and Cooperative Computing (GCC \u201908), China (LNCS 4967pp. 160-168). Washington, DC: IEEE Computer Society.","DOI":"10.1109\/GCC.2008.24"},{"key":"jdst.2010070102-12","doi-asserted-by":"crossref","unstructured":"Michlmayr, E. (2006). Ant Algorithms for Search in Unstructured Peer-to-Peer Networks. In Proceedings of the 22nd International Conference on Data Engineering Workshops (ICDE2006) (p. 142). Washington, DC: IEEE Computer Society.","DOI":"10.1109\/ICDEW.2006.29"},{"key":"jdst.2010070102-13","unstructured":"Moab Grid Suite. (2009). Cluster Resource Inc. Retrieved from http:\/\/www.clusterresources. com\/pages\/products\/moab-grid- suite.php"},{"key":"jdst.2010070102-14","unstructured":"Ripeanu, M., & Foster, I. (2001). Peer-to-peer architecture case study: Gnutella network. In Proceedings of the First Conference on Peer-to-peer Computing, Sweden (pp. 99-100). Washington, DC: IEEE Computer Press."},{"key":"jdst.2010070102-15","doi-asserted-by":"crossref","unstructured":"Ripeanu, M., Iamnitchi, A., Foster, I., & Rogers, A. (2007). In Search of Simplicity: A Self-Organizing Group Communication Overlay (Tech. Rep. No. TR-2007-05). Vancouver, Canada: University of British Columbia.","DOI":"10.1109\/SASO.2007.34"},{"key":"jdst.2010070102-16","unstructured":"Schmid, S., & Wattenhofer, R. (2007). Structuring Unstructured Peer-to-Pee Networks. In Proceedings of the 14th Annual IEEE International Conference on High Performance Computing (HiPC), Goa, India. Washington, DC: IEEE Press."},{"key":"jdst.2010070102-17","doi-asserted-by":"publisher","DOI":"10.1177\/105971239700500203"},{"key":"jdst.2010070102-18","doi-asserted-by":"crossref","unstructured":"Schopf, J. (2003). Ten actions when superscheduling: A grid scheduling architecture. Paper presented at the Workshop on Scheduling Architecture, Tokyo.","DOI":"10.1007\/978-1-4615-0509-9_2"},{"key":"jdst.2010070102-19","unstructured":"Shen, K. (2004). Structure management for scalable overlay service construction. In Proceedings of the First Symposium on Networked Systems Design and Implementation (NSDI\u201904) (pp. 21-21). Berkeley, CA: USENIX Association."},{"key":"jdst.2010070102-20","unstructured":"Tonellotto, N., Wieder, P., & Yahyapour, R. (2005). A proposal for a generic grid scheduling architecture. In Proceedings of the Integrated Research in Grid Computing Workshop, Greece (pp. 337-346). New York: Springer."},{"key":"jdst.2010070102-21","doi-asserted-by":"crossref","unstructured":"Troger, P., Rajic, H., Haas, A., & Domagalski, P. (2007). Standardization of an API for Distributed Resource Management Systems. In Proceedings of the Seventh IEEE International Symposium on Cluster Computing and the Grid (CCGRID \u201907) (pp. 619-626). Washington, DC: IEEE Computer Society.","DOI":"10.1109\/CCGRID.2007.109"},{"key":"jdst.2010070102-22","doi-asserted-by":"publisher","DOI":"10.1007\/11752578_94"},{"key":"jdst.2010070102-23","unstructured":"Xiaohui, W., Zhaohui, D., Shutao, Y., Chang, H., & Huizhen, L. (2006). CSF4: A WSRF compliant meta-scheduler. In Proceedings of the 2006 World Congress in Computer Science, Computer Engineering, and Applied Computing (GCA) (Vol. 6, pp. 61-67). Las Vegas, NV: Bentham Science."}],"container-title":["International Journal of Distributed Systems and Technologies"],"original-title":[],"language":"ng","link":[{"URL":"https:\/\/www.igi-global.com\/viewtitle.aspx?TitleId=46048","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,6,1]],"date-time":"2022-06-01T16:28:51Z","timestamp":1654100931000},"score":1,"resource":{"primary":{"URL":"https:\/\/services.igi-global.com\/resolvedoi\/resolve.aspx?doi=10.4018\/jdst.2010070102"}},"subtitle":["An Interoperable, Decentralized and Modular High-Level Grid Scheduler"],"short-title":[],"issued":{"date-parts":[[2010,7,1]]},"references-count":24,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2010,7]]}},"URL":"https:\/\/doi.org\/10.4018\/jdst.2010070102","relation":{},"ISSN":["1947-3532","1947-3540"],"issn-type":[{"value":"1947-3532","type":"print"},{"value":"1947-3540","type":"electronic"}],"subject":[],"published":{"date-parts":[[2010,7,1]]}}}