Abstract
InfiniBand is very likely to become the de facto standard for communication between nodes and I/O devices (SANs) as well as for interprocessor communication (NOWs). The InfiniBand Architecture (IBA) defines a switch-based network with point-to-point links whose topology is arbitrarily established by the customer. Often, the interconnection pattern is irregular. Up*/down* is the most popular routing scheme currently used in NOWs with irregular topologies. However, the main drawbacks of up*/down* routing are the unbalanced channel utilization and the difficulties to route most packets through minimal paths, which negatively affects network performance. Using additional virtual lanes can improve up*/down* routing performance by reducing the head-of-line blocking effect, but its use is not aimed to remove its main drawbacks. In this paper, we propose a new methodology that uses a reduced number of virtual lanes in an efficient way to achieve a better traffic balance and a higher number of minimal paths. This methodology is based on routing packets simultaneously through several properly selected up*/down* trees. To guarantee deadlock freedom, each up*/down* tree is built over a different virtual network. Simulation results, show that the proposed methodology increases throughput up to an average factor ranging from 1.18 to 2.18 for 8, 16, and 32-switch networks by using only two virtual lanes. For larger networks with an additional virtual lane, network throughput is tripled, on average.
This work was supported by the Spanish CICYT under Grant TIC2000-1151 and by Generalitat Valenciana under Grant GV00-131-14.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
N. J. Boden et al., Myrinet-A gigabit per second local area network, IEEE Micro, vol. 15, Feb. 1995.
L. Cherkasova, V. Kotov, and T. Rokicki, “Fibre channel fabrics: Evaluation and design,” in Proc. of 29th Int. Conf. on System Sciences, Feb. 1995.
W. J. Dally, Virtual-channel flow control, IEEE Transactions on Parallel and Distributed Systems, vol. 3, no. 2, pp. 194–205, March 1992.
W. J. Dally and C. L. Seitz, Deadlock-free message routing in multiprocessors interconnection networks, IEEE Transactions on Computers, vol. C-36, no. 5, pp. 547–553, May. 1987.
J. Duato, A. Robles, F. Silla, and R. Beivide, A comparison of router architectures for virtual cut-through and wormhole switching in a NOW environment in Proc. of 13th International Parallel Processing Symposium, April 1998.
J. Flich, P. Lopez, M.P. Malumbres, J. Duato, and T. Rokicki, “Combining In-Transit Buffers with Optimized Routing Schemes to Boost the Performance of Networks with Source Routing,” Proc. of Int. Symp. on High Performance Computing, Oct. 2000.
D. García and W. Watson, Servernet II, in Proceedings of the 1997 Parallel Computer, Routing, and Communication Workshop, Jun 1997.
InfiniBand™ Trade Association, http://www.infinibandta.com
InfiniBand™ Trade Association, InfiniBand™ architecture. Specification Volumen 1. Release 1.0.a. Available at http://www.infinibandta.com
P. Kermani and L. Kleinrock, Virtual cut-through: A new computer communication switching technique, Computer Networks, vol. 3, pp. 267–286, 1979.
C. Minkenberg and T. Engbersen, A Combined Input and Output Queued Packet-Switched System Based on PRIZMA Switch-on-a-Chip Technology, in IEEE Communication Magazine, Dec. 2000.
P. López, J. Flich, and J. Duato, Deadlock-free Routing in InfiniBand™ through Destination Renaming, in Proc. of 2001 International Conference on Parallel Processing (ICPP’01), Sept. 2001.
G. Pfister, In search of clusters, Prentice Hall, 1995.
W. Qiao and L. M. Ni, “Adaptive routing in irregular networks using cut-through switches,” in Proc. of the 1996 International Conference on Parallel Processing, Aug. 1996.
J.C. Sancho, A. Robles, and J. Duato, Effective Strategy to Compute Forwarding Tables for InfiniBand Networks, in Proc. of 2001 International Conference on Parallel Processing (ICPP’01), Sept. 2001.
J.C. Sancho and A. Robles, Improving the Up*/down* routing scheme for networks of workstations in Proc. of Euro-Par 2000, Aug. 2000.
J.C. Sancho, A. Robles, and J. Duato, New methodology to compute deadlock-free routing tables for irregular networks, in Proc. of CANPC’2000, Jan. 2000.
J.C. Sancho, J. Flich, A. Robles, P. López and J. Duato, “Analyzing the Influence of Virtual Lanes on InfiniBand Networks,” submitted for publication.
F. Silla and J. Duato, Tuning the Number of Virtual Channels in Networks of Workstations, in Proc. of the 10th International Conference on Parallel and Distributed Computing Systems (PDCS’97), Oct. 1997.
M. D. Schroeder et al., Autonet: A high-speed, self-configuring local area network using point-to-point links, SRC research report 59, DEC, Apr. 1990.
R. Sheifert, Gigabit Ethernet, Addison-Wesley, April 1998.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2002 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Flich, J., López, P., Sancho, J.C., Robles, A., Duato, J. (2002). Improving InfiniBand Routing through Multiple Virtual Networks. In: Zima, H.P., Joe, K., Sato, M., Seo, Y., Shimasaki, M. (eds) High Performance Computing. ISHPC 2002. Lecture Notes in Computer Science, vol 2327. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-47847-7_7
Download citation
DOI: https://doi.org/10.1007/3-540-47847-7_7
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-43674-4
Online ISBN: 978-3-540-47847-8
eBook Packages: Springer Book Archive