Abstract
We study the problem of reaching a consensus in the values of a distributed system of agents with time-varying connectivity in the presence of delays. We consider a widely studied consensus algorithm, in which at each time step, every agent forms a weighted average of its own value with values received from the neighboring agents. We study an asynchronous operation of this algorithm using delayed agent values. Our focus is on establishing convergence rate results for this algorithm. In particular, we first show convergence to consensus under a bounded delay condition and some connectivity and intercommunication conditions imposed on the multi-agent system. We then provide a bound on the time required to reach the consensus. Our bound is given as an explicit function of the system parameters including the delay bound and the bound on agents’ intercommunication intervals.
Similar content being viewed by others
References
Angeli, D., Bliman, P.-A.: Convergence speed of unsteady distributed consensus: decay estimate along the settling spanning-trees. http://arxiv.org/abs/math.OC/0610854 (2006)
Bertsekas D.P., Tsitsiklis J.N.: Parallel and Distributed Computation: Numerical Methods. Athena Scientific, Belmont, MA (1997)
Bliman, P.-A., Ferrari-Trecate, G.: Average consensus problems in networks of agents with delayed communications. http://arxiv.org/abs/math.OC/0503009v2 (2005)
Blondel, V.D., Hendrickx, J.M., Olshevsky, A., Tsitsiklis, J.N.: Convergence in multiagent coordination, consensus, and flocking. Proceeding of 44th IEEE Conference on Decision and Control, pp. 2996–3000 (2005)
Boyd, S., Ghosh, A., Prabhakar, B., Shah, D.: Gossip algorithms: design, analysis, and applications. Proceedings of IEEE INFOCOM, 24th Joint Conference of the IEEE Computer and Communications Societies, vol. 3, pp. 1653–1664 (2005)
Cao, M., Spielman, D.A., Morse, A.S.: A lower bound on convergence of a distributed network consensus algorithm. Proceedings of 44th IEEE Conference on Decision and Control, pp. 2356–2361 (2005)
Carli, R., Fagnani, F., Speranzon, A., Zampieri, S.: Communication constraints in coordinated consensus problems. Proceedings of IEEE American Control Conference, pp. 4189–4194 (2006)
Carli, R., Fagnani, F., Frasca, P., Taylor, T., Zampieri, S.: Average consensus on networks with transmission noise or quantization. Proceedings of European Control Congerence (2007)
Jadbabaie A., Lin J., Morse S.: Coordination of groups of mobile autonomous agents using nearest neighbor rules. IEEE Trans. Autom. Control 48(6), 988–1001 (2003)
Kashyap, A., Basar, T., Srikant, R.: Consensus with quantized information updates. Proceedings of 45th IEEE Conference on Decision and Control, pp. 2728–2733 (2006)
Li S., Basar T.: Asymptotic agreement and convergence of asynchronous stochastic algorithms. IEEE Trans. on Autom. Control 32(7), 612–618 (1987)
Moallemi, C., Van Roy, B.: Consensus propagation. Advances in neural information processing systems 18. In: Weiss, Y., Scholkopf, B., Platt, J. (eds.) Proceedings of Neural Information Processing Systems, pp. 899–906 (2005)
Nedić, A., Ozdaglar, A. : On the rate of convergence of distributed subgradient methods for multi-agent optimization. Proceedings of 46th IEEE Conference on Decision and Control, pp. 4711–4716 (2007)
Nedić A., Ozdaglar A.: Distributed subradient methods for multi-agent optimization. IEEE Trans. on Autom. Control (2009, to appear)
Olfati-Saber R., Murray R.M.: Consensus problems in networks of agents with switching topology and time-delays. IEEE Trans. Autom. Control 49(9), 1520–1533 (2004)
Olshevsky, A., Tsitsiklis, J.N.: Convergence rates in distributed consensus and averaging, Proceedings of 46th IEEE Conference on Decision and Control, pp. 3387–3392 (2007)
Olshevsky, A., Tsitsiklis, J.N.:Convergence speed in distributed consensus and averaging, SIAM J. Control Optim. archive link: arXiv:math/0612682v1 (2006, forthcoming)
Tsitsiklis, J.N.: Problems in decentralized decision making and computation. Ph.D. Thesis, Department of Electrical Engineering and Computer Science, Massachusetts Institute of Technology (1984)
Tsitsiklis J.N., Athans M.: Convergence and asymptotic agreement in distributed decision problems. IEEE Trans. Autom. Control 29(1), 42–50 (1984)
Tsitsiklis J.N., Bertsekas D.P., Athans M.: Distributed asynchronous deterministic and stochastic gradient optimization algorithms. IEEE Trans. Autom. Control 31(9), 803–812 (1986)
Xiao L., Boyd S.: Fast linear iterations for distributed averaging. Syst. Control Lett. 53, 65–78 (2004)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Nedić, A., Ozdaglar, A. Convergence rate for consensus with delays. J Glob Optim 47, 437–456 (2010). https://doi.org/10.1007/s10898-008-9370-2
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10898-008-9370-2