Abstract
Time synchronization is a fundamental requirement for many services provided by distributed systems. For this purpose, several time synchronization protocols have been proposed. However, they either achieve high accuracy by adding further network traffic, even more than common protocols such as network time protocol and precision time protocol, or consume a lot of time in additional computations. An online distributed tracing and monitoring system, used to identify functional and performance problems in distributed systems, must offer high precision with minimum time overhead and system resource consumption. The aim of this paper is to propose an efficient algorithm for time synchronization in online mode, applicable for all distributed services. The proposed method in this paper addresses five key requirements for a practical solution in distributed systems. First, it provides microseconds scale accuracy, which is applicable for trace events with nanosecond timestamp granularity. Secondly, it does not require adding new network traffic, using the send and receive time of existing traffic. Thirdly, it synchronizes the distributed traces in average time complexity of O(1) per synchronization update. Fourthly, it updates online synchronization parameters immediately without latency. Finally, it iteratively refines the early estimates without requiring significant buffering of earlier data. Although we used this work for distributed trace synchronization, it is a general, fully incremental, continuous synchronization approach applicable to most synchronization purposes.
Similar content being viewed by others
References
Marouani, H., Dagenais, M.: Internal clock drift estimation in computer clusters. J. Comput. Syst. Netw. Commun. 2008(1), 1–7 (2008)
Jasperneite, J., Shehab, K., Weber, K.: Enhancements to the time synchronization standard IEEE-1588 for a system of cascaded bridges. In: IEEE International Workshop on Factory Communication Systems, pp. 239–244 (2004)
Desnoyers, M.: Low-Impact Operating System Tracing, Ph.D. thesis, École Polytechnique de Montréal (2009)
Duda, A., Harrus, G., Haddad, Y., Bernard, G.: Estimating global time in distributed system. In: Proceedings of 7th International Conference on Distributed Computing Systems, Berlin (1987)
Jabbarifar, M., Shameli-Sendi, A., Pedram, H., Dehghan, M., Dagenais, M.: L-SYNC: larger degree clustering based time-synchronisation for wireless sensor network. In: Eighth ACIS International Conference on Software Engineering Research, Management and Applications, pp. 171–178 (2010)
Moon, S.B., Skelly, P., Towsley, D.: Estimation and removal of clock skew from network delay measurements. In: INFOCOM (1999)
Ashton, P.: Algorithms for off-line clock synchronization. University of Canterbury, Department of Computer Science, Technical report (1995)
Poirier, B., Roy, R., Dagenais, M.: Accurate offline synchronization of distributed traces using kernel-level events. Oper. Syst. Rev. 44, 75–87 (2010)
Jabbarifar, M., Shameli-Sendi, A., Sadighian, A., Ezzati-Jivan, N., Dagenais, M.: A reliable and efficient time synchronization protocol for heterogeneous wireless sensor network. J. Wirel. Sens. Netw. 2(12), 910–918 (2010)
Clement, E., Dagenais, M.: Trace synchronization in distributed networks. J. Comput. Syst. Netw. Commun. 2009(5), 11 (2009)
NIST Time and frequency from A to Z., February 2011. http://tf.nist.gov/general/glossary.htm
Jabbarifar, M., Roy, R., Dagenais, M., Shameli-Sendi, A.: Optimum off-line trace synchronization of computer clusters. J. Phys.: Conf. Ser. 341, 012029 (2012)
Khlifi, H., Gregorie, J.C.: Low-complexity offline and online clock skew estimation and removal. Int. J. Comput. Telecommun. Netw. 50(11), 1872–1884 (2006)
Shameli-Sendi, A., Cheriet, M., Hamou-Lhadj, A.: Taxonomy of intrusion risk assessment and response system. Comput. Secur. 45, 1–16 (2014)
Domingos, P., Hulten, G.: Mining high-speed data streams. In: Proceedings of the Sixth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 71–80 (2000)
Mills, D.L.: Computer network time synchronization. In: The Network Time Protocol.CRC Press Inc, Boca Raton (2006)
Veitch, D., Ridoux, J., Korada, S.B.: Robust synchronization of absolute and difference clocks over networks. J. IEEE/ACM Trans. Netw. 17(2), 417–430 (2009)
Ridoux, J., Veitch, D., Broomhead, T.: The case for feed-forward clock synchronization. IEEE/ACM Trans. Netw. 20(1), 231–242 (2012)
Lamport, L.: Time, clocks, and the ordering of events in a distributed system. Commun. ACM 21(7), 558–565 (1978)
Fidge, C.: Timestamps in message-passing systems that preserve the partial ordering. In: Proceedings of the 11th Australian Computer Science Conference (ACSC’88), pp. 56–66 (1988)
Mattern, F.: Virtual time and global states of distributed systems. Parallel Distrib. Algorithms 1(23), 215–226 (1989)
Cristian, F.: Probabilistic clock synchronization. Distrib. Comput. 3(3), 146–158 (1989)
Gusella, R., Zatti, S.: The accuracy of the clock synchronization achieved by TEMPO in Berkeley UNIX 4.3BSD. IEEE Trans. Softw. Eng. 15(7), 847–853 (1989)
Gaber, M., Zaslavsky, A., Krishnaswamy, S.: Mining data streams: a review. SIGMOD Rec. 34(2), 18–26 (2005)
Han, J., Kamber, M.: Data Mining: Concepts and Techniques, 2nd edn. Elsevier, San Francisco (2006)
Zhang, L., Liu, Z., Xia, C.H.: Clock synchronization algorithms for network measurements. In: Proceedings of Twenty-First Annual Joint Conference of the IEEE Computer and Communications Societies, pp. 160–169 (2002)
Choi, J.H., Yoo, C.: One-way delay estimation and its application. In: Computer Communications, pp. 819–828 (2005)
Kim, D., Lee, J.: End-to-end one-way delay estimation using one-way delay variation and round-trip time. In: Proceedings of Qshine (2007)
Lu, W.Z., Gu, W.X., Yu, S.Z.: One-way queuing delay measurement and its application on detecting DDoS attack. J. Netw. Comput. Appl. 32(2), 367–376 (2009)
Aoki, M., Oki, E., Rojas-Cessa, R.: Measurement scheme for one-way delay variation with detection and removal of clock skew. ETRI J. 32(6), 854–862 (2010)
Cola, M., Lucia, G.D., Mazza, D., Patrignani, M., Rimondini, M.: Covert channel for one-way delay measurements. In: Proceedings of 18th Internatonal Conference on Computer Communications and Networks, pp. 1–6 (2009)
Ngamwongwattana, B., Thompson, R.: Measuring one-way delay of VoIP packets without clock synchronization. In: Instrumentation and Measurement Technology Conference, pp. 532–535 (2009)
Kuhn, F., Locher, T., Oshman, R.: Gradient clock synchronization in dynamic networks. Theory Comput. Syst. 49(4), 781–816 (2011)
Betti, E., Cesati, M., Gioiosa, R, Piermaria, F.: A global operating system for HPC clusters. In: IEEE International Conference on Cluster Computing and Workshops, pp. 1–10 (2009)
Desnoyers, M., Dagenais, M.: Deploying LTTng on exotic embedded architectures. In: Embedded Linux Conference (2009)
Ellingson, C., Kulpinski, R.: Dissemination of system time. IEEE Trans. Commun. 21(5), 605–624 (1973)
Acknowledgments
The support of the Natural Sciences and Engineering Research Council of Canada (NSERC) and Ericsson Software Research is gratefully acknowledged.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Jabbarifar, M., Dagenais, M. & Shameli-Sendi, A. Online Incremental Clock Synchronization. J Netw Syst Manage 23, 1034–1066 (2015). https://doi.org/10.1007/s10922-014-9331-7
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10922-014-9331-7