Abstract
Software performance anomaly detection is a major challenge in complex industrial cyber-physical systems. The automated comparison of runtime execution metrics to reference ones provides a potential solution. We introduce the concept of software passports, intended to act as a signature construct for runtime performance behaviour of reference executions. Our software passport design is based on Extra-Functional Behaviour (EFB) metrics. Amongst such metrics, our focus has been especially on CPU time, read and write communication event counts of different processes. The notion of phases for systems with repetitive tasks during their execution and its fundamental role in our software passports has also been elaborated. We employ regression modelling of our collected data for comparative purposes. The comparison reveals inconsistencies between the execution at hand and the software passport, if present. Such inconsistencies are strong indicators for presence of performance anomalies. Our design is capable of detecting synthetically introduced performance anomalies to the real execution tracing data from a semiconductor photolithography machine.
This paper is composed as part of the research project 14208, titled “Interactive DSL for Composable EFB Adaptation using Bi-simulation and Extrinsic Coordination (iDAPT)”, funded by The Netherlands Organisation for Scientific Research (NWO).
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Barnes, B.J., Rountree, B., Lowenthal, D.K., Reeves, J., de Supinski, B., Schulz, M.: A regression-based approach to scalability prediction. In: Proceedings of the 22nd Annual International Conference on Supercomputing, ICS 2008, pp. 368–377 (2008)
Chandola, V., Banerjee, A., Kumar, V.: Anomaly detection: a survey. ACM Comput. Surv. 41(3), 15:1–15:58 (2009)
Chatfield, C.: Model uncertainty, data mining and statistical inference. J. Roy. Stat. Soc. Ser. A (Stat. Soc.) 158(3), 419–466 (1995)
Chen, D., Shao, X., Hu, B., Su, Q.: Simultaneous wavelength selection and outlier detection in multivariate regression of near-infrared spectra. Anal. Sci. 21(2), 161–166 (2005)
Ibidunmoye, O., Hernández-Rodriguez, F., Elmroth, E.: Performance anomaly detection and bottleneck identification. ACM Comput. Surv. 48(1), 4:1–4:35 (2015)
Jain, R.: The Art of Computer Systems Performance Analysis: Techniques for Experimental Design, Measurement, Simulation, and Modeling. Wiley, New York (1990)
Joseph, P.J., Thazhuthaveetil, M.J.: Construction and use of linear regression models for processor performance analysis. In: The Twelfth International Symposium on High-Performance Computer Architecture 2006, pp. 99–108 (2006)
Lee, B.C., Brooks, D.M.: Accurate and efficient regression modeling for microarchitectural performance and power prediction. In: Proceedings of the 12th International Conference on Architectural Support for Programming Languages and Operating Systems, pp. 185–194. ASPLOS XII (2006)
Lee, B.C., Brooks, D.M., de Supinski, B.R., Schulz, M., Singh, K., McKee, S.A.: Methods of inference and learning for performance modeling of parallel applications. In: Proceedings of the 12th ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, PPoPP 2007, pp. 249–258 (2007)
Meyer, H., Odyurt, U., Polstra, S., Paradas, E., Alonso, I.G., Pimentel, A.D.: On the effectiveness of communication-centric modelling of complex embedded systems. In: 2018 IEEE International Conference on Parallel Distributed Processing with Applications (ISPA), pp. 979–986, December 2018
Odyurt, U., Meyer, H., Polstra, S., Paradas, E., Alonso, I.G., Pimentel, A.D.: Work-in-progress: communication-centric analysis of complex embedded computing systems. In: 2018 International Conference on Embedded Software (EMSOFT), pp. 1–3, September 2018
Philip, H.S., Torr, D.W.M.: Outlier detection and motion segmentation, vol. 2059 (1993)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Odyurt, U., Meyer, H., Pimentel, A.D., Paradas, E., Alonso, I.G. (2019). Software Passports for Automated Performance Anomaly Detection of Cyber-Physical Systems. In: Pnevmatikatos, D., Pelcat, M., Jung, M. (eds) Embedded Computer Systems: Architectures, Modeling, and Simulation. SAMOS 2019. Lecture Notes in Computer Science(), vol 11733. Springer, Cham. https://doi.org/10.1007/978-3-030-27562-4_18
Download citation
DOI: https://doi.org/10.1007/978-3-030-27562-4_18
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-27561-7
Online ISBN: 978-3-030-27562-4
eBook Packages: Computer ScienceComputer Science (R0)