Abstract
Testing service-oriented or component-based systems poses new challenges due to the non-availability of code and the distributed nature of the applications being tested. Structural coverage criteria, traditionally used to assess test suites, require access to code. As an alternative we consider model-based criteria based on interface specifications using visual contracts.
Formally represented as graph transformation rules, visual contracts are analysed for potential dependencies and conflicts and dependency graphs are derived for defining the criteria. In order to assess the coverage of a given set of tests, AGG is used for simulating the model while tests are executed. In the course of the simulation, which also serves as a test oracle, conflicts and dependencies are observed and recorded. This allows us to see if the statically detected potential dependencies and conflicts are exercised at runtime. For evaluation purposes, we compare coverage with respect to model-based criteria and traditional structural ones.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
AGG: AGG - Attributed Graph Grammar System Environment (2007), http://tfs.cs.tu-berlin.de/agg
Ammann, P., Offutt, J.: Introduction to Software Testing. Cambridge University Press, New York (2008)
Bartolini, C., Bertolino, A., Marchetti, E., Parissis, I.: Data Flow-Based Validation of Web Services Compositions: Perspectives and Examples. In: de Lemos, R., Di Giandomenico, F., Gacek, C., Muccini, H., Vieira, M. (eds.) Architecting Dependable Systems V. LNCS, vol. 5135, pp. 298–325. Springer, Heidelberg (2008)
Beizer, B.: Black-box testing: techniques for functional testing of software and systems. John Wiley & Sons, Inc., New York (1995)
Belli, F., Guandler, N., Linschulte, M.: Are longer test sequences always better? - a reliability theoretical analysis. In: Fourth International Conference on Secure Software Integration and Reliability Improvement Companion (SSIRI-C), pp. 78–85. IEEE (June 2010)
Biermann, E., Ehrig, H., Ermel, C., Golas, U., Taentzer, G.: Parallel Independence of Amalgamated Graph Transformations Applied to Model Transformation. In: Engels, G., Lewerentz, C., Schäfer, W., Schürr, A., Westfechtel, B. (eds.) Nagl Festschrift. LNCS, vol. 5765, pp. 121–140. Springer, Heidelberg (2010)
Briand, L., Labiche, Y., Lin, Q.: Improving the coverage criteria of UML state machines using data flow analysis. Software Testing, Validation, and Reliability 20(3) (2010)
Chen, Y., Liu, S., Nagoya, F.: An Approach to Integration Testing Based on Data Flow Specifications. In: Liu, Z., Araki, K. (eds.) ICTAC 2004. LNCS, vol. 3407, pp. 235–249. Springer, Heidelberg (2005)
Ehrig, H., Ehrig, K., Prange, U., Taentzer, G.: Fundamentals of Algebraic Graph Transformation (Monographs in Theoretical Computer Science. An EATCS Series). Springer (2006)
Frankl, P.G., Weyuker, E.J.: An applicable family of data flow testing criteria. IEEE Trans. Softw. Eng. 14(10), 1483–1498 (1988)
Golas, U., Biermann, E., Ehrig, H., Ermel, C.: A Visual Interpreter Semantics for Statecharts Based on Amalgamated Graph Transformation. In: Proceedings of Int. Workshop on Graph Computation Models (GCM 2010). Electronic Communications of the EASST, vol. 39 (2011)
Güldali, B., Mlynarski, M., Wübbeke, A., Engels, G.: Model-based system testing using visual contracts. In: Proceedings of Euromicro SEAA Conference 2009, Special Session on “Model Driven Engineering”, pp. 121–124. IEEE Computer Society, Washington, DC (2009)
Hausmann, J.H., Heckel, R., Lohmann, M.: Model-based development of web services descriptions enabling a precise matching concept. Int. J. Web Service Res. 2(2), 67–84 (2005)
Heckel, R., Khan, T.A., Machado, R.: Towards test coverage criteria for visual contracts. In: Proceedings of Graph Transformation and Visual Modeling Techniques, GTVMT 2011. Electronic Communications of the EASST, vol. 41 (2011)
Heckel, R., Llabrés, M., Ehrig, H., Orejas, F.: Concurrency and loose semantics of open graph transformation systems. Mathematical Structures in Computer Science 12(4), 349–376 (2002)
Hou, J., Xu, B., Xu, L., Wang, D., Xu, J.: A testing method for web services composition based on data-flow. Wuhan University Journal of Natural Sciences 13, 455–460 (2008)
Khan, T.A., Runge, O., Heckel, R.: Visual contracts as test oracle in AGG 2.0. In: Proceedings of Graph Transformation and Visual Modeling Techniques, GTVMT 2012. Electronic Communications of the EASST, vol. 47 (2012)
Lohmann, M., Mariani, L., Heckel, R.: A model-driven approach to discovery, testing and monitoring of web services. In: Test and Analysis of Web Services, pp. 173–204. Springer (2007)
Mei, L., Chan, W., Tse, T., Kuo, F.C.: An empirical study of the use of Frankl-Weyuker data flow testing criteria to test BPEL web services. In: 33rd Annual IEEE International Computer Software and Applications Conference, COMPSAC 2009, vol. 1, pp. 81–88 (July 2009)
Najumudheen, E., Mall, R., Samanata, D.: A dependence representation for coverage testing of object-oriented programs. Journal of Object Technology 9(4), 1–23 (2010)
Podgurski, A., Lori, C.A.: A formal model of program dependences and its implications for software testing, debugging, and maintenance. IEEE Transactions on Software Engineering 16, 965–979 (1990)
Runge, O., Ermel, C., Taentzer, G.: AGG 2.0 – new features for specifying and analyzing algebraic graph transformations. In: Proceedings of the 4th International Symposium on Applications of Graph Transformation with Industrial Relevance, AGTIVE 2011. LNCS, vol. 7233, Springer (2012)
Sinha, A., Paradkar, A.: Model-based functional conformance testing of web services operating on persistent data. In: Proceedings of the 2006 Workshop on Testing, Analysis, and Verification of Web Services and Applications, TAV-WEB 2006, pp. 17–22. ACM, New York (2006)
Zhu, H., Hall, P.A.V., May, J.H.R.: Software unit test coverage and adequacy. ACM Comput. Surv. 29, 366–427 (1997)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Khan, T.A., Runge, O., Heckel, R. (2012). Testing against Visual Contracts: Model-Based Coverage. In: Ehrig, H., Engels, G., Kreowski, HJ., Rozenberg, G. (eds) Graph Transformations. ICGT 2012. Lecture Notes in Computer Science, vol 7562. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-33654-6_19
Download citation
DOI: https://doi.org/10.1007/978-3-642-33654-6_19
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-33653-9
Online ISBN: 978-3-642-33654-6
eBook Packages: Computer ScienceComputer Science (R0)