Abstract
Recent years have seen many advances in ontology modularisation. This has made it difficult to determine whether a module is actually a good module; it is unclear which metrics should be considered. The few existing works on evaluation metrics focus on only some metrics that suit the modularisation technique, and there is not always a quantitative approach to calculate them. Overall, the metrics are not comprehensive enough to apply to a variety of modules and it is unclear which metrics fare well with particular types of ontology modules. To address this, we create a comprehensive list of module evaluation metrics with quantitative measures. These measures were implemented in the new Tool for Ontology Module Metrics (TOMM) which was then used in a testbed to test these metrics with existing modules. The results obtained, in turn, uncovered which metrics fare well with which module types, i.e., which metrics need to be measured to determine whether a module of some type is a ‘good’ module.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
- 1.
An earlier version of this section was presented at [14] and has now been updated with some corrections, refinements, and better descriptions.
References
Borgo, S.: Goals of modularity: a voice from the foundational viewpoint. In: Fifth International Workshop on Modular Ontologies (WOMO 2011). Frontiers in Artificial Intelligence and Applications, vol. 230, pp. 1–6. IOS Press, ljubljana, August 2011
Cuenca Grau, B., Parsia, B., Sirin, E., Kalyanpur, A.: Modularity and web ontologies. In: 10th International Conference on Principles of Knowledge Representation and Reasoning (KR 2006), pp. 198–209. AAAI Press, Lake District, 2–5 June 2006
d’Aquin, M., Schlicht, A., Stuckenschmidt, H., Sabou, M.: Ontology modularization for knowledge selection: experiments and evaluations. In: Wagner, R., Revell, N., Pernul, G. (eds.) DEXA 2007. LNCS, vol. 4653, pp. 874–883. Springer, Heidelberg (2007)
d’Aquin, M., Schlicht, A., Stuckenschmidt, H., Sabou, M.: Criteria and evaluation for ontology modularization techniques. In: Stuckenschmidt, H., Parent, C., Spaccapietra, S. (eds.) Modular Ontologies. LNCS, vol. 5445, pp. 67–89. Springer, Heidelberg (2009)
Ensan, F., Du, W.: A semantic metrics suite for evaluating modular ontologies. Inf. Syst. 38(5), 745–770 (2013)
Freeman, L.C.: Centrality in social networks conceptual clarification. Soc. Netw. 1(3), 215–239 (1978)
García, J., García-Peñalvo, F.J., Therón, R.: A survey on ontology metrics. In: Lytras, M.D., Ordonez De Pablos, P., Ziderman, A., Roulstone, A., Maurer, H., Imber, J.B. (eds.) WSKS 2010. CCIS, vol. 111, pp. 22–27. Springer, Heidelberg (2010)
Gennari, J.H., Musen, M.A., Fergerson, R.W., Grosso, W.E., Crubézy, M., Eriksson, H., Noy, N.F., Tu, S.W.: The evolution of Protégé: an environment for knowledge-based systems development. Int. J. Hum. Comput. Stud. 58(1), 89–123 (2003)
Grau, B.C., Horrocks, I., Kazakov, Y., Sattler, U.: Modular reuse of ontologies: theory and practice. J. Artif. Intell. Res. 31, 273–318 (2008)
Hodgson, R., Keller, P.J.: QUDT-quantities, units, dimensions and data types in OWL and XML (2011). http://www.qudt.org. Accessed September 2011
Kalyanpur, A., Parsia, B., Sirin, E., Cuenca Grau, B., Hendler, J.A.: Swoop: a web ontology editing browser. J. Web Semant. 4(2), 144–153 (2006)
Khan, Z.C., Keet, C.M.: The foundational ontology library ROMULUS. In: Cuzzocrea, A., Maabout, S. (eds.) MEDI 2013. LNCS, vol. 8216, pp. 200–211. Springer, Heidelberg (2013)
Khan, Z.C., Keet, C.M.: Feasibility of automated foundational ontology interchangeability. In: Janowicz, K., Schlobach, S., Lambrix, P., Hyvönen, E. (eds.) EKAW 2014. LNCS, vol. 8876, pp. 225–237. Springer, Heidelberg (2014)
Khan, Z.C.: Evaluation metrics in ontology modules. In: 29th International Workshop on Description Logics (DL 2016), CEUR Workshop Proceedings, vol. 1577, Cape Town, South Africa. CEUR-WS.org, 22–25 April 2016
Khan, Z.C., Keet, C.M.: An empirically-based framework for ontology modularisation. Appl. Ontology 10(3–4), 171–195 (2015)
Loebe, F.: Requirements for logical modules. In: First International Workshop on Modular Ontologies (WoMO 2006), CEUR Workshop Proceedings, vol. 232, Athens, Georgia, USA. CEUR-WS.org, 5 November 2006
McComb, D.: Gist: the minimalist upper ontology. In: Semantic Technology Conference, San Francisco, CA, 21–25 June 2010
Noy, N.F., Musen, M.A.: Specifying ontology views by traversal. In: McIlraith, S.A., Plexousakis, D., van Harmelen, F. (eds.) ISWC 2004. LNCS, vol. 3298, pp. 713–725. Springer, Heidelberg (2004)
Oh, S., Ahn, J.: Ontology module metrics. In: International Conference on e-Business Engineering, (ICEBE 2009), pp. 11–18. IEEE Computer Society, Macau, 21–23 October 2009
Oh, S., Yeom, H.Y., Ahn, J.: Cohesion and coupling metrics for ontology modules. Inf. Technol. Manag. 12(2), 81–96 (2011)
Orme, A.M., Yao, H., Etzkorn, L.H.: Coupling metrics for ontology-based systems. IEEE Softw. 23(2), 102–108 (2006)
Pathak, J., Johnson, T.M., Chute, C.G.: Survey of modular ontology techniques and their applications in the biomedical domain. Integr. Comput.-Aided Eng. 16(3), 225–242 (2009)
Rospocher, M.: An ontology for personalized environmental decision support. In: Formal Ontology in Information Systems FOIS 2014, pp. 421–42, Rio de Janeiro, Brazil, 22–25 September, 2014
Schlicht, A., Stuckenschmidt, H.: Towards structural criteria for ontology modularization. In: First International Workshop on Modular Ontologies, (WoMO 2006), CEUR Workshop Proceedings, vol. 232, Athens, Georgia, USA. CEUR-WS.org, 5 November 2006
Tartir, S., Arpinar, I.B., Moore, M., Sheth, A.P., Aleman-Meza, B.: OntoQA: metric-based ontology quality analysis. In: IEEE Workshop on Knowledge Acquisition from Distributed, Autonomous, Semantically Heterogeneous Data and Knowledge Sources, vol. 9 (2005)
Vescovo, C.D.: The modular structure of an ontology: atomic decomposition towards applications. In: 24th International Workshop on Description Logics (DL 2011), CEUR Workshop Proceedings, vol. 745, Barcelona, Spain. CEUR-WS.org, 13–16 July 2011
Yao, H., Orme, A.M., Etzkorn, L.: Cohesion metrics for ontology design and application. J. Comput. Sci. 1(1), 107 (2005)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
A Appendix: Summarised Types of Ontology Modules
A Appendix: Summarised Types of Ontology Modules
-
T1
Ontology design pattern modules An ontology is modularised by identifying a part of the ontology for general reuse.
-
T2
Subject domain modules A large domain is divided by subdomains present in the ontology.
-
T3
Isolation branch modules A subset of entities from an ontology is extracted but entities with weak dependencies to the signature are not to be included in the module.
-
T4
Locality modules A subset of entities from an ontology is extracted, including all entities that are dependent on the subset.
-
T5
Privacy modules Some information is hidden from an ontology.
-
T6
Domain coverage modules A large ontology is partitioned by its graphical structure and placement of entities in the taxonomy.
-
T7
Ontology matching modules An ontology is modularised for ontology matching into disjoint modules so that there is no repetition of entities.
-
T8
Optimal reasoning modules An ontology is split into smaller modules to aid in overall reasoning over the ontology.
-
T9
Axiom abstraction modules An ontology is modularised to have fewer axioms, to decrease the horizontal structure of the ontology.
-
T10
Entity type abstraction modules An ontology is modularised by removing a certain type of entity e.g., data properties or object properties.
-
T11
High-level abstraction modules An ontology is modularised by removing lower-level classes and only keeping higher-level classes.
-
T12
Weighted abstraction modules An ontology is modularised by a weighting decided by the developer.
-
T13
Expressiveness sub-language modules An ontology is modularised by using a sub-language of a core ontology language.
-
T14
Expressiveness feature modules An ontology is modularised by using limited language features.
Rights and permissions
Copyright information
© 2016 Springer International Publishing AG
About this paper
Cite this paper
Khan, Z.C., Keet, C.M. (2016). Dependencies Between Modularity Metrics Towards Improved Modules. In: Blomqvist, E., Ciancarini, P., Poggi, F., Vitali, F. (eds) Knowledge Engineering and Knowledge Management. EKAW 2016. Lecture Notes in Computer Science(), vol 10024. Springer, Cham. https://doi.org/10.1007/978-3-319-49004-5_26
Download citation
DOI: https://doi.org/10.1007/978-3-319-49004-5_26
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-49003-8
Online ISBN: 978-3-319-49004-5
eBook Packages: Computer ScienceComputer Science (R0)