{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,4,8]],"date-time":"2024-04-08T05:58:32Z","timestamp":1712555912814},"reference-count":60,"publisher":"Springer Science and Business Media LLC","issue":"6","license":[{"start":{"date-parts":[[2023,8,9]],"date-time":"2023-08-09T00:00:00Z","timestamp":1691539200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,8,9]],"date-time":"2023-08-09T00:00:00Z","timestamp":1691539200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Transparent Machines project of Automated Decision Making and Society"},{"name":"Royal Melbourne Institute of Technology"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Data Min Knowl Disc"],"published-print":{"date-parts":[[2023,11]]},"abstract":"Abstract<\/jats:title>Knowledge graphs (KGs) are becoming essential resources for many downstream applications. However, their incompleteness may limit their potential. Thus, continuous curation is needed to mitigate this problem. One of the strategies to address this problem is KG alignment, i.e., forming a more complete KG by merging two or more KGs. This paper proposes i-Align, an interpretable KG alignment model. Unlike the existing KG alignment models, i-Align provides an explanation for each alignment prediction while maintaining high alignment performance. Experts can use the explanation to check the correctness of the alignment prediction. Thus, the high quality of a KG can be maintained during the curation process (e.g., the merging process of two KGs). To this end, a novel Transformer-based Graph Encoder (Trans-GE) is proposed as a key component of i-Align for aggregating information from entities\u2019 neighbors (structures). Trans-GE uses Edge-gated Attention<\/jats:italic> that combines the adjacency matrix and the self-attention matrix to learn a gating mechanism to control the information aggregation from the neighboring entities. It also uses historical embeddings<\/jats:italic>, allowing Trans-GE to be trained over mini-batches, or smaller sub-graphs, to address the scalability issue when encoding a large KG. Another component of i-Align is a Transformer encoder for aggregating entities\u2019 attributes. This way, i-Align can generate explanations in the form of a set of the most influential attributes\/neighbors based on attention weights. Extensive experiments are conducted to show the power of i-Align. The experiments include several aspects, such as the model\u2019s effectiveness for aligning KGs, the quality of the generated explanations, and its practicality for aligning large KGs. The results show the effectiveness of i-Align in these aspects.<\/jats:p>","DOI":"10.1007\/s10618-023-00963-3","type":"journal-article","created":{"date-parts":[[2023,8,9]],"date-time":"2023-08-09T17:01:45Z","timestamp":1691600505000},"page":"2494-2516","update-policy":"http:\/\/dx.doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["i-Align: an interpretable knowledge graph alignment model"],"prefix":"10.1007","volume":"37","author":[{"ORCID":"http:\/\/orcid.org\/0000-0002-1672-9483","authenticated-orcid":false,"given":"Bayu Distiawan","family":"Trisedya","sequence":"first","affiliation":[]},{"given":"Flora D.","family":"Salim","sequence":"additional","affiliation":[]},{"given":"Jeffrey","family":"Chan","sequence":"additional","affiliation":[]},{"given":"Damiano","family":"Spina","sequence":"additional","affiliation":[]},{"given":"Falk","family":"Scholer","sequence":"additional","affiliation":[]},{"given":"Mark","family":"Sanderson","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2023,8,9]]},"reference":[{"issue":"7","key":"963_CR1","doi-asserted-by":"publisher","first-page":"0130140","DOI":"10.1371\/journal.pone.0130140","volume":"10","author":"S Bach","year":"2015","unstructured":"Bach S, Binder A, Montavon G, Klauschen F, M\u00fcller K-R, Samek W (2015) On pixel-wise explanations for non-linear classifier decisions by layer-wise relevance propagation. PLOS ONE 10(7):0130140","journal-title":"PLOS ONE"},{"key":"963_CR2","unstructured":"Bastani O, Kim C, Bastani H (2017) Interpretability via model extraction. In: Proceedings of FAT ML, pp 57\u201361"},{"key":"963_CR3","unstructured":"Berant J, Chou A, Frostig R, Liang P (2013) Semantic parsing on freebase from question-answer pairs. In: Proceedings of EMNLP, pp 1533\u20131544"},{"key":"963_CR4","unstructured":"Bordes A, Usunier N, Garcia-Dur\u00e1n A, Weston J, Yakhnenko O (2013) Translating embeddings for modeling multi-relational data. In: Proceedings of NeurIPS, pp 2787\u20132795"},{"key":"963_CR5","doi-asserted-by":"crossref","unstructured":"Cao Y, Liu Z, Li C, Li J, Chua T-S (2019) Multi-channel graph neural network for entity alignment. In: Proceedings of ACL, pp 1452\u20131461","DOI":"10.18653\/v1\/P19-1140"},{"key":"963_CR6","doi-asserted-by":"crossref","unstructured":"Chefer H, Gur S, Wolf L (2021) Generic attention-model explainability for interpreting bi-modal and encoder-decoder transformers. In: Proceedings of ICCV, pp 397\u2013406","DOI":"10.1109\/ICCV48922.2021.00045"},{"key":"963_CR7","unstructured":"Chen J, Song L, Wainwright M, Jordan M (2018) Learning to explain: an information-theoretic perspective on model interpretation. In: Proceedings of ICML, pp 883\u2013892"},{"key":"963_CR8","doi-asserted-by":"crossref","unstructured":"Chen M, Tian Y, Chang K-W, Skiena S, Zaniolo C (2018) Co-training embeddings of knowledge graphs and entity descriptions for cross-lingual entity alignment. In: Proceedings of IJCAI, pp 3998\u20134004","DOI":"10.24963\/ijcai.2018\/556"},{"key":"963_CR9","doi-asserted-by":"crossref","unstructured":"Chen M, Tian Y, Yang M, Zaniolo C (2017) Multilingual knowledge graph embeddings for cross-lingual knowledge alignment. In: Proceedings of IJCAI, pp 1511\u20131517","DOI":"10.24963\/ijcai.2017\/209"},{"key":"963_CR10","unstructured":"Chen J, Zhu J, Song L (2018) Stochastic training of graph convolutional networks with variance reduction. In: Proceedings of ICML, pp 942\u2013950"},{"key":"963_CR11","doi-asserted-by":"crossref","unstructured":"Chiang W-L, Liu X, Si S, Li Y, Bengio S, Hsieh C-J (2019) Cluster-gcn: An efficient algorithm for training deep and large graph convolutional networks. In: Proceedings of KDD, pp 257\u2013266","DOI":"10.1145\/3292500.3330925"},{"key":"963_CR12","doi-asserted-by":"crossref","unstructured":"Cho K, van Merri\u00ebnboer B, Bahdanau D, Bengio Y (2014) On the properties of neural machine translation: encoder\u2013decoder approaches. In: Proceedings of the Workshop on Syntax, Semantics and Structure in Statistical Translation, pp 103\u2013111","DOI":"10.3115\/v1\/W14-4012"},{"key":"963_CR13","unstructured":"Dwivedi VP, Bresson X (2021) A generalization of transformer networks to graphs. In: Proceedings of AAAI"},{"key":"963_CR14","doi-asserted-by":"crossref","unstructured":"Ensan F, Bagheri E (2017) Document retrieval model through semantic linking. In: Proceedings of WSDM, pp 181\u2013190","DOI":"10.1145\/3018661.3018692"},{"key":"963_CR15","doi-asserted-by":"crossref","unstructured":"Fader A, Zettlemoyer L, Etzioni O (2014) Open question answering over curated and extracted knowledge bases. In: Proceedings of KDD, pp 1156\u20131165","DOI":"10.1145\/2623330.2623677"},{"key":"963_CR16","unstructured":"Fey M, Lenssen JE, Weichert F, Leskovec J (2021) GNNAutoScale: scalable and expressive graph neural networks via historical embeddings. In: Proceedings of ICML, pp 3294\u20133304"},{"issue":"1","key":"963_CR17","doi-asserted-by":"publisher","first-page":"359","DOI":"10.1137\/S1064827595287997","volume":"20","author":"G Karypis","year":"1998","unstructured":"Karypis G, Kumar V (1998) A fast and high quality multilevel scheme for partitioning irregular graphs. SIAM J Sci Comput 20(1):359\u2013392","journal-title":"SIAM J Sci Comput"},{"key":"963_CR18","unstructured":"Kipf TN, Welling M (2017) Semi-supervised classification with graph convolutional networks. In: Proceedings of ICLR"},{"key":"963_CR19","doi-asserted-by":"crossref","unstructured":"Kumar D, Wong A, Taylor GW (2017) Explaining the unexplained: A class-enhanced attentive response (clear) approach to understanding deep neural networks. In: Proceedings of CVPR, pp 36\u201344","DOI":"10.1109\/CVPRW.2017.215"},{"issue":"1","key":"963_CR20","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s41467-019-08987-4","volume":"10","author":"S Lapuschkin","year":"2019","unstructured":"Lapuschkin S, W\u00e4ldchen S, Binder A, Montavon G, Samek W, M\u00fcller K-R (2019) Unmasking clever hans predictors and assessing what machines really learn. Nat Commun 10(1):1\u20138","journal-title":"Nat Commun"},{"issue":"7553","key":"963_CR21","doi-asserted-by":"publisher","first-page":"436","DOI":"10.1038\/nature14539","volume":"521","author":"Y LeCun","year":"2015","unstructured":"LeCun Y, Bengio Y, Hinton G (2015) Deep learning. Nature 521(7553):436\u2013444","journal-title":"Nature"},{"key":"963_CR22","doi-asserted-by":"crossref","unstructured":"Li C, Cao Y, Hou L, Shi J, Li J, Chua T-S (2019) Semi-supervised entity alignment via joint knowledge embedding model and cross-graph model. In: Proceedings of EMNLP, pp 2723\u20132732","DOI":"10.18653\/v1\/D19-1274"},{"issue":"6","key":"963_CR23","doi-asserted-by":"publisher","first-page":"473","DOI":"10.1007\/s10791-015-9267-x","volume":"18","author":"X Liu","year":"2015","unstructured":"Liu X, Fang H (2015) Latent entity space: a novel retrieval approach for entity-bearing queries. Inform Retriev J 18(6):473\u2013503","journal-title":"Inform Retriev J"},{"key":"963_CR24","doi-asserted-by":"crossref","unstructured":"Liu Z, Cao Y, Pan L, Li J, Chua T-S (2020) Exploring and evaluating attributes, values, and structure for entity alignment. In: Proceedings of EMNLP, pp 6355\u20136364","DOI":"10.18653\/v1\/2020.emnlp-main.515"},{"key":"963_CR25","unstructured":"Liu G, Gifford D (2017) Visualizing feature maps in deep neural networks using deepresolve. a genomics case study. In: Proceedings of the ICML Workshop on Visualization for Deep Learning, pp 32\u201341"},{"key":"963_CR26","unstructured":"Lundberg SM, Lee S-I (2017) A unified approach to interpreting model predictions. In: Proceedings of NeurIPS, pp 4768\u20134777"},{"key":"963_CR27","unstructured":"Luo D, Cheng W, Xu D, Yu W, Zong B, Chen H, Zhang X (2020) Parameterized explainer for graph neural network. In: Proceedings of NeurIPS, pp 19620\u201319631"},{"key":"963_CR28","doi-asserted-by":"crossref","unstructured":"Mao X, Wang W, Xu H, Lan M, Wu Y (2020) Mraea: an efficient and robust entity alignment approach for cross-lingual knowledge graph. In: Proceedings of WSDM, pp 420\u2013428","DOI":"10.1145\/3336191.3371804"},{"key":"963_CR29","doi-asserted-by":"crossref","unstructured":"Nie H, Han X, Sun L, Wong CM, Chen Q, Wu S, Zhang W (2021) Global structure and local semantics-preserved embeddings for entity alignment. In: Proceedings of IJCAI, pp 3658\u20133664","DOI":"10.24963\/ijcai.2020\/506"},{"issue":"3","key":"963_CR30","doi-asserted-by":"publisher","first-page":"489","DOI":"10.3233\/SW-160218","volume":"8","author":"H Paulheim","year":"2017","unstructured":"Paulheim H (2017) Knowledge graph refinement: a survey of approaches and evaluation methods. Semantic web 8(3):489\u2013508","journal-title":"Semantic web"},{"key":"963_CR31","doi-asserted-by":"crossref","unstructured":"Pershina M, Yakout M, Chakrabarti K (2015) Holistic entity matching across knowledge graphs. In: Proceedings of Big Data, pp 1585\u20131590","DOI":"10.1109\/BigData.2015.7363924"},{"issue":"4","key":"963_CR32","doi-asserted-by":"publisher","first-page":"289","DOI":"10.1561\/1500000063","volume":"14","author":"R Reinanda","year":"2020","unstructured":"Reinanda R, Meij E, de Rijke M (2020) Knowledge graphs: an information retrieval perspective. Found Trends Inform Retriev 14(4):289\u2013444","journal-title":"Found Trends Inform Retriev"},{"key":"963_CR33","doi-asserted-by":"crossref","unstructured":"Ribeiro MT, Singh S, Guestrin C (2016) \u201cwhy should i trust you?\u201d: explaining the predictions of any classifier. In: Proceedings of KDD, pp 1135\u20131144","DOI":"10.1145\/2939672.2939778"},{"issue":"5","key":"963_CR34","doi-asserted-by":"publisher","first-page":"206","DOI":"10.1038\/s42256-019-0048-x","volume":"1","author":"C Rudin","year":"2019","unstructured":"Rudin C (2019) Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead. Nat Mach Intell 1(5):206\u2013215","journal-title":"Nat Mach Intell"},{"key":"963_CR35","doi-asserted-by":"crossref","unstructured":"Selvaraju RR, Cogswell M, Das A, Vedantam R, Parikh D, Batra D (2017) Grad-cam: Visual explanations from deep networks via gradient-based localization. In: Proceedings of ICCV, pp 618\u2013626","DOI":"10.1109\/ICCV.2017.74"},{"key":"963_CR36","unstructured":"Shrikumar A, Greenside P, Kundaje A (2017) Learning important features through propagating activation differences. In: Proceedings of ICML, pp 3145\u20133153"},{"issue":"4","key":"963_CR37","doi-asserted-by":"publisher","first-page":"333","DOI":"10.3233\/SW-2011-0052","volume":"3","author":"C Stadler","year":"2012","unstructured":"Stadler C, Lehmann J, Hoffner K, Auer S (2012) Linkedgeodata: a core for a web of spatial open data. Semantic Web 3(4):333\u2013354","journal-title":"Semantic Web"},{"key":"963_CR38","unstructured":"Sundararajan M, Taly A, Yan Q (2017) Axiomatic attribution for deep networks. In: Proceedings of ICML, pp 3319\u20133328"},{"key":"963_CR39","doi-asserted-by":"crossref","unstructured":"Sun Z, Huang J, Hu W, Chen M, Guo L, Qu Y (2019) Transedge: translating relation-contextualized embeddings for knowledge graphs. In: Proceedings of ISWC, pp 612\u2013629","DOI":"10.1007\/978-3-030-30793-6_35"},{"key":"963_CR40","doi-asserted-by":"crossref","unstructured":"Sun Z, Hu W, Li C (2017) Cross-lingual entity alignment via joint attribute-preserving embedding. In: Proceedings of ISWC, pp 628\u2013644","DOI":"10.1007\/978-3-319-68288-4_37"},{"key":"963_CR41","doi-asserted-by":"crossref","unstructured":"Sun Z, Hu W, Zhang Q, Qu Y (2018) Bootstrapping entity alignment with knowledge graph embedding. In: Proceedings of IJCAI, pp 4396\u20134402","DOI":"10.24963\/ijcai.2018\/611"},{"key":"963_CR42","doi-asserted-by":"crossref","unstructured":"Sun Z, Wang C, Hu W, Chen M, Dai J, Zhang W, Qu Y (2020) Knowledge graph alignment network with gated multi-hop neighborhood aggregation. In: Proceedings of AAAI, pp 222\u2013229","DOI":"10.1609\/aaai.v34i01.5354"},{"key":"963_CR43","doi-asserted-by":"crossref","unstructured":"Trisedya BD, Qi J, Zhang R (2019) Entity alignment between knowledge graphs using attribute embeddings. In: Proceedings of AAAI, pp 297\u2013304","DOI":"10.1609\/aaai.v33i01.3301297"},{"key":"963_CR44","unstructured":"Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, Kaiser \u0141, Polosukhin I (2017) Attention is all you need. In: Proceedings of NeurIPS, pp 5998\u20136008"},{"key":"963_CR45","unstructured":"Veli\u010dkovi\u0107 P, Cucurull G, Casanova A, Romero A, Li\u00f2 P, Bengio Y (2018) Graph attention networks. In: Proceedings of ICLR"},{"key":"963_CR46","doi-asserted-by":"crossref","unstructured":"Volz J, Bizer C, Gaedke M, Kobilarov G (2009) Discovering and maintaining links on the web of data. In: Proceedings of ISWC, pp 650\u2013665","DOI":"10.1007\/978-3-642-04930-9_41"},{"issue":"12","key":"963_CR47","doi-asserted-by":"publisher","first-page":"2724","DOI":"10.1109\/TKDE.2017.2754499","volume":"29","author":"Q Wang","year":"2017","unstructured":"Wang Q, Mao Z, Wang B, Guo L (2017) Knowledge graph embedding: a survey of approaches and applications. IEEE Trans Knowl Data Eng 29(12):2724\u20132743","journal-title":"IEEE Trans Knowl Data Eng"},{"key":"963_CR48","doi-asserted-by":"crossref","unstructured":"Wang Z, Lv Q, Lan X, Zhang Y (2018) Cross-lingual knowledge graph alignment via graph convolutional networks. In: Proceedings of EMNLP, pp 349\u2013357","DOI":"10.18653\/v1\/D18-1032"},{"key":"963_CR49","unstructured":"Wang Z, Yang J, Ye X Knowledge graph alignment with entity-pair embedding. In: Proceedings of EMNLP, pp 1672\u20131680"},{"key":"963_CR50","doi-asserted-by":"crossref","unstructured":"Wiegreffe S, Pinter Y (2019) Attention is not not explanation. In: Proceedings of EMNLP, pp 11\u201320","DOI":"10.18653\/v1\/D19-1002"},{"key":"963_CR51","doi-asserted-by":"crossref","unstructured":"Wu Y, Liu X, Feng Y, Wang Z, Zhao D (2019) Jointly learning entity and relation representations for entity alignment. In: Proceedings of EMNLP, pp 240\u2013249","DOI":"10.18653\/v1\/D19-1023"},{"key":"963_CR52","doi-asserted-by":"crossref","unstructured":"Wu Y, Liu X, Feng Y, Wang Z, Zhao D (2020) Neighborhood matching network for entity alignment. In: Proceedings of ACL, pp 6477\u20136487","DOI":"10.18653\/v1\/2020.acl-main.578"},{"key":"963_CR53","doi-asserted-by":"crossref","unstructured":"Xu K, Wang L, Yu M, Feng Y, Song Y, Wang Z, Yu D (2019) Cross-lingual knowledge graph alignment via graph matching neural network. In: Proceedings of ACL, pp 3156\u20133161","DOI":"10.18653\/v1\/P19-1304"},{"key":"963_CR54","doi-asserted-by":"crossref","unstructured":"Ye R, Li X, Fang Y, Zang H, Wang M (2019) A vectorized relational graph convolutional network for multi-relational network alignment. In: Proceedings of IJCAI, pp 4135\u20134141","DOI":"10.24963\/ijcai.2019\/574"},{"key":"963_CR55","unstructured":"Ying R, Bourgeois D, You J, Zitnik M, Leskovec J (2019) Gnnexplainer: generating explanations for graph neural networks. In: Proceedings of NeurIPS, pp 9240\u20139251"},{"key":"963_CR56","doi-asserted-by":"crossref","unstructured":"Zhang Q, Sun Z, Hu W, Chen M, Guo L, Qu Y (2019) Multi-view knowledge graph embedding for entity alignment. In: Proceedings of IJCAI, pp 5429\u20135435","DOI":"10.24963\/ijcai.2019\/754"},{"issue":"5","key":"963_CR57","doi-asserted-by":"publisher","first-page":"1143","DOI":"10.1007\/s00778-022-00747-z","volume":"31","author":"R Zhang","year":"2022","unstructured":"Zhang R, Trisedya BD, Li M, Jiang Y, Qi J (2022) A benchmark and comprehensive survey on knowledge graph entity alignment via representation learning. VLDB J 31(5):1143\u20131168","journal-title":"VLDB J"},{"key":"963_CR58","doi-asserted-by":"crossref","unstructured":"Zhang F, Yuan NJ, Lian D, Xie X, Ma W-Y (2016) Collaborative knowledge base embedding for recommender systems. In: Proceedings of KDD, pp 353\u2013362","DOI":"10.1145\/2939672.2939673"},{"key":"963_CR59","doi-asserted-by":"crossref","unstructured":"Zhao H, Yao Q, Li J, Song Y, Lee DL (2017) Meta-graph based recommendation fusion over heterogeneous information networks. In: Proceedings of KDD, pp. 635\u2013644","DOI":"10.1145\/3097983.3098063"},{"key":"963_CR60","doi-asserted-by":"crossref","unstructured":"Zhu H, Xie R, Liu Z, Sun M (2017) Iterative entity alignment via joint knowledge embeddings. In: Proceedings of IJCAI, pp 4258\u20134264","DOI":"10.24963\/ijcai.2017\/595"}],"container-title":["Data Mining and Knowledge Discovery"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10618-023-00963-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10618-023-00963-3\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10618-023-00963-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,10,13]],"date-time":"2023-10-13T09:22:42Z","timestamp":1697188962000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10618-023-00963-3"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,8,9]]},"references-count":60,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2023,11]]}},"alternative-id":["963"],"URL":"https:\/\/doi.org\/10.1007\/s10618-023-00963-3","relation":{},"ISSN":["1384-5810","1573-756X"],"issn-type":[{"value":"1384-5810","type":"print"},{"value":"1573-756X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,8,9]]},"assertion":[{"value":"28 November 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"12 July 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"9 August 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}