{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,2,21]],"date-time":"2025-02-21T14:56:49Z","timestamp":1740149809535,"version":"3.37.3"},"reference-count":46,"publisher":"MDPI AG","issue":"10","license":[{"start":{"date-parts":[[2023,10,21]],"date-time":"2023-10-21T00:00:00Z","timestamp":1697846400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"Link prediction remains paramount in knowledge graph embedding (KGE), aiming to discern obscured or non-manifest relationships within a given knowledge graph (KG). Despite the critical nature of this endeavor, contemporary methodologies grapple with notable constraints, predominantly in terms of computational overhead and the intricacy of encapsulating multifaceted relationships. This paper introduces a sophisticated approach that amalgamates convolutional operators with pertinent graph structural information. By meticulously integrating information pertinent to entities and their immediate relational neighbors, we enhance the performance of the convolutional model, culminating in an averaged embedding ensuing from the convolution across entities and their proximal nodes. Significantly, our methodology presents a distinctive avenue, facilitating the inclusion of edge-specific data into the convolutional model\u2019s input, thus endowing users with the latitude to calibrate the model\u2019s architecture and parameters congruent with their specific dataset. Empirical evaluations underscore the ascendancy of our proposition over extant convolution-based link prediction benchmarks, particularly evident across the FB15k, WN18, and YAGO3-10 datasets. The primary objective of this research lies in forging KGE link prediction methodologies imbued with heightened efficiency and adeptness, thereby addressing salient challenges inherent to real-world applications.<\/jats:p>","DOI":"10.3390\/e25101472","type":"journal-article","created":{"date-parts":[[2023,10,21]],"date-time":"2023-10-21T16:59:01Z","timestamp":1697907541000},"page":"1472","source":"Crossref","is-referenced-by-count":2,"title":["Convolutional Models with Multi-Feature Fusion for Effective Link Prediction in Knowledge Graph Embedding"],"prefix":"10.3390","volume":"25","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1552-9033","authenticated-orcid":false,"given":"Qinglang","family":"Guo","sequence":"first","affiliation":[{"name":"School of Cyber Science and Technology, University of Science and Technology of China, Heifei 230027, China"},{"name":"National Engineering Research Center for Public Safety Risk Perception and Control by Big Data (RPP), CETC Academy of Electronics and Information Technology Group Co., Ltd., China Academic of Electronics and Information Technology, Beijing 100041, China"}]},{"given":"Yong","family":"Liao","sequence":"additional","affiliation":[{"name":"School of Cyber Science and Technology, University of Science and Technology of China, Heifei 230027, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0519-7434","authenticated-orcid":false,"given":"Zhe","family":"Li","sequence":"additional","affiliation":[{"name":"Department of Electrical and Electronic Engineering, The Hong Kong Polytechnic University, Hong Kong SAR, China"}]},{"given":"Hui","family":"Lin","sequence":"additional","affiliation":[{"name":"National Engineering Research Center for Public Safety Risk Perception and Control by Big Data (RPP), CETC Academy of Electronics and Information Technology Group Co., Ltd., China Academic of Electronics and Information Technology, Beijing 100041, China"}]},{"given":"Shenglin","family":"Liang","sequence":"additional","affiliation":[{"name":"School of Telecommunications Engineering, Xidian University, Xi\u2019an 710071, China"}]}],"member":"1968","published-online":{"date-parts":[[2023,10,21]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"124289","DOI":"10.1016\/j.physa.2020.124289","article-title":"Link prediction techniques, applications, and performance: A survey","volume":"553","author":"Kumar","year":"2020","journal-title":"Phys. Stat. Mech. Appl."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"2724","DOI":"10.1109\/TKDE.2017.2754499","article-title":"Knowledge graph embedding: A survey of approaches and applications","volume":"29","author":"Wang","year":"2017","journal-title":"IEEE Trans. Knowl. Data Eng."},{"doi-asserted-by":"crossref","unstructured":"Yu, Q., Li, Z., Sheng, J., Sun, J., and Slamu, W. (2020, January 10\u201312). YuQ: A Chinese-Uyghur Medical-Domain Neural Machine Translation Dataset Towards Knowledge-Driven. Proceedings of the Machine Translation: 16th China Conference, CCMT 2020, Hohhot, China. Revised Selected Papers 16.","key":"ref_3","DOI":"10.1007\/978-981-33-6162-1_4"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"10981","DOI":"10.1109\/TKDE.2022.3233481","article-title":"A Multi-type Transferable Method for Missing Link Prediction in Heterogeneous Social Networks","volume":"35","author":"Wang","year":"2023","journal-title":"IEEE Trans. Knowl. Data Eng."},{"doi-asserted-by":"crossref","unstructured":"Ke, Z., Li, Z., Zhou, C., Sheng, J., Silamu, W., and Guo, Q. (2020). Rumor detection on social media via fused semantic information and a propagation heterogeneous graph. Symmetry, 12.","key":"ref_5","DOI":"10.3390\/sym12111806"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"3570","DOI":"10.1109\/ACCESS.2020.3048088","article-title":"Knowledge-guided sentiment analysis via learning from natural language explanations","volume":"9","author":"Ke","year":"2021","journal-title":"IEEE Access"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"125154","DOI":"10.1016\/j.physa.2020.125154","article-title":"Link prediction in recommender systems based on vector similarity","volume":"560","author":"Su","year":"2020","journal-title":"Phys. Stat. Mech. Appl."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"3071","DOI":"10.1007\/s13042-023-01821-w","article-title":"Recommendation model based on multi-grained interaction that fuses users\u2019 dynamic interests","volume":"14","author":"Yang","year":"2023","journal-title":"Int. J. Mach. Learn. Cybern."},{"doi-asserted-by":"crossref","unstructured":"Zheng, K., Zhang, X.L., Wang, L., You, Z.H., Ji, B.Y., Liang, X., and Li, Z.W. (2023). SPRDA: A link prediction approach based on the structural perturbation to infer disease-associated Piwi-interacting RNAs. Briefings Bioinform., 24.","key":"ref_9","DOI":"10.1093\/bib\/bbac498"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"110124","DOI":"10.1016\/j.knosys.2022.110124","article-title":"Self-attention presents low-dimensional knowledge graph embeddings for link prediction","volume":"260","author":"Baghershahi","year":"2023","journal-title":"Knowl.-Based Syst."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"e7817","DOI":"10.1002\/cpe.7817","article-title":"Query cost estimation in graph databases via emphasizing query dependencies by using a neural reasoning network","volume":"35","author":"He","year":"2023","journal-title":"Concurr. Comput. Pract. Exp."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"148489","DOI":"10.1109\/ACCESS.2020.3015854","article-title":"AgglutiFiT: Efficient low-resource agglutinative language model fine-tuning","volume":"8","author":"Li","year":"2020","journal-title":"IEEE Access"},{"unstructured":"Li, X., Li, Z., Sheng, J., and Slamu, W. (November, January 30). Low-resource text classification via cross-lingual language model fine-tuning. Proceedings of the China National Conference on Chinese Computational Linguistics, Hainan, China.","key":"ref_13"},{"doi-asserted-by":"crossref","unstructured":"Li, Z., Maimaiti, M., Sheng, J., Ke, Z., Silamu, W., Wang, Q., and Li, X. (2020). An empirical study on deep neural network models for chinese dialogue generation. Symmetry, 12.","key":"ref_14","DOI":"10.3390\/sym12111756"},{"doi-asserted-by":"crossref","unstructured":"Sheng, J., Wumaier, A., and Li, Z. (2020). Poise: Efficient cross-domain Chinese named entity recognization via transfer learning. Symmetry, 12.","key":"ref_15","DOI":"10.3390\/sym12101673"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"119164","DOI":"10.1016\/j.eswa.2022.119164","article-title":"Semi-supervised learning with graph convolutional extreme learning machines","volume":"213","author":"Zhang","year":"2023","journal-title":"Expert Syst. Appl."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"118841","DOI":"10.1016\/j.eswa.2022.118841","article-title":"Heterogeneous deep graph convolutional network with citation relational BERT for COVID-19 inline citation recommendation","volume":"213","author":"Dai","year":"2023","journal-title":"Expert Syst. Appl."},{"unstructured":"Kamigaito, H., and Hayashi, K. (2022, January 17\u201323). Comprehensive analysis of negative sampling in knowledge graph representation learning. Proceedings of the International Conference on Machine Learning. PMLR, Baltimore, MA, USA.","key":"ref_18"},{"doi-asserted-by":"crossref","unstructured":"Yang, Z., Ding, M., Zhou, C., Yang, H., Zhou, J., and Tang, J. (2020, January 6\u201310). Understanding negative sampling in graph representation learning. Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, Virtual.","key":"ref_19","DOI":"10.1145\/3394486.3403218"},{"doi-asserted-by":"crossref","unstructured":"Chen, X., Jiang, J.Y., and Wang, W. (2022, January 17\u201321). Scalable Graph Representation Learning via Locality-Sensitive Hashing. Proceedings of the 31st ACM International Conference on Information & Knowledge Management, Atlanta, GA, USA.","key":"ref_20","DOI":"10.1145\/3511808.3557689"},{"doi-asserted-by":"crossref","unstructured":"Wang, M., Qiu, L., and Wang, X. (2021). A survey on knowledge graph embeddings for link prediction. Symmetry, 13.","key":"ref_21","DOI":"10.3390\/sym13030485"},{"unstructured":"Yang, B., Yih, S.W.t., He, X., Gao, J., and Deng, L. (2015, January 7\u20139). Embedding Entities and Relations for Learning and Inference in Knowledge Bases. Proceedings of the International Conference on Learning Representations (ICLR) 2015, San Diego, CA, USA.","key":"ref_22"},{"unstructured":"Trouillon, T., Welbl, J., Riedel, S., Gaussier, \u00c9., and Bouchard, G. (2016, January 20\u201322). Complex embeddings for simple link prediction. Proceedings of the International Conference on Machine Learning. PMLR, New York, NY, USA.","key":"ref_23"},{"unstructured":"Trivedi, R., Dai, H., Wang, Y., and Song, L. (2017, January 6\u201311). Know-evolve: Deep temporal reasoning for dynamic knowledge graphs. Proceedings of the International Conference on Machine Learning. PMLR, Sydney, Australia.","key":"ref_24"},{"doi-asserted-by":"crossref","unstructured":"Pareja, A., Domeniconi, G., Chen, J., Ma, T., Suzumura, T., Kanezashi, H., Kaler, T., Schardl, T., and Leiserson, C. (2020, January 7\u201312). Evolvegcn: Evolving graph convolutional networks for dynamic graphs. Proceedings of the AAAI Conference on Artificial Intelligence, New York, NY, USA.","key":"ref_25","DOI":"10.1609\/aaai.v34i04.5984"},{"doi-asserted-by":"crossref","unstructured":"Nickel, M., Rosasco, L., and Poggio, T. (2016, January 12\u201317). Holographic embeddings of knowledge graphs. Proceedings of the AAAI Conference on Artificial Intelligence, Phoenix, AZ, USA.","key":"ref_26","DOI":"10.1609\/aaai.v30i1.10314"},{"unstructured":"Tan, M., and Le, Q. (2019, January 9\u201315). Efficientnet: Rethinking model scaling for convolutional neural networks. Proceedings of the International Conference on Machine Learning. PMLR, Long Beach, CA, USA.","key":"ref_27"},{"doi-asserted-by":"crossref","unstructured":"Liu, Z., Mao, H., Wu, C.Y., Feichtenhofer, C., Darrell, T., and Xie, S. (2022, January 18\u201324). A convnet for the 2020s. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.","key":"ref_28","DOI":"10.1109\/CVPR52688.2022.01167"},{"doi-asserted-by":"crossref","unstructured":"Dettmers, T., Minervini, P., Stenetorp, P., and Riedel, S. (2018, January 2\u20137). Convolutional 2d knowledge graph embeddings. Proceedings of the AAAI Conference on Artificial Intelligence, New Orleans, LA, USA.","key":"ref_29","DOI":"10.1609\/aaai.v32i1.11573"},{"unstructured":"Liu, Z. (2022). Knowledge Graph Embedding with Graph Convolutional Networks and Attention Mechanisms. arXiv.","key":"ref_30"},{"doi-asserted-by":"crossref","unstructured":"Zhang, Y. (2022). Hierarchical Graph Convolutional Networks for Knowledge Graph Embeddings. arXiv.","key":"ref_31","DOI":"10.1145\/3485447.3511923"},{"doi-asserted-by":"crossref","unstructured":"Li, L., and Wang, Z. (2023). Knowledge Relation Rank Enhanced Heterogeneous Learning Interaction Modeling for Neural Graph Forgetting Knowledge Tracing. arXiv.","key":"ref_32","DOI":"10.1371\/journal.pone.0295808"},{"unstructured":"Kikuta, D., Suzumura, T., Rahman, M.M., Hirate, Y., Abrol, S., Kondapaka, M., Ebisu, T., and Loyola, P. (2022). KQGC: Knowledge Graph Embedding with Smoothing Effects of Graph Convolutions for Recommendation. arXiv.","key":"ref_33"},{"unstructured":"Wang, J. (2022). Knowledge Graph Embeddings with Conv2D Layers. arXiv.","key":"ref_34"},{"unstructured":"Liu, H. (2022). Graph Neural Networks for Knowledge Graph Embeddings with Convolutional Layers. arXiv.","key":"ref_35"},{"doi-asserted-by":"crossref","unstructured":"Zhang, X., Wen, S., Yan, L., Feng, J., and Xia, Y. (2022). A hybrid-convolution spatial\u2013temporal recurrent network for traffic flow prediction. Comput. J., bxac171.","key":"ref_36","DOI":"10.1093\/comjnl\/bxac171"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"3607","DOI":"10.1109\/TKDE.2020.2970044","article-title":"Modeling relation paths for knowledge graph completion","volume":"33","author":"Shen","year":"2020","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"54","DOI":"10.1007\/s44196-023-00233-6","article-title":"Multiscale feature extraction and fusion of image and text in VQA","volume":"16","author":"Lu","year":"2023","journal-title":"Int. J. Comput. Intell. Syst."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"83","DOI":"10.1016\/j.comcom.2022.02.002","article-title":"Path extension similarity link prediction method based on matrix algebra in directed networks","volume":"187","author":"Guo","year":"2022","journal-title":"Comput. Commun."},{"doi-asserted-by":"crossref","unstructured":"Wu, D., He, Y., and Luo, X. (2023). A Graph-Incorporated Latent Factor Analysis Model for High-Dimensional and Sparse Data. IEEE Trans. Emerg. Top. Comput., 1\u201312.","key":"ref_40","DOI":"10.1109\/TETC.2023.3292866"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"802","DOI":"10.1109\/TSC.2022.3178543","article-title":"A double-space and double-norm ensembled latent factor model for highly accurate web service QoS prediction","volume":"16","author":"Wu","year":"2022","journal-title":"IEEE Trans. Serv. Comput."},{"unstructured":"Bordes, A., Usunier, N., Garcia-Duran, A., Weston, J., and Yakhnenko, O. (2013). Translating embeddings for modeling multi-relational data. Adv. Neural Inf. Process. Syst., 26.","key":"ref_42"},{"unstructured":"Mahdisoltani, F., Biega, J., and Suchanek, F. (2014, January 4\u20137). Yago3: A knowledge base from multilingual wikipedias. Proceedings of the 7th Biennial Conference on Innovative Data Systems Research. CIDR Conference, Asilomar, CA, USA.","key":"ref_43"},{"unstructured":"Niepert, M. (2016). Discriminative gaifman models. arXiv.","key":"ref_44"},{"unstructured":"Liu, H., Wu, Y., and Yang, Y. (2017, January 6\u201311). Analogical inference for multi-relational embeddings. Proceedings of the International Conference on Machine Learning. PMLR, Sydney, NSW, Australia.","key":"ref_45"},{"doi-asserted-by":"crossref","unstructured":"Schlichtkrull, M., Kipf, T.N., Bloem, P., Van Den Berg, R., Titov, I., and Welling, M. (2018, January 3\u20137). Modeling relational data with graph convolutional networks. Proceedings of the Semantic Web: 15th International Conference, ESWC 2018, Heraklion, Crete, Greece. Proceedings 15.","key":"ref_46","DOI":"10.1007\/978-3-319-93417-4_38"}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/25\/10\/1472\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,12,24]],"date-time":"2023-12-24T15:02:28Z","timestamp":1703430148000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/25\/10\/1472"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,10,21]]},"references-count":46,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2023,10]]}},"alternative-id":["e25101472"],"URL":"https:\/\/doi.org\/10.3390\/e25101472","relation":{},"ISSN":["1099-4300"],"issn-type":[{"type":"electronic","value":"1099-4300"}],"subject":[],"published":{"date-parts":[[2023,10,21]]}}}