Abstract
Cross-lingual entity linking is the task of resolving ambiguous mentions in text to corresponding entities in knowledge base, where the query text and knowledge base are in different languages. Recent multilingual embedding based methods bring significant progress in this task. However, they still meet some potential problems: (1) They directly use multilingual embeddings obtained by cross-lingual mapping, which may bring noise and degrade the performance; (2) They also rely on the pre-trained fixed entity embeddings, which only carry limited information about entities. In this paper, we propose a cross-lingual entity linking framework with the help of more adaptive representations. For the first problem, we apply trainable adjusting matrices to fine-tune the semantic representations built from multilingual embeddings. For the second problem, we introduce attention mechanisms on entity descriptions to obtain dynamic entity representations, exploiting more clues about entity candidates according to the query mentions. Experiments on the TAC KBP 2015 Chinese-English cross-lingual entity linking dataset show that our model yields better performance than state-of-the-art models.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Bahdanau, D., Cho, K., Bengio, Y.: Neural Machine Translation by Jointly Learning to Align and Translate. arXiv:1409.0473 [cs, stat], September 2014
Cho, K., et al.: Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation. arXiv:1406.1078 [cs, stat], June 2014
Conneau, A., Lample, G., Ranzato, M., Denoyer, L., Jégou, H.: Word Translation Without Parallel Data. arXiv:1710.04087 [cs], October 2017
Faruqui, M., Dyer, C.: Improving vector space word representations using multilingual correlation. In: Proceedings of the 14th Conference of the European Chapter of the Association for Computational Linguistics, pp. 462–471. Association for Computational Linguistics, Gothenburg, Sweden (2014)
Ganea, O.E., Hofmann, T.: Deep Joint Entity Disambiguation with Local Neural Attention. arXiv:1704.04920 [cs], April 2017
Ji, H., Grishman, R., Dang, H.: Overview of the TAC 2011 knowledge base population track. In: Text Analysis Conference (TAC 2011), January 2011
Ji, H., Nothman, J., Hachey, B.: Overview of TAC-KBP2014 entity discovery and linking tasks. In: Text Analysis Conference (TAC 2014) (2014)
Ji, H., Nothman, J., Hachey, B., Florian, R.: Overview of TAC-KBP2015 tri-lingual entity discovery and linking. In: Text Analysis Conference (TAC 2015) (2015)
Luong, M.T., Pham, H., Manning, C.D.: Effective Approaches to Attention-based Neural Machine Translation. arXiv:1508.04025 [cs], August 2015
McNamee, P., Mayfield, J., Lawrie, D., Oard, D., Doermann, D.: Cross-language entity linking. In: Proceedings of 5th International Joint Conference on Natural Language Processing, pp. 255–263. Asian Federation of Natural Language Processing, Chiang Mai, Thailand, November 2011
Mikolov, T., Chen, K., Corrado, G., Dean, J.: Efficient Estimation of Word Representations in Vector Space. arXiv:1301.3781 [cs], January 2013
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., Dean, J.: Distributed Representations of Words and Phrases and their Compositionality. arXiv:1310.4546 [cs, stat], October 2013
Shen, W., Wang, J., Han, J.: Entity linking with a knowledge base: issues, techniques, and solutions. IEEE Trans. Knowl. Data Eng. 27(2), 443–460 (2015)
Sil, A., Florian, R.: One for All: Towards Language Independent Named Entity Linking. arXiv:1712.01797 [cs], December 2017
Sil, A., Kundu, G., Florian, R., Hamza, W.: Neural cross-lingual entity linking. In: Thirty-Second AAAI Conference on Artificial Intelligence, April 2018
Tsai, C.T., Roth, D.: Cross-lingual wikification using multilingual embeddings. In: Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pp. 589–598. Association for Computational Linguistics, San Diego (2016)
Wang, H., Zheng, J.G., Ma, X., Fox, P., Ji, H.: Language and domain independent entity linking with quantified collective validation. In: Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, pp. 695–704. Association for Computational Linguistics, Lisbon, September 2015
Yamada, I., Shindo, H., Takeda, H., Takefuji, Y.: Joint learning of the embedding of words and entities for named entity disambiguation. In: Proceedings of The 20th SIGNLL Conference on Computational Natural Language Learning, pp. 250–259. Association for Computational Linguistics, Berlin (2016)
Yamada, I., Shindo, H., Takeda, H., Takefuji, Y.: Learning Distributed Representations of Texts and Entities from Knowledge Base. arXiv:1705.02494 [cs], May 2017
Zhang, T., Liu, K., Zhao, J.: Cross lingual entity linking with bilingual topic model. In: Twenty-Third International Joint Conference on Artificial Intelligence (2013)
Acknowledgements
This work is supported by the National Natural Science Foundation of China (No. 61533018), the Natural Key R&D Program of China (No. 2017YFB1002101), the National Natural Science Foundation of China (No. 61806201, No. 61702512) and the independent research project of National Laboratory of Pattern Recognition. This work was also supported by Alibaba Group through Alibaba Innovative Research (AIR) Program and CCF-Tencent Open Research Fund.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Wang, C., Chen, Y., Liu, K., Zhao, J. (2019). Adaptive Multilingual Representations for Cross-Lingual Entity Linking with Attention on Entity Descriptions. In: Zhu, X., Qin, B., Zhu, X., Liu, M., Qian, L. (eds) Knowledge Graph and Semantic Computing: Knowledge Computing and Language Understanding. CCKS 2019. Communications in Computer and Information Science, vol 1134. Springer, Singapore. https://doi.org/10.1007/978-981-15-1956-7_1
Download citation
DOI: https://doi.org/10.1007/978-981-15-1956-7_1
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-15-1955-0
Online ISBN: 978-981-15-1956-7
eBook Packages: Computer ScienceComputer Science (R0)