PDF (9.2 MB)
Collect
Submit Manuscript
Open Access

Dual Context Representation Learning Framework for Entity Alignment

Zhejiang Key Laboratory of Intelligent Education Technology and Application, Zhejiang Normal University, Jinhua 321000, China
Department of Computer Science, University of Messina, Messina 98100, Italy
Show Author Information

Abstract

Entity alignment, which aims to identify entities with the same meaning in different Knowledge Graphs (KGs), is a key step in knowledge integration. Despite the promising results achieved by existing methods, they often fail to fully leverage the structure information of KGs for entity alignment. Therefore, our goal is to thoroughly explore the features of entity neighbors and relationships to obtain better entity embeddings. In this work, we propose DCEA, an effective dual-context representation learning framework for entity alignment. Specifically, the neighbor-level embedding module introduces relation information to more accurately aggregate neighbor context. The relation-level embedding module utilizes neighbor context to enhance relation-level embeddings. To eliminate semantic gaps between neighbor-level and relation-level embeddings, and fully exploit their complementarity, we design a hybrid embedding fusion model that adaptively performs embedding fusion to obtain powerful joint entity embeddings. We also jointly optimize the contrastive loss of multi-level embeddings, enhancing their mutual reinforcement while preserving the characteristics of neighbor and relation embeddings. Additionally, the decision fusion module combines the similarity scores calculated between entities based on embeddings at different levels to make the final alignment decision. Extensive experimental results on public datasets indicate that our DCEA performs better than state-of-the-art baselines.

References

[1]

S. A. Immanuel and C. Jeong, Lightweight recurrent cross-modal encoder for video question answering, Knowl. Based Syst., vol. 276, p. 110773, 2023.

[2]

L. Song, J. Li, J. Liu, Y. Yang, X. Shang, and M. Sun, Answering knowledge-based visual questions via the exploration of question purpose, Pattern Recognit., vol. 133, p. 109015, 2023.

[3]

J. Sohafi-Bonab, M. Hosseinzadeh Aghdam, and K. Majidzadeh, DCARS: Deep context-aware recommendation system based on session latent context, Appl. Soft Comput., vol. 143, p. 110416, 2023.

[4]

F. Yang, H. Xie, and H. Li, RETRACTED: Video associated cross-modal recommendation algorithm based on deep learning, Appl. Soft Comput., vol. 82, p. 105597, 2019.

[5]

M. Żelaszczyk and J. Mańdziuk, Cross-modal text and visual generation: A systematic review. Part 1: Image to text, Inf Fusion, vol. 93, pp. 302–329, 2023.

[6]

J. Nie, X. Huang, Y. Liu, C. Kong, X. Liu, L. Yang, and E. Yang, End-to-end hard constrained text generation via incrementally predicting segments, Knowl. Based Syst., vol. 278, p. 110886, 2023.

[7]
P. N. Mendes, M. Jakob, and C. Bizer, DBpedia: A multilingual cross-domain knowledge base, in Proc. 8th Int. Conf. Language Resources and Evaluation, Istanbul, Turkey, 2012, pp. 1813–1817.
[8]
F. M. Suchanek, G. Kasneci, and G. Weikum, Yago: A core of semantic knowledge, in Proc. 16th Int. Conf. World Wide Web, Banff, Canada, pp. 697–706.
[9]
K. Bollacker, C. Evans, P. Paritosh, T. Sturge, and J. Taylor, Freebase: A collaboratively created graph database for structuring human knowledge, in Proc. 2008 ACM SIGMOD Int. Conf. Management of Data, Vancouver, Canada, 2008, pp. 1247–1250.
[10]

Z. Sun, Q. Zhang, W. Hu, C. Wang, M. Chen, F. Akrami, and C. Li, A benchmarking study of embedding-based entity alignment for knowledge graphs, Proc. VLDB Endow., vol. 13, no. 12, pp. 2326–2340, 2020.

[11]

X. Zhao, W. Zeng, J. Tang, W. Wang, and F. M. Suchanek, An experimental study of state-of-the-art entity alignment approaches, IEEE Trans. Knowl. Data Eng., vol. 34, no. 6, pp. 2610–2625, 2022.

[12]

K. Zeng, C. Li, L. Hou, J. Li, and L. Feng, A comprehensive survey of entity alignment for knowledge graphs, AI Open, vol. 2, pp. 1–13, 2021.

[13]
Z. Wang, Q. Lv, X. Lan, and Y. Zhang, Cross-lingual knowledge graph alignment via graph convolutional networks, in Proc. 2018 Conf. Empirical Methods in Natural Language Processing, Brussels, Belgium, 2018, pp. 349–357.
[14]
T. N. Kipf and M. Welling, Semi-supervised classification with graph convolutional networks, arXiv preprint arXiv: 1609.02907, 2016.
[15]

Z. Sun, C. Wang, W. Hu, M. Chen, J. Dai, W. Zhang, and Y. Qu, Knowledge graph alignment network with gated multi-hop neighborhood aggregation, Proc. AAAI Conf. Artif. Intell., vol. 34, no. 1, pp. 222–229, 2020.

[16]
P. Veličković, G. Cucurull, A. Casanova, A. Romero, P. Lio, and Y. Bengio, Graph attention networks, arXiv preprint arXiv: 1710.10903v3, 2018.
[17]
R. Zhu, M. Ma, and P. Wang, RAGA: Relation-aware graph attention networks for global entity alignment, in Proc. Advances in Knowledge Discovery and Data Mining, K. Karlapalem, H. Cheng, N. Ramakrishnan, R. K. Agrawal, P. K. Reddy, J. Srivastava, and T. Chakraborty, eds. Cham, Switzerland: Springer, 2021, pp. 501–513.
[18]
K. Xin, Z. Sun, W. Hua, W. Hu, and X. Zhou, Informed multi-context entity alignment, in Proc. 15th ACM Int. Conf. Web Search and Data Mining, Virtual Event, 2022, pp. 1197–1205.
[19]
F. Xie, X. Zeng, B. Zhou, and Y. Tan, Improving knowledge graph entity alignment with graph augmentation, in Advances in Knowledge Discovery and Data Mining, H. Kashima, T. Ide, and W. C. Peng, eds. Cham, Switzerland: Springer, 2023, pp. 3–14.
[20]

L. Zhang, Z. Li, Y. Li, S. Wu, and T. Chen, Entity alignment with global information aggregation, Electronics, vol. 13, no. 12, p. 2331, 2024.

[21]

Z. Sun, W. Hu, C. Wang, Y. Wang, and Y. Qu, Revisiting embedding-based entity alignment: A robust and adaptive method, IEEE Trans. Knowl. Data Eng., vol. 35, no. 8, pp. 8461–8475, 2023.

[22]
W. Tang, F. Su, H. Sun, Q. Qi, J. Wang, S. Tao, and H. Yang, Weakly supervised entity alignment with positional inspiration, in Proc. 16th ACM Int. Conf. Web Search and Data Mining, Singapore, 2023, pp. 814–822.
[23]
B. Liu, T. Lan, W. Hua, and G. Zuccon, Dependency-aware self-training for entity alignment, in Proc. 16th ACM Int. Conf. Web Search and Data Mining, Singapore, 2023, pp. 796–804.
[24]

W. Cai, W. Ma, L. Wei, and Y. Jiang, Semi-supervised entity alignment via relation-based adaptive neighborhood matching, IEEE Trans. Knowl. Data Eng., vol. 35, no. 8, pp. 8545–8558, 2023.

[25]
X. Liu, J. Wu, T. Li, L. Chen, and Y. Gao, Unsupervised entity alignment for temporal knowledge graphs, in Proc. ACM Web Conf. 2023, Austin, TX, USA, 2023, pp. 2528–2538.
[26]
S. Liang, Knowledge graph embedding based on graph neural network, in Proc. IEEE 39th Int. Conf. Data Engineering (ICDE), Anaheim, CA, USA, 2023, pp. 3908–3912.
[27]

Z. Cao, Q. Xu, Z. Yang, X. Cao, and Q. Huang, Geometry interaction knowledge graph embeddings, Proc. AAAI Conf. Artif. Intell., vol. 36, no. 5, pp. 5521–5529, 2022.

[28]
M. Chen, Y. Tian, M. Yang, and C. Zaniolo, Multilingual knowledge graph embeddings for cross-lingual knowledge alignment, in Proc. 26th Int. Joint Conf. Artificial Intelligence, Melbourne, Australia, 2017, pp. 1511–1517.
[29]
H. Zhu, R. Xie, Z. Liu, and M. Sun, Iterative entity alignment via joint knowledge embeddings, in Proc. 26th Int. Joint Conf. Artificial Intelligence, Melbourne, Australia, 2017, pp. 4258–4264.
[30]
Z. Sun, W. Hu, Q. Zhang, and Y. Qu, Bootstrapping entity alignment with knowledge graph embedding, in Proc. 27th Int. Joint Conf. Artificial Intelligence, Stockholm, Sweden, 2018, pp. 4396–4402.
[31]
S. Pei, L. Yu, R. Hoehndorf, and X. Zhang, Semi-supervised entity alignment via knowledge graph embedding with awareness of degree difference, in Proc. World Wide Web Conference, San Francisco, CA, USA, 2019, pp. 3130–3136.
[32]
A. Bordes, N. Usunier, A. Garcia-Duran, J. Weston, and O. Yakhnenko, Translating embeddings for modeling multi-relational data, in Proc. 26th Int. Conf. Neural Information Processing Systems, Lake Tahoe, NV, USA, 2013, pp. 2787–2795.
[33]
M. Chen, Y. Tian, K. W. Chang, S. Skiena, and C. Zaniolo, Co-training embeddings of knowledge graphs and entity descriptions for cross-lingual entity alignment, in Proc. 27th Int. Joint Conf. Artificial Intelligence, Stockholm, Sweden, 2018, pp. 3998–4004.
[34]
Z. Sun, W. Hu, and C. Li, Cross-lingual entity alignment via joint attribute-preserving embedding, in The Semantic Web—ISWC 2017, C. d’Amato, M. Fernandez, V. Tamma, F. Lecue, P. Cudré-Mauroux, J. Sequeda, C. Lange, and J. Heflin, eds. Cham, Switzerland: Springer, 2017, pp. 628–644.
[35]

B. D. Trisedya, J. Qi, and R. Zhang, Entity alignment between knowledge graphs using attribute embeddings, Proc. AAAI Conf. Artif. Intell., vol. 33, no. 1, pp. 297–304, 2019.

[36]
Q. Zhang, Z. Sun, W. Hu, M. Chen, L. Guo, and Y. Qu, Multi-view knowledge graph embedding for entity alignment, in Proc. 28th Int. Joint Conf. Artificial Intelligence, Macao, China, 2019, pp. 5429–5435.
[37]
K. Xu, L. Wang, M. Yu, Y. Feng, Y. Song, Z. Wang, and D. Yu, Cross-lingual knowledge graph alignment via graph matching neural network, in Proc. 57th Annual Meeting of the Association for Computational Linguistics, Florence, Italy, 2019, pp. 3156–3161.
[38]
Y. Cao, Z. Liu, C. Li, Z. Liu, J. Li, and T. S. Chua, Multi-channel graph neural network for entity alignment, in Proc. 57th Annual Meeting of the Association for Computational Linguistics, Florence, Italy, 2019, pp. 1452–1461.
[39]
Y. Wu, X. Liu, Y. Feng, Z. Wang, R. Yan, and D. Zhao, Relation-aware entity alignment for heterogeneous knowledge graphs, in Proc. 28th Int. Joint Conf. Artificial Intelligence, Macao, China, 2019, pp. 5278–5284.
[40]
Q. Zhu, X. Zhou, J. Wu, J. Tan, and L. Guo, Neighborhood-aware attentional representation for multilingual knowledge graphs, in Proc. 28th Int. Joint Conf. Artificial Intelligence, Macao, China, 2019, pp. 1943–1949.
[41]
R. Ye, X. Li, Y. Fang, H. Zang, and M. Wang, A vectorized relational graph convolutional network for multi-relational network alignment, in Proc. 28th Int. Joint Conf. Artificial Intelligence, Macao, China, 2019, pp. 4135–4141.
[42]
X. Mao, W. Wang, H. Xu, M. Lan, and Y. Wu, MRAEA: An efficient and robust entity alignment approach for cross-lingual knowledge graph, in Proc. 13th Int. Conf. Web Search and Data Mining, Houston, TX, USA, 2020, pp. 420–428.
[43]
Q. Zhu, H. Wei, B. Sisman, D. Zheng, C. Faloutsos, X. L. Dong, and J. Han, Collective multi-type entity alignment between knowledge graphs, in Proc. The Web Conf. 2020, Taipei, China, 2020, pp. 2241–2252.
[44]
Y. Wu, X. Liu, Y. Feng, Z. Wang, and D. Zhao, Neighborhood matching network for entity alignment, in Proc. 58th Annual Meeting of the Association for Computational Linguistics, Virtual Event, 2020, pp. 6477–6487.
[45]
Y. Wu, X. Liu, Y. Feng, Z. Wang, and D. Zhao, Jointly learning entity and relation representations for entity alignment, in Proc. 2019 Conf. Empirical Methods in Natural Language Processing and the 9th Int. Joint Conf. Natural Language Processing (EMNLP-IJCNLP), Hong Kong, China, 2019, pp. 240–249.
[46]
X. Mao, W. Wang, H. Xu, Y. Wu, and M. Lan, Relational reflection entity alignment, in Proc. 29th ACM Int. Conf. Information & Knowledge Management, Virtual Event, 2020, pp. 1095–1104.
[47]
B. Chen, J. Zhang, X. Tang, H. Chen, and C. Li, JarKA: Modeling attribute interactions for cross-lingual knowledge alignment, in Advances in Knowledge Discovery and Data Mining, H. W. Lauw, R. C. W. Wong, A. Ntoulas, E. P. Lim, S. K. Ng, and S. J. Pan, eds. Cham, Switzerland: Springer, 2020, pp. 845–856.
[48]
H. W. Yang, Y. Zou, P. Shi, W. Lu, J. Lin, and X. Sun, Aligning cross-lingual entities with multi-aspect information, in Proc. 2019 Conf. Empirical Methods in Natural Language Processing and the 9th Int. Joint Conf. Natural Language Processing (EMNLP-IJCNLP), Hong Kong, China, 2019, pp. 4431–4441.
[49]

K. Yang, S. Liu, J. Zhao, Y. Wang, and B. Xie, COTSAE: CO-training of structure and attribute embeddings for entity alignment, Proc. AAAI Conf. Artif. Intell., vol. 34, no. 3, pp. 3025–3032, 2020.

[50]
X. Tang, J. Zhang, B. Chen, Y. Yang, H. Chen, and C. Li, BERT-INT: A BERT-based interaction model for knowledge graph alignment, in Proc. 29th Int. Joint Conf. Artificial Intelligence, Yokohama, Japan, 2020, pp. 3174–3180.
[51]
Z. Liu, Y. Cao, L. Pan, J. Li, Z. Liu, and T. S. Chua, Exploring and evaluating attributes, values, and structures for entity alignment, in Proc. 2020 Conf. Empirical Methods in Natural Language Processing (EMNLP), Virtual Event, 2020, pp. 6355–6364.
[52]
Z. Zhong, M. Zhang, J. Fan, and C. Dou, Semantics driven embedding learning for effective entity alignment, in Proc. IEEE 38th Int. Conf. Data Engineering (ICDE), Kuala Lumpur, Malaysia, 2022, pp. 2127–2140.
[53]
A. Jaiswal, A. R. Babu, M. Z. Zadeh, D. Banerjee, and F. Makedon, A survey on contrastive self-supervised learning, arXiv preprint arXiv: 2011.00362, 2020.
[54]
T. Chen, S. Kornblith, M. Norouzi, and G. Hinton, A simple framework for contrastive learning of visual representations, arXiv preprint arXiv: 2002.05709v2, 2020.
[55]
K. He, H. Fan, Y. Wu, S. Xie, and R. Girshick, Momentum contrast for unsupervised visual representation learning, in Proc. IEEE/CVF Conf. Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA, 2020, pp. 9726–9735.
[56]
R. Cipolla, Y. Gal, and A. Kendall, Multi-task learning using uncertainty to weigh losses for scene geometry and semantics, in Proc. IEEE/CVF Conf. Computer Vision and Pattern Recognition, Salt Lake City, UT, USA, 2018, pp. 7482–7491.
[57]
C. Li, Y. Cao, L. Hou, J. Shi, J. Li, and T. S. Chua, Semi-supervised entity alignment via joint knowledge embedding model and cross-graph model, in Proc. 2019 Conf. Empirical Methods in Natural Language Processing and the 9th Int. Joint Conf. Natural Language Processing (EMNLP-IJCNLP), Hong Kong, China, 2019, pp. 2723–2732.
[58]
X. Liu, K. Zhang, Y. Liu, E. Chen, Z. Huang, L. Yue, and J. Yan, RHGN: Relation-gated heterogeneous graph network for entity alignment in knowledge graphs, in Proc. Findings of the Association for Computational Linguistics : ACL 2023, Toronto, Canada, 2023, pp. 8683–8696.
[59]
W. Zeng, X. Zhao, J. Tang, and X. Lin, Collective entity alignment via adaptive features, in Proc. IEEE 36th Int. Conf. Data Engineering (ICDE), Dallas, TX, USA, 2020, pp. 1870–1873.
Big Data Mining and Analytics
Pages 346-363
Cite this article:
Cheng B, Zhu J, De Meo P. Dual Context Representation Learning Framework for Entity Alignment. Big Data Mining and Analytics, 2025, 8(2): 346-363. https://doi.org/10.26599/BDMA.2024.9020082
Metrics & Citations  
Article History
Copyright
Rights and Permissions
Return