AI Chat Paper
Note: Please note that the following content is generated by AMiner AI. SciOpen does not take any responsibility related to this content.
{{lang === 'zh_CN' ? '文章概述' : 'Summary'}}
{{lang === 'en_US' ? '中' : 'Eng'}}
Chat more with AI
PDF (16.4 MB)
Collect
Submit Manuscript AI Chat Paper
Show Outline
Outline
Show full outline
Hide outline
Outline
Show full outline
Hide outline
Open Access

Node and Edge Joint Embedding for Heterogeneous Information Network

School of Information and Electrical Engineering, Hunan University of Science and Technology, Xiangtan 411201, China
Changde Water Meter Manufacture Co. Ltd., Changde 415000, China
Show Author Information

Abstract

Due to the heterogeneity of nodes and edges, heterogeneous network embedding is a very challenging task to embed highly coupled networks into a set of low-dimensional vectors. Existing models either only learn embedding vectors for nodes or only for edges. These two methods of embedding learning are rarely performed in the same model, and they both overlook the internal correlation between nodes and edges. To solve these problems, a node and edge joint embedding model is proposed for Heterogeneous Information Networks (HINs), called NEJE. The NEJE model can better capture the latent structural and semantic information from an HIN through two joint learning strategies: type-level joint learning and element-level joint learning. Firstly, node-type-aware structure learning and edge-type-aware semantic learning are sequentially performed on the original network and its line graph to get the initial embedding of nodes and the embedding of edges. Then, to optimize performance, type-level joint learning is performed through the alternating training of node embedding on the original network and edge embedding on the line graph. Finally, a new homogeneous network is constructed from the original heterogeneous network, and the graph attention model is further used on the new network to perform element-level joint learning. Experiments on three tasks and five public datasets show that our NEJE model performance improves by about 2.83% over other models, and even improves by 6.42% on average for the node clustering task on Digital Bibliography & Library Project (DBLP) dataset.

References

[1]

X. Wang, D. Bo, C. Shi, S. Fan, Y. Ye, and P. S. Yu, A survey on heterogeneous graph embedding: Methods, techniques, applications and sources, IEEE Trans. Big Data, vol. 9, no. 2, pp. 415–436, 2023.

[2]
Y. Dong, Z. Hu, K. Wang, Y. Sun, and J. Tang, Heterogeneous network representation learning, in Proc. of the Twenty-Ninth International Joint Conference on Artificial Intelligence, Yokohama, Japan, 2021, pp. 4861–4867.
[3]

R. Wang, Y. Liu, and J. Chen, Network representation learning algorithm combined with node text information, J. Phys.: Conf. Ser., vol. 1769, no. 1, p. 012054, 2021.

[4]

Y. Xie, B. Yu, S. Lv, C. Zhang, G. Wang, and M. Gong, A survey on heterogeneous network representation learning, Pattern recognition, vol. 116, p. 107936, 2021.

[5]

L. Chen, Y. Li, X. Deng, Z. Liu, M. Lv, and T. He, Semantic-aware network embedding via optimized random walk and paragaraph2vec, J. Comput. Sci., vol. 63, p. 101825, 2022.

[6]

L. Chen, Y. Li, and X. Deng, Multi-view learning based heterogeneous network representation learning, Journal of King Saud University-Computer and Information Sciences, vol. 35, no. 10, p. 101855, 2023.

[7]

L. Chen, Y. Li, Y. Lei, and X. Deng, Metarelation2vec: A metapath-free scalable representation learning model for heterogeneous networks, Tsinghua Science and Technology, vol. 29, no. 2, pp. 553–575, 2024.

[8]

C. Yang, Y. Xiao, Y. Zhang, Y. Sun, and J. Han, Heterogeneous network representation learning: A unified framework with survey and benchmark, IEEE Trans. Knowl. Data Eng., vol. 34, no. 10, pp. 4854–4873, 2022.

[9]

L. Zhu, Z. Zhang, L. Feng, and L. Liu, Virtual network embedding in cross-domain network based on topology and resource attributes, IOP Conf. Ser.: Mater. Sci. Eng., vol. 322, p. 072010, 2018.

[10]
Y. Dong, N. V. Chawla, and A. Swami, metapath2vec: Scalable representation learning for heterogeneous networks, in Proc. 23rd ACM SIGKDD Int. Conf. Knowledge Discovery and Data Mining, Halifax, Canada, 2017, p. 135–144.
[11]
D. Zhang, J. Yin, X. Zhu, and C. Zhang, Metagraph2vec: Complex semantic pathaugmented heterogeneous network embedding, in Proc. Advances in Knowledge Discovery and DataMining : 22nd Pacific-Asia Conference, PAKDD2018, Melbourne, Australia, 2018, pp. 196–208.
[12]

T. Yang, L. Hu, C. Shi, H. Ji, X. Li, and L. Nie, HGAT: Heterogeneous graph attention networks for semi-supervised short text classification, ACM Trans. Inf. Syst., vol. 39, no. 3, pp. 1–29, 2021.

[13]
B. Hu, Y. Fang, and C. Shi, Adversarial learning on heterogeneous information networks, in Proc. 25th ACM SIGKDD Int. Conf. Knowledge Discovery & Data Mining, Anchorage, AK, USA, 2019, pp. 120–129.
[14]

C. Wang, C. Wang, Z. Wang, X. Ye, and P. S. Yu, Edge2vec: Edge-based social network embedding, ACM Trans. Knowl. Discov. Data, vol. 14, no. 4, p. 45, 2020.

[15]

P. Goyal, H. Hosseinmardi, E. Ferrara, and A. Galstyan, Capturing edge attributes via network embedding, IEEE Trans. Comput. Soc. Syst., vol. 5, no. 4, pp. 907–917, 2018.

[16]

X. Jiang, R. Zhu, P. Ji, and S. Li, Co-embedding of nodes and edges with graph neural networks, IEEE Trans. Pattern Anal. Mach. Intell., vol. 45, no. 6, pp. 7075–7086, 2023.

[17]

I. Makarov, K. Korovina, and D. Kiselev, JONNEE: Joint network nodes and edges embedding, IEEE Access, vol. 9, pp. 144646–144659, 2021.

[18]
Y. He, Y. Song, J. Li, C. Ji, J. Peng, and H. Peng, HeteSpaceyWalk: A heterogeneous spacey random walk for heterogeneous information network embedding, in Proc. 28th ACM Int. Conf. Information and Knowledge Management, Beijing, China, 2019, pp. 639–648.
[19]

X. Zhang and L. Chen, mSHINE: A multiple-meta-paths simultaneous learning framework for heterogeneous information network embedding, IEEE Trans. Knowl. Data Eng., vol. 34, no. 7, pp. 3391–3404, 2022.

[20]

X. Wang, Y. Zhang, and C. Shi, Hyperbolic heterogeneous information network embedding, Proc. AAAI Conf. Artif. Intell., vol. 33, no. 1, pp. 5337–5344, 2019.

[21]

W. Zhang, Y. Fang, Z. Liu, M. Wu, and X. Zhang, mg2vec: Learning relationship-preserving heterogeneous graph representations via metagraph embedding, IEEE Trans. Knowl. Data Eng., vol. 34, no. 3, pp. 1317–1329, 2022.

[22]
P. Veličković, G. Cucurull, A. Casanova, A. Romero, P. Liò, and Y. Bengio, Graph attention networks, arXiv preprint arXiv: 1710.10903, 2017.
[23]
T. N. Kipf and M. Welling, Semi-supervised classification with graph convolutional networks, arXiv preprint arXiv: 1609.02907, 2016.
[24]

I. Goodfellow, J. Pouget-Abadie, M. Mirza, B. Xu, D. Warde-Farley, S. Ozair, A. Courville, and Y. Bengio, Generative adversarial networks, Commun. ACM, vol. 63, no. 11, pp. 139–144, 2020.

[25]

L. Chen, F. Chen, Z. Liu, M. Lv, T. He, and S. Zhang, Parallel gravitational clustering based on grid partitioning for large-scale data, Appl. Intell., vol. 53, no. 3, pp. 2506–2526, 2023.

[26]
X. Fu, J. Zhang, Z. Meng, and I. King, MAGNN: Metapath aggregated graph neural network for heterogeneous graph embedding, in Proc. The Web Conf. 2020, Taipei, China, 2020, pp. 2331–2341.
[27]
L. Xu, X. Wei, J. Cao, and P. S. Yu, Embedding of embedding (EOE): Joint embedding for coupled heterogeneous networks, in Proc. Tenth ACM Int. Conf.
[28]
Y. Shi, H. Gui, Q. Zhu, L. Kaplan, and J. Han, AspEm: Embedding learning by aspects in heterogeneous information networks, in Proc. of the 2018 SIAM International Conference on Data Mining, San Diego, CA, USA, 2018. pp. 144–152,
[29]
J. Verma, S. Gupta, D. Mukherjee, and T. Chakraborty, Heterogeneous edge embedding for friend recommendation, in Proc. 41st European Conference on IR Research, Cologne, Germany, 2019, pp. 172−179.
[30]
H. Chen and H. Koga, GL2vec: Graph embedding enriched by line graphs with edge features, in Proc. International Conference on Neural Information Processing, Sydney, Australia, 2019, pp. 3−14.
[31]

B. Xiong, P. Bao, and Y. Wu, Learning semantic and relationship joint embedding for author Name disambiguation, Neural Comput. Appl., vol. 33, no. 6, pp. 1987–1998, 2021.

Big Data Mining and Analytics
Pages 730-752
Cite this article:
Chen L, Li Y, Liu H, et al. Node and Edge Joint Embedding for Heterogeneous Information Network. Big Data Mining and Analytics, 2024, 7(3): 730-752. https://doi.org/10.26599/BDMA.2023.9020037

53

Views

0

Downloads

0

Crossref

0

Web of Science

0

Scopus

0

CSCD

Altmetrics

Received: 26 August 2023
Revised: 28 October 2023
Accepted: 28 November 2023
Published: 28 August 2024
© The author(s) 2024.

The articles published in this open access journal are distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/).

Return