AI Chat Paper
Note: Please note that the following content is generated by AMiner AI. SciOpen does not take any responsibility related to this content.
{{lang === 'zh_CN' ? '文章概述' : 'Summary'}}
{{lang === 'en_US' ? '中' : 'Eng'}}
Chat more with AI
Powered by AMiner. Clicking this button will take you away from SciOpen.
Home Big Data Mining and Analytics Article
PDF (16.4 MB)
Cite
EndNote(RIS) BibTeX
Collect
Submit Manuscript AI Chat Paper
Show Outline
Outline
Show full outline
Hide outline
Outline
Show full outline
Hide outline
Open Access

Node and Edge Joint Embedding for Heterogeneous Information Network

School of Information and Electrical Engineering, Hunan University of Science and Technology, Xiangtan 411201, China
Changde Water Meter Manufacture Co. Ltd., Changde 415000, China
Show Author Information

Abstract

Due to the heterogeneity of nodes and edges, heterogeneous network embedding is a very challenging task to embed highly coupled networks into a set of low-dimensional vectors. Existing models either only learn embedding vectors for nodes or only for edges. These two methods of embedding learning are rarely performed in the same model, and they both overlook the internal correlation between nodes and edges. To solve these problems, a node and edge joint embedding model is proposed for Heterogeneous Information Networks (HINs), called NEJE. The NEJE model can better capture the latent structural and semantic information from an HIN through two joint learning strategies: type-level joint learning and element-level joint learning. Firstly, node-type-aware structure learning and edge-type-aware semantic learning are sequentially performed on the original network and its line graph to get the initial embedding of nodes and the embedding of edges. Then, to optimize performance, type-level joint learning is performed through the alternating training of node embedding on the original network and edge embedding on the line graph. Finally, a new homogeneous network is constructed from the original heterogeneous network, and the graph attention model is further used on the new network to perform element-level joint learning. Experiments on three tasks and five public datasets show that our NEJE model performance improves by about 2.83% over other models, and even improves by 6.42% on average for the node clustering task on Digital Bibliography & Library Project (DBLP) dataset.

Keywords

node embeddingedge embeddingjoint embeddingHeterogeneous Information Network (HIN)

References

[1]

X. Wang, D. Bo, C. Shi, S. Fan, Y. Ye, and P. S. Yu, A survey on heterogeneous graph embedding: Methods, techniques, applications and sources, IEEE Trans. Big Data, vol. 9, no. 2, pp. 415–436, 2023.
Crossref Google Scholar
[2]
Y. Dong, Z. Hu, K. Wang, Y. Sun, and J. Tang, Heterogeneous network representation learning, in Proc. of the Twenty-Ninth International Joint Conference on Artificial Intelligence, Yokohama, Japan, 2021, pp. 4861–4867.
Crossref
[3]

R. Wang, Y. Liu, and J. Chen, Network representation learning algorithm combined with node text information, J. Phys.: Conf. Ser., vol. 1769, no. 1, p. 012054, 2021.
Crossref Google Scholar
[4]

Y. Xie, B. Yu, S. Lv, C. Zhang, G. Wang, and M. Gong, A survey on heterogeneous network representation learning, Pattern recognition, vol. 116, p. 107936, 2021.
Crossref Google Scholar
[5]

L. Chen, Y. Li, X. Deng, Z. Liu, M. Lv, and T. He, Semantic-aware network embedding via optimized random walk and paragaraph2vec, J. Comput. Sci., vol. 63, p. 101825, 2022.
Crossref Google Scholar
[6]

L. Chen, Y. Li, and X. Deng, Multi-view learning based heterogeneous network representation learning, Journal of King Saud University-Computer and Information Sciences, vol. 35, no. 10, p. 101855, 2023.
Crossref Google Scholar
[7]

L. Chen, Y. Li, Y. Lei, and X. Deng, Metarelation2vec: A metapath-free scalable representation learning model for heterogeneous networks, Tsinghua Science and Technology, vol. 29, no. 2, pp. 553–575, 2024.
Crossref Google Scholar
[8]

C. Yang, Y. Xiao, Y. Zhang, Y. Sun, and J. Han, Heterogeneous network representation learning: A unified framework with survey and benchmark, IEEE Trans. Knowl. Data Eng., vol. 34, no. 10, pp. 4854–4873, 2022.
Crossref Google Scholar
[9]

L. Zhu, Z. Zhang, L. Feng, and L. Liu, Virtual network embedding in cross-domain network based on topology and resource attributes, IOP Conf. Ser.: Mater. Sci. Eng., vol. 322, p. 072010, 2018.
Crossref Google Scholar
[10]
Y. Dong, N. V. Chawla, and A. Swami, metapath2vec: Scalable representation learning for heterogeneous networks, in Proc. 23rd ACM SIGKDD Int. Conf. Knowledge Discovery and Data Mining, Halifax, Canada, 2017, p. 135–144.
Crossref
[11]
D. Zhang, J. Yin, X. Zhu, and C. Zhang, Metagraph2vec: Complex semantic pathaugmented heterogeneous network embedding, in Proc. Advances in Knowledge Discovery and DataMining : 22nd Pacific-Asia Conference, PAKDD2018, Melbourne, Australia, 2018, pp. 196–208.
Crossref
[12]

T. Yang, L. Hu, C. Shi, H. Ji, X. Li, and L. Nie, HGAT: Heterogeneous graph attention networks for semi-supervised short text classification, ACM Trans. Inf. Syst., vol. 39, no. 3, pp. 1–29, 2021.
Crossref Google Scholar
[13]
B. Hu, Y. Fang, and C. Shi, Adversarial learning on heterogeneous information networks, in Proc. 25th ACM SIGKDD Int. Conf. Knowledge Discovery & Data Mining, Anchorage, AK, USA, 2019, pp. 120–129.
Crossref
[14]

C. Wang, C. Wang, Z. Wang, X. Ye, and P. S. Yu, Edge2vec: Edge-based social network embedding, ACM Trans. Knowl. Discov. Data, vol. 14, no. 4, p. 45, 2020.
Crossref Google Scholar
[15]

P. Goyal, H. Hosseinmardi, E. Ferrara, and A. Galstyan, Capturing edge attributes via network embedding, IEEE Trans. Comput. Soc. Syst., vol. 5, no. 4, pp. 907–917, 2018.
Crossref Google Scholar
[16]

X. Jiang, R. Zhu, P. Ji, and S. Li, Co-embedding of nodes and edges with graph neural networks, IEEE Trans. Pattern Anal. Mach. Intell., vol. 45, no. 6, pp. 7075–7086, 2023.
Crossref Google Scholar
[17]

I. Makarov, K. Korovina, and D. Kiselev, JONNEE: Joint network nodes and edges embedding, IEEE Access, vol. 9, pp. 144646–144659, 2021.
Crossref Google Scholar
[18]
Y. He, Y. Song, J. Li, C. Ji, J. Peng, and H. Peng, HeteSpaceyWalk: A heterogeneous spacey random walk for heterogeneous information network embedding, in Proc. 28th ACM Int. Conf. Information and Knowledge Management, Beijing, China, 2019, pp. 639–648.
Crossref
[19]

X. Zhang and L. Chen, mSHINE: A multiple-meta-paths simultaneous learning framework for heterogeneous information network embedding, IEEE Trans. Knowl. Data Eng., vol. 34, no. 7, pp. 3391–3404, 2022.
Google Scholar
[20]

X. Wang, Y. Zhang, and C. Shi, Hyperbolic heterogeneous information network embedding, Proc. AAAI Conf. Artif. Intell., vol. 33, no. 1, pp. 5337–5344, 2019.
Crossref Google Scholar
[21]

W. Zhang, Y. Fang, Z. Liu, M. Wu, and X. Zhang, mg2vec: Learning relationship-preserving heterogeneous graph representations via metagraph embedding, IEEE Trans. Knowl. Data Eng., vol. 34, no. 3, pp. 1317–1329, 2022.
Crossref Google Scholar
[22]
P. Veličković, G. Cucurull, A. Casanova, A. Romero, P. Liò, and Y. Bengio, Graph attention networks, arXiv preprint arXiv: 1710.10903, 2017.
[23]
T. N. Kipf and M. Welling, Semi-supervised classification with graph convolutional networks, arXiv preprint arXiv: 1609.02907, 2016.
[24]

I. Goodfellow, J. Pouget-Abadie, M. Mirza, B. Xu, D. Warde-Farley, S. Ozair, A. Courville, and Y. Bengio, Generative adversarial networks, Commun. ACM, vol. 63, no. 11, pp. 139–144, 2020.
Crossref Google Scholar
[25]

L. Chen, F. Chen, Z. Liu, M. Lv, T. He, and S. Zhang, Parallel gravitational clustering based on grid partitioning for large-scale data, Appl. Intell., vol. 53, no. 3, pp. 2506–2526, 2023.
Crossref Google Scholar
[26]
X. Fu, J. Zhang, Z. Meng, and I. King, MAGNN: Metapath aggregated graph neural network for heterogeneous graph embedding, in Proc. The Web Conf. 2020, Taipei, China, 2020, pp. 2331–2341.
Crossref
[27]
L. Xu, X. Wei, J. Cao, and P. S. Yu, Embedding of embedding (EOE): Joint embedding for coupled heterogeneous networks, in Proc. Tenth ACM Int. Conf.
[28]
Y. Shi, H. Gui, Q. Zhu, L. Kaplan, and J. Han, AspEm: Embedding learning by aspects in heterogeneous information networks, in Proc. of the 2018 SIAM International Conference on Data Mining, San Diego, CA, USA, 2018. pp. 144–152,
Crossref
[29]
J. Verma, S. Gupta, D. Mukherjee, and T. Chakraborty, Heterogeneous edge embedding for friend recommendation, in Proc. 41st European Conference on IR Research, Cologne, Germany, 2019, pp. 172−179.
Crossref
[30]
H. Chen and H. Koga, GL2vec: Graph embedding enriched by line graphs with edge features, in Proc. International Conference on Neural Information Processing, Sydney, Australia, 2019, pp. 3−14.
Crossref
[31]

B. Xiong, P. Bao, and Y. Wu, Learning semantic and relationship joint embedding for author Name disambiguation, Neural Comput. Appl., vol. 33, no. 6, pp. 1987–1998, 2021.
Crossref Google Scholar
Big Data Mining and Analytics
Volume 7 Issue 3,
September 2024
Pages 730-752
DOI: 10.26599/BDMA.2023.9020037
Cite this article:
Chen L, Li Y, Liu H, et al. Node and Edge Joint Embedding for Heterogeneous Information Network. Big Data Mining and Analytics, 2024, 7(3): 730-752. https://doi.org/10.26599/BDMA.2023.9020037

142

Views

19

Downloads

0

Crossref

0

Web of Science

0

Scopus

0

CSCD

Altmetrics
Received: 26 August 2023
Revised: 28 October 2023
Accepted: 28 November 2023
Published: 28 August 2024
© The author(s) 2024.

The articles published in this open access journal are distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/).
Return