AI Chat Paper
Note: Please note that the following content is generated by AMiner AI. SciOpen does not take any responsibility related to this content.
{{lang === 'zh_CN' ? '文章概述' : 'Summary'}}
{{lang === 'en_US' ? '中' : 'Eng'}}
Chat more with AI
Powered by AMiner. Clicking this button will take you away from SciOpen.
Home International Journal of Crowd Science Article
PDF (804.2 KB)
Cite
EndNote(RIS) BibTeX
Collect
Submit Manuscript AI Chat Paper
Show Outline
Outline
Show full outline
Hide outline
Outline
Show full outline
Hide outline
Open Access

Link Prediction in Continuous-Time Dynamic Heterogeneous Graphs with Causality of Event Types

Jiarun Zhu1, Xingyu Wu1, Muhammad Usman1, Xiangyu Wang1, Huanhuan Chen1( )
School of Computer Science and Technology, University of Science and Technology of China, Hefei 230026, China
Show Author Information

Abstract

Dynamic heterogeneous graphs comprise different types of events with temporal labels. In many real-world scenarios, the temporal order of different types of events possibly implies causal relationships between these event types. However, existing methods designed to model dynamic heterogeneous graphs neglect the underlying causal relationships between event types. For instance, the determination of the occurrence of a new event is misled by irrelevant historical events considering the type and could lead to performance degradation. First, this paper explicitly defines the causality of event types by the heterogeneous causality graph to utilize such causality from the perspective of the graph structure to tackle the aforementioned issue. Second, this paper proposes the event type causality based continuous-time heterogeneous attention network (ECHN) to model dynamic heterogeneous graphs. ECHN aggregates features based on the strength of different causal relationships between event types in the prediction process to utilize the causality of event types from the perspective of the modeling algorithm. The utilities of event type causality weaken the negative effect of irrelevant events. Experimental results demonstrate that ECHN outperforms state-of-the-arts in the link prediction task. The authors believe that this paper is the first study to model the causality of event types in dynamic heterogeneous graphs explicitly.

Keywords

heterogeneous graphattention networklink predictioncontinuous-time model

References

1

X. Wang, L. Chen, T. Ban, M. Usman, Y. Guan, S. Liu, T. Wu, and H. Chen, Knowledge graph quality control: A survey, Fundamental Research, vol. 1, no. 5, pp. 607–626, 2021.
Crossref Google Scholar
2
X. Zhao, L. Chen, and H. Chen, A weighted heterogeneous graph-based dialog system, IEEE Transactions on Neural Networks and Learning Systems, doi: 10.1109/TNNLS.2021.3124640.https://doi.org/10.1109/TNNLS.2021.3124640
Crossref
3
X. Zhao, H. Chen, Z. Xing, and C. Miao, Brain-inspired search engine assistant based on knowledge graph, IEEE Transactions on Neural Networks and Learning Systems, doi: 10.1109/TNNLS.2021.3113026.https://doi.org/10.1109/TNNLS.2021.3113026
Crossref
4

B. Jiang, H. Chen, B. Yuan, and X. Yao, Scalable graph-based semi-supervised learning through sparse bayesian model, IEEE Transactions on Knowledge and Data Engineering, vol. 29, no. 12, pp. 2758–2771, 2017.
Crossref Google Scholar
5

L. Chen, J. Cao, H. Chen, W. Liang, H. Tao, and G. Zhu, Attentive multi-task learning for group itinerary recommendation, Knowledge and Information Systems, vol. 63, pp. 1687–1716, 2021.
Crossref Google Scholar
6

L. Ding, B. Han, S. Wang, X. Li, and B. Song, User-centered recommendation using US-ELM based on dynamic graph model in E-commerce, International Journal of Machine Learning and Cybernetics, vol. 10, pp. 693–703, 2019.
Crossref Google Scholar
7

Y. Wang, J. Cao, Z. Bu, J. Jiang, and H. Chen, Proximity-based group formation game model for community detection in social network, Knowledge-Based Systems, vol. 214, p. 106670, 2021.
Crossref Google Scholar
8
C. Yuan, J. Li, W. Zhou, Y. Lu, X. Zhang, and S. Hu, DyHGCN: A dynamic heterogeneous graph convolutional network to learn users’ dynamic preferences for information diffusion prediction, arXiv preprint arXiv: 2006.05169, 2020.https://doi.org/10.1007/978-3-030-67664-3_21
Crossref
9
J. Liu, Z. Liu, and H. Chen, Revisit word embeddings with semantic lexicons for modeling lexical contrast, in Proc. 2017 IEEE International Conference on Big Knowledge (ICBK), Hefei, China, 2017, pp. 72–79.https://doi.org/10.1109/ICBK.2017.35
Crossref
10
W. Luo, H. Zhang, X. Yang, L. Bo, X. Yang, Z. Li, X. Qie, and J. Ye, Dynamic heterogeneous graph neural network for real-time event prediction, in Proc. 26th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, CA, USA, 2020, pp. 3213–3223.https://doi.org/10.1145/3394486.3403373
Crossref
11
L. Yang, Z. Xiao, W. Jiang, Y. Wei, Y. Hu, and H. Wang, Dynamic heterogeneous graph embedding using hierarchical attentions, in Proc. 42nd European Conference on IR Research, Lisbon, Portugal, 2020, pp. 425–432.https://doi.org/10.1007/978-3-030-45442-5_53
Crossref
12
H. Xue, L. Yang, W. Jiang, Y. Wei, Y. Hu, and Y. Lin, Modeling dynamic heterogeneous network for link prediction using hierarchical attention with temporal RNN, in Proc. European Conference on Machine Learning and Knowledge Discovery in Databases, Ghent, Belgium, 2020, pp. 282–298.https://doi.org/10.1007/978-3-030-67658-2_17
Crossref
13

X. Wu, B. Jiang, K. Yu, and H. Chen, Separation and recovery markov boundary discovery and its application in EEG-based emotion recognition, Information Sciences, vol. 571, pp. 262–278, 2021.
Crossref Google Scholar
14
Y. Zhong, X. Wu, B. Jiang, and H. Chen, Multi-label local-to-global feature selection, in Proc. 2021 International Joint Conference on Neural Networks, Shenzhen, China, 2021, pp. 1–8.https://doi.org/10.1109/IJCNN52387.2021.9534246
Crossref
15
Y. Wang, Q. Ding, K. Wang, Y. Liu, X. Wu, J. Wang, Y. Liu, and C. Miao, The skyline of counterfactual explanations for machine learning decision models, in Proc. 30th ACM International Conference on Information and Knowledge Management, Queensland, Australia, 2021, pp. 2030–2039.https://doi.org/10.1145/3459637.3482397
Crossref
16
S. Lyu, X. Wu, J. Li, Q. Chen, and H. Chen, Do models learn the directionality of relations? A new evaluation: Relation direction recognition, IEEE Transactions on Emerging Topics in Computational Intelligence, doi: 10.1109/TETCI.2021.3136598.https://doi.org/10.1109/TETCI.2021.3136598
Crossref
17

W. Shu, Y. Yao, S. Lyu, J. Li, and H. Chen, Short isometric shapelet transform for binary time series classification, Knowledge and Information Systems, vol. 63, pp. 2023–2051, 2021.
Crossref Google Scholar
18

Z. Gong, H. Chen, B. Yuan, and X. Yao, Multiobjective learning in the model space for time series classification, IEEE Transactions on Cybernetics, vol. 49, no. 3, pp. 918–932, 2018.
Crossref Google Scholar
19

X. Wu, B. Jiang, K. Yu, and H. Chen, Accurate markov boundary discovery for causal feature selection, IEEE Transactions on Cybernetics, vol. 50, no. 12, pp. 4983–4996, 2019.
Crossref Google Scholar
20
X. Wu, B. Jiang, Y. Zhong, and H. Chen, Tolerant markov boundary discovery for feature selection, in Proc. 29th ACM International Conference on Information and Knowledge Management, Ireland, 2020, pp. 2261–2264.https://doi.org/10.1145/3340531.3415927
Crossref
21

X. Wu, B. Jiang, K. Yu, H. Chen, and C. Miao, Multi-label causal feature selection, Proceedings of the AAAI Conference on Artificial Intelligence, vol. 34, no. 4, pp. 6430–6437, 2020.
Crossref Google Scholar
22

S. Hochreiter and J. Schmidhuber, Long short-term memory, Neural Computation, vol. 9, no. 8, pp. 1735–1780, 1997.
Crossref Google Scholar
23
A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, Ł. Kaiser, and I. Polosukhin, Attention is all you need, in Proc. 31st International Conference on Neural Information Processing Systems, Long Beach, CA, USA, 2017, pp. 6000–6010.
24
X. Zhao, F. Xiao, H. Zhong, J. Yao, and H. Chen, Condition aware and revise transformer for question answering, in Proc. Web Conference 2020, Taipei, China, 2020, pp. 2377–2387.https://doi.org/10.1145/3366423.3380301
Crossref
25
D. Yang, H. Chen, Y. Song, and Z. Gong, Granger causality for multivariate time series classification, in Proc. 2017 IEEE International Conference on Big Knowledge (ICBK), Hefei, China, 2017, pp. 103–110.https://doi.org/10.1109/ICBK.2017.36
Crossref
26
P. Veličković, G. Cucurull, A. Casanova, A. Romero, P. Liò, and Y. Bengio, Graph attention networks, arXiv preprint arXiv: 1710.10903, 2017.
27
X. Wang, H. Ji, C. Shi, B. Wang, Y. Ye, P. Cui, and P. Yu, Heterogeneous graph attention network, in Proc. the World Wide Web Conference (WWW’19), San Francisco, CA, USA, 2019, pp. 2022–2032.https://doi.org/10.1145/3308558.3313562
Crossref
28
R. Bian, Y. S. Koh, G. Dobbie, and A. Divoli, Network embedding and change modeling in dynamic heterogeneous networks, in Proc. 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval, Paris, France, 2019, pp. 861–864.https://doi.org/10.1145/3331184.3331273
Crossref
29
A. M. Fard, E. Bagheri, and K. Wang, Relationship prediction in dynamic heterogeneous information networks, in Proc. 41st European Conference on Information Retrieval, Cologne, Germany, 2019, pp. 19–34.https://doi.org/10.1007/978-3-030-15712-8_2
Crossref
30

S. Sajadmanesh, S. Bazargani, J. Zhang, and H. R. Rabiee, Continuous-time relationship prediction in dynamic heterogeneous information networks, ACM Transactions on Knowledge Discovery from Data(TKDD), vol. 13, no. 4, pp. 1–31, 2019.
Crossref Google Scholar
31
X. Chang, X. Liu, J. Wen, S. Li, Y. Fang, L. Song, and Y. Qi, Continuous-time dynamic graph learning via neural interaction processes, in Proc. 29th ACM International Conference on Information and Knowledge Management, Ireland, 2020, pp. 145–154.https://doi.org/10.1145/3340531.3411946
Crossref
32
D. J. Daley and D. Vere-Jones, An Introduction to the Theory of Point Processes: Volume II: General Theory and Structure. New York, NY, USA: Springer, 2008.https://doi.org/10.1007/978-0-387-49835-5
Crossref
33
Y. Ji, T. Jia, Y. Fang, and C. Shi, Dynamic heterogeneous graph embedding via heterogeneous hawkes process, in Proc. Joint European Conference on Machine Learning and Knowledge Discovery in Databases, Bilbao, Spain, 2021, pp. 388–403.https://doi.org/10.1007/978-3-030-86486-6_24
Crossref
34
J. Leskovec and A. Krevl, Snap datasets: Stanford large network dataset collection, http://snap.stanford.edu/data, 2014.
35
H. Zhu, D. Chang, Z. Xu, P. Zhang, X. Li, J. He, H. Li, J. Xu, and K. Gai, Joint optimization of tree-based index and deep model for recommender systems, in Proc. 33rd International Conference on Neural Information Processing Systems, Vancouver, Canada, 2019, pp. 3971–3980.
36
B. Perozzi, R. Al-Rfou, and S. Skiena, Deepwalk: Online learning of social representations, in Proc. 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, New York, NY, USA, 2014, pp. 701–710.https://doi.org/10.1145/2623330.2623732
Crossref
37
T. Mikolov, I. Sutskever, K. Chen, G. S. Corrado, and J. Dean, Distributed representations of words and phrases and their compositionality, in Proc. 26th International Conference on Neural Information Processing Systems, Lake Tahoe, NV, USA, 2013, pp. 3111–3119.
38
A. Grover and J. Leskovec, Node2vec: Scalable feature learning for networks, in Proc. 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Francisco, CA, USA, 2016, pp. 855–864.https://doi.org/10.1145/2939672.2939754
Crossref
39
T. N. Kipf and M. Welling, Semi-supervised classification with graph convolutional networks, arXiv preprint arXiv: 1609.02907, 2016.
40
A. Pareja, G. Domeniconi, J. Chen, T. Ma, T. Suzumura, H. Kanezashi, T. Kaler, T. Schardl, and C. Leiserson. EvolveGCN: Evolving graph convolutional networks for dynamic graphs, Proceedings of the AAAI Conference on Artificial Intelligence, vol. 34, no. 4, pp. 5363–5370, 2020.https://doi.org/10.1609/aaai.v34i04.5984
Crossref
41
M. Schlichtkrull, T. N. Kipf, P. Bloem, R. V. D. Berg, I. Titov, and M. Welling, Modeling relational data with graph convolutional networks, in Proc. European Semantic Web Conference, Heraklion, Greece, 2018, pp. 593–607.https://doi.org/10.1007/978-3-319-93417-4_38
Crossref
42

H. Chen, P. Tiňo, and X. Yao, Probabilistic classification vector machines, IEEE Transactions on Neural Networks, vol. 20, no. 6, pp. 901–914, 2009.
Crossref Google Scholar
43

H. Chen, P. Tiňo, and X. Yao, Efficient probabilistic classification vector machine with incremental basis function selection, IEEE Transactions on Neural Networks and Learning Systems, vol. 25, no. 2, pp. 356–369, 2014.
Crossref Google Scholar
44
H. Chen, F. Tang, P. Tino, and X. Yao, Model-based kernel for efficient time series analysis, in Proc. 19th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Chicago, IL, USA, 2013, pp. 392–400.https://doi.org/10.1145/2487575.2487700
Crossref
International Journal of Crowd Science
Volume 6 Issue 2,
June 2022
Pages 80-91
DOI: 10.26599/IJCS.2022.9100013
Cite this article:
Zhu J, Wu X, Usman M, et al. Link Prediction in Continuous-Time Dynamic Heterogeneous Graphs with Causality of Event Types. International Journal of Crowd Science, 2022, 6(2): 80-91. https://doi.org/10.26599/IJCS.2022.9100013

843

Views

76

Downloads

7

Crossref

7

Scopus

Altmetrics
Received: 28 January 2022
Revised: 05 April 2022
Accepted: 06 April 2022
Published: 30 June 2022
© The author(s) 2022

The articles published in this open access journal are distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/).
Return