Node Embedding Research over Temporal Graph
Author:
Affiliation:

Fund Project:

National Natural Science Foundation of China (61932004, 62002054, 61732003, 61729201); Research Funds for the Central Universities (N181605012); China Postdoctoral Science Foundation Funded Project (2020M670780)

  • Article
  • | |
  • Metrics
  • |
  • Reference [35]
  • |
  • Related [20]
  • | | |
  • Comments
    Abstract:

    Compared with the traditional graph data analysis method, graph embedding algorithm provides a new graph data analysis strategy. It aims to encoder graph nodes into vectors to perform graph data analysis or mining tasks more effectively by using neural network related technologies. And some classic tasks have been improved significantly by graph embedding methods, such as node classification, link prediction, and traffic flow prediction. Although plenty of works have been proposed by former researchers in graph embedding, the nodes embedding problem over temporal graph has been seldom studied. This study proposed an adaptive temporal graph embedding, ATGED, attempting to encoder temporal graph nodes into vectors by combining previous research works and the information propagation characteristics together. First, an adaptive cluster method is proposed by solving the situation that nodes active frequency is different in different types of graph. Then, a new node walk strategy is designed in order to store the time sequence between nodes, and also the walking list will be stored in bidirectional multi-tree in walking process to get complete walking lists fast. Last, based on the basic walking characteristics and graph topology, an important node sampling strategy is proposed to train the satisfied neural network as soon as possible. Sufficient experiments demonstrate that the proposed method surpasses existing embedding methods in terms of node clustering, reachability prediction, and node classification in temporal graphs.

    Reference
    [1] Scarselli F, Gori M, Tsoi AC, Hagenbuchner M, Monfardini G. The graph neural network model. IEEE Trans. on Neural Networks, 2009,20(1):61-80.
    [2] Perozzi B, Al-Rfou R, Skiena S. DeepWalk:Online learning of social representations. In:Proc. of the 20th ACM SIGKDD Int'l Conf. on Knowledge Discovery and Data Mining. 2014. 701-710.
    [3] Mikolov T, Chen K, Corrado G, Dean J. Efficient estimation of word representations in vector space. arXiv:1301.3781v3.
    [4] Tang J, Qu M, Wang MZ, Zhang M, Yan J, Mei QZ. LINE:Large-scale information network embedding. In:Proc. of the 24th Int'l Conf. on World Wide Web. 2015. 1067-1077.
    [5] Tang J, Qu M, Mei QZ. PTE:Predictive text embedding through large-scale heterogeneous text networks. In:Proc. of the 21st ACM SIGKDD Int'l Conf. on Knowledge Discovery and Data Mining. 2015. 1165-1174.
    [6] Grover A, Leskovec J. node2vec:Scalable feature learning for networks. In:Proc. of the 22nd ACM SIGKDD Int'l Conf. on Knowledge Discovery and Data Mining. 2016. 855-864.
    [7] Leonardo FRR, Pedro HPS, Daniel RF. struc2vec:Learning node representations from structural identity. In:Proc. of the 23rd ACM SIGKDD Int'l Conf. on Knowledge Discovery and Data Mining. 2017. 385-394.
    [8] Qiu JZ, Dong YX, Ma H, Li J, Wang KS, Tang J. Network embedding as matrix factorization:Unifying DeepWalk, LINE, PTE, and node2vec. In:Proc. of the 11th ACM Int'l Conf. on Web Search and Data Mining. 2018. 459-467.
    [9] Hamilton W, Ying Z, Leskovec J. Inductive representation learning on large graphs. In:Advances in Neural Information Processing Systems. 2017. 1024-1034.
    [10] Kipf TN, Welling M. Semi-Supervised classification with graph convolutional networks. In:Proc. of the ICLR (Poster). 2017.
    [11] Velickovic P, Cucurull G, Casanova A, Romero A, Liò P, Bengio Y. Graph attention networks. In:Proc. of the ICLR (Poster). 2018.
    [12] Wang YS, Yuan Y, Ma YL, Wang GR. Time-dependent graphs:Definitions, applications, and algorithms. Data Science and Engineering, 2019,4(4):352-366.
    [13] Takaguchi T, Yano Y, Yoshida Y. Coverage centralities for temporal networks. European Physical Journal B, 2016,89(2):35.
    [14] Frand D, Masoud TO, Jörg-Rüdiger S. Shortest paths in FIFO time-dependent networks. Algorithmica, 2012,62(1-2):416-435.
    [15] Rossi L, Musolesi M, Torsello A. On the k-anonymization of time-varying and multi-layer social graphs. In:Proc. of the 9th Int'l Conf. on Web and Social Media. 2015. 377-386.
    [16] Przytycka TM, Singh M, Slonim DK. Toward the dynamic interactome:It's about time. Briefings in Bioinformatics, 2010,11(1):15-29.
    [17] Han JD, Bertin N, Hao T, et al. Evidence for dynamically organized modularity in the yeast protein-protein interaction network. Nature, 2004,430(6995):88-93.
    [18] Lèbre S, Becq J, Devaux F, et al. Statistical inference of the time-varying structure of gene-regulation networks. BMC Systems Biology, 2010,4(1):1-16.
    [19] Wu H, Cheng J, Ke Y, et al. Efficient algorithms for temporal path computation. IEEE Trans. on Knowledge & Data Engineering, 2016,28(11):2927-2942.
    [20] Li J, Han ZC, Cheng H, Su J, Wang PY, Zhang JF, Pan LJ. Predicting path failure in time-evolving graphs. In:Proc. of the 25th ACM SIGKDD Int'l Conf. on Knowledge Discovery & Data Mining. 2019. 1279-1289.
    [21] Hu JL, Yang B, Guo CJ, Jensen CS, Xiong H. Stochastic origin-destination matrix forecasting using dual-stage graph convolutional, recurrent neural networks. In:Proc. of the IEEE Int'l Conf. on Data Engineering. 2020. 1417-1428.
    [22] Kumar S, Hamilton WL, Leskovec J, Jurafsky D. Community interaction and conflict on the Web. In:Proc. of the World Wide Web Conf. 2018. 933-943.
    [23] Panzarasa P, Opsahl T, Carley KM. Patterns and dynamics of users' behavior and interaction:Network analysis of an online community. Journal of the American Society for Information Science and Technology, 2009,60(5):911-932.
    [24] Bai C, Kumar S, Leskovec J, Metzger M, Nunamaker JF, Subrahmanian VS. Predicting visual focus of attention in multi-person discussion videos. In:Proc. of the Int'l Joint Conf. on Artificial Intelligence. 2019. 4504-4510.
    [25] Wu HH, Huang YZ, Cheng J, Li JF, Ke YP. Reachability and time-based path queries in temporal graphs. In:Proc. of the IEEE Int'l Conf. on Data Engineering. 2016. 145-156.
    [26] Yuan Y, Lian X, Wang GR, Ma YL, Wang YS. Constrained shortest path query in a large time-dependent graph. Proc. of the VLDB Endow, 2019,12(10):1058-1070.
    [27] Yuan Y, Lian X, Wang GR, Chen L, Ma YL, Wang YS. Weight-Constrained route planning over time-dependent graphs. In:Proc. of the IEEE Int'l Conf. on Data Engineering. 2019. 914-925.
    [28] Bron C, Kerbosch J. Finding all cliques of an undirected graph (algorithm 457). Commun. ACM, 1973,16(9):575-576.
    [29] Chen W, Wang YJ, Yang SY. Efficient influence maximization in social networks. In:Proc. of the 15th ACM SIGKDD Int'l Conf. on Knowledge Discovery and Data Mining. 2009. 199-207.
    [30] Kumar S, Spezzano F, Subrahmanian VS, Faloutsos C. Edge weight prediction in weighted signed networks. In:Proc. of the IEEE Int'l Conf. on Data Mining. 2016. 221-230.
    [31] Kumar S, Hooi B, Makhija D, Kumar M, Subrahmanian VS, Faloutsos C. REV2:Fraudulent user prediction in rating platforms. In:Proc. of the ACM Int'l Conf. on Web Search and Data Mining. 2018. 333-341.
    [32] Paranjape A, Benson AR, Leskovec J. Motifs in temporal networks. In:Proc. of the 10th ACM Int'l Conf. on Web Search and Data Mining. 2017. 601-610.
    [33] Nguyen GH, Lee JB, rossi RA, Ahmed NK, Koh E, Kim S. Continuous-Time dynamic network embeddings. In:Companion Proc. of the Web Conf. 2018. 2018. 969-976.
    [34] Wang Y, Jian X, Yang ZH. Query optimal k-plex based community in graphs. Data Science and Engineering, 2017,2(4):257-273.
    [35] Fan WF, Hu CM. Big graph analyses:From queries to dependencies and association rules. Data Science and Engineering, 2017,2(1):36-55.
    Cited by
    Comments
    Comments
    分享到微博
    Submit
Get Citation

吴安彪,袁野,马玉亮,王国仁.时序图节点嵌入策略的研究.软件学报,2021,32(3):650-668

Copy
Share
Article Metrics
  • Abstract:2278
  • PDF: 6699
  • HTML: 3586
  • Cited by: 0
History
  • Received:July 19,2020
  • Revised:September 03,2020
  • Online: January 21,2021
  • Published: March 06,2021
You are the first2044070Visitors
Copyright: Institute of Software, Chinese Academy of Sciences Beijing ICP No. 05046678-4
Address:4# South Fourth Street, Zhong Guan Cun, Beijing 100190,Postal Code:100190
Phone:010-62562563 Fax:010-62562533 Email:jos@iscas.ac.cn
Technical Support:Beijing Qinyun Technology Development Co., Ltd.

Beijing Public Network Security No. 11040202500063