Contrastive Meta-learning on Heterogeneous Information Networks for Cold-start Recommendation
Author:
Affiliation:

  • Article
  • | |
  • Metrics
  • |
  • Reference [38]
  • |
  • Related
  • | | |
  • Comments
    Abstract:

    In recommendationsystem, cold-start issue is challenging due to the lack of interactions between new users or new items. Such issue could be alleviated via data-level and model-level strategies. Traditional data-level methods employ side information like feature information to enhance the learning of user and item embeddings. Recently, heterogeneous information networks (HINs) have been incorporated into the recommendationsystem as they provide more fruitful auxiliary information and meaningful semantics. However, these models are unable to capture the structural and semantic information comprehensively and neglect the unlabeled information of HINs during training. Model-level methods propose to apply the meta-learning framework which naturally fits into the cold-start issue, as it learns the prior knowledge from similar tasks and adapts to new tasks quickly with few labeled samples. Therefore, a contrastive meta-learning framework on HINs named CM-HIN is proposed, which addresses the cold-start issue in both data level and model level. Specifically, metapath and network schema views are exploredto describe the higher-order and local structural information of HINs. Within metapath and network schema views, contrastive learning is adopted to mine the unlabeled information of HINs and these two viewsare incorporated. Extensive experiments on three benchmark datasets demonstrate that CM-HIN outperforms all state-of-the-art baselines in three cold-start scenarios.

    Reference
    [1] Dacrema MF, Cremonesi P, Jannach D. Are we really making much progress? A worrying analysis of recent neural recommendation approaches. In: Proc. of the 13th ACM Conf. on Recommender System. 2019. 101-109.
    [2] Hu B, Shi C, Zhao WX, Yu PS. Leveraging meta-path based context for top-n recommendation with a neural co-attention model. In: Proc. of the 24th ACM SIGKDD Int’l Conf. on Knowledge Discovery and Data Mining. 2018. 1531-1540.
    [3] Wang X, He XN, Wang M, Feng F, Chua TS. Neural graph collaborative filtering. In: Proc. of the 42nd ACM SIGIR Int’l Conf. on Research and Development in Information Retrieval. 2019. 165-174.
    [4] Zhu Y, Lin JH, He SB, Wang BD, Guan ZY, Liu HF, Cai D. Addressing the item cold-start problem by attribute-driven active learning. IEEE Trans. on Knowledge and Data Engineering, 2020, 32(4): 631-644.
    [5] Li XP, She J. Collaborative variational autoencoder for recommender systems. In: Proc. of the 40th ACM SIGIR Int’l Conf. on Research and Development in Information Retrieval. 2017. 305-314.
    [6] Shi C, Wang RJ, Wang X. A survey of heterogeneous information networks analysis and applications. Ruan Jian Xue Bao/Journal of Software, 2022, 33(2): 598-621(in Chinese with English abstract). http://www.jos.org.cn/1000-9825/6357.htm [doi: 10.13328/ j.cnki.jos.006357]
    [7] Sun YZ, Han JW, Yan XF, Yu PS, Wu TY. PathSim: Meta path-based top-K similarity search in heterogeneous information networks. Proc. of the VLDB Endowment, 2011, 4(11): 992-1003.
    [8] Finn C, Abbeel P, Levine S. Model-agnostic meta-learning for fast adaptation of deep networks. In: Proc. of the 34th Int’l Conf on Machine Learning. 2017. 1126-1135.
    [9] Vartak M, Thiagarajan A, Miranda C, Bratman J, Larochelle H. A meta-learning perspective on cold-start recommendations for items. In: Proc. of the Annual Conf. on Neural Information Processing Systems. 2017. 6904-6914.
    [10] Lee H, Im J, Jang S, Cho H, Chung S. MeLU: Meta-learned user preference estimator for cold-start recommendation. In: Proc. of the 25th ACM SIGKDD Int’l Conf. on Knowledge Discovery and Data Mining. 2019. 1073-1082.
    [11] Pan F, Li S, Ao X, Tang PZ, He Q. Warm up cold-start advertisements: Improving CTR predictions via learning to learn ID embeddings. In: Proc. of the 42nd ACM SIGIR Int’l Conf. on Research and Development in Information Retrieval. 2019. 695-704.
    [12] Lu YF, Fang Y, Shi C. Meta-learning on heterogeneous information networks for cold-start recommendation. In: Proc. of the 26th ACM SIGKDD Int’l Conf. on Knowledge Discovery and Data Mining. 2020. 1563-1573.
    [13] Zheng JW, Ma1 QL, Gu H, Zheng ZJ. Multi-view denoising graph auto-encoders on heterogeneous information networks for cold- start recommendation. In: Proc. of the 27th ACM SIGKDD Int’l Conf. on Knowledge Discovery and Data Mining. 2021. 2338-2348.
    [14] Sun YZ, Han JW. Ming heterogeneous information networks: A structural analysis approach. ACM SIGKDD Explorations Newsletter, 2013, 14(2): 20-28.
    [15] Qiu JZ, Chen QB, Dong YX, Zhang J, Yang HX, Ding M, Wang KS, Tang J. GCC: Graph contrastive coding for graph neural network pre-training. In: Proc. of the 26th ACM SIGKDD Int’l Conf. on Knowledge Discovery and Data Mining. 2020. 1150-1160.
    [16] Le DT, Fang Y, Lauw HW. Modeling sequential preferences with dynamic user and context factors. In: Proc. of the Machine Learning and Knowledge Discovery in Databases—European Conf. 2016. 145-161.
    [17] Volkovs M, Yu GW, Poutanen T. Dropoutnet: Addressing cold start in recommender systems. In: Proc. of the Annual Conf. on Neural Information Processing Systems. 2017. 4957-4966.
    [18] Fang Y, Lin WQ, Zheng VW, Wu M, Shi JQ, Chang K, Li XL. Metagraph-based learning on heterogeneous graphs. IEEE Trans. on Knowledge and Data Engineering, 2021, 33(1): 154-168.
    [19] Shi C, Hu BB, Zhao WX, Yu PS. Heterogeneous information network embedding for recommendation. IEEE Trans. on Knowledge and Data Engineering, 2018, 31(2): 357-370.
    [20] Wang X, He XN, Cao YX, Liu M, Chua TS. Kgat: Knowledge graph attention network for recommendation. In: Proc. of the 25th ACM SIGKDD Int’l Conf. on Knowledge Discovery and Data Mining. 2019. 950-958.
    [21] Zhang YF, Ai QY, Chen X, Croft WB. Joint representation learning for top-n recommendation with heterogeneous information sources. In: Proc. of the 2017 ACM Conf. on Information and Knowledge Management. 2017. 1449-1458.
    [22] Hu GN, Zhang Y, Yang Q. Conet: Collaborative cross networks for cross-domain recommendation. In: Proc. of the 2018 ACM Conf. on Information and Knowledge Management. 2018. 667-676.
    [23] Kang SK, Hwang JY, Lee D, Yu H. Semi-supervised learning for cross-domain recommendation to cold-start users. In: Proc. of the 2019 ACM Conf. on Information and Knowledge Management. 2019. 1563-1572.
    [24] Dong YX, Chawla NV, Swami A. Metapath2Vec: Scalable feature learning for networks. In: Proc. of the 23rd ACM SIGKDD Int’l Conf. on Knowledge Discovery and Data Mining. 2017. 135-144.
    [25] Fu TY, Lee WC, Lei Z. Hin2Vec: Explore meta-paths in heterogeneous information networks for representation learning. In: Proc. of the 2017 ACM Conf. on Information and Knowledge Management. 2017. 1797-1806.
    [26] Zhang CX, Song DJ, Huang C, Swami A, Chawla NV. Heterogeneous graph neural network. In: Proc. of the 25th ACM SIGKDD Int’l Conf. on Knowledge Discovery and Data Mining. 2019. 793-803.
    [27] Wang X, Ji HY, Shi C, Wang B, Ye YF, Cui P, Yu PS. Heterogeneous graph attention network. In: Proc. of the World Wide Web Conf. 2019. 2022-2032.
    [28] Vilalta R, Drissi Y. A perspective view and survey of meta-learning. Artificial Intelligence Review, 2002, 18(2): 77-95.
    [29] Snell J, Swersky K, Zemel R. Prototypical networks for few-shot learning. In: Proc. of the Annual Conf. on Neural Information Processing Systems. 2017. 4077-4087.
    [30] Santoro A, Bartunov S, Botvinick M, Wierstra D, Lillicrap T. Meta-learning with memory-augmented neural networks. In: Proc. of the 33rd Int’l Conf on Machine Learning. 2016. 1842-1850.
    [31] Du ZX, Wang XW, Yang HX, Zhou JR, Tang J. Sequential scenario-specific meta learner for online recommendation. In: Proc. of the 25th ACM SIGKDD Int’l Conf. on Knowledge Discovery and Data Mining. 2019. 2895-2904.
    [32] Zhang XS, Tang FY, Dodge HH, Zhou JY, Wang F. Metapred: Meta-learning for clinical risk prediction with limited patient electronic health records. In: Proc. of the 25th ACM SIGKDD Int’l Conf. on Knowledge Discovery and Data Mining. 2019. 2487-2495.
    [33] Velickovic P, Fedus W, Hamilton WL, Lio P, Bengio Y, Hjelm RD. Deep graph infomax. In: Proc. of the 7th Int’l Conf. on Learning Representations. 2019.
    [34] Kipf TN, Welling M. Semi-supervised classification with graph convolutional networks. In: Proc. of the 5th Int’l Conf. on Learning Representations. 2017.
    [35] Rendle S, Gantner Z, Freudenthaler C, Schmidt-Thieme L. Fast context-aware recommendations with factorization machines. In: Proc. of the 34th ACM SIGIR Int’l Conf. on Research and Development in Information Retrieval. 2011. 635-644.
    [36] Berg RVD, Kipf TN, Welling M. Graph convolutional matrix completion. arXiv:1706.02263, 2017.
    附中文参考文献:
    [6] 石川, 王睿嘉, 王啸. 异质信息网络分析与应用综述. 软件学报, 2022, 33(2): 598-621. http://www.jos.org.cn/1000-9825/6357.htm [doi: 10.13328/j.cnki.jos.006357]
    Related
    Cited by
    Comments
    Comments
    分享到微博
    Submit
Get Citation

方阳,谭真,陈子阳,肖卫东,张玲玲,田锋.用于冷启动推荐的异质信息网络对比元学习.软件学报,2023,34(10):4548-4564

Copy
Share
Article Metrics
  • Abstract:1518
  • PDF: 3976
  • HTML: 2467
  • Cited by: 0
History
  • Received:July 05,2022
  • Revised:August 18,2022
  • Online: January 13,2023
  • Published: October 06,2023
You are the first2034587Visitors
Copyright: Institute of Software, Chinese Academy of Sciences Beijing ICP No. 05046678-4
Address:4# South Fourth Street, Zhong Guan Cun, Beijing 100190,Postal Code:100190
Phone:010-62562563 Fax:010-62562533 Email:jos@iscas.ac.cn
Technical Support:Beijing Qinyun Technology Development Co., Ltd.

Beijing Public Network Security No. 11040202500063