Information Fusion Recommendation Approach Combining Attention CNN and GNN
Author:
Affiliation:

Clc Number:

TP391

Fund Project:

National Natural Science Foundation of China (61762041); Jiangxi Provincial Natural Science Foundation of China (20181BAB202009); Key Project of Science and Technology of Jiangxi Provincial Department of Education of China (GJJ180250)

  • Article
  • | |
  • Metrics
  • |
  • Reference [52]
  • |
  • Related [20]
  • | | |
  • Comments
    Abstract:

    The sparsity has always been a primary challenge for recommendation system, and information fusion recommendation can alleviate this problem by exploiting user preference through their comments, ratings, and trust information, so as to generate corresponding recommendations for target users. Full learning of user and item information is the key to build a successful recommendation system. Different users have different preferences for various items, and users’ interest preferences and social circle are changeable dynamically. A recommendation method combining deep learning and information fusion is proposed to solve the problem of sparsity. Particularly, a new deep learning model named information fusion recommendation model combining attention CNN and GNN (ACGIF for short), is constructed. First, attention mechanism is added to the CNN to process the comment information and learn the personalized representation of users and items from the comment information. It learns the comment representation based on comment coding, and learns the user/item representation in the comment through user/item coding. It adds personalized attention mechanism to filter comments with different levels of importance. Then, the rating and trust information are processed through the GNN. For each user, the diffusion process begins with the initial embedding, combining the relevant features and the free user potential vectors that capture the potential behavioral preferences. A layered influence propagation structure is designed to simulate how the user’s potential embedding evolves as the social diffusion process continues. Finally, the preference vector of the user for the item obtained from the first two parts is weighted and fused to obtain the preference vector of the final user for the item. The MAE and RMSE of the recommended results are employed as the experimenalevaluation indicators on four public data sets. The experimental results show that the proposed model has better recommendation effect and running time compared with the existing seven typical recommendation models.

    Reference
    [1] Shi FJ, Ghedira C. Improving recommender systems with an intention-based algorithm switching strategy. In: Proc. of the 2017 Symp. on Applied Computing. Marrakech: ACM, 2017. 1668–1673.
    [2] Brovman YM, Jacob M, Srinivasan N, Neola S, Galron D, Snyder R, Wang P. Optimizing similar item recommendations in a semi-structured marketplace to maximize conversion. In: Proc. of the 10th ACM Conf. on Recommender Systems. Boston: ACM, 2016. 199–202.
    [3] Goldberg D, Nichols D, Oki BM, Terry D. Using collaborative filtering to weave an information tapestry. Communications of the ACM, 1992, 35(12): 61–70. [doi: 10.1145/138859.138867]
    [4] Wu Y, DuBois C, Zheng AX, Ester M. Collaborative denoising auto-encoders for top-n recommender systems. In: Proc. of the 9th ACM Int’l Conf. on Web Search and Data Mining. San Francisco: ACM, 2016. 153–162.
    [5] Zhang S, Yao LN, Sun AX, Tay Y. Deep learning based recommender system: A survey and new perspectives. ACM Computing Surveys, 2019, 52(1): 5. [doi: 10.1145/3285029]
    [6] Kim D, Park C, Oh J, Li S, Yu H. Convolutional matrix factorization for document context-aware recommendation. In: Proc. of the 10th ACM Conf. on Recommender Systems. Boston: ACM, 2016. 233–240.
    [7] 戴琳, 孟祥武, 张玉洁, 纪威宇. 融合多种数据信息的餐馆推荐模型. 软件学报, 2019, 30(9): 2869–2885. http://www.jos.org.cn/1000-9825/5540.htm
    Dai L, Meng XW, Zhang YJ, Ji WY. Restaurant recommendation model with multiple information fusion. Ruan Jian Xue Bao/Journal of Software, 2019, 30(9): 2869–2885 (in Chinese with English abstract). http://www.jos.org.cn/1000-9825/5540.htm
    [8] 李琳, 刘锦行, 孟祥福, 苏畅, 李鑫, 钟珞. 融合评分矩阵与评论文本的商品推荐模型. 计算机学报, 2018, 41(7): 1559–1573. [doi: 10.11897/SP.J.1016.2018.01559]
    Li L, Liu JH, Meng XF, Su C, Li X, Zhong L. Recommendation models by exploiting rating matrix and review text. Chinese Journal of Computers, 2018, 41(7): 1559–1573 (in Chinese with English abstract). [doi: 10.11897/SP.J.1016.2018.01559]
    [9] 吴宾, 娄铮铮, 叶阳东. 一种面向多源异构数据的协同过滤推荐算法. 计算机研究与发展, 2019, 56(5): 1034–1047. [doi: 10.7544/issn1000-1239.2019.20180461]
    Wu B, Lou ZZ, Ye YD. A collaborative filtering recommendation algorithm for multi-source heterogeneous data. Journal of Computer Research and Development, 2019, 56(5): 1034–1047 (in Chinese with English abstract). [doi: 10.7544/issn1000-1239.2019.20180461]
    [10] 陈婷, 朱青, 周梦溪, 王珊. 社交网络环境下基于信任的推荐算法. 软件学报, 2017, 28(3): 721–731. http://www.jos.org.cn/1000-9825/5159.htm
    Chen T, Zhu Q, Zhou MX, Wang S. Trust-based recommendation algorithm in social network. Ruan Jian Xue Bao/Journal of Software, 2017, 28(3): 721–731 (in Chinese with English abstract). http://www.jos.org.cn/1000-9825/5159.htm
    [11] 刘华锋, 景丽萍, 于剑. 融合社交信息的矩阵分解推荐方法研究综述. 软件学报, 2018, 29(2): 340–362. http://www.jos.org.cn/1000-9825/5391.htm
    Liu HF, Jing LP, Yu J. Survey of matrix factorization based recommendation methods by integrating social information. Ruan Jian Xue Bao/Journal of Software, 2018, 29(2): 340–362 (in Chinese with English abstract). http://www.jos.org.cn/1000-9825/5391.htm
    [12] 潘一腾, 何发智, 于海平. 一种基于信任关系隐含相似度的社会化推荐算法. 计算机学报, 2018, 41(1): 65–81. [doi: 10.11897/SP.J.1016.2018.00065]
    Pan YT, He FZ, Yu HP. Social recommendation algorithm using implicit similarity in trust. Chinese Journal of Computers, 2018, 41(1): 65–81 (in Chinese with English abstract). [doi: 10.11897/SP.J.1016.2018.00065]
    [13] Michlmayr E, Cayzer S. Learning user profiles from tagging data and leveraging them for personal(ized) information access. In: Proc. of the 2007 WWW2007. Banff, 2007. 1–7.
    [14] Mooney RJ, Roy L. Content-based book recommending using learning for text categorization. In: Proc. of the 5th ACM Conf. on Digital Libraries. San Antonio: ACM, 2000. 195–204.
    [15] Huo H, Zhang W, Liu L, Li Y. Collaborative filtering recommendation model based on convolutional denoising auto encoder. In: Proc. of the 12th Chinese Conf. on Computer Supported Cooperative Work and Social Computing. Chongqing: ACM, 2017. 64–71.
    [16] 张宜浩, 朱小飞, 徐传运, 董世都. 基于用户评论的深度情感分析和多视图协同融合的混合推荐方法. 计算机学报, 2019, 42(6): 1316–1333. [doi: 10.11897/SP.J.1016.2019.01316](查阅所有网上资料, DOI打不开, 请联系作者确认)
    Zhang YH, Zhu XF, Xu CY, Dong SD. Hybrid recommendation approach based on deep sentiment analysis of user reviews and multi-view collaborative fusion. Chinese Journal of Computers, 2019, 42(6): 1316–1333 (in Chinese with English abstract). [doi: 10.11897/SP.J.1016.2019.01316]
    [17] 黄立威, 江碧涛, 吕守业, 刘艳博, 李毅德. 基于深度学习的推荐系统研究综述. 计算机学报, 2018, 41(7): 1619–1647. [doi: 10.11897/SP.J.1016.2018.01619]
    Huang LW, Jiang BT, Lv SY, Liu YB, Li YD. Survey on deep learning based recommender systems. Chinese Journal of Computers, 2018, 41(7): 1619–1647 (in Chinese with English abstract). [doi: 10.11897/SP.J.1016.2018.01619]
    [18] Lu YC, Dong RH, Smyth B. Coevolutionary recommendation model: Mutual learning between ratings and reviews. In: Proc. of the 2018 World Wide Web Conf. Lyon: ACM, 2018. 773–782.
    [19] Liu HT, Wu FZ, Wang WJ, Wang XC, Jiao PF, Wu CH. NRPA: Neural recommendation with personalized attention. In: Proc. of the 42nd Int’l ACM SIGIR Conf. on Research and Development in Information Retrieval. Paris: ACM, 2019: 1233–1236.
    [20] Kipf TN, Welling M. Semi-supervised classification with graph convolutional networks. In: Proc. of the 5th Int’l Conf. on Learning Representations. Toulon: OpenReview.net, 2017. 24–26.
    [21] Hamilton WL, Ying R, Leskovec J. Inductive representation learning on large graphs. In: Proc. of the 31st Int’l Conf. on Neural Information Processing Systems. Long Beach: ACM, 2017. 1025–1035.
    [22] Hamilton WL, Ying R, Leskovec J. Representation learning on graphs: Methods and applications. IEEE Data Engineering Bulletin, 2017, 40(3): 52–74.
    [23] van den Berg R, Kipf TN, Welling M. Graph convolutional matrix completion. arXiv:1706.02263, 2017.
    [24] Wu L, Sun PJ, Fu YJ, Hong RC, Wang XT, Wang M. A neural influence diffusion model for social recommendation. In: Proc. of the 42nd Int’l ACM SIGIR Conf. on Research and Development in Information Retrieval. Paris: ACM, 2019: 235–244.
    [25] Wu L, Li JW, Sun PJ, Hong RC, Ge Y, Wang M. DiffNet++: A neural influence and interest diffusion network for social recommendation. IEEE Trans. on Knowledge and Data Engineering.
    [26] Zhang YF, Ai QY, Chen X, Croft WB. Joint representation learning for top-n recommendation with heterogeneous information sources. In: Proc. of the 2017 ACM on Conf. on Information and Knowledge Management. Singapore: ACM, 2017. 1449–1458.
    [27] Koren Y. Factorization meets the neighborhood: A multifaceted collaborative filtering model. In: Proc. of the 14th ACM SIGKDD Int’l Conf. on Knowledge Discovery and Data Mining. Las Vegas: ACM, 2008. 426–434.
    [28] Guo GB, Zhang J, Yorke-Smith N. TrustSVD: Collaborative filtering with both the explicit and implicit influence of user trust and of item ratings. In: Proc. of the 29th AAAI Conf. on Artificial Intelligence. Austin: AAAI Press, 2015. 123–129.
    [29] Kim Y. Convolutional neural networks for sentence classification. In: Proc. of the 2014 Conf. on Empirical Methods in Natural Language Processing. Doha: Association for Computational Linguistics, 2014. 1746–1751.
    [30] Wang H, Wang NY, Yeung DY. Collaborative deep learning for recommender systems. In: Proc. of the 21st ACM SIGKDD Int’l Conf. on Knowledge Discovery and Data Mining. Sydney: ACM, 2014. 1235–1244.
    [31] Wang ML, Ma J. A novel recommendation approach based on users’ weighted trust relations and the rating similarities. Soft Computing, 2016, 20(10): 3981–3990. [doi: 10.1007/s00500-015-1734-1]
    [32] Noda K, Yamaguchi Y, Nakadai K, Okuno HG, Ogata T. Audio-visual speech recognition using deep learning. Applied Intelligence, 2015, 42(4): 722–737. [doi: 10.1007/s10489-014-0629-7]
    [33] Shen YL, He XD, Gao JF, Deng L, Mesnil G. A latent semantic model with convolutional-pooling structure for information retrieval. In: Proc. of the 23rd ACM Int’l Conf. on Conf. on Information and Knowledge Management. Shanghai: ACM, 2014. 101–110.
    [34] Kalchbrenner N, Grefenstette E, Blunsom P. A convolutional neural network for modelling sentences. In: Proc. of the 52nd Annual Meeting of the Association for Computational Linguistics. Baltimore: Association for Computational Linguistics, 2014. 655–665.
    [35] Pennington J, Socher R, Manning C. GloVe: Global vectors for word representation. In: Proc. of the 2014 Conf. on Empirical Methods in Natural Language Processing. Doha: Association for Computational Linguistics, 2014. 1532–1543.
    [36] Collobert R, Weston J, Bottou L, Karlen M, Kavukcuoglu K, Kuksa P. Natural language processing (almost) from scratch. The Journal of Machine Learning Research, 2011, 12: 2493–2537. [doi: 10.5555/1953048.2078186]
    [37] Glorot X, Bordes A, Bengio Y. Deep sparse rectifier neural networks. In: Proc. of the 14th Int’l Conf. on Artificial Intelligence and Statistics. Lauderdale: JMLR. org, 2011. 315–323.
    [38] Maas AL, Hannun AY, Ng AY. Rectifier nonlinearities improve neural network acoustic models. In: Proc. of the 30th Int’l Conf. on Machine Learning. Atlanta: JMLR, 2013. 1152–1160.
    [39] 皮怀雨. 基于多源异构数据的混合推荐模型 [硕士学位论文]. 北京: 北京交通大学, 2019.
    Pi HY. Hybrid recommendation models based on multi-source heterogeneous data [MS. Thesis]. Beijing: Beijing Jiaotong University, 2019 (in Chinese with English abstract).
    [40] Wang C, Blei DM. Collaborative topic modeling for recommending scientific articles. In: Proc. of the 17th ACM SIGKDD Int’l Conf. on Knowledge Discovery and Data Mining. San Diego: ACM, 2011. 448–456.
    [41] Shani G, Gunawardana A. Evaluating recommendation systems. In: Ricci F, Rokach L, Shapira B, Kantor PB, eds. Recommender Systems Handbook. Boston: Springer, 2011. 257–297.
    [42] Rendle S, Freudenthaler C, Gantner Z, Schmidt-Thieme L. BPR: Bayesian personalized ranking from implicit feedback. In: Proc. of the 25th Conf. on Uncertainty in Artificial Intelligence. Montreal: AUAI Press, 2009. 452–461.
    [43] Rendle S. Factorization machines. In: Proc. of the 2010 IEEE Int’l Conf. on Data Mining. Sydney: IEEE, 2010. 995–1000.
    Cited by
    Comments
    Comments
    分享到微博
    Submit
Get Citation

钱忠胜,赵畅,俞情媛,李端明.结合注意力CNN与GNN的信息融合推荐方法.软件学报,2023,34(5):2317-2336

Copy
Share
Article Metrics
  • Abstract:2193
  • PDF: 3237
  • HTML: 1720
  • Cited by: 0
History
  • Received:August 17,2020
  • Revised:December 13,2020
  • Online: July 07,2022
  • Published: May 06,2023
You are the first2034160Visitors
Copyright: Institute of Software, Chinese Academy of Sciences Beijing ICP No. 05046678-4
Address:4# South Fourth Street, Zhong Guan Cun, Beijing 100190,Postal Code:100190
Phone:010-62562563 Fax:010-62562533 Email:jos@iscas.ac.cn
Technical Support:Beijing Qinyun Technology Development Co., Ltd.

Beijing Public Network Security No. 11040202500063