Deep Recommendation Model with Cross-domain Association and Privacy Protection
Author:
Affiliation:

Clc Number:

TP309

  • Article
  • | |
  • Metrics
  • |
  • Reference [54]
  • |
  • Related [20]
  • | | |
  • Comments
    Abstract:

    Recommendation systems, which can effectively filter information based on user preferences, has been applied widely. The problem of cold start and data sparsity becomes more and more serious with the explosive growth of the number of users. Multi-source data fusion, which can effectively alleviate the recommendation accuracy under the conditions of data sparsity and the cold start problem, is favored by researchers. Its main idea is to fuse auxiliary information of users in other aspects for missing values filling to optimize the accuracy of target recommendation service. Nevertheless, more serious risk of privacy disclosure is introduced due to the relations between data. To solve the above problems, this study proposes a deep cross-domain recommendation model with privacy protection. In detail, a deep learning collaborative recommendation method is designed featuring multi-source data fusion and differential privacy protection. On the one hand, this method fuses auxiliary domain information to improve the accuracy of recommendation and corrects the deviation of abnormal points to improve the performance of the recommender system; on the other hand, this method adds noise in the collaborative training process based on differential privacy model to solve the data security problem in data fusion. In order to evaluate the long tail effect in the recommendation system, this study proposes a new metric—discovery degree for the first time, which is used to measure the ability of the recommendation algorithm to find users’ invisible requirements. Based on the performance comparison and analysis of the existing algorithms, the results show that the proposed method has better recommendation accuracy and diversity than the existing methods on the premise of ensuring privacy security, and can effectively discover the hidden needs of users.

    Reference
    [1] Jordan MI, Mitchell TM. Machine learning: Trends, perspectives, and prospects. Science, 2015, 349(6245): 255–260. [doi: 10.1126/science.aaa8415]
    [2] Berkovsky S, Goldwasser D, Kuflik T, Ricci F. Identifying inter-domain similarities through content-based analysis of hierarchical Web-directories. In: Proc. of the 17th European Conf. on Artificial Intelligence (ECAI 2006). Riva del Garda: IOS Press, 2006. 789–790.
    [3] Yi C, Shang MS, Zhang QM. Auxiliary domain selection in cross-domain collaborative filtering. Applied Mathematics & Information Sciences, 2015, 9(3): 1375–1381.
    [4] Sahebi S, Brusilovsky P. It takes two to Tango: An exploration of domain pairs for cross-domain collaborative filtering. In: Proc. of the 9th ACM Conf. on Recommender Systems. Vienna: ACM, 2015. 131–138.
    [5] Al-Qasem Al-Hadi IA, Sharef NM, Sulaiman N, Mustapha N. Ensemble divide and conquer approach to solve the rating scores' deviation in recommendation system. Journal of Computer Science, 2016, 12(6): 265–275. [doi: 10.3844/jcssp.2016.265.275]
    [6] Winoto P, Tang T. If you like the devil wears prada the book, will you also enjoy the devil wears prada the movie? A study of cross-domain recommendations. New Generation Computing, 2008, 26(3): 209–225. [doi: 10.1007/s00354-008-0041-0]
    [7] Fernández-Tobías I, Cantador I, Kaminskas M, Ricci F. A generic semantic-based framework for cross-domain recommendation. In: Proc. of the 2nd Int’l Workshop on Information Heterogeneity and Fusion in Recommender Systems. Chicago: ACM, 2011. 25–32.
    [8] Yang DQ, He JR, Qin HZ, Xiao YH, Wang W. A graph-based recommendation across heterogeneous domains. In: Proc. of the 24th ACM Int’l on Conf. on Information and Knowledge Management. Melbourne: ACM, 2015. 463–472.
    [9] Li X, He JS, Zhu NF, Hou ZQ. Collaborative filtering recommendation based on multi-domain semantic fusion. In: Proc. of the 44th IEEE Annual Computers, Software, and Applications Conf. (COMPSAC). Madrid: IEEE, 2020. 255–261.
    [10] Singh AP, Gordon GJ. Relational learning via collective matrix factorization. In: Proc. of the 14th ACM SIGKDD Int’l Conf. on Knowledge Discovery and Data Mining. Las Vegas: ACM, 2008. 650–658.
    [11] Shi Y, Larson M, Hanjalic A. Tags as bridges between domains: Improving recommendation with tag-induced cross-domain collaborative filtering. In: Konstan JA, Conejo R, Marzo JL, Oliver N, eds. User Modeling, Adaption and Personalization (UMAP 2011). Lecture Notes in Computer Science. Girona: Springer, 2011, 6787. 305–316.
    [12] Shapira B, Rokach L, Freilikhman S. Facebook single and cross domain data for recommendation systems. User Modeling and User-Adapted Interaction, 2013, 23(2): 211–247. [doi: 10.1007/s11257-012-9128-x]
    [13] Jiang M, Cui P, Chen XM, Wang F, Zhu WW, Yang SQ. Social recommendation with cross-domain transferable knowledge. IEEE Transactions on Knowledge and Data Engineering, 2015, 27(11): 3084–3097. [doi: 10.1109/TKDE.2015.2432811]
    [14] Jiang M, Cui P, Yuan NJ, Xie X, Yang SQ. Little is much: Bridging cross-platform behaviors through overlapped crowds. In: Proc. of the 30th AAAI Conf. on Artificial Intelligence. Phoenix: AAAI Press, 2016. 13–19.
    [15] Wang JQ, Lv J. Tag-informed collaborative topic modeling for cross domain recommendations. Knowledge-Based Systems, 2020, 203: 106119. [doi: 10.1016/j.knosys.2020.106119]
    [16] Ouhbi B, Frikh B, Zemmouri E, Abbad A. Deep learning based recommender systems. In: Proc. of the 5th IEEE Int’l Congress on Information Science and Technology (CiSt). Marrakech: IEEE, 2018. 161–166.
    [17] Covington P, Adams J, Sargin E. Deep neural networks for YouTube recommendations. In: Proc. of the 10th ACM Conf. on Recommender Systems. Boston: ACM, 2016. 191–198.
    [18] Cheng HT, Koc L, Harmsen J, Shaked T, Chandra T, Aradhye H, Anderson G, Corrado G, Chai W, Ispir M, Anil R, Haque Z, Hong LC, Jain V, Liu XB, Shah H. Wide & deep learning for recommender systems. arXiv:1606.07792v1, 2016.
    [19] Lian JX, Zhou XH, Zhang FZ, Chen ZX, Xie X, Sun GZ. xDeepFM: Combining explicit and implicit feature interactions for recommender systems. In: Proc. of the 24th ACM SIGKDD Int’l Conf. on Knowledge Discovery & Data Mining. London: ACM, 2018. 1754–1763.
    [20] Okura S, Tagami Y, Ono S, Tajima A. Embedding-based news recommendation for millions of users. In: Proc. of the 23rd ACM SIGKDD Int’l Conf. on Knowledge Discovery and Data Mining. Halifax: ACM, 2017. 1933–1942.
    [21] Ying R, He RN, Chen KF, Eksombatchai P, Hamilton WL, Leskovec J. Graph convolutional neural networks for Web-scale recommender systems. In: Proc. of the 24th ACM SIGKDD Int’l Conf. on Knowledge Discovery & Data Mining. London: ACM, 2018. 974–983.
    [22] 葛尧, 陈松灿. 面向推荐系统的图卷积网络. 软件学报, 2020, 31(4): 1101–1112. http://www.jos.org.cn/1000-9825/5928.htm
    0zGe Y, Chen SC. Graph convolutional network for recommender systems. Ruan Jian Xue Bao/Journal of Software, 2020, 31(4): 1101–1112 (in Chinese with English abstract). http://www.jos.org.cn/1000-9825/5928.htm
    [23] Krishnan A, Das M, Bendre M, Yang H, Sundaram H. Transfer learning via contextual invariants for one-to-many cross-domain recommendation. In: Proc. of the 43rd Int’l ACM SIGIR Conf. on Research and Development in Information Retrieval. Xi’an: ACM, 2020. 1081–1090.
    [24] McAuley J, Leskovec J. Hidden factors and hidden topics: Understanding rating dimensions with review text. In: Proc. of the 7th ACM Conf. on Recommender Systems. Hong Kong: ACM, 2013. 165–172.
    [25] 李琳, 刘锦行, 孟祥福, 苏畅, 李鑫, 钟珞. 融合评分矩阵与评论文本的商品推荐模型, 计算机学报, 2018, 41(7): 1559–1573.
    Li L, Liu JH, Meng XF, Su C, Li X, Zhong L. Recommendation models by exploiting rating matrix and review text. Chinese Journal of Computers, 2018, 41(7): 1559–1573 (in Chinese with English abstract).
    [26] Zheng L, Noroozi V, Yu PS. Joint deep modeling of users and items using reviews for recommendation. In: Proc. of the 10th ACM Int’l Conf. on Web Search and Data Mining. Cambridge: ACM, 2017. 425–434.
    [27] Chen C, Zhang M, Liu YQ, Ma SP. Neural attentional rating regression with review-level explanations. In: Proc. of the 2018 World Wide Web Conf. Lyon: Int’l World Wide Web Conf. Steering Committee, 2018. 1583–1592.
    [28] 冯兴杰, 曾云泽. 基于评分矩阵与评论文本的深度推荐模型. 计算机学报, 2020, 43(5): 884–900. [doi: 10.11897/SP.J.1016.2020.00884]
    Feng XJ, Zeng YZ. Joint deep modeling of rating matrix and reviews for recommendation. Chinese Journal of Computers, 2020, 43(5): 884–900 (in Chinese with English abstract). [doi: 10.11897/SP.J.1016.2020.00884]
    [29] Li Y, Xu JJ, Zhao PP, Fang JH, Chen W, Zhao L. ATLRec: An attentional adversarial transfer learning network for cross-domain recommendation. Journal of Computer Science and Technology, 2020, 35(4): 794–808. [doi: 10.1007/s11390-020-0314-8]
    [30] Zhao XY, Xia L, Zou LX, Liu H, Yin DW, Tang JL. Whole-chain recommendations. In: Proc. of the 29th ACM Int’l Conf. on Information and Knowledge Management. ACM, 2020. 1883–1891.
    [31] Casino F, Domingo-Ferrer J, Patsakis C, Puig D, Solanas A. A k-anonymous approach to privacy preserving collaborative filtering. Journal of Computer and System Sciences, 2015, 81(6): 1000–1011. [doi: 10.1016/j.jcss.2014.12.013]
    [32] Hu ZY, Luo YL, Zheng XY, Zhao YN. A novel privacy-preserving matrix factorization recommendation system based on random perturbation. Journal of Intelligent & Fuzzy Systems, 2020, 38(4): 4525–4535. [doi: 10.3233/JIFS-191287]
    [33] Hua JY, Xia C, Zhong S. Differentially private matrix factorization. In: Proc. of the 24th Int’l Conf. on Artificial Intelligence (IJCAI 2015). Buenos Aires: AAAI Press, 2015. 1763–1770.
    [34] Shin H, Kim S, Shin J, Xiao XK. Privacy enhanced matrix factorization for recommendation with local differential privacy. IEEE Transactions on Knowledge and Data Engineering, 2018, 30(9): 1770–1782. [doi: 10.1109/TKDE.2018.2805356]
    [35] 何明, 常盟盟, 吴小飞. 一种基于差分隐私保护的协同过滤推荐方法. 计算机研究与发展, 2017, 54(7): 1439–1451. [doi: 10.7544/issn1000-1239.2017.20160207]
    He M, Chang MM, Wu XF. A collaborative filtering recommendation method based on differential privacy. Journal of Computer Research and Development, 2017, 54(7): 1439–1451 (in Chinese with English abstract). [doi: 10.7544/issn1000-1239.2017.20160207]
    [36] Zhang LJ, Zhu XY, Ma JF, Ma Z, Yuan DN. Medical privacy-preserving service recommendation. In: Proc. of the 2020 IEEE Int’l Conf. on Communications (ICC 2020). Dublin: IEEE, 2020. 1–6.
    [37] Berkovsky S, Eytani Y, Kuflik T, Ricci F. Hierarchical neighborhood topology for privacy enhanced collaborative filtering. In: Proc. of the 2006 Workshop on Privacy-enhanced Personalization (PEP06, CHI 2006). Montreal, 2006. 6–13.
    [38] Kim S, Kim J, Koo D, Kim Y, Yoon H, Shin J. Efficient privacy-preserving matrix factorization via fully homomorphic encryption: Extended abstract. In: Proc. of the 11th ACM on Asia Conf. on Computer and Communications Security. Xi’an: ACM, 2016. 617–628.
    [39] Tang Q, Wang J. Privacy-preserving context-aware recommender systems: Analysis and new solutions. In: Pernul G, Ryan PYA, Weippl E, eds. Computer Security (ESORICS 2015). Lecture Notes in Computer Science. Vienna: Springer, 2015. 101–119.
    [40] Bourse F, Minelli M, Minihold M, Paillier P. Fast homomorphic evaluation of deep discretized neural networks. In: Shacham H, Boldyreva A, eds. Advances in Cryptology (CRYPTO 2018). Lecture Notes in Computer Science. Santa Barbara: Springer, 2018. 483–512.
    [41] Wang Q, Du MX, Chen XY, Chen YJ, Zhou P, Chen XF, Huang XY. Privacy-preserving collaborative model learning: The case of word vector training. IEEE Transactions on Knowledge and Data Engineering, 2018, 30(12): 2381–2393. [doi: 10.1109/TKDE.2018.2819673]
    [42] 刘国丽, 李昂, 李艳萍, 于丽梅. 跨系统协同过滤推荐算法的隐私保护技术研究. 计算机应用研究, 2017, 34(9): 2804–2807. [doi: 10.3969/j.issn.1001-3695.2017.09.053]
    Liu GL, Li A, Li YP, Yu LM. Privacy-preserving technology research on collaborative filtering recommendation algorithm between systems. Application Research of Computers, 2017, 34(9): 2804–2807 (in Chinese with English abstract). [doi: 10.3969/j.issn.1001-3695.2017.09.053]
    [43] Truex S, Baracaldo N, Anwar A, Steinke T, Ludwig H, Zhang R, Zhou Y. A hybrid approach to privacy-preserving federated learning. In: Proc. of the 12th ACM Workshop on Artificial Intelligence and Security. London: ACM, 2019. 1–11.
    [44] Shaik I, Singh AK, Narumanchi H, Emmadi N, Bhattachar RMA. A recommender system for efficient implementation of privacy preserving machine learning primitives based on FHE. In: Dolev S, Kolesnikov V, Lodha S, Weiss G, eds. Cyber Security Cryptography and Machine Learning (CSCML 2020). Lecture Notes in Computer Science, vol. 12161. Be’er Sheva: Springer, 2020. 193–218.
    [45] Wang LE, Wang YH, Bai Y, Liu P, Li XX. POI recommendation with federated learning and privacy preserving in cross domain recommendation. In: Proc. of the 2021 IEEE Conf. on Computer Communications Workshops. Vancouver: IEEE, 2021. 1–6.
    [46] Dwork C. Differential privacy. In: Bugliesi M, Preneel B, Sassone V, Wegener I, eds. Proc. of the 2006 Int’l Conf. on Automata, Languages and Programming (ICALP 2006). Venice: Springer, 2006. 1–12.
    [47] McSherry F, Talwar K. Mechanism design via differential privacy. In: Proc. of the 48th Annual IEEE Symp. on Foundations of Computer Science (FOCS 2007). Providence: IEEE, 2007. 94–103.
    [48] Xu YB, Yang YJ, Han JY, Wang E, Zhuang FZ, Yang JY, Xiong H. NeuO: Exploiting the sentimental bias between ratings and reviews with neural networks. Neural Networks, 2019, 111: 77–88. [doi: 10.1016/j.neunet.2018.12.011]
    [49] Lathia N, Hailes S, Capra L, Amatriain X. Temporal diversity in recommender systems. In: Proc. the 33rd Int’l ACM SIGIR Conf. on Research and Development in Information Retrieval. Geneva: ACM, 2010. 210–217.
    Cited by
    Comments
    Comments
    分享到微博
    Submit
Get Citation

王利娥,李东城,李先贤.基于跨域关联与隐私保护的深度推荐模型.软件学报,2023,34(7):3365-3384

Copy
Share
Article Metrics
  • Abstract:927
  • PDF: 3097
  • HTML: 1287
  • Cited by: 0
History
  • Received:November 26,2020
  • Revised:January 28,2021
  • Online: November 30,2022
  • Published: July 06,2023
You are the first2038061Visitors
Copyright: Institute of Software, Chinese Academy of Sciences Beijing ICP No. 05046678-4
Address:4# South Fourth Street, Zhong Guan Cun, Beijing 100190,Postal Code:100190
Phone:010-62562563 Fax:010-62562533 Email:jos@iscas.ac.cn
Technical Support:Beijing Qinyun Technology Development Co., Ltd.

Beijing Public Network Security No. 11040202500063