一种协同过滤式零次学习方法
作者:
作者单位:

作者简介:

杨博(1974-),男,博士,教授,博士生导师,CCF杰出会员,主要研究领域为知识发现与知识工程,网络分析理论与应用,推荐系统,多智能体系统.
张春旭(1996-),女,学士,主要研究领域为数据挖掘,网络表示学习.
张钰雪晴(1997-),女,硕士,主要研究领域为零次学习,深度学习.
黄晶(1975-),女,博士,副教授,博士生导师,CCF专业会员,主要研究领域为大规模网络数据挖掘与学习,智能大数据处理,复杂网络分析,深度学习,多Agent系统,数据驱动的智能传染病防控.
彭羿达(1996-),男,学士,主要研究领域为计算机视觉.

通讯作者:

黄晶,E-mail:huangjing@jlu.edu.cn

中图分类号:

TP183

基金项目:

国家自然科学基金(61876069,62172185);吉林省自然科学基金(20200201036JC);吉林省科技厅重点研发项目(20180201044GX,20180201067GX)


Collaborative Filtering Based Zero-Shot Learning
Author:
Affiliation:

Fund Project:

National Natural Science Foundation of China (61876069, 62172185); Jilin Province Natural Science Foundation (20200201036JC); Jilin Province Key Scientific and Technological Research and Development Project (20180201044GX, 20180201067 GX)

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    深度学习算法在很多有监督学习任务上达到了令人满意的结果,但其依赖于大量标注样本,并且使用特定类别训练的分类器,只能对这些类别进行分类.零次学习希望计算机像人类一样,能够结合历史经验与知识进行推理,无需使用大量新类别样本训练,便可达到识别新类别的效果.发现了零次学习任务存在“冷启动”以及矩阵稀疏两个特点,这些特点在推荐任务中同样存在.受推荐任务启发,将零次图像分类任务建模为矩阵填充问题,借鉴推荐领域中协同过滤算法,将稀疏的样本标签矩阵视为非稀疏的视觉特征矩阵和类别特征矩阵的内积结果,进而实现对新类别样本的分类预测.此外,构建了基于类间语义关联的语义图结构,使用图神经网络进行已知类别和新类别之间的知识迁移,以较小代价为类别学得准确的语义特征.在3个经典零次学习数据集上分别进行传统零次学习和广义零次学习实验,实验结果表明:提出的协同过滤式零次学习方法能够有效提升分类精度,且训练代价较小.

    Abstract:

    Many deep learning algorithms have achieved satisfactory results on many supervised learning tasks, but they rely on a large number of labeled samples, and the classifiers trained with specific categories can only classify these categories. Zero-shot learning wishes that the computer can reason like a human, it uses historical knowledge to infer the characteristics of new objects and has the ability to recognize novel categories without lots of samples. It is found that there are sparse matrix and "cold-start" phenomena in zero-shot learning task, these phenomena are also in the recommendation tasks. Inspired by the recommendation tasks, the zero-shot classification task is modeled as a matrix completion problem, hoping to learn from the collaborative filtering algorithms in the recommendation field, which regards the sparse labeled matrix as the product of the visual feature matrix and semantic feature matrix, and then classifies the novel samples. In order to make the semantic representation of each category more accurate, a semantic graph structure is constructed based on the semantic relations between categories and a graph neural network is applied on it for information transferring between known and novel categories. Traditional zero-shot learning and generalized zero-shot learning experiments are performed on three classic zero-shot learning data sets. The experimental results show that the collaborative filtering based zero-shot learning method proposed in this study can effectively improve the classification accuracy, and the training cost is relatively small.

    参考文献
    相似文献
    引证文献
引用本文

杨博,张钰雪晴,彭羿达,张春旭,黄晶.一种协同过滤式零次学习方法.软件学报,2021,32(9):2801-2815

复制
分享
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:2020-11-12
  • 最后修改日期:2021-02-11
  • 录用日期:
  • 在线发布日期: 2021-09-15
  • 出版日期: 2021-09-06
您是第位访问者
版权所有:中国科学院软件研究所 京ICP备05046678号-3
地址:北京市海淀区中关村南四街4号,邮政编码:100190
电话:010-62562563 传真:010-62562533 Email:jos@iscas.ac.cn
技术支持:北京勤云科技发展有限公司

京公网安备 11040202500063号