Deep-SBFL:基于频谱的深度神经网络缺陷定位方法
作者:
作者单位:

作者简介:

李铮(1998-),男,硕士生,CCF学生会员,主要研究领域为智能软件工程;崔展齐(1984-),男,博士,副教授,CCF高级会员,主要研究领域为软件测试及分析,智能软件工程;陈翔(1980-),男,博士,副教授,CCF高级会员,主要研究领域为软件缺陷预测,软件缺陷定位,回归测试,组合测试;王荣存(1979-),男,博士,副教授,CCF专业会员,主要研究领域为软件测试,缺陷定位,软件维护;刘建宾(1963-),男,博士,教授,CCF专业会员,主要研究领域为程序建模理论与方法,智能化软件开发技术,模型驱动软件工程;郑丽伟(1979-),男,博士,副教授,CCF专业会员,主要研究领域为需求工程,群体协同,大数据挖掘

通讯作者:

崔展齐,czq@bistu.edu.cn

中图分类号:

TP311

基金项目:

江苏省前沿引领技术基础研究专项(BK20202001);国家自然科学基金(61702041);江苏省自然科学基金面上项目(BK20181353);北京信息科技大学“勤信人才”培育计划(QXTCPC201906)


Deep-SBFL: Spectrum-based Fault Localization Approach for Deep Neural Networks
Author:
Affiliation:

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    深度神经网络已经在自动驾驶和智能医疗等领域取得了广泛的应用.与传统软件一样,深度神经网络也不可避免地包含缺陷,如果做出错误决定,可能会造成严重后果.因此,深度神经网络的质量保障受到了广泛关注.然而,深度神经网络与传统软件存在较大差异,传统软件质量保障方法无法直接应用于深度神经网络,需要设计有针对性的质量保障方法.软件缺陷定位是保障软件质量的重要方法之一,基于频谱的缺陷定位方法在传统软件的缺陷定位中取得了很好的效果,但无法直接应用于深度神经网络.在传统软件缺陷定位方法的基础上提出了一种基于频谱的深度神经网络缺陷定位方法Deep-SBFL.该方法首先通过收集深度神经网络的神经元输出信息和预测结果作为频谱信息;然后将频谱信息进行处理作为贡献信息,以用于量化神经元对预测结果所做的贡献;最后提出了针对深度神经网络缺陷定位的怀疑度公式,基于贡献信息计算深度神经网络中神经元的怀疑度并进行排序,以找出最有可能存在缺陷的神经元.为验证该方法的有效性,以EInspect@n(结果排序列表前n个位置内成功定位的缺陷数)和EXAM(在找到缺陷元素之前必须检查元素的百分比)作为评测指标,在使用MNIST数据集训练的深度神经网络上进行了实验.结果表明,该方法可有效定位深度神经网络中不同类型的缺陷.

    Abstract:

    Deep neural networks have been widely used in fields such as autonomous driving and smart healthcare. Like traditional software, deep neural networks inevitably contain defects, and it may cause serious consequences if they make wrong decisions. Therefore, the quality assurance of deep neural networks has received extensive attention. However, deep neural networks are quite different from traditional software. Traditional software quality assurance methods cannot be directly applied to deep neural networks, and targeted quality assurance methods need to be designed. Software fault localization is one of the important methods to ensure software quality. The spectrum-based fault localization method has achieved good results in traditional software fault localization methods, but it cannot be directly applied to deep neural networks. In this study, based on the traditional software fault localization methods, a spectrum-based fault localization approach named Deep-SBFL for deep neural network is proposed. The approach firstly collects the neuron output information and the prediction results of deep neural network as the spectrum. The spectrum is then further calculated as the contribution information, which can be used to quantify the contribution of neurons to the predicted results. Finally, a suspicious formula for the defect localization of deep neural network is proposed. Based on the contribution information, the suspiciousness scores of neurons in deep neural network are calculated and ranked to find out the most likely defective neurons. To verify the effectiveness of the method, EInspect@n (the number of defects successfully located by inspecting the first n positions of the sorted list) and EXAM (the percentage of elements that must be checked before finding defect elements) are evaluated on a deep neural network trained by the MNIST data set. Experimental results show that this approach can effectively locate different types of defects in deep neural networks.

    参考文献
    相似文献
    引证文献
引用本文

李铮,崔展齐,陈翔,王荣存,刘建宾,郑丽伟. Deep-SBFL:基于频谱的深度神经网络缺陷定位方法.软件学报,2023,34(5):2231-2250

复制
分享
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:2020-12-21
  • 最后修改日期:2021-02-24
  • 录用日期:
  • 在线发布日期: 2022-07-07
  • 出版日期:
您是第位访问者
版权所有:中国科学院软件研究所 京ICP备05046678号-3
地址:北京市海淀区中关村南四街4号,邮政编码:100190
电话:010-62562563 传真:010-62562533 Email:jos@iscas.ac.cn
技术支持:北京勤云科技发展有限公司

京公网安备 11040202500063号