微信服务号

微信订阅号

2025-4-6- 9
Home > Archive>Volume 32, Issue 4, 2021 >1039-1050. DOI:10.13328/j.cnki.jos.006220
PDF HTML XML Export Cite reminder
Fault-localization Technique Based on Coincidental Correctness Probability
Author:
Affiliation:

Clc Number:

TP311

  • Article
    • | |
  • Metrics
    • |
  • Reference [36]
    • |
  • Related [20]
    • | | |
  • Comments
    Abstract:

    Coverage-based fault localization is a common technique that identifies the executing program elements correlating with failure. However, the effectiveness of coverage-based fault localization suffers from the effect of coincidental correctness which occurs when a fault is executed but no failure is detected. Coincidental correctness is prevalent. In the previous work, a method is proposed to estimate the probability that coincidental correctness happens for each program execution using dynamic data-flow analysis and control-flow analysis. In this study, a new fault-localization approach is proposed based on the coincidental correctness probability. To evaluate the proposed approach, safety and precision are used as evaluation metrics. The experiment involved Siemens test suite from Software-artifact Infrastructure Repository (SIR) which is mostly used in related works. The results are compared with Tarantula and the fault-localization technique based on coincidental correctness probability. The results show that the proposed approach can improve the safety and precision of the fault-localization technique significantly.

    Reference
    [1] Jones JA. Semi-automatic fault localization. Dissertations & Theses-Gradworks, 2008,53(8):755-764.
    [2] Wong WE, Gao R, Li Y, et al. A survey on software fault localization. IEEE Trans. on Software Engineering, 2016,42(8):707-740.[doi:10.1109/TSE.2016.2521368]
    [3] Zhang ZY, Jiang B, Chan WK, et al. Fault localization through evaluation sequences. Journal of Systems and Software, 2010, 83(2):174-187.[doi:10.1016/j.jss.2009.09.041]
    [4] Yu Y, Jones J, Harrold MJ. An empirical study of the effects of test-suite reduction on fault localization. In:Proc. of the Int'l Conf. on Software Engineering. 2008. 201-210.[doi:10.1145/1368088.1368116]
    [5] Masri W, Abou-Assi R, El-Ghali M, et al. An empirical study of the factors that reduce the effectiveness of coverage-based fault localization. In:Proc. of the Int'l Workshop on Defects in Large Software Systems:Held in Conjunction with the ACM SIGSOFT Int'l Symp. on Software Testing and Analysis. 2009. 1-5.[doi:10.1145/1555860.1555862]
    [6] Lei Y, Sun SN, Mao XG, et al. How test suites impact fault localisation starting from the size. IET Software, 2018,12(3):190-205.[doi:10.1049/iet-sen.2017.0026]
    [7] Masri W, Podgurski A. Measuring the strength of information flows in programs. ACM Trans. on Software Engineering and Methodology, 2009,19(2):5:1-5:33.[doi:10.1145/1571629.1571631]
    [8] Masri W, Abou-Assi R. Prevalence of coincidental correctness and mitigation of its impact on fault localization. ACM Trans. on Software Engineering and Methodology, 2014,23(1):8:1-8:28.[doi:10.1145/2559932]
    [9] Zhou XL, Wang LZ, Li XD, et al. An empirical study on the test adequacy criterion based on coincidental correctness probability. In:Proc. of the 26th Int'l Conf. on Software Engineering and Knowledge Engineering. 2014. 632-635.[doi:10.1145/2020723. 2020743]
    [10] Wong WE, Qi Y, Zhao L, et al. Effective fault localization using code coverage. In:Proc. of the Annual Int'l Computer Software and Applications Conf. 2007,1:449-456.[doi:10.1109/COMPSAC.2007.109]
    [11] Liblit B, Mayur M, Zheng AX, et al. Scalable statistical bug isolation. ACM SIGPLAN Notices, 2005,40(6):15-26.[doi:10.1145/1064978.1065014]
    [12] Jones JA, Harrold MJ. Empirial evaluation of the Tarantula automatic fault-localization technique. In:Proc. of the 20th IEEE/ACM Int'l Conf. on Automated Software Testing and Analysis. 2005. 293-282.
    [13] Rui A, Zoeteweij P, Gemund AJCV. An evaluation of similarity coefficients for software fault localization. In:Proc. of the Pacific RIM Int'l Symp. on Dependable Computing. 2006. 39-46.
    [14] Rui A, Zoeteweij P, Gemund AJCV. On the accuracy of spectrum-based fault localization. In:Proc. of the Testing:Academia-Industry Collaboration, Practice and Research Techniques. 2007. 89-98.[doi:10.1109/taic.part.2007.13]
    [15] Jones JA, Harrold MJ. Empirial evaluation of the Tarantula automatic fault-localization technique. In:Proc. of the IEEE/ACM Int'l Conf. on Automated Software Testing and Analysis. 2005. 273-282.
    [16] Wong WE, Debroy V, Choi B. A family of code coverage-based heuristics for effective fault localization. Journal of Systems and Software, 2010,83(2):188−208.[doi:10.1016/j.jss.2009.09.037]
    [17] Wong E, Wei T, Qi Y, et al. A crosstab-based statistical method for effective fault localization. In:Proc. of the Software Testing, Verification, and Validation. 2008. 42-51.[doi:10.1109/ICST.2008.65]
    [18] Wong WE, Debroy V, Gao R, et al. The DStar method for effective software fault localization. IEEE Trans. on Reliability, 2014,63(1):290-308.[doi:10.1109/TR.2013.2285319]
    [19] Yoo S. Evolving human competitive spectra-based fault localisation techniques. In:Proc. of the Int'l Symp. on Search Based Software Engineering. 2012,7515:244-258.
    [20] Masri W, Abou-Assi R. Cleansing test suites from coincidental correctness to enhance fault-localization. In:Proc. of the Int'l Conf. on Software Testing, Verification, and Validation. 2010. 165-174.[doi:10.1109/icst.2010.22]
    [21] Budd TA, Angluin D. Two notions of correctness and their relation to testing. Acta Informatica, 1982,18(1):31-45.[doi:10.1007/bf00625279]
    [22] Voas JM. PIE:A dynamic failure-based technique. IEEE Trans. on Software Engineering, 1992,18(8):717-727.[doi:10.1109/32. 153381]
    [23] Ammann P, Offutt P. Introduction to Software Testing. Cambridge University Press, 2008.
    [24] Daran M. Software error analysis:A real case study involving real faults and mutations. In:Proc. of the ACM SIGSOFT Int'l Symp. on Software Testing and Analysis. 1996. 158-171.[doi:10.1145/226295.226313]
    [25] Denmat T, Ducasse M, Ridoux O. Data mining and crosschecking of execution traces. In:Proc. of the ACM Int'l Conf. on Automated Software Engineering. 2012. 369-399.[doi:10.1145/1101908.1101979]
    [26] Miao Y, Chen ZY, Li SH, et al. A clustering-based strategy to identify coincidental correctness in fault localization. Int'l Journal of Software Engineering and Knowledge Engineering, 2013,23(5):721-741.[doi:10.1142/S0218194013500186]
    [27] Li Y, Liu C. Identifying coincidental correctness in fault localization via cluster analysis. Journal of Software Engineering, 2014, 8(4):328-344.
    [28] Sun ZQ. Identifying coincidental correctness using path similarity[Ph.D. Thesis]. Dalian:Dalian Maritime University, 2014(in Chinese with English abstract).
    [29] Wang XM, Cheung SH, Chan WK, et al. Taming coincidental correctness:Coverage refinement with context patterns to improve fault localization. In:Proc. of the Int'l Conf. on Software Engineering. Vancouver, 2009. 45-55.
    [30] Zhang Z, Tan QP, Mao XG, et al. Effective fault localization approach based on enhanced contexts. Ruan Jian Xue Bao/Journal of Software, 2019,30(2):366-281(in Chinese with English abstract). http://www.jos.org.cn/1000-9825/5677.htm[doi:10.13328/j.cnki. jos.005677]
    [31] Chen J, Li Q, Zhao JH. Test adequacy criterion based on coincidental correctness probability. Journal of Frontiers of Computer Scienceand Technology, 2011,5(7):602-612.
    [32] Hierons RM. Avoiding coincidental correctness in boundary value analysis. ACM Trans. on Software Engineering and Methodology, 2006,15:227-241.[doi:10.1145/1151695.1151696]
    附中文参考文献:
    [28] 孙召倩.利用路径相似度识别偶然性正确测试用例的方法[博士学位论文].大连:大连海事大学,2014.
    [30] 张卓,谭庆平,毛晓光,雷晏,常曦,薛建新.增强上下文的错误定位技术.软件学报,2019,30(2):266-281. http://www.jos.org.cn/1000-9825/5677.htm[doi:10.13328/j.cnki.jos.005677]
    [31] 陈洁,李倩,赵建华.以偶然正确性概率为基础的测试充分度准则.计算机科学与探索,2011,5(7):602-612.
    Cited by
    Comments
    Comments
    分享到微博
    Submit
Get Citation

周小莉,赵建华.基于偶然正确性概率的错误定位技术.软件学报,2021,32(4):1039-1050

Copy
Share
Article Metrics
  • Abstract:1973
  • PDF: 5146
  • HTML: 3374
  • Cited by: 0
History
  • Received:September 13,2020
  • Revised:October 26,2020
  • Online: January 22,2021
  • Published: April 06,2021
Links:Institute of Software, CASChina Computer FederationCASNSFC
You are the first2033330Visitors
Copyright: Institute of Software, Chinese Academy of Sciences Beijing ICP No. 05046678-4
Address：4# South Fourth Street, Zhong Guan Cun, Beijing 100190,Postal Code：100190
Phone：010-62562563 Fax：010-62562533 Email：jos@iscas.ac.cn
Technical Support：Beijing Qinyun Technology Development Co., Ltd.

Beijing Public Network Security No. 11040202500063