Software Reliability Model Considering both Testing Effort and Testing Coverage
Author:
Affiliation:

  • Article
  • | |
  • Metrics
  • |
  • Reference [42]
  • |
  • Related [20]
  • | | |
  • Comments
    Abstract:

    To further improve the fitting and prediction performance of the non-homogeneous Poisson process (MHPP) software reliability growth models (SRGMs), this paper, as the extension work of the NHPP software reliability modeling framework which considers the TEF, will discuss how to integrate both TEF and TCF into the traditional NHPP software reliability modeling process. This is done in order to capture the integrated effect of testing effort and testing coverage on reliability estimation. First, a comprehensive modeling framework for incorporating the TEF and TCF together into the NHPP SRGMs is proposed. Recur to this framework, a new NHPP SRGM (named IS-LO-SRGM) with both the IS-TEF and logistic TCF (LO-TCF) is proposed. Meanwhile, two issues of this proposed framework are discussed respectively (i.e. how to select the most appropriate TEF and TCF for modeling and the parameter estimation). Then, two case studies on two real failure data-sets are presented. The experimental results show that the IS-LO-SRGM nearly yields the best fitting and prediction results compared with the other comparison NHPP SRGMs for two data-sets. Thus, the applicability and effectiveness of this modeling framework are validated. Finally, the imperfect debugging phenomenon is also considered in the modeling framework for a further discussion.

    Reference
    [1] Lyu MR. Handbook of Software Reliability Engineering. New York: McGraw Hill, 1996.
    [2] Kapur PK, Ompal S, Aggarwal AG, Kumar R. Unified framework for developing testing effort dependent software reliabilitygrowth models. WSEAS Trans. on Systems, 2009,4(8):521-531.
    [3] Huang CY, Lyu MR. Estimation and analysis of some generalized multiple change-point software reliability models. IEEE Trans.on Reliability, 2011,60(2):498-514. [doi: 10.1109/TR.2011.2134350]
    [4] Xu GC, Liu XZ, Hu L, Fu XD, Dong YS. Software reliability assessment models incorporating software defect correlation.Ruanjian Xuebao/Journal of Software, 2011,22(3):439-450 (in Chinese with English abstract). http://www.jos.org.cn/1000-9825/3739.htm [doi: 10.3724/SP.J.1001.2011.03739]
    [5] Okamura H, Etani Y, Dohi T. A multi-factors software reliability model based on Logistic regression. In: Marathe M, ed. Proc. ofthe IEEE 21st Int’l Symp. on Software Reliability Engineering (short for ISSRE). San Jose: IEEE Computer Society, 2010. 31-40.
    [6] Kapur PK, Phan H, Anand S, Yadav K. A unified approach for developing software reliability growth models in the presence ofimperfect debugging and error generation. IEEE Trans. on Reliability, 2011,60(1):331-340. [doi: 10.1109/TR.2010.2103590]
    [7] Huang CY, Kuo SY, Lyu MR. An assessment of testing-effort dependent software reliability growth models. IEEE Trans. onReliability, 2007,56(2):198-211. [doi: 10.1109/TR.2007.895301]
    [8] Shibata K, Rinsaka K, Dohi T. Metrics-Based software reliability models using non-homogeneous Poisson processes. In: Vouk MA,ed. Proc. of the IEEE Int’l Symp. on Software Reliability Engineering (ISSRE). Raleigh: IEEE Computer Society, 2006. 52-61.[doi: 10.1109/ISSRE.2006.28]
    [9] Cai X, Lyu MR. Software reliability modeling with test coverage experimentation and measurement with a fault-tolerant softwareproject. In: Goseva-Popstojanova K, ed. Proc. of the 18th IEEE Int’l Symp. on Software Reliability Engineering. Trollhattan: IEEEComputer Society, 2007. 17-26. [doi: 10.1109/ISSRE.2007.17]
    [10] Kuo SY, Huang CY, Lyu MR. Framework for modeling software reliability, using various testing-efforts and fault-detection rates.IEEE Trans. on Reliability, 2001,50(3):310-320. [doi: 10.1109/24.974129]
    [11] Huang CY, Kuo SY. Analysis of incorporating logistic testing-effort function into software reliability modeling. IEEE Trans. onReliability, 2002,51(3):261-270. [doi: 10.1109/TR.2002.801847]
    [12] Ahmad N, Khan MGM, Rafi LS. A study of testing-effort dependent inflection S-shaped software reliability growth models withimperfect debugging. Int’l Journal of Quality & Reliability Management, 2010,27(1):89-110. [doi: 10.1108/02656711011009335]
    [13] Norman EF, Martin N. A critique of software defect prediction models. IEEE Trans. on Software Engineering, 1999,25(5):675-688. [doi: 10.1109/32.815326]
    [14] Yamada S, Hishitani J, Osaki S. Software reliability growth model with a Weibull testing effort: A model and application. IEEETrans. on Reliability, 1993,42(1):100-106. [doi: 10.1109/24.210278]
    [15] Ahmad N, Bokhari MU, Quadri SMK, Khan MGM. The exponentiated Weibull software reliability growth model with varioustesting-efforts and optimal release policy. Int’l Journal of Quality & Reliability Management, 2008,25(2):211-235. [doi: 10.1108/02656710810846952]
    [16] Lin CT, Huang CY. Enhancing and measuring the predictive capabilities of testing-effort dependent software reliability models.The Journal of Systems and Software, 2008,81:1025-1038. [doi: 10.1016/j.jss.2007.10.002]
    [17] Ahmad N, Khan MGM, Quadri SMK, Kumar M. Modeling and analysis of software reliability with Burr type X testing-effort andrelease-time determination. Journal of Modeling in Management, 2009,4(1):28-54. [doi: 10.1108/17465660910943748]
    [18] Huang CY. Cost-Reliability-Optimal release policy for software reliability models incorporating improvements in testing efficiency.The Journal of Systems and Software, 2005,77:139-155. [doi: 10.1016/j.jss.2004.10.014]
    [19] Huang CY, Lyu MR. Optimal release time for software systems considering cost, testing-effort, and test efficiency. IEEE Trans. onReliability, 2005,54(4):583-591. [doi: 10.1109/TR.2005.859230]
    [20] Ahmad N, Quadri SMK, Mohd R. Comparison of predictive capability of software reliability growth models with exponentiatedWeibull distribution. Int’l Journal of Computer Applications, 2011,15(6):40-43. [doi: 10.5120/1949-2607]
    [21] Chatterjee S, Misra RB, Alam SS. Joint effect of test effort and learning factor on software reliability and optimal release policy.Int’l Journal of System Science, 1997,28(4):391-396. http://dx.doi.org/10.1080/00207729708929399
    [22] Yamada S, Ohtera H, Narihisa H. Software reliability growth models with testing-effort. IEEE Trans. on Reliability, 1986,R-35(1):19-23. [doi: 10.1109/TR.1986.4335332]
    [23] Kapur PK, Goswami DN, Bardhan A, Singh O. Flexible software reliability growth model with testing effort dependent learningprocess. Applied Mathematical Modeling, 2008,32:1298-1307. [doi: 10.1016/j.apm.2007.04.002]
    [24] Kapur PK, Shatnawi O, Aggarwal AG, Ravi K. Unified framework for developing testing effort dependent software reliabilitygrowth models. WSEAS Trans. on Systems, 2009,4(8):521-531.
    [25] Jha PC, Gupta D, Yang B, Kapur PK. Optimal testing resource allocation during module testing considering cost, testing effort andreliability. Computers & Industrial Engineering, 2009,57:1122-1130. [doi: 10.1016/j.cie.2009.05.001]
    [26] Huang CY. Performance analysis of software reliability growth models with testing-effort and change-point. The Journal ofSystems and Software, 2005,76:181-194. [doi: 10.1016/j.jss.2004.04.024]
    [27] Kapur PK, Gupta A. Testing effort control using flexible software reliability growth model with change point. Int’l Journal ofPerformability Engineering, 2006,2(3):245-262.
    [28] Kapur PK, Grover PS, Younes S. Modeling an imperfect debugging phenomenon with testing effort. In: Ferraz P, ed. Proc. of theISSRE. Monterey: IEEE Computer Society, 1994. 178-183. [doi: 10.1109/ISSRE.1994.341371]
    [29] Lin CT, Huang CY, Chang JR. Integrating generalized Weibull-type testing-effort function and multiple change-points intosoftware reliability growth models. In: Huang WT, ed. Proc. of the 12th Asia-Pacific Software Engineering Conf. Taipei: IEEEComputer Society, 2005. 431-438.
    [30] Li QY, Li HF, Lu MY, Wang XC. Software reliability growth model with S-shaped testing effort function. Journal of BeijingUniversity of Aeronautics and Astronautics, 2011,37(2):149-155 (in Chinese with English abstract).
    [31] Malaiya YK, Li MN. Software reliability growth with test coverage. IEEE Trans. on Reliability, 2002,51(4):420-426. [doi: 10.1109/TR.2002.804489]
    [32] Del Frate F, Garg P, Mathur AP, Pasquini A. On the correlation between code coverage and software reliability. In: Joseph H, ed.Proc. of the 6th IEEE Int’l Symp. on Software Reliability Engineering. Toulouse: IEEE Computer Society, 1995. 124-132. [doi: 10.1109/ISSRE.1995.497650]
    [33] Briand LC, Phahl D. Using simulation for assessing the real impact of test-coverage on defect-coverage. IEEE Trans. on Reliability,2000,49(1):60-70.
    [34] Cai X. Coverage-Based testing strategies and reliability modeling for fault-tolerant software systems [Ph.D. Thesis]. Hong Kong:The Chinese University of Hong Kong, 2006.
    [35] Lyu MR, Huang Z, Sze SKS, Cai X. An empirical study on testing and fault tolerance for software reliability engineering. In:Malaiya Y, ed. Proc. of the 14th IEEE Int’l Symp. on Software Reliability Engineering. Denver: IEEE Computer Society, 2003.119-130. [doi: 10.1109/ISSRE.2003.1251036]
    [36] Gokhale SS, Trivedi KS. A time/structure based software reliability model. Annals of Software Engineering, 1999,8(1):85-121.[doi: 10.1023/A:1018923329647]
    [37] Pham H, Zhang XM. NHPP software reliability and cost models with testing coverage. European Journal of Operational Research,2003,145(2):443-454. [doi: 10.1016/S0377-2217(02)00181-9]
    [38] Li HF, Li QY, Lu MY. Software reliability modeling with logistic test coverage function. Journal of Computer Research andDevelopment, 2011,48(2):232-240 (in Chinese with English abstract).
    [39] Huang CY, Lin CT. Software reliability analysis by considering fault dependency and debugging time lag. IEEE Trans. onReliability, 2006,55(3):436-450. [doi: 10.1109/TR.2006.879607]
    [40] Lin CT. Reliability analysis and management during software testing and debugging [Ph.D. Thesis]. Hsinchu City: TsingHuaUniversity, 2009.
    [41] Xie JY, An JX, Zhu JH. NHPP software reliability growth model considering imperfect debugging. Ruanjian Xuebao/Journal ofSoftware, 2010,21(5):942-949 (in Chinese with English abstract). http://www.jos.org.cn/1000-9825/3539.htm [doi: 10.3724/SP.J.1001.2010.03539]
    [42] Barghout M. Predicting software reliability using an imperfect debugging Jelinski-Moranda non-homogeneous Poisson processmodel. Model Assisted Statistics and Applications, 2010,5:31-41.
    Cited by
    Comments
    Comments
    分享到微博
    Submit
Get Citation

李海峰,王栓奇,刘畅,郑军,李震.考虑测试工作量与覆盖率的软件可靠性模型.软件学报,2013,24(4):749-760

Copy
Share
Article Metrics
  • Abstract:4636
  • PDF: 6828
  • HTML: 0
  • Cited by: 0
History
  • Received:November 23,2011
  • Revised:April 26,2012
  • Online: March 26,2013
You are the first2033271Visitors
Copyright: Institute of Software, Chinese Academy of Sciences Beijing ICP No. 05046678-4
Address:4# South Fourth Street, Zhong Guan Cun, Beijing 100190,Postal Code:100190
Phone:010-62562563 Fax:010-62562533 Email:jos@iscas.ac.cn
Technical Support:Beijing Qinyun Technology Development Co., Ltd.

Beijing Public Network Security No. 11040202500063