Specification-Based Logic Coverage Testing Criteria
Affiliation:

  • Article
  • | |
  • Metrics
  • |
  • Reference [17]
  • |
  • Related
  • | | |
  • Comments
    Abstract:

    The specification-based testing can be used to test software functions without knowing program code. Decisions are the main form of the pre- and post-conditions in formal specifications. This work analyzes logic coverage testing criteria for specification-based testing. It proposes and analyzes in detail masking logic coverage testing criteria, to solve the problems that the existent determinant logic coverage testing criteria can not solve. A feasible test case generation algorithm based on the masking logic coverage testing criteria is presented. The test cases satisfying the masking logic coverage testing criteria can detect those errors caused by the masking property of conditions. It also analyzes the constraints among conditions, how to decompose and compose a complicated decision, and the relationship among decisions. These can respectively clarify the coupling problem among conditions, the multiple occurrences of a condition in a decision, and the position problem of decisions in a program. Additionally, test criteria including full true decision coverage, full false decision coverage, all sub-decisions coverage, unique condition true coverage and unique condition false coverage are proposed. The test sets satisfying these criteria can detect respectively different types of errors. Finally, the subsumption relation graph among these testing criteria is presented and different applicable scenarios for different testing criteria are suggested.

    Reference
    [1] Amman P, Offutt J. Coverage criteria for logical expressions. In: Stephanie K, ed. Proc. of the 14th Int’l Symp. on Software Reliability Engineering. Washington: IEEE Computer Society Press, 2003. 99?107.
    [2] Chilenski J, Miller S. Applicability of modified condition/decision coverage to software testing. Software Engineering Journal, 1994,9(5):193?200.
    [3] Vilkomir SA, Bowen JP. Reinforced condition/decision coverage (RC/DC): A new criterion for software testing. In: Proc. of the 2nd Int’l Conf. of Z and B Users. LNCS 2272, Heidelberg: Springer-Verlag, 2002. 295?313. http://core.ecu.edu/vilkomirs/Papers/ zb2002_Vilkomir.pdf
    [4] Offutt J, Xiong Y, Liu SY. Criteria for generating specification-based tests. In: Proc. of the 5th IEEE Int’l Conf. on Engineering of Complex Computer Systems. Washington: IEEE Computer Society Press, 1999. 119?129. http://www.ise.gmu.edu/~offutt/rsrch/ papers/SpecsICECCS99.pdf
    [5] Vilkomir SA, Bowen JP. Formalization of software testing criteria using the Z notation. In: Proc. of the 25th IEEE Annual Int’l Computer Software and Applications Conf. Washington: IEEE Computer Society Press, 2001. 351?356. http://reference.kfupm. edu.sa/content/f/o/formalization_of_software_testing_criter_95390.pdf
    [6] Zhu H. A formal analysis of the subsume relation between software test adequacy criteria. IEEE Trans. on Software Engineering, 1996,22(4):248?255. [doi: 10.1109/32.491648]
    [7] Hayhurst KJ, Veerhusen DS, Chilenski JJ, Rierson LK. A practical tutorial on modified condition/decision coverage. Technical Report, NASA/TM-2001-210876, Hampton: Langley Research Center, 2001.
    [8] Vilkomir SA, Bowen JP. From MC/DC to RC/DC: Formalization and analysis of control-flow testing criteria. Formal Aspects Computing, 2006,18(1):42?62. [doi: 10.1007/s00165-005-0084-7]
    [9] Yu YT, Lau MF. A comparison of MC/DC, MUMCUT and several other coverage criteria for logic decisions. Journal of System and Software, 2006,79(5):577?590. [doi: 10.1016/j.jss.2005.05.030]
    [10] Yu YT, Lau MF, Chen TY. Automatic generation of test cases from Boolean specifications using the MUMCUT strategy. Journal of System and Software, 2006,79(6):820?840. [doi: 10.1016/j.jss.2005.08.016]
    [11] Chen TY, Lau MF, Yu YT. MUMCUT: A fault-based strategy for testing Boolean specifications. In: Proc. of the 6th Asia-Pacific Software Engineering Conf. Washington: IEEE Computer Society Press, 1999. 606?613. http://www.computer.org/portal/web/ csdl/doi/10.1109/APSEC.1999.809656
    [12] Liu L, Miao HK. Axiomatic assessment of logic coverage software testing criteria. Journal of Software, 2004,15(9):1301?1310 (in Chinese with English abstract). http://www.jos.org.cn/1000-9825/15/1301.htm
    [13] Zhu H, Jin LZ. Software Quality Assurance and Quality Testing. Beijing: Science Press, 1997 (in Chinese).
    [14] Zhang XF, Xu BW, Nie CH, Shi L. An approach for optimizing test suite based on testing requirement reduction. Journal of Software, 2007,18(4):821?831 (in Chinese with English abstract). http://www.jos.org.cn/1000-9825/18/821.htm [doi: 10.1360/ jos180821]
    附中文参考文献: [12] 刘玲,缪淮扣.对逻辑覆盖软件测试准则的公理化评估.软件学报,2004,15(9):1301?1310. http://www.jos.org.cn/1000-9825/15/ 1301.htm
    [13] 朱鸿,金凌紫.软件质量保障与测试.北京:科学出版社,1997.
    [14] 章晓芳,徐宝文,聂长海,史亮.一种基于测试需求约简的测试用例集优化方法.软件学报,2007,18(4):821?831. http://www.jos.org. cn/1000-9825/18/821.htm [doi: 10.1360/jos180821]
    Related
    Cited by
    Comments
    Comments
    分享到微博
    Submit
Get Citation

钱忠胜,缪淮扣.基于规格说明的若干逻辑覆盖测试准则.软件学报,2010,21(7):1536-1549

Copy
Share
Article Metrics
  • Abstract:
  • PDF:
  • HTML:
  • Cited by:
History
  • Received:April 03,2008
  • Revised:March 31,2009
You are the first2038072Visitors
Copyright: Institute of Software, Chinese Academy of Sciences Beijing ICP No. 05046678-4
Address:4# South Fourth Street, Zhong Guan Cun, Beijing 100190,Postal Code:100190
Phone:010-62562563 Fax:010-62562533 Email:jos@iscas.ac.cn
Technical Support:Beijing Qinyun Technology Development Co., Ltd.

Beijing Public Network Security No. 11040202500063