基于场景模型的DDS架构一体化舰船任务系统测试
作者:
通讯作者:

钱巨,E-mail:jqian@nuaa.edu.cn

中图分类号:

TP311

基金项目:

国防基础科研计划(JCKY2016206B001, JCKY2014206C002); 中央高校基本科研业务费专项资金(NS2021066)


Scenario Model Based Testing of Integrated DDS-based Naval Mission Systems
Author:
  • 摘要
  • | |
  • 访问统计
  • |
  • 参考文献 [41]
  • |
  • 相似文献 [20]
  • | | |
  • 文章评论
    摘要:

    以数据分发服务(data-distribution service, DDS)为基础架构的新型一体化舰船任务系统在研发模式、结构和应用方面具有特殊特点, 使得其测试相当具有挑战. 基于模型的测试(model-based testing, MBT)是工业系统测试的一种有效方法. 然而, 对于类舰船任务系统, 由于其自身的高度复杂性和协同开发方式, 传统需要建立完整模型以表达系统内部行为的MBT技术极难应用. 为此, 提出了一种基于场景模型的类舰船任务系统MBT方法. 方法从外部角度构建模型来表达DDS架构系统中的交互场景. 模型使用扩展正则表达式来建模交互序列, 使用基本数据元素限制、约束公式和计算函数来建模交互数据, 能够在保留抽象性的同时便捷并相对完整地表达交互过程. 基于场景模型, 进一步提出算法生成直接可执行的测试用例. 在某真实舰船任务系统上的实验表明, 方法能够测试从一族舰船任务系统历史失效中总结出的21种常见风险场景, 对类舰船任务系统的DDS架构工业系统测试具有潜在应用价值.

    Abstract:

    Modern integrated naval mission systems (NMS) built on data-distribution service (DDS) have special characteristics in development, structure, and application which, in combination, make their testing challenging. Model-based testing (MBT) is considered a promising technique for testing such systems. However, for NMS-like systems under test, due to their high complexity and cooperative ways of development, traditional MBT techniques requiring a complete model of the system internals are difficult to be used. This paper presents a scenario-based MBT approach for NMS-like systems. The approach builds scenario models to express the interaction scenarios in a DDS-based system from the external perspective. A scenario model uses an extended form of regular expression to model interaction sequences and uses basic data element restrictions (e.g., ranges and enumerations), constraints, and calculation functions to model interaction data. It can express the interaction processes in an abstract, convenient, and relatively comprehensive way. On the models, algorithms are proposed to generate directly executable test cases for testing. Experiments on a real NMS show that the approach can be used to test 21 kinds of common risky scenarios identified from historical failures reported during the development of a family of NMS. This indicates that the approach might be helpful for testing NMS-like DDS-based industrial systems.

    参考文献
    [1] 王达, 左艳军, 郭俊. 美国海军新一代水面舰艇作战系统体系架构. 指挥控制与仿真, 2018, 40(1): 132–140.
    Wang D, Zuo YJ, Guo J. New generation surface warship combat system of the US navy system architecture. Command Control & Simulation, 2018, 40(1): 132–140.
    [2] 宋敏, 韦正现, 印桂生. 面向数据流的网构软件服务动态演化分析. 软件学报, 2013, 24(12): 2797–2813. http://www.jos.org.cn/1000-9825/4396.htm
    Song M, Wei ZX, Yin GS. Evolution analysis of data flow oriented internetware service. Ruan Jian Xue Bao/Journal of Software, 2013,24(12):2797–2813 (in Chinese with English abstract). http://www.jos.org.cn/1000-9825/4396.htm
    [3] 陶传奇, 李必信, Gao J. 构件软件的回归测试复杂性度量. 软件学报, 2015, 26(12): 3043–3061. http://www.jos.org.cn/1000-9825/4876.htm
    Tao CQ, Li BX, Gao J. Complexity metrics for regression testing of component-based software. Ruan Jian Xue Bao/Journal of Software, 2015, 26(12): 3043–3061 (in Chinese with English abstract). http://www.jos.org.cn/1000-9825/4876.htm
    [4] Piel EAB, González A, Gross HG. Automating integration testing of large scale publish/subscribe systems. Principles and Applications of Distributed Event-based Systems. 2010. 140–163.
    [5] Köksal Ö, Tekinerdogan B. Obstacles in data distribution service middleware: A systematic review. Future Generation Computer Systems, 2017, 68: 191–210.
    [6] OMG. A data distribution service for real-time systems. 2015. https://www.omg.org/spec/DDS/1.4
    [7] Anand S, Burke EK, Chen TY, Clark J, Cohen MB, Grieskamp W, Harman M, Harrold MJ, McMinn P. An orchestrated survey of methodologies for automated software test case generation. Journal of Systems and Software, 2013, 86(8): 1978–2001. [doi: 10.1016/j.jss.2013.02.061]
    [8] Utting M, Pretschner A, Legeard B. A taxonomy of model-based testing approaches. Software Testing, Verification and Reliability, 2012, 22(5): 297–312. [doi: 10.1002/stvr.456]
    [9] Gurbuz HG, Tekinerdogan B. Model-based testing for software safety: A systematic mapping study. Software Quality Journal, 2018, 26(4): 1327–1372. [doi: 10.1007/s11219-017-9386-2]
    [10] Li YS, Pierce BC, Zdancewic S. Model-based testing of networked applications. In: Proc. of the 30th ACM SIGSOFT Int’l Symp. on Software Testing and Analysis (ISSTA). Virtual: ACM, 2021. 529–539.
    [11] Nebut C, Fleurey F, Le Traon Y, Jezequel JM. Automatic test generation: A use case driven approach. IEEE Transactions on Software Engineering, 2006, 32(3): 140–155. [doi: 10.1109/TSE.2006.22]
    [12] Dadeau F, Castillos KC, Tissot R. Scenario-based testing using symbolic animation of B models. Software Testing, Verification and Reliability, 2012, 22(6): 407–434. [doi: 10.1002/stvr.1467]
    [13] Kesserwan N, Dssouli R, Bentahar J, Stepien B, Labrèche P. From use case maps to executable test procedures: A scenario-based approach. Software & Systems Modeling, 2019, 18(2): 1543–1570. [doi: 10.1007/s10270-017-0620-y]
    [14] Bandyopadhyay A, Ghosh S. Test input generation using UML sequence and state machines models. In: Proc. of the 2009 Int’l Conf. on Software Testing Verification and Validation (ICST). Denver: IEEE, 2009. 121–130.
    [15] Rocha M, Simão A, Sousa T. Model-based test case generation from UML sequence diagrams using extended finite state machines. Software Quality Journal, 2021, 29(3): 597–627. [doi: 10.1007/s11219-020-09531-0]
    [16] Dan HT, Hierons RM. Conformance testing from message sequence charts. In: Proc. of the 4th IEEE Int’l Conf. on Software Testing, Verification and Validation (ICST). Berlin: IEEE, 2011. 279–288.
    [17] Minhas NM, Masood S, Petersen K, Nadeem A. A systematic mapping of test case generation techniques using UML interaction diagrams. Journal of Software: Evolution and Process, 2020, 32(6): e2235. [doi: 10.1002/smr.2235]
    [18] Wang LZ, Yuan JS, Yu XF, Hu J, Li XD, Zheng GL. Generating test cases from UML activity diagram based on gray-box method. In: Proc. of the 11th Asia-Pacific Software Engineering Conf. Busan: IEEE, 2004. 284–291.
    [19] Grieskamp W. Multi-paradigmatic model-based testing. In: Proc. of the 1st Combined Int’l Workshops on Formal Approaches to Software Testing and Runtime Verification. Seattle: Springer, 2006. 1–19.
    [20] Masson PA, Julliand J, Plessis JC, Jaffuel E, Debois G. Automatic generation of model based tests for a class of security properties. In: Proc. of the 3rd Int’l Workshop on Advances in Model-based Testing. London: ACM, 2007. 12–22.
    [21] Larsen PG, Lausdahl K, Battle N. Combinatorial testing for VDM. In: Proc. of the 8th Int’l Conf. on Software Engineering and Formal Methods (SEFM). Pisa: IEEE, 2010. 278–285.
    [22] Ledru Y, du Bousquet L, Maury O, Bontron P. Filtering TOBIAS combinatorial test suites. In: Proc. of the 7th Int’l Conf. on Fundamental Approaches to Software Engineering (FASE). Barcelona: Springer, 2004. 281–294.
    [23] Polo M, Pedreira O, Places ÁS, de Guzmán IGR. Automated generation of oracled test cases with regular expressions and combinatorial techniques. Journal of Software: Evolution and Process, 2020, 32(12): e2273. [doi: 10.1002/smr.2273]
    [24] Belli F, Budnik CJ, Hollmann A. A holistic approach to testing of interactive systems using statecharts. In: Proc. of the 2nd South-east European Workshop on Formal Methods.2005. 59–73.
    [25] Liu P, Miao HK. Theory of test modeling based on regular expressions. In: Proc. of the 3rd Int’l Workshop on Structured Object-oriented Formal Language and Method. Queenstown: Springer, 2013. 17–31.
    [26] RTI in aerospace and defense. https://www.rti.com/docs/RTI_for_Defense.pdf
    [27] Hoffman DM, Ly-Gagnon D, Strooper P, Wang HY. Grammar-based test generation with YouGen. Software: Practice and Experience, 2011, 41(4): 427–447. [doi: 10.1002/spe.1017]
    [28] Ali S, Iqbal MZ, Khalid M, Arcuri A. Improving the performance of OCL constraint solving with novel heuristics for logical operations: A search-based approach. Empirical Software Engineering, 2016, 21(6): 2459–2502. [doi: 10.1007/s10664-015-9392-6]
    [29] Sartaj H, Iqbal MZ, Khan MU. Testing cockpit display systems of aircraft using a model-based approach. Software and Systems Modeling, 2021, 20(6): 1977–2002. [doi: 10.1007/s10270-020-00844-z]
    [30] Dadeau F, Fourneret E, Bouchelaghem A. Temporal property patterns for model-based testing from UML/OCL. Software & Systems Modeling, 2019, 18(2): 865–888. [doi: 10.1007/s10270-017-0635-4]
    [31] Kanso B, Taha S. Specification of temporal properties with OCL. Science of Computer Programming, 2014, 96: 527–551. [doi: 10.1016/j.scico.2014.02.029]
    [32] Michlmayr A, Fenkam P, Dustdar S. Architecting a testing framework for publish/subscribe applications. In: Proc. of the 30th Annual Int’l Computer Software and Applications Conference (COMPSAC’06). Chicaco: IEEE, 2006. 467–474.
    [33] Cotroneo D, Natella R, Russo S, Scippacercola F. State-driven testing of distributed systems. In: Proc. of the 17th Int’l Conf. on Principles of Distributed Systems. Nice: Springer, 2013. 114–128.
    [34] Grace P, Barbosa J, Pickering B, Surridge M. Taming the interoperability challenges of complex IoT systems. In: Proc. of the 1st ACM Workshop on Middleware for Context-aware Applications in the IoT. Bordeaux: ACM, 2014. 1–6.
    [35] Bozkurt M, Harman M, Hassoun Y. Testing and verification in service-oriented architecture: A survey. Software Testing, Verification and Reliability, 2013, 23(4): 261–313. [doi: 10.1002/stvr.1470]
    [36] de Moura L, Bjørner N. Z3: An efficient SMT solver. In: Proc. of the 14th Int’l Conf. on Tools and Algorithms for the Construction and Analysis of Systems. Budapest: Springer, 2008. 337–340.
    [37] DDSTest. https://github.com/juqian/ddstest
    [38] automaton. http://www.brics.dk/automaton/
    引证文献
    网友评论
    网友评论
    分享到微博
    发 布
引用本文

钱巨,王寅,程浩,韦正现.基于场景模型的DDS架构一体化舰船任务系统测试.软件学报,2022,33(5):1711-1735

复制
分享
文章指标
  • 点击次数:889
  • 下载次数: 4194
  • HTML阅读次数: 2740
  • 引用次数: 0
历史
  • 收稿日期:2021-08-10
  • 最后修改日期:2021-10-09
  • 在线发布日期: 2022-01-28
  • 出版日期: 2022-05-06
文章二维码
您是第19710135位访问者
版权所有:中国科学院软件研究所 京ICP备05046678号-3
地址:北京市海淀区中关村南四街4号,邮政编码:100190
电话:010-62562563 传真:010-62562533 Email:jos@iscas.ac.cn
技术支持:北京勤云科技发展有限公司

京公网安备 11040202500063号