基于TTCN-3的手机网络应用软件测试方法研究

介绍了手机网络应用软件的主要开发技术,概述了TTCN-3标准规范中的TTCN-3核心语言、TTCN-3运行时接口和TTCN-3控制接口的基本概念,并在对手机网络应用软件网络连接方式分析的基础上,提出了基于TTCN-3的手机网络应用软件测试方法,说明了使用TTCN-3测试手机网络应用软件的测试流程.通过给出一个手机网络应用软件的测试实例,展示了这种测试方法的可行性.     

An approach to quality engineering of TTCN-3 test specifications

Experience with the development and maintenance of large test suites specified using the Testing and Test Control Notation (TTCN-3) has shown that it is difficult to construct tests that are concise with respect to quality aspects such as maintainability or usability. The ISO/IEC standard 9126 defines a general software quality model that substantiates the term “quality” with characteristics and subcharacteristics. The domain of test specifications, however, requires an adaption of this general model. To apply it to specific languages such as TTCN-3, it needs to be instantiated. In this paper, we present an instantiation of this model as well as an approach to assess and improve test specifications. The assessment is based on metrics and the identification of code smells. The quality improvement is based on refactoring. Example measurements using our TTCN-3 tool TRex demonstrate how this procedure is applied in practise. B. Zeiss is supported by a Ph.D. scholarship from Siemens AG, Corporate Technology.     

History,status, and recent trends of the testing and test control notation version 3 (TTCN-3)

This overview article presents the Testing and Test Control Notation (TTCN-3) success story and serves as an introduction to this Special Section that contains five articles selected from the TTCN-3 user conference in 2011. The article sketches the development of TTCN-3 from its very beginning. It summarizes the current status of the language by reviewing its standardization process, available test suites, tools, and services as well as its training program. In addition, the article puts the articles selected for this Special Section into perspective, with regard to the evolution of TTCN-3 and the testing methodology in general. Last but not least, it discusses indicators for possible future developments of TTCN-3.     

TTCN-3研究综述

随着网络技术的发展，TTCN-3在协议测试领域的运用越来越广泛。文章介绍了TTCN-3的发展过程和应用状况，阐述了其核心语言、表格及图形表示格式，重点分析了TTCN-3标准对比TTCN前版本改进的主要特性，并以此为基础提出TTCN-3的应用前景。     

TTCN-3编译器符号表的设计和实现

TTCN-3是一种用于协议与软件测试的标准化测试语言。本文在对TTCN-3核心语言标准的研究基础上分析了TTCN-3核心语言的前向引用和Import机制等方面的规范与特点,设计并实现了一种TTCN-3符号表组织结构。在此基础上完成了TTCN-3到中间语言的编译转换。     

基于TTCN-3的Web应用功能测试方法

针对日益增长的Web应用功能测试需求与测试重用需求,提出了一种基于TTCN-3的Web应用功能测试方法。该方法结合分层测试的思想以及TTCN-3的特点,提出将Web应用功能测试划分为页面内容测试、会话管理测试、使用场景测试等3个层次,并分别从这3个层次给出了采用TTCN-3进行测试的过程。该方法应用TTCN-3参数化设计测试用例的思想,有效分离了测试设计与测试实现,使测试用例具有高可重用性。结合实例,表明了该方法的有效性。     

Innovation and evolution in integrated web application testing with TTCN-3

Over the last 10 years there has been continuous innovation and evolution in the technology of web applications. While originally designed as a telecom testing platform, TTCN-3 has proven to be a flexible and powerful platform for web application testing throughout this period. Major challenges to testing have been integration with unit test frameworks, service-oriented architecture, rich client interfaces, and security vulnerabilities. Through careful analysis and practical experience in industrial projects we have developed mechanisms to address each of these aspects of web application testing in TCN-3. These mechanisms are summarized here with examples drawn from our industrial experience to show how TTCN-3 provides significant advantages for testing web applications in comparison to other tools typically used in industry. We also present a significant extension to the model architecture for TTCN-3 which greatly facilitates web application testing that has been implemented by a major vendor and is now under consideration by the ETSI standards committee.     

TTCN-3 语言非侵入式调试技术

TTCN-3(Testing and Test Control Notation version 3)是一种形式化的测试描述语言,被广泛应用于协议测试等领域。由于测试套的复杂度越来越高,测试人员迫切需要能够调试TTCN-3语言的技术。本文提出了一种非侵入式的TTCN-3语言调试方法,通过驱动第三方调试器对TTCN-3语言编译后生成的目标代码进行调试,同时结合语句映射和符号解析等算法,实现了基本的调试功能。实验结果表明,该调试技术对测试系统的执行性能影响非常小,能更好的满足对大型测试套的调试需求。     

基于MSC的网络游戏软件测试方法研究*

针对网络游戏软件测试方法研究方面的不足,结合基于模型测试方法和TTCN测试技术,对网络游戏软件可玩性的测试方法进行研究。采用MSC图作为网络游戏玩法建模工具,建立玩法测试模型;用TTCN-3核心语言对玩法测试模型加以实现;结合一个具体的网络游戏软件测试案例,给出上述测试方法和技术的解释。从理论角度验证了基于模型测试方法在网络游戏软件测试上的可行性;从技术角度表明了TTCN对网络游戏软件测试的有效性。     

Introduction of TTCN-3 into the product development process: considerations from an electronic devices developer point of view

Following the successful standardisation of TTCN-3, several attempts were made to introduce the language into the product development process to improve the related testing activities. For several years appreciation was moderate. Reasons are to be found in the structure of existing testing procedures and problems of interoperability in early TTCN-3 products. Testing and development environments typical for electronic devices manufacturing are outlined and it is shown where in the process future benefits through further formalisation of test definition and implementations may be found.     

Testing hybrid systems with TTCN-3 embedded

A testing language typically provides a set of test automation statements that allows for a systematic definition and automatic application of stimulation data (i.e. messages or signals) to a system under test. Moreover, it eases the assessment of the system’s reaction by providing customizable evaluation statements and functions. TTCN-3, the Testing and Test Control Notation, already provides universal and powerful concepts to describe tests for discrete, message-based systems. However, software-based control systems that are used to control physical processes often show continuous quantities that can be only poorly stimulated and assessed by means of the currently available language constructs in TTCN-3. In this article, we show how this problem can be solved by extending the TTCN-3 language. We introduce an extension of TTCN-3, namely TTCN-3 embedded, that provides concepts and constructs that directly address the specification of tests for continuous and hybrid real time systems. The extension includes the notion of streams that can be used to represent continuous quantities over time. In addition, TTCN-3 has been extended with the concepts of stream-based ports, sampling, equation systems, and with additional control flow structures. The concepts are integrated with standard TTCN-3 and allow for defining test cases that handle continuous quantities, as well as discrete state changes and the exchange of messages within the same concept space. The feasibility of the approach is shown by providing a small example from the automotive industry.     

基于TTCN-3底层协议测试方法研究*

TTCN-3测试语言不仅可以应用于普通的协议测试,也可以应用于硬件系统、应用服务系统以及与操作系统和硬件相关的服务型底层协议的测试。将协议一致性框架应用到TTCN-3中,在原有测试方法基础上,基于本实验室开发的测试平台,提出了一种新的测试方法,并以ARP为例按照新的测试方法对其进行测试,验证了ARP的一致性和TTCN-3语言应用于底层协议的可能。     

From testing to anti-product development

The requirements for testing in large software projects drastically changed in recent years. The reasons for this mainly come from evolving development processes, demanding early stabilisations of complete software loads, early handover to subsequent steps, high software release quality, and in particular flexible adaptations to changing roadmaps. This study is an experience report from industrial testing in the field of telecommunications software and based on a speech given by the author at the Testing and Test Control Notation version 3 (TTCN-3) User Conference in Berlin 2006. It advocates to consider modern testing rather as the development of an anti-product that is to be developed in parallel to the product. This anti-product is itself a complex software system. Following this approach has a significant impact on the testing in these large software projects mentioned and leads to a number of consequences for the development of test systems and the structure of test teams. In this study, the role and virtues of TTCN-3 as programming language for anti-products as well as for defining the test system structure are investigated. Dealing with large embedded software systems that have several concurrent parts and additionally obey soft real-time requirements, similar constraints also hold for the test system. The virtues of parallel testing/software development life cycles as it becomes mandatory in following modern development processes are presented, and it is shown how TTCN-3 turned out in our experience to be a language particularly well suited for this purpose because of its advanced structured programming concepts derived from strong typing, template concepts and parametrizations of templates.     

Quantifying the evolution of TTCN-3 as a language

Ten years of maintenance, nine published revisions of the standards for the Testing and Test Control Notation version 3 (TTCN-3), more than 500 change requests since 2006, and 10 years of activity on the official TTCN-3 mailing list add up to a rich history, not unlike that of many successful Open Source Software (OSS) projects. In this article, we contemplate TTCN-3 in the context of software evolution and examine its history quantitatively. We mined the changes in the textual content of the standards, the data in change requests from the past 5 years, and the mailing list archives from the past 10 years. In addition, to characterize the use of the TTCN-3 we investigated the meta-data of the contributions at the TTCN-3 User Conference, and the use of language constructs in a large-scale TTCN-3 test suite. Based on these data sets, we first analyze the amount, density, and location of changes within the different parts of the standard. Then, we analyze the activity and focus of the user community and the maintenance team in both the change request management system and the official TTCN-3 mailing list. Finally, we analyze the distribution of contributions at the TTCN-3 User Conference across different topics over the past 8 years and construct use anomalies during the development of a large-scale test suite. Our findings indicate that the TTCN-3 is becoming increasingly stable as the overall change density and intensity, as well as the number of change requests are decreasing, despite the monotonous increase in the size of the standards.     

6LoWPAN协议一致性测试方法及仪表设计

针对6LoWPAN协议栈的MAC层、适配层、网络层及路由协议,研究6LoWPAN协议的一致性测试方法,将TTCN-3测试标准引入到无线传感器网络协议的一致性测试领域,设计了一套以TTCN-3为协议测试描述语言、以ISO9646中定义的协议一致性测试模型为方法的6LoWPAN协议一致性测试仪表.     

基于TTCN-3表格形式的OSP测试例

为了满足日益增长的测试需求,欧洲电信标准协会推出了新一代测试描述语言TTCN-3。TTCN-3的表格形式不仅是其核心语言的一种表现形式,而且强调了如何满足协议一致性测试的需求。文中研究了TTCN-3的表格形式,并提出了一个用表格形式描述的OSP协议的测试例。该测试例可以被应用于OSP协议的一致性测试。     

Slicing concurrent Java programs using Indus and Kaveri

Program slicing is a program analysis and transformation technique that has been successfully used in a wide range of applications including program comprehension, debugging, maintenance, testing, and verification. However, there are only few fully featured implementations of program slicing that are available for industrial applications or academic research. In particular, very little tool support exists for slicing programs written in modern object-oriented languages such as Java, C#, or C++. In this paper, we present Indus—a robust framework for analyzing and slicing concurrent Java programs, and Kaveri—a feature-rich Eclipse-based GUI front end for Indus slicing. For Indus, we describe the underlying tool architecture, analysis components, and program dependence capabilities required for slicing. In addition, we present a collection of advanced features useful for effective slicing of Java programs including calling-context sensitive slicing, scoped slicing, control slicing, and chopping. For Kaveri, we discuss the design goals and basic capabilities of the graphical facilities integrated into a Java development environment to present the slicing information. This paper is an extended version of a tool demonstration paper presented at the International Conference on Fundamental Aspects of Software Engineering (FASE 2005). Thus, the paper highlights tool capabilities and engineering issues and refers the reader to other papers for technical details. This work was supported in part by the US Army Research Office (DAAD190110564), by DARPA/IXO’s PCES program (AFRL Contract F33615-00-C-3044), by NSF (CCR-0306607) by Lockheed Martin, and and by Intel Corporation.     

TTCN-3测试套开发模式及其应用

在测试系统应用研究的基础上,分析TTCN-3测试系统结构,提出适用于软件测试和协议测试的TTCN-3测试套开发模式。该模式借鉴设计模式和模板库思想,在设计和重用抽象测试套和可执行测试套两方面有所突破,可以显著提高测试系统的可复用性和可扩展性,缩短测试系统的开发周期。结合GSM的移动应用部分(MAP)协议栈测试为例,说明该测试套开发模式的实际应用。