基于ASM模型的协议一致性测试研究

针对协议测试中,状态机描述、测试集成环境和被测实现彼此独立带来的问题,提出了在可视化编程环境下利用抽象状态机模型和桩函数结合实现协议一致性测试方法。在分析抽象状态机测试理论的基础上,给出基于抽象状态机和remoting技术的协议分布式测试模型。以抽象状态机语言描述简单文件传输协议为例,采用分布式测试模型,实现了被测协议的远程一致性测试。     

iSCSI协议一致性测试研究与实现

不同iSCSI协议实现之间能否互联互通取决于协议实现是否与iSCSI协议规范相一致。针对这个问题,研究了iSCSI协议一致性测试的测试原理和测试流程,设计了适合于iSCSI协议一致性测试的测试系统以及基于XML描述的iSCSI协议一致性测试套,给出了较为完整的iSCSI协议一致性测试例。使用该测试例对某产品的iSCSI协议实现进行一致性测试,发现了被测实现存在与协议规范不一致的地方。     

Translating Grafcet specifications into Mealy machines for conformance test purposes

Conformance test is a black-box test technique aiming at checking whether an implementation conforms to its specification. Numerous results have been already obtained in this field for specifications expressed in a formal language. However, these results cannot be applied for conformance test of industrial logic controllers whose specifications are given in standardized specification languages. To contribute to solve this issue, this paper proposes a method to obtain, from a Grafcet specification, an equivalent Mealy machine, without semantics loss. This method permits to describe explicitly and formally all the states and transitions that are implicitly represented in a Grafcet model.     

TTCN-3在RRC协议一致性测试中的应用

设计了一种通过开发测试和测试控制表示法版本3(TTCN-3)抽象测试套进行测试的新方法。利用德国Testing tech公司开发的TTworkbench平台运行TTCN-3测试套,自动生成图形表示格式(GFT),有效验证了RRC层功能实现的一致性。目前该方案已成功应用于LTE系统TTCN扩展测试集仪表的项目开发中。     

New state-recognition patterns for conformance testing of finite state machine implementations

In black-box conformance testing of reactive systems, the system is often assumed to be an implementation of a given finite state machine and to possess no more states than the machine. The key activity in the interpretation of an input/output sequence observed on the system is then to recognize the visited states as states of the specification machine. In the paper, three traditional state-recognition patterns (SRPs) are generalized to two much stronger, but still relatively easy to apply SRPs, and further to an extremely strong and general SRP from which further practically interesting SRPs can be developed simply by specialization.     

列车用CAN协议一致性测试平台的设计与实现

列车用CAN总线协议一致性测试是保证不同设备制造厂家生产的CAN通信设备之间实现互联、互通和互操作的前提。在对协议一致性测试原理和CAN总线协议特点进行简要分析的基础上,提出了针对CAN总线协议一致性测试的协同测试方法和相应的一致性测试内容,设计并构建了相应的一致性测试硬件平台,并对测试软件平台中可执行测试实例产生、测试执行、测试评估以及测试管理等诸多环节所涉及的基本功能软件进行了设计和实现,完成了CAN协议一致性测试的基本功能。实际运行和测试结果表明：所设计的测试平台达到了预期结果,为下一步列车用CAN总线协议的一致性测试打下了基础。     

Trace analysis for conformance and arbitration testing

The authors explore a testing approach where the concern for selecting the appropriate test input provided to the implementation under test (IUT) is separated as much as possible from the analysis of the observed output. Particular emphasis is placed on the analysis of the observed interactions of the IUT in order to determine whether the observed input/output trace conforms to the IUT's specification. The authors consider this aspect of testing with particular attention to testing of communication protocol implementations. Various distributed test architectures are used for this purpose, where partial input/output traces are observable by local observers at different interfaces. The error-detection power of different test configurations is determined on the basis of the partial trace visible to each local observer and their global knowledge about the applied test case. The automated construction of trace analysis modules from the formal specification of the protocol is also discussed. Different transformations of the protocol specification may be necessary to obtain the reference specification, which can be used by a local or global observer for checking the observed trace. Experience with the construction of an arbiter for the OSI (open systems interconnection) transport protocol is described     

Batch-mode semi-supervised active learning for statistical machine translation

The development of high-performance statistical machine translation (SMT) systems is contingent on the availability of substantial, in-domain parallel training corpora. The latter, however, are expensive to produce due to the labor-intensive nature of manual translation. We propose to alleviate this problem with a novel, semi-supervised, batch-mode active learning strategy that attempts to maximize in-domain coverage by selecting sentences, which represent a balance between domain match, translation difficulty, and batch diversity. Simulation experiments on an English-to-Pashto translation task show that the proposed strategy not only outperforms the random selection baseline, but also traditional active selection techniques based on dissimilarity to existing training data.     

移动终端的一致性测试技术

一致性测试技术是保证移动终端产品质量的重要测试手段,在欧洲和北美已经形成了一致性测试的成熟体系和认证组织,由此保证商用移动终端产品能够可靠地接入移动通信网络且能正常工作,同时也保证终端对网络和其他用户的干扰控制在允许的范围内。一致性测试结果也是评价移动终端软、硬件质量的重要指标。简要介绍了一致性测试的基本概念和相关技术。     

MAP 2.1 conformance testing tools

The major components of the MAP 2.1 conformance test system are described. Protocol conformance testing and program testing are compared. The scope and process of dynamic conformance testing is reviewed. The architecture of the tests system is presented, first in terms of the developing ISO (International Organization for Standardization) framework, and then in terms of run-time components. Several specific tools which comprise the test system are described. These tools include test engines, a high-level control tool, monitoring and analysis tools, and document handling tools. Benefits and limitations of the test tools are examined. Conclusions and suggestions for future efforts are provided     

FSM-based incremental conformance testing methods

The development of appropriate test cases is an important issue for conformance testing of protocol implementations and other reactive software systems. A number of methods are known for the development of a test suite based on a specification given in the form of a finite state machine. In practice, the system requirements evolve throughout the lifetime of the system and the specifications are modified incrementally. We adapt four well-known test derivation methods, namely, the HIS, W, Wp, and UIOv methods, for generating tests that would test only the modified parts of an evolving specification. Some application examples and experimental results are provided. These results show significant gains when using incremental testing in comparison with complete testing, especially when the modified part represents less than 20 percent of the whole specification.     

On conformance testing of non-deterministic systems

Conformance testing aims at checking if an implementation conforms to its specification. This paper presents the definition of distinguishing sequences of non-deterministic systems. It pro-poses a novel algorithm for derivation of distinguishing sequences in a reduced system based on an observational equivalence. It extends the previous method [2] for dynamic testing of deterministic finite state machines for testing non-deterministic labeled transition systems.     

Progress on standardizing OSI conformance testing

International standards for Open Systems Interconnection (OSI) services and protocols are well advanced. Complementary standardization work has begun for testing conformance of products to OSI protocol standards. This is drawing on about 7 years R&D work on techniques and tools for testing protocol implementations. This paper presents the major aspects of the testing methodology and framework being standardized by ISO and CCITT. It relates some of the ideas to the work done in the R&D community and identifies the main topics on which further work is needed.