Impediments for software test automation: A systematic literature review

Automated software testing is a critical enabler for modern software development, where rapid feedback on the product quality is expected. To make the testing work well, it is of high importance that impediments related to test automation are prevented and removed quickly. An enabling factor for all types of improvement is to understand the nature of what is to be improved. We have performed a systematic literature review of reported impediments related to software test automation to contribute to this understanding. In this paper, we present the results from the systematic literature review: The list of identified publications, a categorization of identified impediments, and a qualitative discussion of the impediments proposing a socio‐technical system model of the use and implementation of test automation.     

金融软件功能自动化测试的分析及应用

在金融软件测试中,面时大规模复杂的金融算法以及大量的回归测试,自动化测试有着相当的重要的作用.通过介绍自动化测试的相关知识,结合金融软件的特点,搭建相应的金融软件自动化测试环境,并使用一个实例来展示功能自动化测试在金融软件测试中的应用.实验结果表明,自动化测试显著提高金融软件测试的效率和准确率,节省人力和成本.讨论了自动化测试实施的难点和有待改进的地方.     

基于STAF自动化测试框架的研究与应用

随着软件功能实现技术越来越复杂,软件测试领域迫切需要具有自动化、多平台、开销小的自动化测试框架,STAF的出现很好地解决了这个问题。提出一种基于STAF的自动化测试框架,并进行模拟实践,采用ATT工具设计自动测试引擎,通过模拟实验测试,构建基于STAF的自动化测试框架。测试结果显示：在不同环境下,该框架均具有软件测试自动化程度高、测试效率高,易于管理、维护和可扩展等优点。     

Big Data-Oriented PaaS Architecture with Disk-as-a-Resource Capability and Container-Based Virtualization

With the increasing adoption of Big Data technologies as basic tools for the ongoing Digital Transformation, there is a high demand for data-intensive applications. In order to efficiently execute such applications, it is vital that cloud providers change the way hardware infrastructure resources are managed to improve their performance. However, the increasing use of virtualization technologies to achieve an efficient usage of infrastructure resources continuously widens the gap between applications and the underlying hardware, thus decreasing resource efficiency for the end user. Moreover, this scenario is especially troublesome for Big Data applications, as storage resources are one of the most heavily virtualized, thus imposing a significant overhead for large-scale data processing. This paper proposes a novel PaaS architecture specifically oriented for Big Data where the scheduler offers disks as resources alongside the more common CPU and memory resources, looking forward to provide a better storage solution for the user. Furthermore, virtualization overheads are reduced to the bare minimum by replacing heavy hypervisor-based technologies with operating-system-level virtualization based on light software containers. This architecture has been deployed on a Big Data infrastructure at the CESGA supercomputing center, used as a testbed to compare its performance with OpenStack, a popular private cloud platform. Results have shown significant performance improvements, reducing the execution time of representative Big Data workloads by up to 4.5×.     

虚拟化安全服务器研究与设计

随着服务器虚拟化技术的推广与发展,深圳供电局开始引入虚拟化应用来提高硬件资源使用率,虚拟化技术在给深圳供电局带来便利的同时也暴露一些安全问题,例如出现针对虚拟化操作系统的新型攻击,在虚拟环境下无法有效实现访问控制、流量检测及安全审计等隐患。通过对虚拟化环境基础架构及虚拟化环境信息安全整体防护的探讨,提出一套适用于深圳供电局的虚拟化安全服务器解决方案。     

移动智能网软件自动化测试的研究与实现

对移动智能网原有的手工测试系统进行了分析,总结出测试系统存在的不足,提出了改进方案。改进后的自动化测试系统能够在测试用例执行的不同阶段实现测试自动化,包括测试用例的设计、数据表的配置、状态机的构造、测试结果的检查、测试环境的配置和回归测试。改进后的测试系统在移动智能网项目的测试中进行了实验,并对实验结果进行了分析。     

Automating test automation

When trying to introduce TTCN-3 and thus improving test automation we are regularly faced with the issue of legacy test automation. These existing approaches to test automation range from small code developed for a very specific task to large applications with substantial development effort or even purchased solution from third party vendors that might include hardware components. Often these solutions cater for a specific need and their combined application is controlled by humans. A higher degree of test automation can be achieved if these solutions are combined in a test system to enable batch runs for example. TTCN-3 can be a good choice for implementing a future-oriented solution. However, recreating all of the existing parts in TTCN-3 might not be a feasible solution from a business perspective. Instead of refraining from creating an advanced solution, the idea is to use those existing parts to substantially reduce the effort necessary to introduce an improved test automation solution. In this paper, we will report on the successful integration of legacy test solutions using TTCN-3 and creating a new, advanced test system that enables overnight test runs. The paper will illustrate our challenges and experiences from this project.     

关键字驱动自动化测试的原理和实现

由GUI自动化功能测试存在的问题，引出了一种以关键字驱动思想为指导的自动化测试模型。首先解释了关键字驱动思想的原理，进而根据这个原理介绍了一种自动化功能测试模型，详细讨论了这个模型的优越性，以及如何应用它来进行测试开发的流程。     

Intel virtualization technology

A virtualized system includes a new layer of software, the virtual machine monitor. The VMM's principal role is to arbitrate accesses to the underlying physical host platform's resources so that multiple operating systems (which are guests of the VMM) can share them. The VMM presents to each guest OS a set of virtual platform interfaces that constitute a virtual machine (VM). Once confined to specialized, proprietary, high-end server and mainframe systems, virtualization is now becoming more broadly available and is supported in off-the-shelf systems based on Intel architecture (IA) hardware. This development is due in part to the steady performance improvements of IA-based systems, which mitigates traditional virtualization performance overheads. Intel virtualization technology provides hardware support for processor virtualization, enabling simplifications of virtual machine monitor software. Resulting VMMs can support a wider range of legacy and future operating systems while maintaining high performance.     

A reference model for deploying applications in virtualized environments

Modern scientific research has been revolutionized by the availability of powerful and flexible computational infrastructure. Virtualization has made it possible to acquire computational resources on demand. Establishing and enabling use of these environments is essential, but their widespread adoption will only succeed if they are transparently usable. Requiring changes to applications being deployed or requiring users to change how they utilize those applications represent barriers to the infrastructure acceptance. The problem lies in the process of deploying applications so that they can take advantage of the elasticity of the environment and deliver it transparently to users. Here, we describe a reference model for deploying applications into virtualized environments. The model is rooted in the low‐level components common to a range of virtualized environments and it describes how to compose those otherwise dispersed components into a coherent unit. Use of the model enables applications to be deployed into the new environment without any modifications, it imposes minimal overhead on management of the infrastructure required to run the application, and yields a set of higher‐level services as a byproduct of the component organization and the underlying infrastructure. We provide a fully functional sample application deployment and implement a framework for managing the overall application deployment. Copyright © 2011 John Wiley & Sons, Ltd.     

模型驱动的分布式测试执行自动化研究与实现

随着分布式应用在商业领域中的普及,对可用于有效缩短产品上市周期的分布式测试自动化技术的研究显得日益重要。本文提出了一种模型驱动的自动化测试方法,并将其应用于分布式测试中。为了能够支持分布式测试执行,本文提供了部署和调度两个测试模型,其中,部署模型描述了测试执行环境和脚本分发的情况,调度模型描述了远程测试执行机的调度运行顺序;为了能够实现测试执行的自动化,我们设计了一个分布式测试执行框架。最后,通过Web 应用测试的实例验证了该方法能有效减少测试时间。     

An approach to creating concretized test scenarios within test automation technology for industrial software projects

The paper describes an approach for creation of effective test automation technology for industrial software projects based on a formal model of the system under test, performing its automatic symbolic verification of the model and generation of symbolic traces, then their automatic concretization, generation and execution of test suites. The technology includes means for test results analysis and tests correction and update. High quality of software products is ensured by a balance between static (verification) and dynamic (testing) analysis techniques starting from the earlier development phases and through automation of all phases of software development. Special emphasis is made on presentation of the algorithm of concretization and configuring test scenarios.     

Automated Power Control for Virtualized Infrastructures

Power control for virtualized enviromnents has is keeping underlying infrastructure in reasonably low power gained much attention recently. One of the major challenges states and achieving service-level objectives （SLOs） of upper applications as well. Existing solutions, however, cannot effectively tackle this problem for virtualized environments. In this paper, we propose an automated power control solution for such scenarios in hope of making some progress. The major advantage of our solution is being able to precisely control the CPU frequency levels of a physical environment and the CPU power allocations among virtual machines with respect to the SLOs of multiple applications. Based on control theory and online model estimation, our solution can adapt to the variations of application power demands. Additionally, our solution can simultaneously manage the CPU power control for all virtual machines according to their dependencies at either the application-level or the infrastructure-level. The experimental evaluation demonstrates that our solution outperforms three state-of-the-art methods in terms of achieving the application SLOs with low infrastructure power consumption.     

GPS导航软件的一种功能自动化测试框架

GPS导航软件已经大量涌入市场,对于GPS导航软件本身的质量越来越受到重视。针对GPS导航软件的应用特点,提出了一种GPS导航软件功能自动测试框架,并介绍了相关实现技术,它能自动模拟软件的使用环境和GPS测试数据来验证软件的正确性。在实践中证明此框架行之有效,能有效构建测试环境,及时发现软件的缺陷,并可提高其回归测试的效率。     

Agent virtual machine for automation controllers: Example application: Shipboard automation

We are interested in providing an agent infrastructure for truly distributed control. Requirements include multiple language implementations, so that this agent host environment can exist in both real-time controllers and contain the ability to operate with external agent systems. Our first infrastructure, the Autonomous Cooperative System (ACS), accomplished these goals, but presented other issues. Although ACS has been successfully deployed on commercial controllers, new releases of controllers will cause complications in the evolution of the software and adoption of future functionality. We need to establish a formal integration procedure of the agent functionality with the controllers and to transform the underlying system into a fully integrated and open heterogeneous system. We use a shipboard automation example to demonstrate the use of the agent virtual machine. With this system, the shipboard automation system is designed as a distributed and survivable environment, thereby spreading intelligence throughout the controllers and not in central locations.     

基于场景技术的嵌入式软件测试用例生成方法

软件测试自动化是当前软件测试的发展趋势.场景技术的引入可以更有效地进行测试用例的描述,从而有助于实现软件测试自动化,提高测试效率和测试的可维护性、可重复性.从被测系统的文档分析入手,将场景技术运用于测试用例生成过程中,提出了嵌入式软件测试用例生成方法,并将该方法运用到实际的软件测试中,验证了该方法的正确性和有效性.     

服务器虚拟化的演进

本文根据ESG在2010《存储虚拟化研究过程》调查报告所撰写。ESG就1602个IT专业人士调研显示,74%北美企业级或大中机构已经部署了虚拟化,12%正在评估或者试用虚拟化技术。调研包括:目前虚拟化部署现状;截至现在物理服务器虚拟化百分比;多少不同应用在虚拟环境运营;多数虚拟机是用在生产环境还是测试研发环境服务器虚拟化和存储虚拟化的关系等问题。目前中国虚拟化市场滞后于北美市场,然而,通过虚拟化提高IT对业务的管控能力是大势所趋。ESG调查结果为中国IT决策者提供定量调查数据,在虚拟化战略决定和技术选择上做出具有前瞻性决策。     

A survey of memory management techniques in virtualized systems

Virtualization technology allows multiple operating systems to share hardware resources of a computer system in an isolated manner. Traditionally, memory is shared by an operating system using segmentation and paging techniques. With virtualization, memory partitioning and management has several new challenges. For isolated and safe execution, hypervisors do not provide direct access to hardware resources. Lack of direct access to the memory management hardware like page tables disqualifies direct usage of virtual memory solutions used on native (non-virtualized) setups. Further, aspects of dual control of the memory resource (by the guest OS and the hypervisor) and lack of semantics regarding memory usage in virtual machines present additional challenges for memory management. This paper surveys different techniques of memory partitioning and management across multiple guest OSs in a virtualized environment.An important goal of virtualization is to increase the physical machine utilization in order to save costs. With varying application demand for memory and diverse memory management policies of the guest OSs, ensuring optimal usage of memory is non-trivial. In this survey, challenges of memory management in virtualized systems, different memory management techniques with their implications, and optimizations to increase memory utilization are discussed in detail.     

基于实例的自动测试维护代价研究

不考虑自动测试的维护代价,盲目进行自动化测试是有风险的。以画板程序升级为例,详细介绍了它的修改过程和相应测试程序的维护代价,然后利用COCOMO度量方法,对测试程序与被测试程序的维护代价作一个比较,说明测试程序和被测试程序一样,需要反复维护才能进行回归测试。通过实例和理论分析使测试者清醒认识自动测试的维护代价,合理利用自动化测试。     

应用软件自动化开发的实现研究

基于组装软件技术,提出了一种实现应用软件开发自动化的新方法,给出了可进行自动化开发的应用软件系统架构和自动化开发平台架构.设计实现了集方法和工具于一体的应用软件自动化开发平台,并对业务组件的自动生成和基于业务流程的应用软件系统组装作了进一步研究.该方法是对传统组构件技术和工作流技术的突破,已成功获得应用.