基于APK的Android应用程序GUI遍历自动化方法

为了提高应用程序自动执行技术的图形用户界面（GUI）覆盖率和自动化程度以满足Android应用程序动态安全分析和GUI测试的需求,提出了一种基于应用程序安装包（APK）的Android应用程序GUI遍历自动化方法。该方法通过动态地捕捉目标应用程序GUI并模拟用户行为与之交互,驱动应用程序自动执行。基于开源框架Appium实现了一个能够自动化遍历轻量Android应用程序GUI的跨平台原型工具。实验结果表明,该自动化方法能够获得较高的GUI覆盖率。     

A model driven engineering process of platform neutral agents for ambient intelligence devices

Ambient intelligence (AmI) systems are now considered a promising approach to assist people in their daily life. AmI proposes the development of context aware systems equipped with devices that can recognize your context and act accordingly. Agents provide an effective way to develop such systems since agents are reactive, proactive and exhibit an intelligent and autonomous behavior. However, current agent approaches do not adequately fulfill the requirements posed by AmI systems. From a modeling point of view, the aim should be to help in the design by providing adequate tools that assist in the development of important properties of AmI systems, such as context-awareness; and from an implementation point of view, agent technologies must be adapted to the diversity of AmI devices and communication technologies. As a solution to these issues we propose a Model driven engineering process, which supports the automatic generation of agent-based AmI systems. The source metamodel is PIM4Agents, a general purpose agent metamodel that we have adapted to support the explicit modeling of context aware systems, and the target metamodel is Malaca, an aspect-oriented agent architecture. Aspect-orientation makes Malaca platform-neutral for FIPA compliant agent platforms, simplifying the model driven process. The solution generates MalacaTiny agents, an implementation of Malaca that is able to run in AmI devices. We have evaluated the convenience of applying a model driven approach by measuring the degree of automation of our process and we have evaluated MalacaTiny for mobile phones by assessing different parameters, related to the scarcity of resources in AmI systems. All the results obtained are satisfactory.     

Domain Specific High-Level Constraints for User Interface Layout

We present the Auckland Layout Model (ALM), a constraint-based technique for specifying 2D layout as it is used for arranging the controls in a graphical user interface (GUI). Most GUI frameworks offer layout managers that are basically adjustable tables; often adjacent table cells can be merged. In the ALM, the focus switches from the table cells to vertical and horizontal tabulators between the cells. On the lowest level of abstraction, the model applies linear constraints, and an optimal layout is calculated using linear programming. However, bare linear programming makes layout specification cumbersome and unintuitive, especially for GUI domain experts who are often not used to such mathematical formalisms. In order to improve the usability of the model, ALM offers several other layers of abstraction that make it possible to define common GUI layout more easily. In the domain of user interfaces it is important that specifications are not over-constrained, therefore ALM introduces soft constraints, which are automatically translated to appropriate hard linear constraints and terms in the objective function. GUIs are usually composed of rectangular areas containing controls, therefore ALM offers an abstraction for such areas. Dynamic resizing behavior is very important for GUIs, hence areas have domain-specific parameters specifying their minimum, maximum and preferred sizes. From such definitions, hard and soft constraints are automatically derived. A third level of abstraction allows designers to arrange GUIs in a tabular fashion, using abstractions for columns and rows, which offer additional parameters for ordering and alignment. Row and column definitions are used to automatically generate definitions from lower levels of abstraction, such as hard and soft constraints and areas. Specifications from all levels of abstraction can be consistently combined, offering GUI developers a rich set of tools that is much closer to their needs than pure linear constraints. Incremental computation of solutions makes constraint solving fast enough for near real-time use.     

Simultaneous automatic tuning of cascade control systems from closed-loop step response data

This study presents a novel automatic tuning method for cascade control systems in which both primary and secondary controllers are tuned simultaneously using a single closed-loop step test. The proposed technique identifies the required process information with the help of B-spline series representation for the step responses. The two proportional–integral–derivative (PID) controllers are then tuned using an internal model control (IMC) approach. Considering the rationale of cascade control, the secondary controller is designed for faster disturbance attenuation. Without requiring an additional experiment, the primary controller is designed based on an identified process model that accurately accounts for inner loop dynamics. Finally, this study includes robustness considerations in the controller tuning process, and develops explicit guidelines for the selection of the IMC tuning parameters, completing the automatic tuning procedure for cascade control systems. The proposed method is robust to measurement noise because of the filtering property of the B-splines, and can provide superior control performance for both set-point tracking and disturbance rejection. Simulation examples demonstrate the effectiveness of the proposed automatic tuning method.     

基于Qt/Embedded的嵌入式GUI的研究与构建

嵌入式系统在手机、PDA等手持信息设备领域的应用出现了强劲的发展势头。而一个十分友好的图形用户界面(GUI)是嵌入式系统设计的关键技术之一,针对这种GUI的开发应用软件有很多,Qt/E是其中比较流行的一种。首先分析了Qt/E的运行机制及特点,并详细阐述其在基于ARM的嵌入式Linux系统下的移植方法,最后使用一个简单的应用程序来说明Qt/Embedded的嵌入式GUI的开发流程。     

Android应用程序GUI遍历的自动化方法

近来针对Android应用程序的基于GUI(图形用户界面)的分析和测试方法已经成为一个研究热点. 自动化技术和较高的GUI覆盖率可以提高大部分方法的效率和效果. 然而以前的工作并不能充分满足自动化和高GUI覆盖率的要求. 提出了一种在不需要程序源代码的情况下遍历Android应用程序GUI的自动化方法. 其主要思想是通过模拟用户的行为自动探测Android应用程序的GUI. 我们的工作主要解决了UI元素提取和处理、用户行为模拟、GUI遍历算法设计和模型构建三方面中的一些关键问题. 实验结果表明, 该方法能获得较高的GUI覆盖率可以有效遍历应用程序的GUI. 此外, 该方法也将有助于程序安全分析、GUI测试等其他研究.     

Parameter validity control in process control systems

Possibility of identifying the (explicit and implicit) invalidity in sensors’ indications within the process control systems (automatic control systems for industrial processes) is considered, on the basis of statistical data on industrial processes provided by the control system; the data is represented in the form of simulation model with interval validity estimates of the parameters. In the designed model, validity identification includes verifying all the functional relations specified for the selected industrial process. The issue of implementing the suggested model is studied subject to process control systems in the energy sector.     

Visual guided navigation for image retrieval

In this work, we are interested in technologies that will allow users to actively browse and navigate large image databases and to retrieve images through interactive fast browsing and navigation. The development of a browsing/navigation-based image retrieval system has at least two challenges. The first is that the system's graphical user interface (GUI) should intuitively reflect the distribution of the images in the database in order to provide the users with a mental picture of the database content and a sense of orientation during the course of browsing/navigation. The second is that it has to be fast and responsive, and be able to respond to users actions at an interactive speed in order to engage the users. We have developed a method that attempts to address these challenges of a browsing/navigation based image retrieval systems. The unique feature of the method is that we take an integrated approach to the design of the browsing/navigation GUI and the indexing and organization of the images in the database. The GUI is tightly coupled with the algorithms that run in the background. The visual cues of the GUI are logically linked with various parts of the repository (image clusters of various particular visual themes) thus providing intuitive correspondences between the GUI and the database contents. In the backend, the images are organized into a binary tree data structure using a sequential maximal information coding algorithm and each image is indexed by an n-bit binary index thus making response to users’ action very fast. We present experimental results to demonstrate the usefulness of our method both as a pre-filtering tool and for developing browsing/navigation systems for fast image retrieval from large image databases.     

GUI抽象描述模型研究

图形用户界面（GUI）是各种计算机应用的一个重要组成部分。但是越来越多的缟程语言和GUI工具包使得开发跨平台的GUI也变得越来越繁琐。同时,日趋庞大和复杂的数据,也迫使开发者在维护GUI相关数据方面付出更多的努力。本文从分析MVC设计模式入手,力图从更高的层次上对GUI及其相关数据的描述模型进行归纳和抽象,提出并形式化描述了一种GUI抽象描述模型,基于该模型的GUI数据建模算法和绑定模型。最后简单介绍了该描述模型基于XML的实现语言——GUI XML。     

基于UML的面向对象的图形用户界面设计模型

1.前言图形用户界面(GUI)最早由Macintosh操作系统所采用,后被各种操作系统如Unix,Window所借鉴。目前GUI已经形成了一系列标准的图形用户界面模式。图形用户界面开发的工作量相当大,它占到了软件设计实现工作量的40-50％。同时,GUI的设计与实现又存在各种困难。在设计时难以真正理解用户需求;用户界面层次结构复杂,缺乏有效的描述方法;界面的任务复杂,缺乏清晰的设计工具;对面向对象的GUI设计实现支持不够;界面设计开发涉及多个领域,如文档的编写,美工设计,标准化,国际化和性能优化等。GUI在实现时也面临设计文档的不明确,实现的复杂性,程序健壮性难以保证,难于测试和维护等诸多问题。     

基于事件流图的GUI自动化测试系统的开发

针对目前GUI自动化测试方法中存在着一定程度的手工依赖性以及对测试用例和测试覆盖率缺乏系统管理等问题,本文结合Microsoft UI Automation框架开发了一个基于事件流图的GUI自动化测试系统。该系统先对被测标准GUI进行逆向工程以得到GUI的事件流图和期望的结果,然后分别采用基于蚁群算法的日常冒烟测试用例生成算法和基于宽度优
先搜索的深度回归测试用例生成算法生成测试用例,并用这些生成的测试用例来测试新的GUI。测试结果表明,该GUI自动化测试模型是切实可用的,为在Windows环境下提高GUI测试的自动化程度提供了一种更为有效的途径。     

单变量系统建模与控制器设计的软件实现

工业过程对象一般可用带时间延迟的低阶单变量系统描述.针对工业控制对象,设计了一个新的软件,该软件从系统辨识得到控制对象模型,根据辨识模型进行PID控制器的设计,可指导手动控制器参数调节.该软件用Matlab实现系统辨识、控制器设计算法和GUI图形界面,可独立于Matlab运行;并在模型阶辨识准则、带时间延迟一阶模型近似、PID控制器设计饱和环节和非线性环节三个方面提出了新的方法.仿真结果表明,该软件设计的控制器具有良好的控制效果.     

Generating Event Sequence-Based Test Cases Using GUI Runtime State Feedback

This paper presents a fully automatic model-driven technique to generate test cases for Graphical user interfaces (GUIs)-based applications. The technique uses feedback from the execution of a “seed test suite,” which is generated automatically using an existing structural event interaction graph model of the GUI. During its execution, the runtime effect of each GUI event on all other events pinpoints event semantic interaction (ESI) relationships, which are used to automatically generate new test cases. Two studies on eight applications demonstrate that the feedback-based technique 1) is able to significantly improve existing techniques and helps identify serious problems in the software and 2) the ESI relationships captured via GUI state yield test suites that most often detect more faults than their code, event, and event-interaction-coverage equivalent counterparts.     

面向对象嵌入式GUI研究和模式应用

文中提出基于面向对象技术的嵌入式CUI模型——ECUI模型，给出该模型的体系结构，讨论系统可移植性、可视化等嵌入式CUI的关键技术。在模型建立的过程中，充分应用设计模式进行系统分析和设计。     

面向手机3D动画自动生成的空间分层布局规划

手机3D动画自动生成系统是将用户发送的短信,经过信息抽取、情节规划等一系列的处理,最终生成一段与短信内容相关的三维动画并发送给接收方这一过程.布局规划是系统的一个重要组成部分,其功能是将模型放置到场景的可用空间上.通过对布局问题的研究,本文提出了一种基于区域布局和模型布局的分层布局方法,其包括定性规划和定量计算两个部分,利用语义网技术建立分层布局知识库,基于规则的方法推导出分层布局定性规划方案,并对模型位置进行动态计算.最后,通过实验验证了分层布局规划的有效性和多样性,满足了自动生成系统对布局规划的要求.     

基于运行监测的图形用户界面自动化测试模型

为提高GUI自动化测试的覆盖率、故障定位的速率和精度,以及检测由于时空变化导致的空间错误引起的故障,建立基于运行监测的GUI自动化测试模型。模型将GUI分为窗口框架层、界面元素层、功能结构层和运行记录层四层。窗口框架层描述GUI所有窗口,界面元素层描述用户输入,功能结构层提出功能覆盖准则,运行记录层通过插桩记录代码动态监测软件每一次执行时路径和各个窗口的运行状态,从而提高测试的覆盖率,并根据运行记录中窗口的总执行次数和正确的执行次数为可靠性计算提供依据。由于监测代码的运行情况,因此故障能够定位到代码级,提高故障定位的精度和速率。最后以记事本程序为例验证了模型的有效性。     

GUI自动化测试工具在民用航空数据链系统集成中的应用

随着综合化、模块化的民用航空电子系统的高速发展,以及航空数据链系统的广泛应用,航空数据链系统集成自动化测试技术需求越发迫切.GUI自动化测试工具是一种基于友好人机界面的软件测试工具,本文结合具体应用需求,提出一种改进的GUI自动化测试框架,采用HMI（Human Machine Interface）界面,将其应用于民用航空数据链系统中,将软件内部模块手动测试转换为功能性的黑盒自动化测试,提高了测试效率.     

基于ARM-LINUX嵌入式GUI的研究与开发

物联网技术的兴起为为嵌入式图形用户界面开发提供了契机,本文首先介绍了几种常用嵌入式系统下的图形用户界面系统,其中MiniGUI和Qt/Embedded是两款典型的图形用户界面系统,详细描述了这两款嵌入式GUI开发平台的构建过程,同时给出了以MiniGUI为图形界面的开发案例。     

基于分布式系统的GUI自动化测试框架

目前,虽然很多工具可以用来实现自动化测试,但是现有的自动化测试过程很大程度上还需要人工参与来完成.如何能利用机器仿真来取代大规模的人工操作成为提升测试效率的关键.首先介绍了分布式作业调度系统中的作业调度原理,然后在基于用WinRunner实现GUI自动化测试的基础上,提出了适合GUI自动化测试的框架,最后给出了一个基于该框架的仿真测试系统实例,对如何全面实现自动化测试过程进行了详细讨论.