基准程序法

本文系统地介绍了基准程序测试法经历了三十多年的发展历史.基准程序法从早期仅仅面向CPU的评价发展到如今对整个系统的评价,并且和计算机的发展密切相关.编译程序,操作系统和体系结构的发展提高了计算机的性能,作为评价方法的基准程序法也相应地发展.对目前广泛应用的工作站和联机事务处理系统的评价,基准程序法也进行了尝试.远程终端仿真器RTE的引入使得基准程序测试活动领域的进展更为迅速.     

面向三维重建的加工基准匹配技术研究

基于加工基准的匹配是制造毛坯动态演变序列三维模型重建过程中的关键点,在前驱三维工序模型投影视图与当前工序图已关联的前提下,通过分析加工基准的类型和特点,结合二维工序图表达形式,提出加工基准的获取方式及基准三元图形这一概念,同时结合这个概念介绍了加工基准匹配算法.最后通过实例验证该算法的可行性和有效性.     

Benchmark characterization

An abstract system of benchmark characteristics that makes it possible, in the beginning of the design stage, to design with benchmark performance in mind is presented. The benchmark characteristics for a set of commonly used benchmarks are then shown. The benchmark set used includes some benchmarks from the Systems Performance Evaluation Cooperative. The SPEC programs are industry-standard applications that use specific inputs. Processor, memory-system, and operating-system characteristics are addressed     

双目立体测量中多视角深度图同时融合算法

提出一种将多次测量得到的深度图数据融合生成完整单一的网格曲面来描述被测物体表面的融合算法.依次将每幅深度图作为基准图,在基准图的基础上定义多幅深度图重叠对应关系;然后合并重叠数据,保留基准图网格;最后将相邻的基准图通过网格缝合连接成单一无缝的曲面.该算法能同时对多幅深度图进行融合,通过对重叠区域的优化,使得最终融合结果更精确地逼近被测物体表面的真实数据.融合实验结果验证了该算法的有效性.     

An overview of various control benchmarks with a focus on automotive control

There exists a gap between control theory and control practice, i.e., all control methods suggested by researchers are not implemented in real systems and, on the other hand, many important industrial problems are not studied in the academic research. Benchmark problems can help close this gap and provide many opportunities for members in both the controls theory and application communities. The goal is to survey and give pointers to different general controls and modeling related benchmark problems that can serve as inspiration for future benchmarks and then specifically focus the benchmark coverage on automotive control engineering application. In the paper reflections are given on how different categories of benchmark designers, benchmark solvers and third part users can benefit from providing, solving, and studying benchmark problems. The paper also collects information about several benchmark problems and gives pointers to papers than give more detailed information about different problems that have been presented.     

Fuel gas blending benchmark for economic performance evaluation of advanced control and state estimation

A simulation of a fuel gas blending process and its measurement system is proposed as a benchmark test case for advanced control and state estimation. The simulation represents an industrial facility and employs a well-established software environment. The objective is to maintain four controlled variables within specified bounds while minimizing an economic performance index. The controlled variables are the fuel gas pressure and three measures of gas quality. Six feed gas flow rates may be adjusted to achieve the objective. Each has a limited availability.The benchmark consists of three reproducible scenarios, each a 46-h period during which 23 discrete upsets occur and the feed gas compositions vary gradually with time. A benchmark multi-loop feedforward–feedback structure is described, tested, and compared to an estimate of optimal performance. The operating cost provided by the benchmark controller is from 1.19 to 1.71 times higher than the estimated minimum.Readers are challenged to download the simulation model, benchmark controller and estimated optimal performance from the URL given in this paper, and to devise case studies of advanced state estimation and control strategies to better the proposed benchmark controller.     

Spec CPU2000基准程序运行路径分析

Spec CPU2000的基准程序被广泛地应用于处理器的设计性能评估。在微处理器RTL级系统评估过程中，需要运行一些性能评估代码来完成系统的评估，因为运行整个基准程序的代价很大，所以都用运行部分代码的方式来获得性能情况。该文利用基准程序的频繁函数提取出微程序的方法，用于微处理器RTL级系统的评估，在函数提取过程中研究函数内部的频繁使用路径，研究了这些最频繁函数中的最频繁使用路径，了解基准程序的运行行为，为处理器的初级阶段的研究提供一些类基准程序，快速评估初级的处理器性能。     

A Benchmark Characterization of the EEMBC Benchmark Suite

Benchmark consumers expect benchmark suites to be complete, accurate, and consistent, and benchmark scores serve as relative measures of performance. However, it is important to understand how benchmarks stress the processors that they aim to test. This study explores the stress points of the EEMBC embedded benchmark suite using the benchmark characterization technique.     

Practical solutions to multivariate feedback control performance assessment problem: reduced a priori knowledge of interactor matrices

The research on control loop performance monitoring and diagnostics has been and remains to be one of the most active research areas in process control community. Despite of numerous developments, it remains as a considerably challenging problem to obtain a minimum variance control benchmark from routine operating data for multivariable process since the solution relies on the interactor matrix (or inverse time delay matrix). Knowing the interactor matrix is tantamount to knowing a complete knowledge of process models that are either not available or not accurate enough for a meaningful calculation of the benchmark. However, the order of an interactor matrix (OIM) for a multivariable process, a scalar measure of multivariate time delay, is a relatively simple parameter to know or estimate a priori. This paper investigates the possibility to estimate a suboptimal multivariate control benchmark from routine operating data if the OIM is available. The relation between this suboptimal benchmark and the true multivariate minimum variance control benchmark is investigated. Analytical expressions for the lower and upper bounds of the true multivariate minimum variance are derived. Although not minimum variance control, this benchmark answers important practical questions like “at least how much potential of the improvement does the control have by tuning or redesigning?”. It is further shown that the proposed suboptimal benchmark is achievable by a practical control provided that the system of interest is minimum phase. Simulation examples illustrate the feasibility of the proposed approach.     

针对Android资源泄漏的基准测试集的构造与评测

Android系统是目前最受欢迎的开放手机操作系统,然而高度的开放性也引来了许多问题,资源泄漏就是其中普遍存在的一个。对于Android系统出现的资源泄漏以及没有基于该漏洞的基准测试集被提出的问题,构造出了一套针对Android资源泄漏的基准测试集ResLeakBench。首先,参考Android官方文档以及观察大量的真实Android应用,整理出了Android程序中使用的资源操作以及它们常用的使用场景。然后,根据整理的信息自主构造了35个基准测试程序;另外,收集了35个资源使用相关的真实开源程序作为基准测试程序来保证测试集的实用性。最后,利用ResLeakBench对资源泄漏检测工具Relda2以及资源泄漏修复工具RelFix进行了有效性评测,发现了Relda2以及RelFix工具存在的问题。实验结果表明ResLeakBench针对资源泄漏问题是一套实用的基准测试集。     

Developing internet e-commerce benchmarks

A benchmark is a standard for measuring and comparing the performance of like systems. For new product makers, a benchmark can provide important statistical information so products can be fine-tuned before their deployment. For end users, on the other hand, a benchmark can be used to compare the strengths and weaknesses of different products so that an informed decision can be made about system adoption. Benchmarks aid in estimations of scalability in terms of the number of users and/or transactions that a system can support, and system response times under various loads and hardware/software deployment platforms.This paper focuses on the design issues in developing benchmarks for e-commerce. Because of the multidisciplinary aspects of e-commerce and the various emerging and distinct e-commerce business models, creating a single benchmark for the e-commerce application is not feasible. Add to this the diverse needs of small to medium enterprises (SMEs) and big business and we motivate the need for a benchmark suite for e-commerce.It is the thesis of this paper that the business model plays the primary role in the development of a e-commerce benchmark. It is the business that determines processes and transactions and thus also the database and navigational designs. For illustrative purposes, we step through the design of an e-commerce benchmark specification, WebEC, based on a e-broker (cybermediary) Internet business model. An example implementation of the benchmark specification, based on Microsoft's COM technology, and sample benchmark results are also presented.     

Benchmark frameworks and τBench

Software engineering frameworks tame the complexity of large collections of classes by identifying structural invariants, regularizing interfaces, and increasing sharing across the collection. We wish to appropriate these benefits for families of closely related benchmarks, say for evaluating query engine implementation strategies. We introduce the notion of a benchmark framework, an ecosystem of benchmarks that are related in semantically rich ways and enabled by organizing principles. A benchmark framework is realized by iteratively changing one individual benchmark into another, say by modifying the data format, adding schema constraints, or instantiating a different workload. Paramount to our notion of benchmark frameworks are the ease of describing the differences between individual benchmarks and the utility of methods to validate the correctness of each benchmark component by exploiting the overarching ecosystem. As a detailed case study, we introduce τBench, a benchmark framework consisting of ten individual benchmarks, spanning XML, XQuery, XML Schema, and PSM, along with temporal extensions to each. The second case study examines the Mining Unstructured Data benchmark framework, and the third examines the potential benefits of rendering the TPC family as a benchmark framework. Copyright © 2013 John Wiley & Sons, Ltd.     

基于历史性能基准的模型预测控制性能监控

针对实际工业过程中希望只利用过程的日常运行数据对控制系统进行监控的情况,提出了1种用历史性能基准对预测控制系统进行性能评估、监控以及分析的方法.利用运行状态良好的1段历史数据计算出历史性能基准,并将历史性能基准与实际性能的比值用于控制器性能的实时监控.根据历史性能指标的残差监控检测出性能变化时,进一步通过历史数据协方差监控及广义特征值分析,区分出性能显著变差或变好的方向和子空间.为现场工程师提供性能变化的一些原因,用于系统维护.最后通过Shell重油分馏塔仿真证明该方法可以获得很好的评估与监控结果.     

A local evaluation of vectorized documents by means of polygon assignments and matching

This paper presents a benchmark for evaluating the raster to vector conversion systems. The benchmark is designed for evaluating the performance of graphics recognition systems on images that contain polygons (solid) within the images. Our contribution is two-fold, an object mapping algorithm to spatially locate errors within the drawing and then a cycle graph matching distance that indicates the accuracy of the polygonal approximation. The performance incorporates many aspects and factors based on uniform units while the method remains non-rigid (thresholdless). This benchmark gives a scientific comparison at polygon level of coherency and uses practical performance evaluation methods that can be applied to complete polygonization systems. A system dedicated to cadastral map vectorization was evaluated under this benchmark and its performance results are presented in this paper. By stress testing a given system, we demonstrate that our protocol can reveal strengths and weaknesses of a system. The behavior of our set of indices was analyzed when increasing image degradation. We hope that this benchmark will help assessing the state of the art in graphics recognition and current vectorization technologies.     

基于多客户端结构的jTPCC测试系统的改进及实现

首先介绍了现在流行的数据库性能测试标准TPC-C;然后根据开源TPC-C测试软件jTPCC在使用过程中存在的问题对该软件进行了分析;由于存在的主要问题是客户端资源占用过多和服务器端压力不足,所以提出了将该软件从单客户端结构改进为可控制的多客户端结构的改进方案,并且实现了该方案.改造完成以后的测试数据表明,经过改进的软件比原软件测试数据更准确,使用更方便.     

基于频率测量的自校正高精度湿度仪

在基于频率测量的湿度仪测量电路中，采用多基准源实时自校正，通过对多基准源信息的数据处理，将测量电路的整体精度、稳定性转换为基准源的精度、稳定性。此外，采用硬件同步方法消除了频率计算时由于计数器和定时器不同步而引起的计数固有误差，从而提高了计算精度。实际测试结果表明，设计产品各项指标达到预计要求，目前已进入批量生产。     

Benchmark性能测试综述

基准(Benchmark)测试是一种应用广泛、内容繁杂的测试技术,也是目前最主要的信息系统性能测试技术。文章对Benchmark测试的规范和测试方法做了归纳总结,给出了选用Benchmark测试的建议和开发Benchmark测试规范需要解决的问题。最后介绍了有代表性的Benchmark测试规范和程序集。     

Instance matching benchmarks in the era of Linked Data

The goal of this survey is to present the state of the art instance matching benchmarks for Linked Data. We introduce the principles of benchmark design for instance matching systems, discuss the dimensions and characteristics of an instance matching benchmark, provide a comprehensive overview of existing benchmarks, as well as benchmark generators, discuss their advantages and disadvantages, as well as the research directions that should be exploited for the creation of novel benchmarks, to answer the needs of the Linked Data paradigm.     

A new Reinforcement Learning-based Memetic Particle Swarm Optimizer

Developing an effective memetic algorithm that integrates the Particle Swarm Optimization (PSO) algorithm and a local search method is a difficult task. The challenging issues include when the local search method should be called, the frequency of calling the local search method, as well as which particle should undergo the local search operations. Motivated by this challenge, we introduce a new Reinforcement Learning-based Memetic Particle Swarm Optimization (RLMPSO) model. Each particle is subject to five operations under the control of the Reinforcement Learning (RL) algorithm, i.e. exploration, convergence, high-jump, low-jump, and fine-tuning. These operations are executed by the particle according to the action generated by the RL algorithm. The proposed RLMPSO model is evaluated using four uni-modal and multi-modal benchmark problems, six composite benchmark problems, five shifted and rotated benchmark problems, as well as two benchmark application problems. The experimental results show that RLMPSO is useful, and it outperforms a number of state-of-the-art PSO-based algorithms.     

HPCC:面向存储访问模型的基准测试--一种可能替代TOP500 HPL的测试方法

高性能计算机系统的性能评价历来是本领域所关注的重要问题．TOP500排名所采用的标准测试HPL（High Performance Linpack）并不能真实的反映系统各方面的性能，尤其是存储访问方面．HPC Challenge基准测试则着重于各种存储访问模型，在HPL的基础之上又整合了多个有代表性的核心测试程序，很有可能在未来取代现在TOP500采用的的HPL测试．本文首先简单介绍HPC Challenge诞生的背景，解释基准测试的基本概念和原理，从存储访问模型的角度对各项测试进行了描述，并根据实际的测试结果进行比较和分析．最后给出结论以及将来的工作．