基于ATCA架构的龙芯服务器刀片设计

设计了一种基于先进电信计算架构的龙芯服务器刀片并实际应用于一嵌入式计算平台。介绍了系统总体结构并重点论述了服务器刀片设计的系统方案、高可靠设计等关键技术。实际测试表明,设计的服务器刀片能满足可靠性测试要求,在测试中表现出良好的性能,满足主流嵌入式计算任务需求。     

一种基于用户需求的基准测试方法

科学数据管理在高性能计算中发挥着越来越重要的作用,作为构建科学数据管理的关键支撑部分,数据库应用的性能和对它的测试评估显得尤为重要.科学数据管理系统是一种新的数据库应用,目前尚没有一个针对科学数据管理应用提出的基准测试程序.文中对数据库性能测试技术和基准测试标准进行了研究,针对面向科学数据管理的数据库应用的特点,采用Set Query Benchmark对支持平台的性能作了测试.最后基于此测试案例研究,提出了一个对Set Query Benchmark改进的基于用户需求的基准测试方法--用户可定制的基准测试方法(User-defined Benchmark),对面向科学数据管理的数据库应用可以提供较好的性能度量.     

基于嵌入式以太网接口的数据采集处理系统

为满足生产及科研中对数据采集网络化的要求,文中介绍了一种采用SOC高性能单片机和嵌入式以太网接口的数据采集处理系统。从硬软件两方面阐述了数据采集系统、数据处理系统和嵌入式以太网接口的设计和实现;对系统的数据采集处理、数据传输的可靠性和速率进行了测试。测试表明系统整体性能满足实际应用的要求。     

基于嵌入式以太网接口的数据采集处理系统

为满足生产及科研中对数据采集网络化的要求,文中介绍了一种采用SOC高性能单片机和嵌入式以太网接口的数据采集处理系统.从硬软件两方面阐述了数据采集系统、数据处理系统和嵌入式以太网接口的设计和实现;对系统的数据采集处理、数据传输的可靠性和速率进行了测试.测试表明系统整体性能满足实际应用的要求.     

基于W5300的以太网嵌入式测试系统设计

随着微控制器的飞速发展,嵌入式系统在数据传输中对以太网模式的应用需求大幅增加;为实现有效测量数据的接收、存储和二级转发功能,并可以长期保留、读取测试数据,设计了一种基于W5300的以太网嵌入式测试系统;以FPGA作为中央核心控制逻辑、W5300以太网控制器为主要硬件芯片、支持UDP协议,经大量测试表明该测试系统性能稳定,存储数据以5M/s高速回传、数据传输可靠,满足设计要求。     

数据库系统应用基准测试规范设计方法

为准确度量数据库系统对领域应用系统的支撑能力,提出了一种应用基准测试规范设计方法,指导数据库系统的基准测试。提出以动作、环境、负载等信息项为框架,建立数据库系统使用需求集,规范初始信息格式;将使用需求初分为操作场景,建立关键变量矩阵,并应用K-means算法、层次式聚类等方法进行操作场景分组,确认典型应用系统集;设计了基准测试用例结构,提出了环境要求、事务要求、执行要求等重要信息项,并构建测试规范框架,描述了典型应用系统与应用基准测试规范的关系;通过实例应用,证明了该方法的可行性与适用性。所提方法可辅助解决应用系统在多个数据库系统中择优选型问题,也可用于数据库系统厂商自测,促进产品能力提升。     

基于Trace重放的文件系统性能分析

基于Trace重放的基准测试是存储系统性能测试中的一个重要方法,本文提出一种如何利用Trace重放来对文件系统的性能进行对比测试,从而选出适合用户应用需求的文件系统的方法。本文选择有代表性的3种Trace集合,使用重放工具FSReplay对EXT2、EXT3、JFS、XFS、ReiserFS这5种文件系统进行对比测试,为用户在类似的应用中选择合适的文件系统提供了参考依据。     

网络性能基准测试序列的边值生成法研究

边值分析是网络性能基准测试序列生成的一种重要方法,本文针对网络基准测试系统的特点,提出网络基准测试模型,并对模型中的实体与关系进行了抽象和描述;在此基础上分析模型中实体和关系属性的边值特性,并根据应用实例提出测试序列的边值分析生成算法。     

模型驱动的嵌入式系统设计与性能优化

直接从规范需求描述入手,研究了嵌入式系统设计中的模型映射、代码自动生成、协同验证和性能优化等关键技术问题,提出了以模型驱动的嵌入式系统软硬件协同设计方法,使面向应用的嵌入式系统设计,在不同抽象层次上同步设计与验证,经过性能优化后得到RTL级SystemC代码表示的虚拟原型,介绍了一个应用实例。     

模型驱动的嵌入式系统设计

随着嵌入式系统设计周期越来越短,功能越来越复杂,越来越多领域的设计人员参与设计,市场需求导向致使需求变更越来越多,以传统文档形式的需求来驱动开发已根本不能满足时间和成本方面的要求。本文提出了采用可执行模型、动态需求规格和接口控制文档共同作用的驱动嵌入式系统设计方法,它能够较好地满足目前系统设计的要求。在文中,我们首先介绍了当前嵌入式系统设计中存在的一些问题,然后介绍了模型驱动设计的方法、语言和优点,并对动态需求规格和接口控制文档的执行给出了建议,最后得出模型驱动的嵌入式系统设计是一种行之有效途径的结论。     

面向大数据存储的主动与被动相结合的性能评测方法体系结构与实现

随着数据量的日益增加,大数据存储在整个大数据应用框架体系中居于重要地位.对大数据存储系统进行性能评测可以指导大数据应用开发人员分析性能瓶颈,进行大数据系统的性能优化.在以往的工作中,通常使用基准测试的方式来对不同大数据框架进行性能评测,或者采用插桩并分析轨迹文件的方式对分布式文件系统进行性能分析.这2种方法采用的分析角...     

A Framework for Benchmarking in CBIR

Content-based image retrieval (CBIR) has been a very active research area for more than ten years. In the last few years the number of publications and retrieval systems produced has become larger and larger. Despite this, there is still no agreed objective way in which to compare the performance of any two of these systems. This fact is blocking the further development of the field since good or promising techniques can not be identified objectively, and the potential commercial success of CBIR systems is hindered because it is hard to establish the quality of an application.We are thus in the position in which other research areas, such as text retrieval or the database systems, found themselves several years ago. To have serious applications, as well as commercial success, objective proof of system quality is needed: in text retrieval the TREC benchmark is a widely accepted performance measure; in the transaction processing field for databases it is the TPC benchmark that has wide support.This paper describes a framework that enables the creation of a benchmark for CBIR. Parts of this framework have already been developed and systems can be evaluated against a small, freely-available database via a web interface. Much work remains to be done with respect to making available large, diverse image databases and obtaining relevance judgments for those large databases. We also need to establish an independent body, accepted by the entire community, that would organize a benchmarking event, give out official results and update the benchmark regularly. The Benchathlon could get this role if it manages to gain the confidence of the field. This should also prevent the negative effects, e.g., benchmarketing, experienced with other benchmarks, such as the TPC predecessors.This paper sets out our ideas for an open framework for performance evaluation. We hope to stimulate discussion on evaluation in image retrieval so that systems can be compared on the same grounds. We also identify query paradigms beyond query by example (QBE) that may be integrated into a benchmarking framework, and we give examples of application-based benchmarking areas.     

防火墙性能基准测试研究

该文通过分析防火墙性能测试影响因素及两种测试模型，重点讨论了防火墙性能评价的指标、测试方法及报告内容，并结合测试原理给出了两种典型的测试系统设计实例。     

An IMS Performance Benchmark Implementation based on the TTCN-3 Language

Performance benchmarking is a method to assess performance characteristics of various systems across different system architectures under realistic conditions. A benchmark is executed to collect measurements such as fail rate, response times or round-trip delays. Additionally, it can be used to identify scalability or usability problems of the system under heavy load. This paper describes a performance benchmark for the IP Multimedia Subsystem (IMS). IMS is a standardised architecture for providing a unified session control on top of various access network technologies realising flexible multimedia applications. In the context of IMS, where a scalability of up to several millions of subscribers is required, the goal of a benchmarking system is to help understand how a system will perform when the number of calls per second and the number of active users increase. The Testing and Test Control Notation (TTCN-3) has been used to implement the benchmark specification.     

A Requirements Driven Framework for Benchmarking Semantic Web Knowledge Base Systems

A key challenge for the semantic Web is to acquire the capability to effectively query large knowledge bases. As there will be several competing systems, we need benchmarks that will objectively evaluate these systems. Development of effective benchmarks in an emerging domain is a challenging endeavor. In this paper, we propose a requirements driven framework for developing benchmarks for semantic Web knowledge base systems (SW KBSs). In this paper, we make two major contributions. First, we provide a list of requirements for SW KBS benchmarks. This can serve as an unbiased guide to both the benchmark developers and personnel responsible for systems acquisition and benchmarking. Second, we provide an organized collection of techniques and tools needed to develop such benchmarks. In particular, the collection contains a detailed guide for generating benchmark workload, defining performance metrics, and interpreting experimental results     

An approach to assessing virtual environments for synchronous and remote collaborative design

This paper considers applying novel Virtual Environments (VEs) in collaborative product design, focusing on reviewing activities. Companies are usually anchored to commercial ICT tools, which are mature and reliable. However, two main problems emerge: the difficulty in selecting the most suitable tools for specific purposes and the complexity in evaluating the impact that using technology has on design collaboration. The present work aims to face both aspects by proposing a structured benchmarking method based on expert judgements and defining a set of benchmarking weights based on experimental tests. The method considers both human–human interaction and teamwork-related aspects. A subsequent evaluation protocol considering both process efficiency and human–human interaction allows a closed-loop verification process. Pilot projects evaluate different technologies, and the benchmarking weights are verified and adjusted for more reliable system assessment. This paper focuses on synchronous and remote design review activities: three different tools have been compared according to expert judgements. The two best performing tools have been implemented as pilot projects within real industrial chains. Design collaboration has been assessed by considering both process performance and human–human interaction quality, as well as benchmarking results validated by indicating some corrective actions. The final benchmarking weights can thus be further adopted for an agile system benchmark in synchronous and remote design. The main findings suggest defining both an innovative process to verify the expert benchmark reliability and a trusty benchmarking method to evaluate tools for synchronous and remote design without experimental testing. Furthermore, the proposed method has a general validity and can be properly set for different collaborative dimensions.     

Benchmarking and comparing multi-exposure image fusion algorithms

Multi-exposure image fusion (MEF) is an important area in computer vision and has attracted increasing interests in recent years. Apart from conventional algorithms, deep learning techniques have also been applied to MEF. However, although many efforts have been made on developing MEF algorithms, the lack of benchmarking studies makes it difficult to perform fair and comprehensive performance comparison among MEF algorithms, thus hindering the development of this field significantly. In this paper, we fill this gap by proposing a benchmark of multi-exposure image fusion (MEFB), which consists of a test set of 100 image pairs, a code library of 21 algorithms, 20 evaluation metrics, 2100 fused images, and a software toolkit. To the best of our knowledge, this is the first benchmarking study in the field of MEF. This paper also gives a literature review on MEF methods with a focus on deep learning-based algorithms. Extensive experiments have been conducted using MEFB for comprehensive performance evaluation and for identifying effective algorithms. We expect that MEFB will serve as an effective platform for researchers to compare the performance of MEF algorithms.     

OLAP性能测试方法研究与实现

随着商业智能市场的逐步扩大,联机分析处理(OLAP)系统的使用质量评估已经成为数据库应用的研究热点.作为效用特性的OLAP系统性能评估需要一个性能基准.以OLAP委员会推出的APB-1性能基准为基础,首先设计了面向多维数据库的立方体(Cube)模型以及相应的多维表达式(MDX)查询模板,在Cube模型设计的过程中修改了APB-1基准ROLAP星型模型的不足之处;接着在测试数据一致和测试参数一致的前提下,通过对设计的MOLAP模型查询结果与ROLAP模型查询结果进行对比分析,证明了MOLAP模型及MDX查询模板设计的正确性;然后给出了OLAP性能测试流程,描述了支持ROLAP和MOLAP性能测试的工具框架及其主要模块.最后使用该测试框架在商业数据库管理系统上对ROLAP和MOLAP进行并发查询实践,验证了框架的有效性.提出的方法及技术实现为未来OLAP产品性能的测试和评价提供多维数据模型、业务模型和工具的支持.     

Semantic BMS: Allowing usage of building automation data in facility benchmarking

Facility benchmarking and evaluation of facility performance are the crucial tasks in reaching efficient, economical and sustainable facility operation. Modern buildings are equipped with building automation systems (BAS) that contain vast numbers of various sensors that can be utilised in performance assessment. However, such systems lack convenient tools for data inspection, which limits their use in building performance and efficiency analysis and benchmarking especially on large sites. The paper presents a middleware layer designed to enrich BAS data with additional semantic information. As a semantic model, an adaptation of the Semantic Sensor Network (SSN) ontology for the field of building operation analysis is used. The middleware provides convenient interfaces for querying the model. The proposed system provides the facility managers with a convenient way to use the BAS data for benchmarking and decision support.     

Empirical performance evaluation of graphics recognition systems

Presents a methodology for evaluating graphics recognition systems operating on images that contain straight lines, circles, circular arcs, and text blocks. It enables an empirical comparison of vectorization software packages and uses practical performance evaluation methods that can be applied to complete vectorization systems. The methodology includes a set of matching criteria for pairs of graphical entities, a set of performance evaluation metrics, and a benchmark for the evaluation of graphics recognition systems. The benchmark was tested on three systems. The results are reported and analyzed in the paper