The role of benchmarking for yardstick competition

With the increasing interest in yardstick regulation, there is a need to understand the most appropriate method for realigning tariffs at the outset. Benchmarking is the tool used for such realignment and is therefore a necessary first-step in the implementation of yardstick competition. A number of concerns have been raised about the application of benchmarking, making some practitioners reluctant to move towards yardstick based regimes. We assess five of the key concerns often discussed and find that, in general, these are not as great as perceived. The assessment is based on economic principles and experiences with applying benchmarking to regulated sectors, e.g. in the electricity and water industries in the UK, The Netherlands, Austria and Germany in recent years. The aim is to demonstrate that clarity on the role of benchmarking reduces the concern about its application in different regulatory regimes. We find that benchmarking can be used in regulatory settlements, although the range of possible benchmarking approaches that are appropriate will be small for any individual regulatory question. Benchmarking is feasible as total cost measures and environmental factors are better defined in practice than is commonly appreciated and collusion is unlikely to occur in environments with more than 2 or 3 firms (where shareholders have a role in monitoring and rewarding performance). Furthermore, any concern about companies under-recovering costs is a matter to be determined through the regulatory settlement and does not affect the case for using benchmarking as part of that settlement.     

The Michigan benchmark: towards XML query performance diagnostics

We propose a micro-benchmark for XML data management to aid engineers in designing improved XML processing engines. This benchmark is inherently different from application-level benchmarks, which are designed to help users choose between alternative products. We primarily attempt to capture the rich variety of data structures and distributions possible in XML, and to isolate their effects, without imitating any particular application. The benchmark specifies a single data set against which carefully specified queries can be used to evaluate system performance for XML data with various characteristics.     

Trade-off analysis on cost and manufacturing technology of an electronic product: Case study

A trade-off analysis on the cost and system packaging metrics of an electronic product aimed at the commercial/retail industry has been carried out. By comparing the system cost and packaging metrics with those of comparable consumer products, we have determined that there is opportunity for significant cost, size, and weight reduction of the overall electronics packaging system. These include the use of fine pitch IC packages, smaller discrete components, denser PCB wiring technology, double sided IC package surface mount, surface mount connectors, and improved plastics for the product housing. The analysis concluded that PCB area reduction of 40%, using a single PCB instead of three boards, reduction in board cost of over 50% and product weight reduction of over 28% are possible using available technologies.     

Benchmarking of electricity networks: Practical problems with its use for regulation

Benchmarking is a technique derived for management purposes, intended to identify outliers in any population as possible problems for resolution. Several regulatory agencies have tried to use benchmarking to define the degree of inefficiency of regulated companies, by reference to some target or frontier. This paper identifies the main problem inherent in trying to adapt a management technique to a regulatory purpose – namely that it requires the exercise of subjective judgements. The resulting lack of predictability and objectivity is not conducive to the provision of efficient regulatory incentives.This paper explains where subjective judgement enters into regulatory applications of benchmarking, which is not always apparent. The choice of model and selection of data sets are two obvious areas, but the main problem arises over the assumption that any costs not explained by the model must be due to inefficiency. Such assumptions are simply unsupported by evidence and lead to cost targets (or cost reduction targets defined over several years) that are little better than subjective guesses. There are other, superior ways to set cost reduction targets, based on long-term trends in total factor productivity for the regulated sector, which are used in the US and in other countries. However, some regulators feel obliged to use benchmarking and the paper concludes with recommendations as to how benchmarking should support further and more objective investigations into the costs of regulated utilities.     

Interoperability results for Semantic Web technologies using OWL as the interchange language

Using Semantic Web technologies in complex scenarios requires that such technologies correctly interoperate by interchanging ontologies using the RDF(S) and OWL languages. This interoperability is not straightforward because of the high heterogeneity in Semantic Web technologies and, while the number of such technologies grows, affordable mechanisms for evaluating Semantic Web technology interoperability are needed to comprehend the current and future interoperability of Semantic Web technologies.This paper presents the OWL Interoperability Benchmarking, an international benchmarking activity that involved the evaluation of the interoperability of different Semantic Web technologies using OWL as the interchange language. It describes the evaluation resources used in this benchmarking activity, the OWL Lite Import Benchmark Suite and the IBSE tool, and presents how to use them for evaluating the OWL interoperability of Semantic Web technologies. Moreover, the paper offers an overview of the OWL interoperability results of the eight tools participating in the benchmarking: one ontology-based annotation tool (GATE), three ontology frameworks (Jena, KAON2, and SWI-Prolog), and four ontology development tools (Protégé Frames, Protégé OWL, SemTalk, and WebODE).     

A method of stepwise benchmarking for inefficient DMUs based on the proximity-based target selection

DEA is a useful nonparametric method of measuring the relative efficiency of a DMU and yielding a reference target for an inefficient DMU. However, it is very difficult for inefficient DMUs to be efficient by benchmarking a target DMU which has different input use. Identifying appropriate benchmarks based on the similarity of input endowment makes it easier for an inefficient DMU to imitate its target DMUs. But it is rare to find out a target DMU, which is both the most efficient and similar in input endowments, in real situation. Therefore, it is necessary to provide an optimal path to the most efficient DMU on the frontier through several times of a proximity-based target selection process. We propose a dynamic method of stepwise benchmarking for inefficient DMUs to improve their efficiency gradually.The empirical study is conducted to compare the performance between the proposed method and the prior methods with a dataset collected from Canadian Bank branches. The comparison result shows that the proposed method is very practical to obtain a gradual improvement for inefficient DMUs while it assures to reach frontier eventually.     

供应链管理在包装制造业的应用研究

供应链管理思想在制造工业中的应用取得了一定的成就,同样对于包装制造业存在着重要作用,它也面临提高生产力和降低成本的压力.但包装制造业有其自身的特征,并且有关理论还不完善.本文认为供应链中的合作伙伴关系、全面质量管理、基准法和精益思想的实施是包装制造业供应链管理发展的必然趋势.     

A Six-sigma approach for benchmarking of RP&M processes

This paper presents a methodology of using six-sigma quality tools for benchmarking of rapid prototyping & manufacturing (RP&M) processes. It involves the fabrication of a geometric benchmark part and a methodology to control and identify the best performance of the process to reduce the variablity in the fabricated parts. The approach is demonstrated with a case study based on the direct laser sintering (DLS) process for prototyping using plastic powder. In the case study an identified set of six-sigma/ statistical process control tools is employed to determine and best tune factors affecting the desired outcomes of the built parts.     

Benchmark problems for nonlinear system identification and control using Soft Computing methods: Need and overview

Using benchmark problems to demonstrate and compare novel methods to the work of others could be more widely adopted by the Soft Computing community. This article contains a collection of several benchmark problems in nonlinear control and system identification, which are presented in a standardized format. Each problem is augmented by examples where it has been adopted for comparison. The selected examples range from component to plant level problems and originate mainly from the areas of mechatronics/drives and process systems. The authors hope that this overview contributes to a better adoption of benchmarking in method development, test and demonstration.     

Benchmarking flexible job-shop scheduling and control systems

Benchmarking is comparing the output of different systems for a given set of input data in order to improve the system’s performance. Faced with the lack of realistic and operational benchmarks that can be used for testing optimization methods and control systems in flexible systems, this paper proposes a benchmark system based on a real production cell. A three-step method is presented: data preparation, experimentation, and reporting. This benchmark allows the evaluation of static optimization performances using traditional operation research tools and the evaluation of control system's robustness faced with unexpected events.