使用基准测试促进研究--对软件工程的挑战

计算机科学中，基准测试已经用来比较计算机系统性能、检索算法信息、数据库和其他一些技术。在研究领域，基准测试的创建和普遍使用经常伴随着快速的技术进步和团队建设。这些形成了科学学科的基准测试理论。基于这个理论，通过团队工作的方式定义基准测试来挑战软件工程研究，变得越来越具有科学性和需要。本文介绍一个成功使用基准测试促进研究状况的个案研究——逆向工程。

Using Benchmarking to Advance Research:A Challenge to Software Engineering

Benchmarks have been used in computer science to compare the performance of computer systems,information retrieval algorithms,databases,and many other technologies.The creation and widespread use of a benchmark within a research area is frequently accompanied by rapid technical progress and community building.These observations have led us to formulate a theory of benchmarking within scientific disciplines.Based on this theory,we challenge software engineering research to become more scientific and cohesive by working as a community to define benchmarks.In support of this challenge,we present a case study of the reverse engineering community,where we have successfully used benchmarks to advance the state of research.