Repeatable software engineering experiments for comparing defect-detection techniques |
| |
Authors: | Christopher M Lott H Dieter Rombach |
| |
Affiliation: | (1) Bell Communications Research, 445 South Street, MCC 1H-331B Morristown, NJ 07960, USA;(2) Fraunhofer Institute for Experimental Software Engineering, Sauerwiesen 6, 67661 Kaiserslautern, Germany;(3) Department of Computer Science, University of Kaiserslautern, 67653 Kaiserslautern, Germany |
| |
Abstract: | Techniques for detecting defects in source code are fundamental to the success of any software development approach. A software development organization therefore needs to understand the utility of techniques such as reading or testing in its own environment. Controlled experiments have proven to be an effective means for evaluating software engineering techniques and gaining the necessary understanding about their utility. This paper presents a characterization scheme for controlled experiments that evaluate defect-detection techniques. The characterization scheme permits the comparison of results from similar experiments and establishes a context for cross-experiment analysis of those results. The characterization scheme is used to structure a detailed survey of four experiments that compared reading and testing techniques for detecting defects in source code. We encourage educators, researchers, and practitioners to use the characterization scheme in order to develop and conduct further instances of this class of experiments. By repeating this experiment we expect the software engineering community will gain quantitative insights about the utility of defect-detection techniques in different environments.This work was conducted while the author was with the Department of Computer Science, University of Kaiserslautern, 67653 Kaiserslautern, Germany. |
| |
Keywords: | code reading by stepwise abstraction functional testing structural testing controlled experiments empirical software engineering |
本文献已被 SpringerLink 等数据库收录! |
|