Useful approach for evaluating expert systems

Abstract: Evaluation of expert systems is an important step in the knowledge engineering process. In recent years, emphasis has been placed on knowledge acquisition, knowledge representation, and inferencing mechanisms. However, evaluation, and to a lesser extent, validation, have been slightly overlooked. This paper addresses some of the evaluation techniques that have been used for measuring information systems effectiveness and expert systems effectiveness. Specific attention is focused on the Analytic Hierarchy Process and Expert Choice. The evaluation results of an expert system prototype, called 'Read', are discussed via the use of the Analytic Hierarchy Process and Expert Choice.