Potential applications of three-way multidimensional scaling and related techniques to integrate knowledge from multiple experts

Theknowledge transfer problem in artificial intelligence consists of finding effective ways to elicit information from a human expert and represent it in a form suitable for use by an expert system. One approach to formalizing and guiding this knowledge transfer process for certain types of expert systems is to use psychometric scaling methods to analyze data on how the human expert compares or groups solutions. For example, Butler and Corter [1] obtained judgments of thesubstitutability of solutions from an expert, then analyzed the resulting data via techniques for fitting trees and extended trees [2]. The expert's interpretation of certain aspects of the solutions were directly encoded as production rules, allowing rapid prototyping. In this paper we consider the problem of combining information from multiple experts. We propose the use of three-way or individual differences multidimensional scaling, tree-fitting, and unfolding models to analyze two types of data obtainable from the multiple experts: judgments of the substitutability of pairs of solutions, and judgments of the appropriateness of specific solutions to specific problems. An application is described in which substitutability data were obtained from three experts and analyzed using the SINDSCAL program [3] for three-way multidimensional scaling [4].