Validation method for intelligent systems

Knowledge incorporated intelligent solving methods are prevailing in practical planning and scheduling systems because of the large problem size and complex constraints. However, when intelligent methods are used in real applications, it is an important problem to validate that both optimality and response time are at expert-level. Turing Test approaches are useful in validating intelligent systems. Nevertheless, validation burdens experts with heavy tasks. In distribution route scheduling, for instance, validation load is considerable since patterns of distribution spots are numerous. A bi-directional, many-sided explanation typed multi-step validation method, which enables to share validation tasks among experts, KEs (Knowledge Engineers) and computers, is proposed to diminish the load for busy experts, in validating intelligent systems. Furthermore, an additional validation tool based on the above method is also proposed. This method ensures efficient validation due to the decrease of load for experts by means of sharing validation tasks through multi-step validation with experts, KEs and computers. From this viewpoint, the proposed method can be used in validating general intelligent solving methods and intelligent systems, as well as intelligent scheduling systems.