An interactive tool for knowledge base refinement

We present a tool that combines two main trends of knowledge base refinement. The first is the construction of interactive knowledge acquisition tools and the second is the development of machine learning methods that automate this procedure. The tool presented here is interactive and gives experts the ability to evaluate an expert system and provide their own diagnoses on specific problems, when the expert system behaves erroneously. We also present a database scheme that supports the collection of specific instances. The second aspect of the tool is that knowledge base refinement and machine learning methods can be applied to the database, in order to automate the procedure refining the knowledge base. In this paper we examine the application of inductive learning algorithms within the proposed framework. Our main goal is to encourage the experts to evaluate expert systems and to introduce new knowledge, based on their experience.     

Combining domain knowledge and machine learning for robust fall detection

This paper presents a method for combining domain knowledge and machine learning (CDKML) for classifier generation and online adaptation. The method exploits advantages in domain knowledge and machine learning as complementary information sources. Whereas machine learning may discover patterns in interest domains that are too subtle for humans to detect, domain knowledge may contain information on a domain not present in the available domain dataset. CDKML has three steps. First, prior domain knowledge is enriched with relevant patterns obtained by machine learning to create an initial classifier. Second, genetic algorithms refine the classifier. Third, the classifier is adapted online on the basis of user feedback using the Markov decision process. CDKML was applied in fall detection. Tests showed that the classifiers developed by CDKML have better performance than machine‐learning classifiers generated on a training dataset that does not adequately represent all real‐life cases of the learned concept. The accuracy of the initial classifier was 10 percentage points higher than the best machine‐learning classifier and the refinement added 3 percentage points. The online adaptation improved the accuracy of the refined classifier by an additional 15 percentage points.     

设计环境中共享学习机制的研究

设计是一个复杂的问题求解和逐步求精的过程。在计算机辅助设计系统中,从设计范例中学习设计知识可以有效地改善设计系统。文中分析了设计与学习活动之间的关系,提出了一种设计的学习模型及具有归纳学习机制的设计Agent的结构框架,介绍了知识表示和学习算法,及一个支持设计环境中共享学习的多Agnet系统。     

Acquiring domain models

Whereas a Learning Apprentice System stresses the generation and refinement of shallow rules of a performance program, presupposing a domain theory, BLIP3 is mainly concerned with the construction of a domain theory as the first phase of the knowledge-acquisition process. In this paper the BLIP approach to machine learning is described. The system design is presented and the already implemented knowledge sources are shown with their formalisms and functions for the learning process.     

Refinement of generated fuzzy production rules by using a fuzzy neural network.

Fuzzy production rules (FPRs) have been used for years to capture and represent fuzzy, vague, imprecise and uncertain domain knowledge in many fuzzy systems. There have been a lot of researches on how to generate or obtain FPRs. There exist two methods to obtain FPRs. One is by painstakingly, repeatedly and time-consuming interviewing domain experts to extract the domain knowledge. The other is by using some machine learning techniques to generate and extract FPRs from some training samples. These extracted rules, however, are found to be nonoptimal and sometimes redundant. Furthermore, these generated rules suffer from the problem of low accuracy of classifying or recognizing unseen examples. The reasons for having these problems are 1) the FPRs generated are not powerful enough to represent the domain knowledge, 2) the techniques used to generate FPRs are pre-matured, ad-hoc or may not be suitable for the problem, and 3) further refinement of the extracted rules has not been done. In this paper we look into the solutions of the above problems by 1) enhancing the representation power of FPRs by including local and global weights, 2) developing a fuzzy neural network (FNN) with enhanced learning algorithm, and 3) using this FNN to refine the local and global weights of FPRs. By experimenting our method with some existing benchmark examples, the proposed method is found to have high accuracy in classifying unseen samples without increasing the number of the FPRs extracted and the time required to consult with domain experts is greatly reduced.     

基于神经网络结构学习的知识求精方法

知识求精是知识获取中必不可少的步骤．已有的用于知识求精的ＫＢＡＮＮ（ｋｎｏｗ ｌｅｄｇｅ ｂａｓｅｄ ａｒｔｉｆｉｃｉａｌｎｅｕｒａｌｎｅｔｗ ｏｒｋ）方法,主要局限性是训练时不能改变网络的拓扑结构．文中提出了一种基于神经网络结构学习的知识求精方法,首先将一组规则集转化为初始神经网络,然后用训练样本和结构学习算法训练初始神经网络,并提取求精的规则知识．网络拓扑结构的改变是通过训练时采用基于动态增加隐含节点和网络删除的结构学习算法实现的．大量实例表明该方法是有效的     

一种基于符号神经网络的知识获取方法

本文介绍一种基于符号神经网络的知识获取方法，该方法首先用传统的机器学习方法获取关于某领域的粗略知识，然后把这些知识映射到神经网络结构，通过神经网络的自学习获取关于该领域的精细知识，这样，既解决了传统机器学习中知识精度，知识表示等问题，又解决了神经网络获取知识时间长，能释能力弱等问题。     

Explanation-based learning as justification of knowledge

Abstract: This paper describes the use of the explanation-based learning (EBL) machine learning technique in the practical domain of knowledge acquisition for expert systems. A knowledge acquisition tool, EBKAT (Explanation-Based Knowledge Acquisition Tool), is described, which may be used in the development of knowledge bases for diagnostic expert systems. The functioning of EBKAT attempts to combine the full potential of a domain expert's skills and the power of explanation-based machine learning techniques. The EBL component is not employed in the acquisition of the knowledge base rules but is used to justify the knowledge entered and to relate it to the knowledge already in the system. It is suggested that the EBKAT tool goes some way towards overcoming the knowledge acquisition bottleneck and results in the acquisition of knowledge which is rich in contextual information.     

Knowledge acquisition and knowledge representation with class: the object-oriented paradigm

Knowledge acquisition and knowledge representation are the fundamental building blocks of knowledge-based systems (KBSs). How to efficiently elicit knowledge from experts and transform this elicited knowledge into a machine usable format is a significant and time consuming problem for KBS developers. Object-orientation provides several solutions to persistent knowledge acquisition and knowledge representation problems including transportability, knowledge reuse, and knowledge growth. An automated graphical knowledge acquisition tool is presented, based upon object-oriented principles. The object-oriented graphical interface provides a modeling platform that is easily understood by experts and knowledge engineers. The object-oriented base for the automated KA tool provides a representation independent methodology that can easily be mapped into any other object-oriented expert system or other object-oriented intelligent tools.     

Introduction of a time series machine learning methodology for the application in a production system

Machine learning methods are considered a promising approach for improving operations and processes in manufacturing. However, the application of machine learning often requires the expertise of a data scientist combined with thorough knowledge of the manufacturing processes. Small and medium-sized companies that specialize in certain high value-added, variant rich production processes often lack an in-house data scientist and therefore miss out on generating a deeper data-driven insight from their production data streams. This paper proposes a three-step machine learning methodology to empower process experts with limited knowledge in machine learning: 1) data exploration through clustering, 2) representation of the production systems behaviour through specially structured neural networks and 3) querying this representation through evolutionary algorithms to achieve decision support through online optimization or scenario simulation. The chosen algorithms focus on parameter-light, well-established, general use algorithms in order to lower knowledge requirements for their application.     

面向农业领域的智能系统技术体系架构及其实现

阐述作者及团队对农业智能系统的技术体系架构取得的研究成果,包括运用专家系统、知识表示、推理机制、知识获取、开发平台,智能计算、机器学习、数据挖掘、本体论、人工生命等关键技术,探索在作物施肥、病虫害诊治、栽培管理,园艺以及畜禽水产养殖等方面,应用于决策支持、控制、预测、检索、仿真等,反映了智能信息技术面向农业领域,具有广阔的应用前景。     

面向应用领域的知识发现系统开发平台KDIST

介绍了一个面向应用领域的知识发现系统开发平台KDIST。将数据挖掘技术巧妙地封装在应用领域的问题中,使开发出的知识发现系统操作傻瓜化,用户无须关心数据挖掘本身,有效地减轻了领域用户使用负担,提高了数据挖掘技术实用性。所开发出的知识发现系统将挖掘得到的知识融合到已有专家系统的知识库中。两个实例系统的应用证明知识发现系统是专家系统自动半自动知识获取和知识库精化的良好工具。     

域自适应学习研究进展

传统的机器学习假设测试样本和训练样本来自同一概率分布. 但当前很多学习场景下训练样本和测试样本可能来自不同的概率分布. 域自 适应学习能够有效地解决训练样本和测试样本概率分布不一致的学习问题,作为 机器学习新出现的研究领域在近几年受到了广泛的关注. 鉴于域自适应学习技术 的重要性,综述了域自适应学习的研究进展. 首先概述了域自适应学习的基本问 题,并总结了近几年出现的重要的域自适应学习方法. 接着介绍了近几年提出的 较为经典的域自适应学习理论和当下域自适应学习的热门研究方向,包括样例加 权域自适应学习、特征表示域自适应学习、参数和特征分解域自适应学习和多 源域自适应学习. 然后对域自适应学习进行了相关的理论分析,讨论了高效的度 量判据,并给出了相应的误差界. 接着对当前域自适应学习在算法、模型结构和 实际应用这三个方面的研究新进展进行了综述. 最后分别探讨了域自适应学习在 特征变换和假设、训练优化、模型和数据表示、NLP 研究中存在的问题这四个方面 的有待进一步解决的问题.     

Reducing one class of machine learning algorithms to logical operations of plausible reasoning

The ways to transform a wide class of machine learning algorithms into processes of plausible reasoning based on known deductive and inductive rules of inference are shown. The employed approach to machine learning problems is based on the concept of a good classification (diagnostic) test for a given set of positive and negative examples. The problem of inferring all good diagnostic tests is to search for the best approximations of the given classification (partition or the partitioning) on the established set of examples. The theory of algebraic lattice is used as a mathematical language to construct algorithms of inferring good classification tests. The advantage of the algebraic lattice is that it is given both as a declarative structure, i.e., the structure for knowledge representation, and as a system of dual operations used to generate elements of this structure. In this work, algorithms of inferring good tests are decomposed into subproblems and operations that are the main rules of plausible human inductive and deductive reasoning. The process of plausible reasoning is considered as a sequence of three mental acts: implementing the rule of reasoning (inductive or deductive)with obtaining a new assertion, refining the boundaries of reasoning domain, and choosing a new rule of reasoning (deductive or inductive one).     

Integrated graphical approach to knowledge representation and acquisition

An approach toward improving the accessbility of the knowledge and information structures of expert systems is described; it is based upon a foundation development environment called the Rule-Based Frame System (RBFS), which forms the kernel of a larger system, IDEAS. RBFS is a knowledge representation language, within which a distinction is drawn between information which represents the world or domain, and knowledge which states how to make conclusions based upon the domain. Information takes the form of frames, for system processing, but is presented to the user/developer as an associative network via a Visual Editor for the Generation of Associative Networks (VEGAN). Knowledge takes the form of production rules, which are connected at suitable points in the domain model, but again it is presented to the user via a graphical interface known as the Knowledge Encoding Tool (KET). KET is designed to assist in knowledge acquisition in expert systems. It uses a combination of decision support trees and associative networks as its representation. A combined use of VEGAN and KET will enable domain experts to interactively create and test their knowledge base with minimum involvement on behalf of a knowledge engineer. An inclusion of learning features in VEGAN/KET is desirable for this purpose. The main objective of these tools, therefore, is to encourage rapid prototyping by the domain expert. VEGAN and KET are implemented in the Poplog environment on SUN 3/50 workstations.     

军事领域本体构建研究

在仿真系统的研究过程中,面临军事领域知识获取及不同应用之间的互操作等问题.这些难题的背后实际是技术人员和军事人员之间理解一致性和机器之间理解一致性的问题.本体是关于事物本质的模型,已被广泛应用于知识分类、表达、共享及重用等方面.首先,讨论了本体的概念并给出了领域本体构建的一套通用原则和方法.然后详细分析了军事领域本体所包含的各方面知识元素,包括作战单元类、单元之间的关系、交战行为、交战规则、武器装备、作战计划等,并分别给出了它们的简单表示结构.最后概要讨论了多个本体合并时的本体检验问题.标准化的军事知识表示结构可以为技术人员和军事人员之间的交流提供统一的认识和参照,为机器之间的互操作提供一种"语言",从而消除理解上的冲突和混乱,为作战仿真系统的开发扫清了道路.     

基于领域知识的个性化协同商务推荐系统

基于领域知识与顾客购买倾向相关联的事实,从知识表示、知识获取、系统实现三个方面研究了个性化协同商务推荐系统的实现策略。知识表示研究了自然语言的本体表示,主要包括：知识本体描述、模糊关系设计、概念关联抽象和公理修正四个部分;知识获取采用多层次领域知识获取和基于数据挖掘的智能知识获取两种方法,对知识的形式化和结构化进行了研究;基于J2EE技术创建了由客户端、服务器端、存储系统组成的协同商务推荐系统的结构模型。最后通过测试网站对系统的有效性进行了验证。     

Learning algorithms in a class of knowledge-based systems

A control system with a static plant described by knowledge representation in the forms of relations and of logical formulas is considered. The learning process consists in using successive knowledge validation and updating it to make current control decisions. Two approaches and algorithms are described: one for the validation and updating of knowledge about the plant, and one on the form of control. In both cases two versions are presented: the learning process in either an open-loop or a closed-loop control system. For a plant with logical knowledge representation, the logic-algebraic method is applied. This work was presented, in part, at the Fourth International Symposium on Artificial Life and Robotics, Oita, Japan, January 19–22, 1999     

FILIP: A fuzzy intelligent information system with learning capabilities

FILIP (fuzzy intelligent learning information processing) system is designed with the goal to model human information processing. The issues addressed are uncertain knowledge representation and approximate reasoning based on fuzzy set theory, and knowledge acquisition by “being told” or by “learning from examples”. Concepts that can be “learned” by the system can be imprecise (fuzzy), or the knowledge can be incomplete. In the latter case, FILIP uses the concept of similarity to extrapolate the knowledge to cases that were not covered by examples provided by the user. Concepts are stored in the Knowledge Base and employed in intelligent query processing, based on flexible inference that supports approximate matches between the data in the database and the query.

The architecture of FILIP is discussed, the learning algorithm is described, and examples of the system's performance in the knowledge acquisition and querying modes, together with its explanatory capabilities are shown.