神经网络规则抽取

神经网络是一种黑箱模型，其学习到的知识蕴涵在大量连接权中，不仅影响了用户对利用神经计算技术构建智能系统的信心，还阻碍了神经网络技术在数据挖掘领域的应用，由于对神经网络规则抽取进行研究有助于解决上述问题，因此该领域已成为机器学习和神经计算界的研究热点，介绍了神经网络规则抽取研究的历史，综述了国际研究现状，对关于这方面研究的不同看法进行了讨论，并指出该领域中一些值得进一步研究的内容。     

FMS智能故障诊断专家系统的建立和开发

采用基于人工智能的故障诊断专家系统方法，附以模糊数学、神经网络、机器学习、数据库等理论，解决故障诊断中知识的合理表达，基于符号和数值的多种快速推理机制，知识的自动获取及知识库智能化管理等关键技术，建立了一个智能模糊故障诊断专家系统。     

神经网络集成

神经网络集成通过训练多个神经网络并将成结论进行合成，可以显著地提高学习系统的泛化能力。它不仅有助于科学家对机器学习和神经的深入研究，还有助于普通工程技术人员利用神经网络技术来解决真实世界中的问题。因此，它被视为一种广阔应用前景的工程化神经计算技术，已经成为机器学习和神经计算领域的研究热点。该文从实现方法、理论分析和应用成果等三个方面综述了神经网络集成的国际研究现状，并对该领域值得进一步研究的一些问题进行了讨论。     

基于机器学习的遥感影像云检测研究进展

在对地观测领域中云检测是遥感定量化应用的重要环节，同时也是卫星气象应用的关键步骤。近年来，基于机器学习的遥感影像云检测逐渐成为该领域的研究热点，并且取得了一系列研究成果。系统阐述了近10 a来国内外基于机器学习的遥感影像云检测的研究进展，将算法模型分为传统的机器学习模型和深度学习模型两类，并对两类中的具体模型进行详细介绍，对比分析不同模型的优缺点及其适用情况。重点介绍了传统机器学习中的支持向量机（SVM）、随机森林等方法，深度学习中的神经网络模型，包括卷积神经网络（CNN）、改进的U-Net网络等模型。在此基础上，分析了基于机器学习的遥感影像云检测研究中存在的问题，讨论了未来潜在发展方向。     

NNKBST：神经网络知识库系统支撑环境

为了有效地解决知识获取这一瓶颈问题，本文提出用神经网络来进行知识获取，以弥补传统归纳学习方法的不足，并以ＮＮ知识获取技术为核心，扩展为ＮＮ知识库系统支撑环境中一些全面技术的研究，包括ＮＮ知识表示和问题求解机制，ＮＮ知识库的推理，维护和求精机制等。     

基于神经网络专家系统的研究与实现

针对传统专家系统推理能力弱和智能水平低等不足,本文采用神经网络方法解决了传统专家系统在知识表示和知识获取等方面的问题。本文从描述传统专家系统几点不足出发,详细阐述了神经网络专家系统的基本原理和框架结构,最后选取三层BP神经网络模型,给出了钻井故障诊断系统的神经网络专家系统的实现。     

遗传算法的改进及其应用研究

基于工程优化命题的特点对传统遗传算法进行了改进，改进算法在尿素工业过程神经网络建模和专家系统知识获取中的应用结果表明，该算法适用范围广，可有效地解决若干工程优化问题。     

基于BP神经网络的电气操作票专家系统

将神经网络理论应用于传统专家系统，提出并实现了基于BP神经网络的电气操作票专家系统，解决了传统电气操作票专家系统知识获取瓶颈问题。介绍了系统的关键实现技术。     

应用遗传算法思想进行知识库自学习的研究

对于知识获取问题,常用的手工方法效率较低,已经不能满足人们的需求,因此提出使用机器学习这种自动知识获取方法来解决该问题.以虚拟旅行代理平台为背景,采用遗传算法和机器学习相结合的理论和方法,将目标知识库的目标荻取问题转化为组合优化问题,并提出了一个目标知识库自学习算法.通过该算法优化出新的旅行目标,实现目标库的更新.实验结果表明,该方法是有效的.     

知识管理系统的神经网络规则抽取算法研究

神经网络与知识管理系统的结合,通过神经网络规则抽取算法来解决专业领域的实际问题,实现了人工智能领域网络机制与符号机制的结合,保证了知识获取的时效性和质量性。     

Fusion of learning automata theory and granular inference systems: ANLAGIS. Applications to pattern recognition and machine learning

In this paper the fusion of artificial neural networks, granular computing and learning automata theory is proposed and we present as a final result ANLAGIS, an adaptive neuron-like network based on learning automata and granular inference systems. ANLAGIS can be applied to both pattern recognition and learning control problems. Another interesting contribution of this paper is the distinction between pre-synaptic and post-synaptic learning in artificial neural networks. To illustrate the capabilities of ANLAGIS some experiments on knowledge discovery in data mining and machine learning are presented. The main, novel contribution of ANLAGIS is the incorporation of Learning Automata Theory within its structure; the paper includes also a novel learning scheme for stochastic learning automata.     

基于神经网络结构学习的知识求精方法

知识求精是知识获取中必不可少的步骤．已有的用于知识求精的ＫＢＡＮＮ（ｋｎｏｗ ｌｅｄｇｅ ｂａｓｅｄ ａｒｔｉｆｉｃｉａｌｎｅｕｒａｌｎｅｔｗ ｏｒｋ）方法,主要局限性是训练时不能改变网络的拓扑结构．文中提出了一种基于神经网络结构学习的知识求精方法,首先将一组规则集转化为初始神经网络,然后用训练样本和结构学习算法训练初始神经网络,并提取求精的规则知识．网络拓扑结构的改变是通过训练时采用基于动态增加隐含节点和网络删除的结构学习算法实现的．大量实例表明该方法是有效的     

Back-propagation learning in expert networks

Expert networks are event-driven, acyclic networks of neural objects derived from expert systems. The neural objects process information through a nonlinear combining function that is different from, and more complex than, typical neural network node processors. The authors develop back-propagation learning for acyclic, event-driven networks in general and derive a specific algorithm for learning in EMYCIN-derived expert networks. The algorithm combines back-propagation learning with other features of expert networks, including calculation of gradients of the nonlinear combining functions and the hypercube nature of the knowledge space. It offers automation of the knowledge acquisition task for certainty factors, often the most difficult part of knowledge extraction. Results of testing the learning algorithm with a medium-scale (97-node) expert network are presented.     

Using mega-trend-diffusion and artificial samples in small data set learning for early flexible manufacturing system scheduling knowledge

Neural networks are widely utilized to extract management knowledge from acquired data, but having enough real data is not always possible. In the early stages of dynamic flexible manufacturing system (FMS) environments, only a litter data is obtained, and this means that the scheduling knowledge is often unreliable. The purpose of this research is to utilize data expansion techniques for an obtained small data set to improve the accuracy of machine learning for FMS scheduling. This research proposes a mega-trend-diffusion technique to estimate the domain range of a small data set and produce artificial samples for training the modified backpropagation neural network (BPNN). The tool used is the Pythia software. The results of the FMS simulation model indicate that learning accuracy can be significantly improved when the proposed method is applied to a very small data set.     

Evolutionary Multi-task Learning for Modular Knowledge Representation in Neural Networks

The brain can be viewed as a complex modular structure with features of information processing through knowledge storage and retrieval. Modularity ensures that the knowledge is stored in a manner where any complications in certain modules do not affect the overall functionality of the brain. Although artificial neural networks have been very promising in prediction and recognition tasks, they are limited in terms of learning algorithms that can provide modularity in knowledge representation that could be helpful in using knowledge modules when needed. Multi-task learning enables learning algorithms to feature knowledge in general representation from several related tasks. There has not been much work done that incorporates multi-task learning for modular knowledge representation in neural networks. In this paper, we present multi-task learning for modular knowledge representation in neural networks via modular network topologies. In the proposed method, each task is defined by the selected regions in a network topology (module). Modular knowledge representation would be effective even if some of the neurons and connections are disrupted or removed from selected modules in the network. We demonstrate the effectiveness of the method using single hidden layer feedforward networks to learn selected n-bit parity problems of varying levels of difficulty. Furthermore, we apply the method to benchmark pattern classification problems. The simulation and experimental results, in general, show that the proposed method retains performance quality although the knowledge is represented as modules.     

Neural network-based design of cellular manufacturing systems

A neural network based on a competitive learning rule, when trained with the part machine incidence matrix of a large number of parts, classifies the parts and machines into part families and machine cells, respectively. This classification compares well with the classical clustering techniques. The steady state values of the activations and interconnecting strengths enable easier identification of the part families, machine cells, overlapping parts and bottleneck machines. Neural networks are mostly applied by treating them as a blackbox, i.e. the interaction with the environment and the information acquisition and retrieval occurs at the input and the output level of the network. This paper presents an approach where knowledge is extracted from the external and internal structure of the neural network.     

An incremental neural learning framework and its application to vehicle diagnostics

This paper presents a framework for incremental neural learning (INL) that allows a base neural learning system to incrementally learn new knowledge from only new data without forgetting the existing knowledge. Upon subsequent encounters of new data examples, INL utilizes prior knowledge to direct its incremental learning. A number of critical issues are addressed including when to make the system learn new knowledge, how to learn new knowledge without forgetting existing knowledge, how to perform inference using both the existing and the newly learnt knowledge, and how to detect and deal with aged learnt systems. To validate the proposed INL framework, we use backpropagation (BP) as a base learner and a multi-layer neural network as a base intelligent system. INL has several advantages over existing incremental algorithms: it can be applied to a broad range of neural network systems beyond the BP trained neural networks; it retains the existing neural network structures and weights even during incremental learning; the neural network committees generated by INL do not interact with one another and each sees the same inputs and error signals at the same time; this limited communication makes the INL architecture attractive for parallel implementation. We have applied INL to two vehicle fault diagnostics problems: end-of-line test in auto assembly plants and onboard vehicle misfire detection. These experimental results demonstrate that the INL framework has the capability to successfully perform incremental learning from unbalanced and noisy data. In order to show the general capabilities of INL, we also applied INL to three general machine learning benchmark data sets. The INL systems showed good generalization capabilities in comparison with other well known machine learning algorithms.     

Knowledge acquisition of conjunctive rules using multilayered neural networks

A major bottleneck in developing knowledge-based systems is the acquisition of knowledge. Machine learning is an area concerned with the automation of this process of knowledge acquisition. Neural networks generally represent their knowledge at the lower level, while knowledge-based systems use higher-level knowledge representations. the method we propose here provides a technique that automatically allows us to extract conjunctive rules from the lower-level representation used by neural networks, the strength of neural networks in dealing with noise has enabled us to produce correct rules in a noisy domain. Thus we propose a method that uses neural networks as the basis for the automation of knowledge acquisition and can be applied to noisy, realworld domains. © 1993 John Wiley & Sons, Inc.     

Neural networks in quality function deployment

Quality Function Deployment (QFD) is a method of product planning in the early phases of the development of new products (pre-CAD phase). A major drawback of its application is the need to input a large amount of data and the necessity to estimate values on a rather subjective basis in order to complete the House of Quality. This data is plentiful and often designers lack the knowledge with satisfying accuracy. This paper suggests a machine learning approach in which a neural network automatically determines the data by learning from examples. Unlike conventional neural networks which are treated as black boxes, the topology and the weight values are not random but represent real circumstances and can directly be interpreted in the terms of the application. A final section discusses problems arising from the small number of training sets which is usually available in the field of product design.