用神经网络驱动的模糊推理入侵检测方法

提出了神经网络驱动模糊推理的入侵检测方法,利用神经网络的学习能力,对不清楚规则的复杂系统的输入输出特性进行适当的非线性划分,自动形成舰则集和相应的隶属关系,克服了在多维空间上经验性的确定隶属函数的困难。对于神经网络的训练数据,采用人工数据,克服了神经网络监督学习和获取已知输出的训练数据的困难。试验证明,这种技术具有很好的灵敏度和鲁棒性,而且,能够检测出未知的入侵行为。     

Construction of a neuron-fuzzy classification model based on feature-extraction approach

In this paper, a Feature-Extraction Neuron-Fuzzy Classification Model (FENFCM) is proposed that enables the extraction of feature variables and provides the classification results. The proposed classification model synergistically integrates a standard fuzzy inference system and a neural network with supervised learning. The FENFCM automatically generates the fuzzy rules from the numerical data and triangular functions that are used as membership functions both in the feature extraction unit and in the inference unit. To adapt the proposed FENFCM, two modificatory algorithms are applied. First, we utilize Evolutionary Programming (EP) to determine the distribution of fuzzy sets for each feature variable of the feature extraction unit. Second, the Weight Revised Algorithm (WRA) is used to regulate the weight grade of the principal output node of the inference unit. Finally, the proposed FENFCM is validated using two benchmark data sets: the Wine database and the Iris database. Computer simulation results demonstrate that the proposed classification model can provide a sufficiently high classification rate in comparison with that of other models proposed in the literature.     

Self-organization of topographic mixture networks using attentional feedback

This article proposes a neural network model of supervised learning that employs biologically motivated constraints of using local, on-line, constructive learning. The model possesses two novel learning mechanisms. The first is a network for learning topographic mixtures. The network's internal category nodes are the mixture components, which learn to encode smooth distributions in the input space by taking advantage of topography in the input feature maps. The second mechanism is an attentional biasing feedback circuit. When the network makes an incorrect output prediction, this feedback circuit modulates the learning rates of the category nodes, by amounts based on the sharpness of their tuning, in order to improve the network's prediction accuracy. The network is evaluated on several standard classification benchmarks and shown to perform well in comparison to other classifiers.     

弱监督语义分割的对抗学习方法

大多数弱监督语义分割的解决方案都利用图像级监督信息产生的类激活特征图进行训练学习.类激活特征图只能发现目标最具判别力的部分,它与真实的像素级标签信息存在较大差距,所以训练效果并不理想.对来自原图像及其仿射变化图像的类激活特征图进行对抗学习来达到更好的训练效果.首先将图像及对其进行仿射变化得到的图像输入孪生网络,使用图像级分类标签得到各自的类激活特征图,然后将这两组类激活特征图输入辨别网络进行对抗学习,训练孪生网络使得原图像与其仿射变化图像的类激活特征图逼近,从而有效利用等变注意力机制,学习更多的有效信息并缩小类激活特征图和真实的像素级标签之间的差距,提高弱监督的性能.在PASACAL VOC 2012数据集上,在验证集上的平均交并比为63.7％,测试集上的平均交并比为65.7％,与当前其他先进弱监督语义分割的方法进行对比,验证集与测试集上的平均交并比提高了1.2％和1.3％.该对抗性学习方案能有效利用等变注意力机制,学习更多的有效信息并缩小类激活特征图和真实的像素级标签之间的差距,提高弱监督的性能且达到了良好的分割效果.     

A fuzzy controller with supervised learning assisted reinforcement learning algorithm for obstacle avoidance

Fuzzy logic systems are promising for efficient obstacle avoidance. However, it is difficult to maintain the correctness, consistency, and completeness of a fuzzy rule base constructed and tuned by a human expert. A reinforcement learning method is capable of learning the fuzzy rules automatically. However, it incurs a heavy learning phase and may result in an insufficiently learned rule base due to the curse of dimensionality. In this paper, we propose a neural fuzzy system with mixed coarse learning and fine learning phases. In the first phase, a supervised learning method is used to determine the membership functions for input and output variables simultaneously. After sufficient training, fine learning is applied which employs reinforcement learning algorithm to fine-tune the membership functions for output variables. For sufficient learning, a new learning method using a modification of Sutton and Barto's model is proposed to strengthen the exploration. Through this two-step tuning approach, the mobile robot is able to perform collision-free navigation. To deal with the difficulty of acquiring a large amount of training data with high consistency for supervised learning, we develop a virtual environment (VE) simulator, which is able to provide desktop virtual environment (DVE) and immersive virtual environment (IVE) visualization. Through operating a mobile robot in the virtual environment (DVE/IVE) by a skilled human operator, training data are readily obtained and used to train the neural fuzzy system.     

Fuzzy min-max neural networks. I. Classification.

A supervised learning neural network classifier that utilizes fuzzy sets as pattern classes is described. Each fuzzy set is an aggregate (union) of fuzzy set hyperboxes. A fuzzy set hyperbox is an n-dimensional box defined by a min point and a max point with a corresponding membership function. The min-max points are determined using the fuzzy min-max learning algorithm, an expansion-contraction process that can learn nonlinear class boundaries in a single pass through the data and provides the ability to incorporate new and refine existing classes without retraining. The use of a fuzzy set approach to pattern classification inherently provides a degree of membership information that is extremely useful in higher-level decision making. The relationship between fuzzy sets and pattern classification is described. The fuzzy min-max classifier neural network implementation is explained, the learning and recall algorithms are outlined, and several examples of operation demonstrate the strong qualities of this new neural network classifier.     

A supervised learning algorithm for hierarchical classification of fuzzy patterns

The notion of “fuzzy separability” is introduced for fuzzy sets of patterns. A supervised learning algorithm is proposed for estimation of membership functions that yield hierarchical partitioning of the feature space for fuzzy separable pattern classes under confusion. Finally we present a methodology for the design of a classifier composed of hierarchical binary decision trees.     

Integrating fuzzy knowledge by genetic algorithms

We propose a genetic algorithm-based fuzzy knowledge integration framework that can simultaneously integrate multiple fuzzy rule sets and their membership function sets. The proposed approach consists of two phases: fuzzy knowledge encoding and fuzzy knowledge integration. In the encoding phase, each fuzzy rule set with its associated membership functions is first transformed into an intermediary representation and then further encoded as a string. The combined strings form an initial knowledge population, which is then ready for integration. In the knowledge-integration phase, a genetic algorithm is used to generate an optimal or nearly optimal set of fuzzy rules and membership functions from the initial knowledge population. Two application domains, the hepatitis diagnosis and the sugarcane breeding prediction, were used to show the performance of the proposed knowledge-integration approach. Results show that the fuzzy knowledge base derived using our approach performs better than every individual knowledge base     

DCT-Yager FNN: a novel Yager-based fuzzy neural network with the discrete clustering technique.

Earlier clustering techniques such as the modified learning vector quantization (MLVQ) and the fuzzy Kohonen partitioning (FKP) techniques have focused on the derivation of a certain set of parameters so as to define the fuzzy sets in terms of an algebraic function. The fuzzy membership functions thus generated are uniform, normal, and convex. Since any irregular training data is clustered into uniform fuzzy sets (Gaussian, triangular, or trapezoidal), the clustering may not be exact and some amount of information may be lost. In this paper, two clustering techniques using a Kohonen-like self-organizing neural network architecture, namely, the unsupervised discrete clustering technique (UDCT) and the supervised discrete clustering technique (SDCT), are proposed. The UDCT and SDCT algorithms reduce this data loss by introducing nonuniform, normal fuzzy sets that are not necessarily convex. The training data range is divided into discrete points at equal intervals, and the membership value corresponding to each discrete point is generated. Hence, the fuzzy sets obtained contain pairs of values, each pair corresponding to a discrete point and its membership grade. Thus, it can be argued that fuzzy membership functions generated using this kind of a discrete methodology provide a more accurate representation of the actual input data. This fact has been demonstrated by comparing the membership functions generated by the UDCT and SDCT algorithms against those generated by the MLVQ, FKP, and pseudofuzzy Kohonen partitioning (PFKP) algorithms. In addition to these clustering techniques, a novel pattern classifying network called the Yager fuzzy neural network (FNN) is proposed in this paper. This network corresponds completely to the Yager inference rule and exhibits remarkable generalization abilities. A modified version of the pseudo-outer product (POP)-Yager FNN called the modified Yager FNN is introduced that eliminates the drawbacks of the earlier network and yi- elds superior performance. Extensive experiments have been conducted to test the effectiveness of these two networks, using various clustering algorithms. It follows that the SDCT and UDCT clustering algorithms are particularly suited to networks based on the Yager inference rule.     

Fuzzy Neural Network Models for Classification

In this paper, we combine neural networks with fuzzy logic techniques. We propose a fuzzy-neural network model for pattern recognition. The model consists of three layers. The first layer is an input layer. The second layer maps input features to the corresponding fuzzy membership values, and the third layer implements the inference engine. The learning process consists of two phases. During the first phase weights between the last two layers are updated using the gradient descent procedure, and during the second phase membership functions are updated or tuned. As an illustration the model is used to classify samples from a multispectral satellite image, a data set representing fruits, and Iris data set.     

Neural-Fuzzy Models for Multispectral Image Analysis

In this paper, we consider neural-fuzzy models for multispectral image analysis. We consider both supervised and unsupervised classification. The model for supervised classification consists of six layers. The first three layers map the input variables to fuzzy set membership functions. The last three layers implement the decision rules. The model learns decision rules using a supervised gradient descent procedure. The model for unsupervised classification consists of two layers. The algorithm is similar to competitive learning. However, here, for each input sample, membership functions of output categories are used to update weights. Input vectors are normalized, and Euclidean distance is used as the similarity measure. In this model if the input vector does not satisfy the similarity criterion, a new cluster is created; otherwise, the weights corresponding to the winner unit are updated using the fuzzy membership values of the output categories. We have developed software for these models. As an illustration, the models are used to analyze multispectral images.     

A neural fuzzy system with fuzzy supervised learning

A neural fuzzy system learning with fuzzy training data (fuzzy if-then rules) is proposed in this paper. This system is able to process and learn numerical information as well as linguistic information. At first, we propose a five-layered neural network for the connectionist realization of a fuzzy inference system. The connectionist structure can house fuzzy logic rules and membership functions for fuzzy inference. We use alpha-level sets of fuzzy numbers to represent linguistic information. The inputs, outputs, and weights of the proposed network can be fuzzy numbers of any shape. Furthermore, they can be hybrid of fuzzy numbers and numerical numbers through the use of fuzzy singletons. Based on interval arithmetics, a fuzzy supervised learning algorithm is developed for the proposed system. It extends the normal supervised learning techniques to the learning problems where only linguistic teaching signals are available. The fuzzy supervised learning scheme can train the proposed system with desired fuzzy input-output pairs which are fuzzy numbers instead of the normal numerical values. With fuzzy supervised learning, the proposed system can be used for rule base concentration to reduce the number of rules in a fuzzy rule base. Simulation results are presented to illustrate the performance and applicability of the proposed system.     

复杂工业过程的遗传模糊神经网络控制

本文提出一种基于遗传算法和监督学习方法的有效模糊神经网络控制，这种控制器采用并行处理的推理网络，具有两个重要特点：自适应和学习性，所提方法经过仿真和温控验证表明控制性能良好。     

典型T-S模糊系统是通用逼近器

研究的多输入单输出T－S模糊系统采用输入变量的线性函数作为规则后件,称为典型T－S模糊系统,在每个输入变量的模糊子集满足一致性以及隶属函数连续且分段可微的条件下,证明了典型T－S模糊系统是通和逼近器,以此为基础,提出当典型T－S模糊系统采用BP算法进行在线学习时,可以仅调节规则后件的参数,而同时仍然能够确保通用逼所性。     

Competition and cooperation in neuronal processing

A new type of model neuron is introduced as a building block of an associative memory. The neuron, which has a number of receptor zones, processes both the amplitude and the frequency of input signals, associating a small number of features encoded by those signals. Using this two-parameter input in our model compared to the one-dimensional inputs of conventional model neurons (e.g., the McCulloch Pitts neuron) offers an increased memory capacity. In our model, there is a competition among inputs in each zone with a subsequent cooperation of the winners to specify the output. The associative memory consists of a network of such neurons. A state-space model is used to define the neurodynamics. We explore properties of the neuron and the network and demonstrate its favorable capacity and recall capabilities. Finally, the network is used in an application designed to find trademarks that sound alike.     

Multilayer associative neural networks (MANN''s): storage capacityversus perfect recall

The objective of this paper is to to resolve important issues in artificial neural nets-exact recall and capacity in multilayer associative memories. These problems have imposed restrictions on coding strategies. We propose the following triple-layered hybrid neural network: the first synapse is a one-shot associative memory using the modified Kohonen's adaptive learning algorithm with arbitrary input patterns; the second one is Kosko's bidirectional associative memory consisting of orthogonal input/output basis vectors such as Walsh series satisfying the strict continuity condition; and finally, the third one is a simple one-shot associative memory with arbitrary output images. A mathematical framework based on the relationship between energy local minima (capacity of the neural net) and noise-free recall is established. The robust capacity conditions of this multilayer associative neural network that lead to forming the local minima of the energy function at the exact training pairs are derived. The chosen strategy not only maximizes the total number of stored images but also completely relaxes any code-dependent conditions of the learning pairs.     

Fuzzy automata with fuzzy relief

This paper shows a definition of a fuzzy automaton, which has the state, input, and output sets as fuzzy sets. The state transition function is defined as moving on a fuzzy relief with fuzzy peak-states and boundaries between different membership functions. After the definition of fuzzy automaton with fuzzy relief, the paper deals with a generalization, simulation and realization of such a fuzzy automaton. The paper links the defined fuzzy automaton to an existing fuzzy JK memory cell and to well-known fuzzy automata defined on the basis of crisp sets     

Fuzzy ARTMAP: A neural network architecture for incrementalsupervised learning of analog multidimensional maps

A neural network architecture is introduced for incremental supervised learning of recognition categories and multidimensional maps in response to arbitrary sequences of analog or binary input vectors, which may represent fuzzy or crisp sets of features. The architecture, called fuzzy ARTMAP, achieves a synthesis of fuzzy logic and adaptive resonance theory (ART) neural networks by exploiting a close formal similarity between the computations of fuzzy subsethood and ART category choice, resonance, and learning. Four classes of simulation illustrated fuzzy ARTMAP performance in relation to benchmark backpropagation and generic algorithm systems. These simulations include finding points inside versus outside a circle, learning to tell two spirals apart, incremental approximation of a piecewise-continuous function, and a letter recognition database. The fuzzy ARTMAP system is also compared with Salzberg's NGE systems and with Simpson's FMMC system.     

A fuzzy neural network with fuzzy impact grades

Fuzzy rule derivation is often difficult and time-consuming, and requires expert knowledge. This creates a common bottleneck in fuzzy system design. In order to solve this problem, many fuzzy systems that automatically generate fuzzy rules from numerical data have been proposed. In this paper, we propose a fuzzy neural network based on mutual subsethood (MSBFNN) and its fuzzy rule identification algorithms. In our approach, fuzzy rules are described by different fuzzy sets. For each fuzzy set representing a fuzzy rule, the universe of discourse is defined as the summation of weighted membership grades of input linguistic terms that associate with the given fuzzy rule. In this manner, MSBFNN fully considers the contribution of input variables to the joint firing strength of fuzzy rules. Afterwards, the proposed fuzzy neural network quantifies the impacts of fuzzy rules on the consequent parts by fuzzy connections based on mutual subsethood. Furthermore, to enhance the knowledge representation and interpretation of the rules, a linear transformation from consequent parts to output is incorporated into MSBFNN so that higher accuracy can be achieved. In the parameter identification phase, the backpropagation algorithm is employed, and proper linear transformation is also determined dynamically. To demonstrate the capability of the MSBFNN, simulations in different areas including classification, regression and time series prediction are conducted. The proposed MSBFNN shows encouraging performance when benchmarked against other models.