一个基于模糊神经网络的数据逼近和泛化建模方法

本文介绍一个基于模糊神经网络的数据逼近和泛化建模方法,定义了一种模糊系统动态调节神经网络的学习率,给出了用迭代自组织数据分析算法确定神经网络结构、初始化神经网络参数的方法.在雷达天线罩视线误差建模中的应用表明,这种方法加快了网络的收敛速度,避免了局部极值,具有较高的数据逼近和泛化能力.     

应用模糊神经网络预测油田产量

为了研究受多变量、时变和不确定因素影响的油田产量预测问题,将模糊逻辑推理技术与人工神经网络相结合,构建具有模糊逻辑推理和学习功能的模糊神经网络(FNN)系统。该系统基于现有的油田开发历史数据,建立相应的规则集,使用神经网络的训练方法(如梯度下降学习算法),在训练过程中调整参数,并自适应增加规则,以使系统的输出最佳地逼近于目标样本。通过对某油田的实际开发历史数据的拟合与测试,结果表明该模糊神经网络能够较精确地预测未来的油产量,与常规的BP神经网络相比,其预测精度更高、训练速度更快。因此,基于模糊神经网络(FNN)的油田产量预测方法研究具有较好的实际应用价值。     

基于IPSO-FNN的风电齿轮箱故障诊断方法

在对风电齿轮箱故障特征提取基础上,利用模糊神经网络(FNN)对齿轮箱故障诊断系统进行网络建模;为了提高网络学习算法效率,采用改进粒子群优化(IPSO)算法对网络参数进行学习。引入适应度方差表征粒子状态,对早熟粒子进行差分进化操作,改善粒子群的多样性。对惯性权重、学习因子进行改进,平衡算法的全局搜索和局部开发能力,提高算法性能。经仿真实验研究表明:所提出的故障诊断方法与FNN,PSO-FNN方法相比,具有较高的诊断精度和较快的收敛速度。     

一种基于FNN的高速网络拥塞控制策略

以ATM（asynchronous transfer mode)为研究对旬,同种基于模糊神经网络（fuzzy neural network,简称FNN）的流量预测和拥塞控制策略,拥塞控制是高速网络（如ATM）研究中的关键问题之一,传统的基于BP神经网络的流量预测方法因其收敛速度较慢且具有较大的误差,影响了拥塞控制效果,而模糊神经网络由于具有处理不确定性问题和很强的学习能力,很好地解决这一问题,最后通过仿真,比较和分析了基于BP神经网络和基于FNN方法和性能,证明此方法是有效的。     

基于非线性Volterra信道的复数神经多项式盲均衡算法

针对传统常模算法收敛速度慢、均方误差大以及传统神经网络参数多、复杂度高的问题,提出了基于非线性Volterra信道的复数神经多项式盲均衡算法(Fuzzy neural network-complex valued neural polynomial-constant modulus algorithm,FNN -CNP-CMA）。该算法包含单层神经网络和非线性处理器的复数神经多项式,模块结构简单、复杂度低。由模糊神经网络(Fuzzy neural network, FNN）设计的模糊规则控制器能有效提高步长的控制精度。仿真实验结果表明,该算法系统结构简单、复杂度低、收敛速度快且稳态误差小,较好地解决了收敛速度与均方误差之间存在的矛盾。     

自组织区间二型模糊神经网络及其自适应学习算法

针对复杂不确定非线性系统的辨识问题,提出一种基于聚类的自组织区间二型模糊神经网络学习算法.首先采用具有两个不同加权参数的FCM算法对输入数据进行划分来获取规则前件的不确定均值,同时结合聚类有效性标准确定模糊规则数目,从而自动完成神经网络的结构辨识和规则前件参数辨识;随后给出了基于梯度下降法和Lyapunov函数稳定收敛定理的规则后件权向量学习速率的自适应学习算法.通过非线性系统辨识实例,验证了该算法与其他方法相比具有更快的收敛速度和更高的逼近精度;并且利用该算法建立了某市电力短期负荷预测模型,结果表明该模型具有较高的预测精度,泛化性能更佳.     

基于EKF的模糊神经网络快速自组织学习算法*

为了快速地构造一个有效的模糊神经网络,提出一种基于扩展卡尔曼滤波(EKF)的模糊神经网络自组织学习算法。在本算法中,按照提出的无须经过修剪过程的生长准则增加规则,加速了网络在线学习过程;使用EKF算法更新网络的自由参数,增强了网络的鲁棒性。仿真结果表明,该算法具有快速的学习速度、良好的逼近精度和泛化能力。     

一种粒子群—神经模糊系统的研究与应用

针对神经网络与模糊逻辑协同系统NFCS(Neuron-Fuzzy Cooperation System)的学习算法存在收敛速度慢和易陷入局部极小点等问题,提出将粒子群优化算法PSO(Particle Swarm Optimization)与NFCS结合的新型系统PSO-NFCS.在PSO-NFCS中,PSO代替原先的学习算法,由其进化预置网络的连接权值、阈值和补偿参数,以实现网络的学习和精确推理.将其应用于某石油化工装置的故障诊断,结果表明PSO-NFCS是有效的,其全局收敛能力、收敛速度和泛化精度等性能均优于原先的学习算法.     

金融风险预警的RST-FNN模型研究

将粗糙集理论（RST）与模糊神经网络（FNN）相结合,提出了一种基于粗糙集理论的模糊神经网络（RST-FNN）模型。新模型利用粗糙集的知识约简对样本数据去噪消冗,提取最优规则,从而克服模糊神经网络的“维数爆炸”灾难。实例仿真的结果表明,该模型的预测准确性较高,且具有结构精简、收敛速度快及泛化能力强等特点。     

量子门Elman神经网络及其梯度扩展的量子反向传播学习算法

针对Elman神经网络的学习速度和泛化性能, 提出一种具有量子门结构的新型Elman神经网络模型及其梯度扩展反向传播(Back-propagation)学习算法, 新模型由量子比特神经元和经典神经元构成. 新网络结构采用量子映射层以确保来自上下文单元的局部反馈与隐藏层输入之间的模式一致; 通过量子比特神经元输出与相关量子门参数的修正互补关系以提高网络更新动力. 新学习算法采用搜索然后收敛的策略自适应地调整学习率参数以提高网络学习速度; 通过将上下文单元的权值扩展到隐藏层的权值矩阵, 使其在与隐藏层权值同步更新过程中获取时间序列的额外信息, 从而提高网络上下文单元输出与隐藏层输入之间的匹配程度. 以峰值检波为例的数值实验结果显示, 在量子反向传播学习过程中, 量子门Elman神经网络具有较快的学习速度和良好的泛化性能.     

Intelligent forecasting system based on integration of electromagnetism-like mechanism and fuzzy neural network

Fuzzy neural network (FNN) architectures, in which fuzzy logic and artificial neural networks are integrated, have been proposed by many researchers. In addition to developing the architecture for the FNN models, evolution of the learning algorithms for the connection weights is also a very important. Researchers have proposed gradient descent methods such as the back propagation algorithm and evolution methods such as genetic algorithms (GA) for training FNN connection weights. In this paper, we integrate a new meta-heuristic algorithm, the electromagnetism-like mechanism (EM), into the FNN training process. The EM algorithm utilizes an attraction–repulsion mechanism to move the sample points towards the optimum. However, due to the characteristics of the repulsion mechanism, the EM algorithm does not settle easily into the local optimum. We use EM to develop an EM-based FNN (the EM-initialized FNN) model with fuzzy connection weights. Further, the EM-initialized FNN model is used to train fuzzy if–then rules for learning expert knowledge. The results of comparisons done of the performance of our EM-initialized FNN model to conventional FNN models and GA-initialized FNN models proposed by other researchers indicate that the performance of our EM-initialized FNN model is better than that of the other FNN models. In addition, our use of a fuzzy ranking method to eliminate redundant fuzzy connection weights in our FNN architecture results in improved performance over other FNN models.     

基于DFP校正拟牛顿法的傅里叶神经网络

针对傅里叶神经网络采用最速下降法导致局部极小、学习速度慢以及泛化能力差的问题,提出一种基于DFP校正拟牛顿法的新学习算法。该算法计算复杂度低,能保证网络具有良好的泛化能力和全局最优性。通过2个数值算例检验该算法,同时和BP神经网络以及另外2种傅里叶神经网络作比较。结果表明,该算法计算复杂度约为最速下降法的5%,为最小二乘学习算法的80%,具有较好的泛化 能力。     

A hybrid learning algorithm for a class of interval type-2 fuzzy neural networks

In real life, information about the world is uncertain and imprecise. The cause of this uncertainty is due to: deficiencies on given information, the fuzzy nature of our perception of events and objects, and on the limitations of the models we use to explain the world. The development of new methods for dealing with information with uncertainty is crucial for solving real life problems. In this paper three interval type-2 fuzzy neural network (IT2FNN) architectures are proposed, with hybrid learning algorithm techniques (gradient descent backpropagation and gradient descent with adaptive learning rate backpropagation). At the antecedents layer, a interval type-2 fuzzy neuron (IT2FN) model is used, and in case of the consequents layer an interval type-1 fuzzy neuron model (IT1FN), in order to fuzzify the rule’s antecedents and consequents of an interval type-2 Takagi-Sugeno-Kang fuzzy inference system (IT2-TSK-FIS). IT2-TSK-FIS is integrated in an adaptive neural network, in order to take advantage the best of both models. This provides a high order intuitive mechanism for representing imperfect information by means of use of fuzzy If-Then rules, in addition to handling uncertainty and imprecision. On the other hand, neural networks are highly adaptable, with learning and generalization capabilities. Experimental results are divided in two kinds: in the first one a non-linear identification problem for control systems is simulated, here a comparative analysis of learning architectures IT2FNN and ANFIS is done. For the second kind, a non-linear Mackey-Glass chaotic time series prediction problem with uncertainty sources is studied. Finally, IT2FNN proved to be more efficient mechanism for modeling real-world problems.     

一种模糊神经网络的快速参数学习算法

提出了一种新的模糊神经网络的快速参数学习算法, 采用一些特殊的处理, 可以用递推最小二乘法(RLS)来调整所有的参数. 以前的学习算法在调整模糊隶属度函数的中心和宽度的时候, 用的是梯度下降法, 具有容易陷入局部最小值点、收敛速度慢等缺点, 而本算法则可以克服这些缺点, 最后通过仿真验证了算法的有效性.     

Efficient learning algorithms for three-layer regular feedforward fuzzy neural networks

A key step of using gradient descend methods to develop learning algorithms of a regular feedforward fuzzy neural network (FNN) is to differentiate max-min functions, which contain max(/spl or/) and min(/spl and/) operations. The paper aims at several objectives. First, investigate further the differentiation of /spl or/-/spl and/ functions. Second, employ general fuzzy numbers, which include triangular and trapezoidal fuzzy numbers as special cases to define a three-layer regular FNN. The general fuzzy numbers related can be approximately determined by their corresponding finite level sets. So, we can approximately represent the input-output (I/O) relationship of the regular FNN as functions of the endpoints of all finite level sets. Third, a fuzzy back-propagation algorithm is presented. And to speed up the convergence of the learning algorithm, a fuzzy conjugate gradient algorithm for fuzzy weights and biases is developed, furthermore, the convergence of the algorithm is analyzed, systematically. Finally, some real simulations demonstrate the efficiency of our learning algorithms. The regular FNN is applied to the approximate realization of fuzzy inference rules and fuzzy functions defined on given compact sets.     

A fuzzy neural network controller with adaptive learning rates for nonlinear slider-crank mechanism

A fuzzy neural network (FNN) controller with adaptive learning rates is proposed to control a nonlinear mechanism system in this study. First, the network structure and the on-line learning algorithm of the FNN is described. To guarantee the convergence of the tracking error, analytical methods based on a discrete-type Lyapunov function are proposed to determine the adaptive learning rates of the FNN. Next, a slider-crank mechanism, which is driven by a permanent magnet (PM) synchronous motor, is studied as an example to demonstrate the effectiveness of the proposed control technique; the FNN controller is implemented to control the slider position of the motor-slider-crank nonlinear mechanism. The robust control performance and learning ability of the proposed FNN controller with adaptive learning rates is demonstrated by simulation and experimental results.     

一种优化的RBF神经网络在调制识别中的应用

提出了一种基于径向基函数 (RBF) 神经网络的通信信号调制识别方法, 该方法采用模糊 C-均值 (FCM) 聚类算法对数据进行聚类, 并获取基函数的参数, 采用梯度下降法训练网络权值. 利用最优停止法对网络进行了优化, 避免了过学习现象, 提高了 RBF 网络的训练速度和泛化能力, 以实际信号数据对该网络进行性能检验, 实验结果表明了该 RBF 网络具有较高的识别精度.     

正负模糊规则系统、极限学习机与图像分类

传统的图像分类一般只利用了图像的正规则,忽略了负规则在图像分类中的作用。Nguyen将负规则引入图像分类,提出将正负模糊规则相结合形成正负模糊规则系统,并将其用于遥感图像和自然图像的分类。实验证明,其在图像分类过程中取得了很好的效果。他们提出的前馈神经网络模型在调整权值时利用了梯度下降法,由于步长选择不合理或陷入局部最优从而使训练速度受到了限制。极限学习机（ELM）是一种单隐层前馈神经网络（SLFN）学习算法,具有学习速度快,泛化性能好的优点。本文证明了极限学习机与正负模糊规则系统的实质是等价的,遂将其用于图像分类。实验结果说明了极限学习机能很好的利用正负模糊规则相结合的方法对图像进行分类,实验结果较为理想。     

A Self-Evolving Interval Type-2 Fuzzy Neural Network With Online Structure and Parameter Learning

This paper proposes a self-evolving interval type-2 fuzzy neural network (SEIT2FNN) with online structure and parameter learning. The antecedent parts in each fuzzy rule of the SEIT2FNN are interval type-2 fuzzy sets and the fuzzy rules are of the Takagi–Sugeno–Kang (TSK) type. The initial rule base in the SEIT2FNN is empty, and the online clustering method is proposed to generate fuzzy rules that flexibly partition the input space. To avoid generating highly overlapping fuzzy sets in each input variable, an efficient fuzzy set reduction method is also proposed. This method independently determines whether a corresponding fuzzy set should be generated in each input variable when a new fuzzy rule is generated. For parameter learning, the consequent part parameters are tuned by the rule-ordered Kalman filter algorithm for high-accuracy learning performance. Detailed learning equations on applying the rule-ordered Kalman filter algorithm to the SEIT2FNN consequent part learning, with rules being generated online, are derived. The antecedent part parameters are learned by gradient descent algorithms. The SEIT2FNN is applied to simulations on nonlinear plant modeling, adaptive noise cancellation, and chaotic signal prediction. Comparisons with other type-1 and type-2 fuzzy systems in these examples verify the performance of the SEIT2FNN.