The improved radial basis function neural network and its application

Compared with other feed-forward neural networks, radial basis function neural networks (RBFNN) have many advantages which make them more suitable for nonlinear system modeling, and they have recently received considerable attention. In this paper, a RBFNN is employed to model strongly nonlinear systems. First, the problems of nonlinear system modeling are analyzed, and then the structure of the RBFNN as well as the training algorithm are improved to solve these problems. Finally, an industrial high-purity distillation column, which is a strongly nonlinear system, is successfully modeled with the improved RBFNN. Owing to the complexities of a nonlinear system, it is necessary to use a real-time model correction method to modify the parameters of the RBFNN model in real time. One efficient method is proposed in this paper. The idea is to employ the Givens transformation to modify the parameters of the RBFNN-based model. This work was presented, in part, at the International Symposium on Artificial Life and Robotics, Oita, Japan, February 18–20, 1996     

Median radial basis function neural network

Radial basis functions (RBFs) consist of a two-layer neural network, where each hidden unit implements a kernel function. Each kernel is associated with an activation region from the input space and its output is fed to an output unit. In order to find the parameters of a neural network which embeds this structure we take into consideration two different statistical approaches. The first approach uses classical estimation in the learning stage and it is based on the learning vector quantization algorithm and its second-order statistics extension. After the presentation of this approach, we introduce the median radial basis function (MRBF) algorithm based on robust estimation of the hidden unit parameters. The proposed algorithm employs the marginal median for kernel location estimation and the median of the absolute deviations for the scale parameter estimation. A histogram-based fast implementation is provided for the MRBF algorithm. The theoretical performance of the two training algorithms is comparatively evaluated when estimating the network weights. The network is applied in pattern classification problems and in optical flow segmentation.     

Transformation radial basis neural network for relevant feature selection

Radial basis neural networks are excellent candidates for selecting relevant features in pattern recognition problems. By a slight change in the traditional three-layer architecture of a radial basis neural network, we can obtain a quantitative method, which allows us to get a ranking within the features. We present a new neural network concept, combining at the same time two different skills: classification and detection of relevant features in the input vector.     

基于可拓理论的RBF神经网络研究及其应用

针对径向基函数（RBF）神经网络构造时其结构和参数难以确定的问题,结合可拓理论对输入样本和基函数的中心向量建立物元模型,并借鉴第2类型可拓神经网络（ENN2）的聚类思想,根据样本分布,采用可拓分析及可拓变换动态调整隐节点数目和基函数中心,从而提出基于可拓理论的RBF（ERBF）神经网络.同时,通过UCI标准数据集进行了测试,并通过应用实例进行了验证,结果表明,ERBF结构和参数的确定方法简单、收敛速度快,且泛化精度、鲁棒性和稳定性均显著提高.     

基于径向基函数神经网络的多级离心压缩机混合模型

大型离心压缩机作为多影响因素和强非线性的复杂系统,其性能的准确预测难以实现.针对这一问题,结合径向基函数(RBF)神经网络,本文建立了多级离心压缩机性能预测的混合模型.首先基于热力学第一定律和压缩机能量损失机理建立了多级离心压缩机性能预测的机理模型.该模型无需任何实验确定的性能曲线,完全由压缩机的几何结构参数预测出压缩机在设计工况和非设计工况下的性能.然后利用RBF神经网络修正机理模型的误差,并通过对RBF神经网络的不断更新,进一步提高了模型的预测精度和适用性.将所建立的混合模型应用于实际的离心压缩机,结果表明该方法具有良好的预测性能.     

A clustering algorithm for radial basis function neural network initialization

In this paper, we propose an Output-Constricted Clustering (OCC) algorithm for Radial Basis Function Neural Network (RBFNN) initialization. OCC first roughly partitions the output based on the required precision and then refinedly clusters data based on the input complexity within each output partition. The main contribution of the proposed clustering algorithm is that we introduce the concept of separability, which is a criterion to judge the suitability of the number of sub-clusters in each output partition. As a result, OCC is able to determine the proper number of sub-clusters with appropriate locations within each output partition by considering both input and output information. The resulting clusters from OCC are used to initialize RBFNN, with proper number and initial locations of for hidden neurons. As a result, RBFNN starting it's learning from a good point, is able to achieve better approximation performance than existing clustering methods for RBFNN initialization. This better performance is illustrated by a number of examples.     

A novel radial basis function neural network for discriminant analysis

A novel radial basis function neural network for discriminant analysis is presented in this paper. In contrast to many other researches, this work focuses on the exploitation of the weight structure of radial basis function neural networks using the Bayesian method. It is expected that the performance of a radial basis function neural network with a well-explored weight structure can be improved. As the weight structure of a radial basis function neural network is commonly unknown, the Bayesian method is, therefore, used in this paper to study this a priori structure. Two weight structures are investigated in this study, i.e., a single-Gaussian structure and a two-Gaussian structure. An expectation-maximization learning algorithm is used to estimate the weights. The simulation results showed that the proposed radial basis function neural network with a weight structure of two Gaussians outperformed the other algorithms.     

孤立点检测改进径向基神经网络动态预测模型

提出一种基于凝聚层次聚类消除孤立点的新方法,借助聚类树识别孤立点。去除孤立点后,利用RBF网络建立动态预测模型,实验结果表明,网络的训练和泛化性能较消除孤立点前有明显提高。说明凝聚层次聚类方法用在孤立点检测方面是有效可行的,消除孤立点后建立的模型收敛速度快,泛化能力更优。     

基于组合核函数的径向基过程神经网络及其在示功图诊断中的应用

针对复杂时间信号动态模式分类问题,提出了一种基于局部核函数与全局核函数组合的径向基过程神经网络(RBFPNN)模型。考虑时间信号过程特征的多样性和复杂性,以及核函数对信号分布形态特征的局部与全局表征能力,通过将具有全局性质的多项式核函数与具有局部性质的高斯核函数进行线性叠加,构成组合核函数,以此建立一种新的径向基过程神经网络,从信息模型上改善RBFPNN对动态样本复杂过程特征的抽取和记忆性质,提高网络对时间信号特征的辨识能力。分析了基于RBFPNN的性质,建立了基于混沌遗传算法CGA的模型参数优化算法。以基于示功图的往复运动机械工作状态诊断为例,实际资料处理结果验证了模型和算法的有效性。     

新型广义径向基函数神经网络结构研究

提出了一种新型的广义径向基函数(RBF)神经网络,并研究了该网络的学习方法.不同于传统三层结构的RBF网络,广义RBF网络增加了基函数输出加权层,并在输出层采用超曲面去逼近任意的非线性曲面.实例仿真结果表明,与传统的RBF网络相比,该网络具有良好的逼近性能,收敛速度快,可逼近任意多变量非线性函数.     

Blind equalization using a predictive radial basis function neural network

In this paper, we propose a novel blind equalization approach based on radial basis function (RBF) neural networks. By exploiting the short-term predictability of the system input, a RBF neural net is used to predict the inverse filter output. It is shown here that when the prediction error of the RBF neural net is minimized, the coefficients of the inverse system are identical to those of the unknown system. To enhance the identification performance in noisy environments, the improved least square (ILS) method based on the concept of orthogonal distance to reduce the estimation bias caused by additive measurement noise is proposed here to perform the training. The convergence rate of the ILS learning is analyzed, and the asymptotic mean square error (MSE) of the proposed predictive RBF identification method is derived theoretically. Monte Carlo simulations show that the proposed method is effective for blind system identification. The new blind technique is then applied to two practical applications: equalization of real-life radar sea clutter collected at the east coast of Canada and deconvolution of real speech signals. In both cases, the proposed blind equalization technique is found to perform satisfactory even when the channel effects and measurement noise are strong.     

A gradient-based sequential radial basis function neural network modeling method

Radial basis function neural network (RBFNN) is widely used in nonlinear function approximation. One of the key issues in RBFNN modeling is to improve the approximation ability with samples as few as possible, so as to limit the network’s complexity. To solve this problem, a gradient-based sequential RBFNN modeling method is proposed. This method can utilize the gradient information of the present model to expand the sample set and refine the model sequentially, so as to improve the approximation accuracy effectively. Two mathematical examples and one practical problem are tested to verify the efficiency of this method. This article was originally presented in the fifth International Symposium on Neural Networks.     

Research on an online self-organizing radial basis function neural network

A new growing and pruning algorithm is proposed for radial basis function (RBF) neural network structure design in this paper, which is named as self-organizing RBF (SORBF). The structure of the RBF neural network is introduced in this paper first, and then the growing and pruning algorithm is used to design the structure of the RBF neural network automatically. The growing and pruning approach is based on the radius of the receptive field of the RBF nodes. Meanwhile, the parameters adjusting algorithms are proposed for the whole RBF neural network. The performance of the proposed method is evaluated through functions approximation and dynamic system identification. Then, the method is used to capture the biochemical oxygen demand (BOD) concentration in a wastewater treatment system. Experimental results show that the proposed method is efficient for network structure optimization, and it achieves better performance than some of the existing algorithms.     

机械臂的自适应径向基函数神经网络双二次泛函最优控制

针对非线性机械臂系统中难以权衡控制能量与控制误差比重的最优控制问题,本文提出一种基于自适应径向基函数(RBF)神经网络二阶段叠加优化的双二次泛函最优求解模型,实现在非线性机械臂控制系统中用不大的控制能量来保持较小的控制误差的综合最优控制.在本文所提模型中,首先设计一种线性误差函数,作用于非线性控制方程,并采用自适应RBF网络逼近非线性控制方程中存在的不确定项,构成闭环反馈系统,实现对非线性系统的最优控制;其次,将待求参数复合成双二次泛函的解域,并设计一种新型的类递归神经网络求解该带约束条件的双二次型模型,实现模型求解的快速收敛并得其解.通过理论分析及数值仿真实例验证了所提模型能有效提高非线性系统的控制精度、稳定性、鲁棒性及自适应性,从而实现非线性系统的综合最优控制.     

A local linear radial basis function neural network for financial time-series forecasting

In this paper a Local Linear Radial Basis Function Neural Network (LLRBFN) is presented. The difference between the proposed neural network and the conventional Radial Basis Function Neural Network (RBFN) is connection weights between the hidden layer and the output layer which are replaced by a local linear model in the LLRBFN. A modified Particle Swarm Optimization (PSO) with hunter particles is introduced for training the LLRBFN. The proposed methods have been applied for prediction of financial time-series and the result shows the feasibility and effectiveness.     

A hybrid radial basis function and data envelopment analysis neural network for classification

We propose a hybrid radial basis function network-data envelopment analysis (RBFN-DEA) neural network for classification problems. The procedure uses the radial basis function to map low dimensional input data from input space ℜ to a high dimensional ℜ⁺ feature space where DEA can be used to learn the classification function. Using simulated datasets for a non-linearly separable binary classification problem, we illustrate how the RBFN-DEA neural network can be used to solve it. We also show how asymmetric misclassification costs can be incorporated in the hybrid RBFN-DEA model. Our preliminary experiments comparing the RBFN-DEA with feed forward and probabilistic neural networks show that the RBFN-DEA fares very well.     

A neural network architecture for visual selection

This article describes a parallel neural net architecture for efficient and robust visual selection in generic gray-level images. Objects are represented through flexible star-type planar arrangements of binary local features which are in turn star-type planar arrangements of oriented edges. Candidate locations are detected over a range of scales and other deformations, using a generalized Hough transform. The flexibility of the arrangements provides the required invariance. Training involves selecting a small number of stable local features from a predefined pool, which are well localized on registered examples of the object. Training therefore requires only small data sets. The parallel architecture is constructed so that the Hough transform associated with any object can be implemented without creating or modifying any connections. The different object representations are learned and stored in a central module. When one of these representations is evoked, it "primes" the appropriate layers in the network so that the corresponding Hough transform is computed. Analogies between the different layers in the network and those in the visual system are discussed. Furthermore, the model can be used to explain certain experiments on visual selection reported in the literature.     

Application of a radial basis function artificial neural network to seismic data inversion

We investigate here the performance and the application of a radial basis function artificial neural network (RBF-ANN) type, in the inversion of seismic data. The proposed structure has the advantage of being easily trained by means of a back-propagation algorithm without getting stuck in local minima. The effects of network architectures, i.e. the number of neurons in the hidden layer, the rate of convergence and prediction accuracy of ANN models are examined. The optimum network parameters and performance were decided as a function of testing error convergence with respect to the network training error. An adequate cross-validation test is run to ensure the performance of the network on new data sets. The application of such a network to synthetic and real data shows that the inverted acoustic impedance section was efficient.     

A fuzzy hybrid learning algorithm for radial basis function neural network with application in human face recognition

This paper presents a fuzzy hybrid learning algorithm (FHLA) for the radial basis function neural network (RBFNN). The method determines the number of hidden neurons in the RBFNN structure by using cluster validity indices with majority rule while the characteristics of the hidden neurons are initialized based on advanced fuzzy clustering. The FHLA combines the gradient method and the linear least-squared method for adjusting the RBF parameters and the neural network connection weights. The RBFNN with the proposed FHLA is used as a classifier in a face recognition system. The inputs to the RBFNN are the feature vectors obtained by combining shape information and principal component analysis. The designed RBFNN with the proposed FHLA, while providing a faster convergence in the training phase, requires a hidden layer with fewer neurons and less sensitivity to the training and testing patterns. The efficiency of the proposed method is demonstrated on the ORL and Yale face databases, and comparison with other algorithms indicates that the FHLA yields excellent recognition rate in human face recognition.