Identification of nonlinear dynamic systems using functional linkartificial neural networks

We have presented an alternate ANN structure called functional link ANN (FLANN) for nonlinear dynamic system identification using the popular backpropagation algorithm. In contrast to a feedforward ANN structure, i.e., a multilayer perceptron (MLP), the FLANN is basically a single layer structure in which nonlinearity is introduced by enhancing the input pattern with nonlinear functional expansion. With proper choice of functional expansion in a FLANN, this network performs as good as and in some cases even better than the MLP structure for the problem of nonlinear system identification.     

Nonlinear dynamic system identification using pipelined functional link artificial recurrent neural network

A computationally efficient pipelined functional link artificial recurrent neural network (PFLARNN) is proposed for nonlinear dynamic system identification using a modification real-time recurrent learning (RTRL) algorithm in this paper. In contrast to a feedforward artificial neural network (such as a functional link artificial neural network (FLANN)), the proposed PFLARNN consists of a number of simple small-scale functional link artificial recurrent neural network (FLARNN) modules. Since those modules of PFLARNN can be performed simultaneously in a pipelined parallelism fashion, this would result in a significant improvement in its total computational efficiency. Moreover, nonlinearity of each module is introduced by enhancing the input pattern with nonlinear functional expansion. Therefore, the performance of the proposed filter can be further improved. Computer simulations demonstrate that with proper choice of functional expansion in the PFLARNN, this filter performs better than the FLANN and multilayer perceptron (MLP) for nonlinear dynamic system identification.     

Nonlinear channel equalization for QAM signal constellation usingartificial neural networks

Application of artificial neural networks (ANN's) to adaptive channel equalization in a digital communication system with 4-QAM signal constellation is reported in this paper. A novel computationally efficient single layer functional link ANN (FLANN) is proposed for this purpose. This network has a simple structure in which the nonlinearity is introduced by functional expansion of the input pattern by trigonometric polynomials. Because of input pattern enhancement, the FLANN is capable of forming arbitrarily nonlinear decision boundaries and can perform complex pattern classification tasks. Considering channel equalization as a nonlinear classification problem, the FLANN has been utilized for nonlinear channel equalization. The performance of the FLANN is compared with two other ANN structures [a multilayer perceptron (MLP) and a polynomial perceptron network (PPN)] along with a conventional linear LMS-based equalizer for different linear and nonlinear channel models. The effect of eigenvalue ratio (EVR) of input correlation matrix on the equalizer performance has been studied. The comparison of computational complexity involved for the three ANN structures is also provided.     

Identification and control of dynamical systems using the self-organizing map.

In this paper, we introduce a general modeling technique, called vector-quantized temporal associative memory (VQTAM), which uses Kohonen's self-organizing map (SOM) as an alternative to multilayer perceptron (MLP) and radial basis function (RBF) neural models for dynamical system identification and control. We demonstrate that the estimation errors decrease as the SOM training proceeds, allowing the VQTAM scheme to be understood as a self-supervised gradient-based error reduction method. The performance of the proposed approach is evaluated on a variety of complex tasks, namely: i) time series prediction; ii) identification of SISO/MIMO systems; and iii) nonlinear predictive control. For all tasks, the simulation results produced by the SOM are as accurate as those produced by the MLP network, and better than those produced by the RBF network. The SOM has also shown to be less sensitive to weight initialization than MLP networks. We conclude the paper by discussing the main properties of the VQTAM and their relationships to other well established methods for dynamical system identification. We also suggest directions for further work.     

A differential evolution based neural network approach to nonlinear system identification

This paper addresses the effectiveness of soft computing approaches such as evolutionary computation (EC) and neural network (NN) to system identification of nonlinear systems. In this work, two evolutionary computing approaches namely differential evolution (DE) and opposition based differential evolution (ODE) combined with Levenberg Marquardt algorithm have been considered for training the feed-forward neural network applied for nonlinear system identification. Results obtained envisage that the proposed combined opposition based differential evolution neural network (ODE-NN) approach to identification of nonlinear system exhibits better model identification accuracy compared to differential evolution neural network (DE-NN) approach. The above method is finally tested on a one degree of freedom (1DOF) highly nonlinear twin rotor multi-input–multi-output system (TRMS) to verify the identification performance.     

An improved SPSA algorithm for system identification using fuzzy rules for training neural networks

Simultaneous perturbation stochastic approximation (SPSA) belongs to the class of gradient-free optimization methods that extract gradient information from successive objective function evaluation. This paper describes an improved SPSA algorithm, which entails fuzzy adaptive gain sequences, gradient smoothing, and a step rejection procedure to enhance convergence and stability. The proposed fuzzy adaptive simultaneous perturbation approximation (FASPA) algorithm is particularly well suited to problems involving a large number of parameters such as those encountered in nonlinear system identification using neural networks (NNs). Accordingly, a multilayer perceptron (MLP) network with popular training algorithms was used to predicate the system response. We found that an MLP trained by FASPSA had the desired accuracy that was comparable to results obtained by traditional system identification algorithms. Simulation results for typical nonlinear systems demonstrate that the proposed NN architecture trained with FASPSA yields improved system identification as measured by reduced time of convergence and a smaller identification error.     

Nonlinear systems identification using dynamic multi-time scale neural networks

In this paper, two Neural Network (NN) identifiers are proposed for nonlinear systems identification via dynamic neural networks with different time scales including both fast and slow phenomena. The first NN identifier uses the output signals from the actual system for the system identification. The on-line update laws for dynamic neural networks have been developed using the Lyapunov function and singularly perturbed techniques. In the second NN identifier, all the output signals from nonlinear system are replaced with the state variables of the neuron networks. The on-line identification algorithm with dead-zone function is proposed to improve nonlinear system identification performance. Compared with other dynamic neural network identification methods, the proposed identification methods exhibit improved identification performance. Three examples are given to demonstrate the effectiveness of the theoretical results.     

GMM/ANN混合说话人辨认模型

通过分析GMM(高斯混合模型)的说话人辨认系统的性能,提出了一种捕捉不同说话人交互信息的人工神经网络(ANN)方法,构成一个GMM/ANN混合说话人辨认系统。实验表明,GMM/ANN混合系统的说话人辨认能够取得比基于GMM和基于MLP(多层感知器)更高的辨认率。     

On-line system identification of complex systems using Chebyshev neural networks

This paper proposes a computationally efficient artificial neural network (ANN) model for system identification of unknown dynamic nonlinear discrete time systems. A single layer functional link ANN is used for the model where the need of hidden layer is eliminated by expanding the input pattern by Chebyshev polynomials. Thus, creation of nonlinear decision boundaries in the multidimensional input space and approximation of complex nonlinear systems becomes easier. These models are linear in their parameters and nonlinear in the inputs. The recursive least squares method with forgetting factor is used as on-line learning algorithm for parameter updation. The good behaviour of the identification method is tested on Box and Jenkins Gas furnace benchmark identification problem, single input single output (SISO) and multi input multi output (MIMO) discrete time plants. Stability of the identification scheme is also addressed.     

Neural equalization applied to systems with bidimensional digital modulation

A new equalization model for digital communication systems is proposed, based on a multi-layer perceptron (MLP) artificial neural network with a backpropagation algorithm. Unlike earlier techniques, the proposed model, called the bidimensional neural equalizer, is composed of two independent MLP networks that operate in parallel for each dimension of the digital modulation scheme. A heuristic method to combine the errors of the two MLP networks is also proposed, with the aim of reducing the convergence time. Simulations performed for linear and nonlinear channels demonstrated that the new model could improve performance in terms of the bit error rate and the convergence time, compared to existing models.     

Automated nonlinear system modelling with multiple neural networks

This article discusses the identification of nonlinear dynamic systems using multi-layer perceptrons (MLPs). It focuses on both structure uncertainty and parameter uncertainty, which have been widely explored in the literature of nonlinear system identification. The main contribution is that an integrated analytic framework is proposed for automated neural network structure selection, parameter identification and hysteresis network switching with guaranteed neural identification performance. First, an automated network structure selection procedure is proposed within a fixed time interval for a given network construction criterion. Then, the network parameter updating algorithm is proposed with guaranteed bounded identification error. To cope with structure uncertainty, a hysteresis strategy is proposed to enable neural identifier switching with guaranteed network performance along the switching process. Both theoretic analysis and a simulation example show the efficacy of the proposed method.     

基于ANN的动态系统状态方程辨识建模仿真

对系统辨识原理、基于神经网络（ANN）的动态系统辨识进行了分析,针对动态系统辨识模型描述的复杂性,为简化ANN辨识建模的输入／输出关系的表达,提高算法的简洁性,采用了状态方程辨识模型,并给出了基于ANN的动态系统状态方程辨识模型。为比较分析不同网络结构的辨识建模效果及网络模型泛化能力,针对三种不同网络结构方案进行了辨识建模仿真研究。仿真结果最示,基于ANN的动态系统状态方程模型的辨识建模是有效的,并且简单合理的网络结构方案,可提高网络辨识模型的泛化能力。     

Enhancing positioning accuracy of GPS/INS system during GPS outages utilizing artificial neural network

Integrated global positioning system and inertial navigation system (GPS/INS) have been extensively employed for navigation purposes. However, low-grade GPS/INS systems generate erroneous navigation solutions in the absence of GPS signals and drift very fast. We propose in this paper a novel method to integrate a low-grade GPS/INS with an artificial neural network (ANN) structure. Our method is based on updating the INS in a Kalman filter structure using ANN during GPS outages. This study focuses on the design, implementation and integration of such an ANN employing an optimum multilayer perceptron (MLP) structure with relevant number of layers/perceptrons and an appropriate learning. As a result, a land test is conducted with the proposed ANN + GPS/INS system and we here provide the system performance with the land trials.     

基于外积FLNN的非线性系统辨识

函数型连接神经网络通过对输入模式预先进行非线性扩展,增强了输入信号的模式表达,从而大大简化网络结构,降低计算复杂度。本文提出一种外积扩展型连接神经网络,用于辨识幂函数非线性系统,并与MLP和CFLNN网络对比,仿真结果表明,外积型辨识幂函数非线性系统结构简单、计算量低、性能最优。     

Fast and improved backpropagation learning of multi-layer artificial neural network using adaptive activation function

In the conventional backpropagation (BP) learning algorithm used for the training of the connecting weights of the artificial neural network (ANN), a fixed slope−based sigmoidal activation function is used. This limitation leads to slower training of the network because only the weights of different layers are adjusted using the conventional BP algorithm. To accelerate the rate of convergence during the training phase of the ANN, in addition to updates of weights, the slope of the sigmoid function associated with artificial neuron can also be adjusted by using a newly developed learning rule. To achieve this objective, in this paper, new BP learning rules for slope adjustment of the activation function associated with the neurons have been derived. The combined rules both for connecting weights and slopes of sigmoid functions are then applied to the ANN structure to achieve faster training. In addition, two benchmark problems: classification and nonlinear system identification are solved using the trained ANN. The results of simulation-based experiments demonstrate that, in general, the proposed new BP learning rules for slope and weight adjustments of ANN provide superior convergence performance during the training phase as well as improved performance in terms of root mean square error and mean absolute deviation for classification and nonlinear system identification problems.     

滑动数据窗口驱动的贝叶斯-高斯网络及其在非线性系统辨识中的应用

工业控制场合中,需要获取非线性被控对象的结构特性,而系统动态响应的数据直接从外部特征上反映了非线性系统结构关系.为了充分利用非线性动态系统响应过程中的数据,本文提出了一种基于滑动数据窗口 (sliding data window)的贝叶斯-高斯神经网络 (SW-BGNN)模型.该模型将数据融合于网络模型结构中,借助于贝叶斯推理和高斯假设,利用滑动窗口数据,实现非线性动态系统的辨识和预测.整个SW-BGNN本身需要确定的参数很少,因此运算的时间很短,适合于非线性动态系统的在线辨识.将SW-BGNN应用于几个非线性动态系统的辨识和预测,仿真试验结果表明了SW-BGNN模型的有效性.     

Predicting neutron diffusion eigenvalues with a query-basedadaptive neural architecture

A query-based approach for adaptively retraining and restructuring a two-hidden-layer artificial neural network (ANN) has been developed for the speedy prediction of the fundamental mode eigenvalue of the neutron diffusion equation, a standard nuclear reactor core design calculation which normally requires the iterative solution of a large-scale system of nonlinear partial differential equations (PDEs). The approach developed focuses primarily upon the adaptive selection of training and cross-validation data and on artificial neural-network (ANN) architecture adjustments, with the objective of improving the accuracy and generalization properties of ANN-based neutron diffusion eigenvalue predictions. For illustration, the performance of a "bare bones" feedforward multilayer perceptron (MLP) is upgraded through a variety of techniques; namely, nonrandom initial training set selection, adjoint function input weighting, teacher-student membership and equivalence queries for generation of appropriate training data, and a dynamic node architecture (DNA) implementation. The global methodology is flexible in that it ran "wrap around" any specific training algorithm selected for the static calculations (i.e., training iterations with a fixed training set and architecture). Finally, the improvements obtained are carefully contrasted against past works reported in the literature.     

Neural network applications in fault diagnosis and detection: an overview of implementations in engineering-related systems

The use of artificial neural networks (ANN) in fault detection analysis is widespread. This paper aims to provide an overview on its application in the field of fault identification and diagnosis (FID), as well as the guiding elements behind their successful implementations in engineering-related applications. In most of the reviewed studies, the ANN architecture of choice for FID problem-solving is the multilayer perceptron (MLP). This is likely due to its simplicity, flexibility, and established usage. Its use managed to find footing in a variety of fields in engineering very early on, even before the technology was as polished as it is today. Recurrent neural networks, while having overall stronger potential for solving dynamic problems, are only suggested for use after a simpler implementation in MLP was attempted. Across various ANN applications in FID, it is observed that preprocessing of the inputs is extremely important in obtaining the proper features for use in training the network, particularly when signal analysis is involved. Normalization is practically a standard for ANN use, and likely many other decision-based learning methods due to its ease of use and high impact on speed of convergence. A simple demonstration of ANN’s ease of use in solving a unique FID problem was also shown.

     

Design of low cost universal artificial neuron controller for chopper fed embedded DC drives

Artificial neural network (ANN) has become very popular in many control applications due to their high computation rate and ability to handle nonlinear functions. This paper proposes an artificial neuron controller for closed loop speed control of DC drive fed by DC chopper. Neuron control is used to reduce the steady state error, overshoot and settling time. The signal corresponding to the motor speed error and change in speed error are used as inputs to ANN Controller. The controller outputs the required change in duty cycle of pulse width modulated gating signal applied to DC chopper. Thus the voltage fed to the armature of the DC motor is adjusted for achieving the desired speed response. The training patterns for the neuron controller are obtained from the conventional PI controller and the effectiveness of the proposed neuron controller is studied using simulation studies.The designed controller was implemented in a low cost 8051-based embedded system and the results are documented. Two-loop control system was implemented with an inner ON/OFF current controller and an outer ANN speed controller.A conventional controller has heavy computation burden whereas a trained neural network requires less computation time. The artificial neural network has the ability to generalize and can interpolate in between the training data. This advantage of ANN makes the ANN controller universal. The ANN controller designed was tested on two different motors and found to work effectively on driving both of them.     

基于WOA优化神经网络的BOTDA传感信息提取

人工神经网络（ANN）已被应用于获取布里渊光时域分析仪（BOTDA）所测的布里渊频移信息（BFS）,然而其存在易陷入局部最优和收敛速度慢等缺点。为了克服上述缺点,本文提出一种基于WOA优化人工神经网络（WOA-NN）快速获取布里渊光纤传感器BFS的方法;随后通过设计非线性收敛因子a,进一步构建基于非线性WOA优化的神经网络（NWOA-NN）用来提取BFS。将提出的2种网络与经典ANN、粒子群优化神经网络（PSO-NN）、遗传算法优化神经网络（GA-NN）等模型进行比较,实验结果表明,本文所提出的WOA-NN模型在提取BOTDA中的温度信息时的性能优于其他3个网络,其所获取的温度的平均RMSE分别低于ANN、PSO-NN和GA-NN约42.66%、52.51%以及45.93%,NWOA-NN模型所获取的平均RMSE进一步优于WOA-NN 19.08%。同时,使用ANN、PSO-NN、GA-NN、WOA-NN和NWOA-NN进行训练所花费的平均时间分别为929.71 s、889.49 s、699.36 s、580.06 s和549.12 s,所提出的2个网络训练时间表现亦较好。