One-against-all ensemble for multiclass pattern classification

This paper presents a new method called one-against-all ensemble for solving multiclass pattern classification problems. The proposed method incorporates a neural network ensemble into the one-against-all method to improve the generalization performance of the classifier. The experimental results show that the proposed method can reduce the uncertainty of the decision and it is comparable to the other widely used methods.     

An error-counting network for pattern classification

This paper presents a novel quadratic error-counting network for pattern classification. Two computational issues namely, the network learning issue and the classification error-counting issue have been addressed. Essentially, a linear series functional approximation to network structure and a smooth quadratic error-counting cost function were proposed to resolve these two computational issues within a single framework. Our analysis shows that the quadratic error-counting objective can be related to the least-squares-error objective by adjusting the class-specific normalization factors. The binary classification network is subsequently extended to cater for multicategory problems. An extensive empirical evaluation validates the usefulness of proposed method.     

Mixed preconditioners for harmonic balance Jacobians

Preconditioning is crucial for the convergence of GMRES iteration in the Harmonic Balance analysis of RF and microwave circuits. In this article, mixed frequency/time‐domain preconditioners for harmonic balance Jacobians are presented. The efficiency of mixed preconditioners is demonstrated with realistic simulation examples. © 2008 Wiley Periodicals, Inc. Int J RF and Microwave CAE, 2009.     

Multi-class pattern classification using neural networks

Multi-class pattern classification has many applications including text document classification, speech recognition, object recognition, etc. Multi-class pattern classification using neural networks is not a trivial extension from two-class neural networks. This paper presents a comprehensive and competitive study in multi-class neural learning with focuses on issues including neural network architecture, encoding schemes, training methodology and training time complexity. Our study includes multi-class pattern classification using either a system of multiple neural networks or a single neural network, and modeling pattern classes using one-against-all, one-against-one, one-against-higher-order, and P-against-Q. We also discuss implementations of these approaches and analyze training time complexity associated with each approach. We evaluate six different neural network system architectures for multi-class pattern classification along the dimensions of imbalanced data, large number of pattern classes, large vs. small training data through experiments conducted on well-known benchmark data.     

A cooperative constructive method for neural networks for pattern recognition

In this paper, we propose a new constructive method, based on cooperative coevolution, for designing automatically the structure of a neural network for classification. Our approach is based on a modular construction of the neural network by means of a cooperative evolutionary process. This process benefits from the advantages of coevolutionary computation as well as the advantages of constructive methods. The proposed methodology can be easily extended to work with almost any kind of classifier.The evaluation of each module that constitutes the network is made using a multiobjective method. So, each new module can be evaluated in a comprehensive way, considering different aspects, such as performance, complexity, or degree of cooperation with the previous modules of the network. In this way, the method has the advantage of considering not only the performance of the networks, but also other features.The method is tested on 40 classification problems from the UCI machine learning repository with very good performance. The method is thoroughly compared with two other constructive methods, cascade correlation and GMDH networks, and other classification methods, namely, SVM, C4.5, and k nearest-neighbours, and an ensemble of neural networks constructed using four different methods.     

Further result on a dynamic recurrent neural-network-based adaptive observer for a class of nonlinear systems

In Kim et al. [(1997) A dynamic recurrent neural-network-based adaptive observer for a class of nonlinear systems. Automatica 33(8), 1539–1543], authors present an excellent neural network (NN) observer for a class of nonlinear systems. However, the output error equation in their paper is strictly positive real (SPR) which is restrictive assumption for nonlinear systems. In this note, by introducing a vector b₀ and Lyapunov equation, the observer design is obtained without requiring the SPR condition. Thus, our observer can be applied to a wider class of systems.     

Dissipative-based adaptive neural control for nonlinear systems

A dissipative-based adaptive neural control scheme was developed for a class of nonlinear uncertain systems with unknown nonlinearities that might not be linearly parameterized. The major advantage of the present work was to relax the requirement of matching condition, i.e., the unknown nonlinearities appear on the same equation as the control input in a state-space representation, which was required in most of the available neural network controllers. By synthesizing a state-feedback neural controller to make the closed-loop system dissipative with respect to a quadratic supply rate, the developed control scheme guarantees that the L2-gain of controlled system was less than or equal to a prescribed level. And then, it is shown that the output tracking error is uniformly ultimate bounded. The design scheme is illustrated using a numerical simulation.     

Adaptive neural network control for strict-feedback nonlinear systems using backstepping design

This paper focuses on adaptive control of strict-feedback nonlinear systems using multilayer neural networks (MNNs). By introducing a modified Lyapunov function, a smooth and singularity-free adaptive controller is firstly designed for a first-order plant. Then, an extension is made to high-order nonlinear systems using neural network approximation and adaptive backstepping techniques. The developed control scheme guarantees the uniform ultimate boundedness of the closed-loop adaptive systems. In addition, the relationship between the transient performance and the design parameters is explicitly given to guide the tuning of the controller. One important feature of the proposed NN controller is the highly structural property which makes it particularly suitable for parallel processing in actual implementation. Simulation studies are included to illustrate the effectiveness of the proposed approach.     

Nonlinear pattern hypothesis generation for data mining

This paper reports on conceptual development in applications of neural networks to data mining and knowledge discovery. Hypothesis generation is one of the significant differences of data mining from statistical analyses. Nonlinear pattern hypothesis generation is a major task of data mining and knowledge discovery. Yet, few methods of nonlinear pattern hypothesis generation are available.

This paper proposes a model of data mining to support nonlinear pattern hypothesis generation. This model is an integration of linear regression analysis model, Kohonen's self-organizing maps, the algorithm for convex polytopes, and back-propagation neural networks.     

A hybrid system for SPC concurrent pattern recognition

Any nonrandom patterns shown in Statistical Process Control (SPC) charts imply possible assignable causes that may deteriorate the process performance. Hence, timely detecting and recognizing Control Chart Patterns (CCPs) for nonrandomness is very important in the implementation of SPC. Due to the limitations of run-rule-based approaches, Artificial Neural Networks (ANNs) have been resorted for detecting CCPs. However, most of the reported ANN approaches are only limited to recognize single basic patterns. Different from these approaches, this paper presents a hybrid approach by integrating wavelet method with ANNs for on-line recognition of CCPs including concurrent patterns. The main advantage of this approach is its capability of recognizing coexisted or concurrent patterns without training by concurrent patterns. The test results using simulated data have demonstrated the improvements and the effectiveness of the methodology with a success rate up to 91.41% in concurrent CCP recognition.     

Neural-networks-based nonlinear dynamic modeling for automotive engines

This paper presents a procedure for using neural networks to identify the nonlinear dynamic model of the intake manifold and the throttle body processes in an automotive engine. A dynamic neural network called external recurrent neural network, is used for dynamic mapping and model construction. Dynamic Levenberg–Marquardt algorithm is then applied to the weight-estimation problem. Modeling results indicate that the neural-network-based models have a rather simple structure. Early results also confirm that the neural-network-based modeling of the manifold dynamics can result in a model that is comparable if not better than the first-principle-based models. In addition, it was verified that the neural model has good generalization capabilities.     

非线性系统的神经网络辨识和控制方法

1引言 在Wiener开创控制论的伊始,就将控制、信息和神经科学作为一个共同的课题。后,控制学科、计算科学和神经生理学趋于分开发展。自从80年代初期以来,神经网络有了长的进步,在人工智能和     

Decentralized control of a class of large-scale nonlinear systems using neural networks

This paper designs a decentralized neural network (NN) controller for a class of nonlinear large-scale systems, in which strong interconnections are involved. NNs are used to handle unknown functions. The proposed scheme is proved guaranteeing the boundedness of the closed-loop subsystems using only local feedback signals.     

Adaptive neural network predictive control for nonlinear pure feedback systems with input delay

This paper presents an adaptive neural control design for nonlinear pure-feedback systems with an input time-delay. Novel state variables and the corresponding transform are introduced, such that the state-feedback control of a pure-feedback system can be viewed as the output-feedback control of a canonical system. An adaptive predictor incorporated with a high-order neural network (HONN) observer is proposed to obtain the future system states predictions, which are used in the control design to circumvent the input delay and nonlinearities. The proposed predictor, observer and controller are all online implemented without iterative predictive calculations, and the closed-loop system stability is guaranteed. The conventional backstepping design and analysis for pure-feedback systems are avoided, which renders the developed scheme simpler in its synthesis and application. Practical guidelines on the control implementation and the parameter design are provided. Simulation on a continuous stirred tank reactor (CSTR) and practical experiments on a three-tank liquid level process control system are included to verify the reliability and effectiveness.     

Adaptive neural network control for a class of uncertain nonlinear systems in pure-feedback form

A procedure is developed for the design of adaptive neural network controller for a class of SISO uncertain nonlinear systems in pure-feedback form. The design procedure is a combination of adaptive backstepping and neural network based design techniques. It is shown that, under appropriate assumptions, the solution of the closed-loop system is uniformly ultimately bounded.     

Central pattern generators based on Matsuoka oscillators for the locomotion of biped robots

Biologically inspired control approaches based on central pattern generators (CPGs) with neural oscillators have been drawing much attention for the purpose of generating rhythmic motion for biped robots with human-like locomotion. This article describes the design of a neural-oscillator-based gait-rhythm generator using a network of Matsuoka oscillators to generate a walking pattern for biped robots. This includes the proper consideration of the oscillator’s parameters, such as a time constant for the adaptation rate, coupling factors for mutual inhibitory connections, etc., to obtain a stable and desirable response from the network. The article examines the characteristics of a CPG network with six oscillators, and the effect of assigning symmetrical and asymmetrical coupling coefficients among oscillators within the network structure under different possible inhibitions and excitations. The kinematics and dynamics of a five-link biped robot have been modeled, and its joints are actuated through simulation by the torques output from the neural rhythm generator to generate the trajectories for hip, knee, and ankle joints. The parameters of the neural oscillators are tuned to achieve flexible trajectories. The CPG-based control strategy is implemented and tested through a simulation. This work was presented in part at the 12th International Symposium on Artificial Life and Robotics, Oita, Japan, January 25–27, 2007     

Adaptive neural sliding mode compensator for a class of nonlinear systems with unmodeled uncertainties

This paper addresses the problem of adaptive neural sliding mode control for a class of multi-input multi-output nonlinear system. The control strategy is an inverse nonlinear controller combined with an adaptive neural network with sliding mode control using an on-line learning algorithm. The adaptive neural network with sliding mode control acts as a compensator for a conventional inverse controller in order to improve the control performance when the system is affected by variations in its entire structure (kinematics and dynamics). The controllers are obtained by using Lyapunov's stability theory. Experimental results of a case study show that the proposed method is effective in controlling dynamic systems with unexpected large uncertainties.     

Type-1 and type-2 fuzzy inference systems as integration methods in modular neural networks for multimodal biometry and its optimization with genetic algorithms

We describe in this paper a comparative study between fuzzy inference systems as methods of integration in modular neural networks for multimodal biometry. These methods of integration are based on techniques of type-1 fuzzy logic and type-2 fuzzy logic. Also, the fuzzy systems are optimized with simple genetic algorithms with the goal of having optimized versions of both types of fuzzy systems. First, we considered the use of type-1 fuzzy logic and later the approach with type-2 fuzzy logic. The fuzzy systems were developed using genetic algorithms to handle fuzzy inference systems with different membership functions, like the triangular, trapezoidal and Gaussian; since these algorithms can generate fuzzy systems automatically. Then the response integration of the modular neural network was tested with the optimized fuzzy systems of integration. The comparative study of the type-1 and type-2 fuzzy inference systems was made to observe the behavior of the two different integration methods for modular neural networks for multimodal biometry.     

Stable nonlinear adaptive controller for an autonomous underwater vehicle using neural networks

In general, the dynamics of autonomous underwater vehicles (AUVs) are highly nonlinear and their hydrodynamic coefficients vary with different operating conditions. For this reason, high performance control system for an AUV usually should have the capacities of learning and adaptation to the time-varying dynamics of the vehicle. In this article, we present a robust adaptive nonlinear control scheme for an AUV, where a linearly parameterized neural network (LPNN) is introduced to approximate the uncertainties of the vehicle's dynamics, and the basis function vector of the network is constructed according to the vehicle's physical properties. The proposed control scheme can guarantee that all of the signals in the closed-loop system are uniformly ultimately bounded (UUB). Numerical simulation studies are performed to illustrate the effectiveness of the proposed control scheme.     

The multi-parameter homotopy harmonic balance method for steady state problems

The analytical solutions of a simple nonlinear equation, e.g., the Duffing equation, can be highly complicated. Homotopy continuation on just one parameter can hardly produce the whole picture, in particular, of the multiple bifurcations in multi-parameter space. This paper reports on the development of the multi-parameter homotopy harmonic balance method for the steady state solutions of a nonlinear vibration problem. The total and tangential stiffnesses with respect to the Fourier components of polynomial nonlinearity are given explicitly. New multiple solutions of the Duffing equation are given for the first time. The period doubling to chaos is interpreted in a new way. Finally, the bifurcation surfaces of folding and period doubling are constructed.