Cellular non‐linear networks for minimization of functionals. Part 2: Examples

A method for the definition of cellular non‐linear networks able to find approximate minima of rather a large class of continuous functionals is illustrated through three examples. The method, based on the spatial discretization of continuous functionals and on the theory of potential functions for resistive circuits, has been presented in Part 1 of this paper. The first example (related to electromagnetic‐field theory) has the main purpose to show some aspects of the application procedure. The other two examples concern, respectively, a possible image‐processing application of the method (where a parallel processing is highly desirable) and a comparison with another method proposed in the literature on CNNs. Copyright © 2001 John Wiley & Sons, Ltd.     

Cellular non‐linear networks for minimization of functionals. Part 1: Theoretical aspects

A method for the definition of cellular non‐linear networks able to find approximate minima of rather a large class of continuous functionals is proposed and discussed from a theoretical point of view. The method is based on the spatial discretization of continuous functionals and on the theory of potential functions for resistive circuits. The discretization of the continuous functionals is obtained by resorting to the finite difference method or to the finite element method. The spatial discretization converts a functional into a function of a finite set of variables. By exploiting the theory of potential functions for resistive circuits, from such a function one can derive a lumped circuit that makes it possible to find an approximate minimum of the given functional. Copyright © 2001 John Wiley & Sons, Ltd.     

On simplex‐based piecewise‐linear approximations of non‐linear mappings

Simplex‐based piecewise‐linear (PWL) approximations of non‐linear mappings are needed when the robust PWL analysis is used to directly solve non‐linear equations. This paper proposes a straightforward technique for transforming the well‐known approximations into another form. This new form is computationally more efficient, since it preserves the sparse structure of the original Jacobian matrix. Furthermore, this new form of PWL approximation explicitly relates the simplex‐based PWL analysis to the conventional formulation of the Katzenelson algorithm. The proposed transform technique is also extended to treat groupwise‐separable mappings and, finally, non‐separable but sparse mappings that arise in real‐life simulation of large electronic circuits. In this paper, all these (transformed) simplex‐based PWL approximations are compared in terms of their generality and efficiency. The computational efficiency of the PWL approximation that utilizes sparsity is validated with realistic simulations. Copyright © 2005 John Wiley & Sons, Ltd.     

An efficient piecewise‐linear DC analysis method for general non‐linear circuits

The convergence problems of conventional DC analysis can be partly avoided by using piecewise‐linear analysis. This paper proposes a piecewise‐linear DC analysis method that can efficiently handle arbitrary couplings between non‐linear circuit elements. Piecewise‐linear modelling of the non‐linear circuit elements is automatically performed during simulation, using simplicial subdivisions. The number of linear regions, and thereby iterations, is considerably reduced by combining the common parts of separate simplicial subdivisions. Due to these reasons and since the method is formulated with the commonly used modified nodal approach, it has been possible to implement the method in the general‐purpose circuit simulator APLAC. The correct operation of the method is demonstrated with three examples. Copyright © 1999 John Wiley & Sons, Ltd.     

A cellular non‐linear network for image fusion based on data regularization

In this paper, a synthesis method developed in the last few years is applied to derive a cellular non‐linear network (CNN) able to find an approximate solution to a variational image‐fusion problem. The functional to be minimized is based on regularization theory and takes into account two complementary principles, namely, knowledge source corroboration and belief enhancement/withdrawal, both typical of data‐fusion approaches. The obtained CNN has been tested by simulations (i.e. by numerically integrating the circuit state equations) in some case studies. The quality of the results is good, as turns out from comparisons with some standard methods. Copyright © 2006 John Wiley & Sons, Ltd.     

A novel compact piecewise‐linear representation

A new compact MAX representation for 2‐D continuous piecewise‐linear (PWL) functions is developed in this paper. The representation is promising since it can be easily generalized into higher dimensions. We also establish the explicit functional form of basis function and demonstrate that the proposed basis function is the elementary ‘building block’ from which a fully general 2‐D PWL function can be constructed. In addition, we reveal the relationship of basis function with minimal degenerate intersection and Hinging Hyperplane, which shows that the MAX model can unify Chua's canonical expression, Li's representation, lattice PWL function and Bremann's Hinging Finding Algorithm into one common theoretical framework. Copyright © 2005 John Wiley & Sons, Ltd.     

Constructive approximation of non‐linear discrete‐time systems

It is known that large classes of approximately‐finite‐memory maps can be uniformly approximated arbitrarily well by the maps of certain non‐linear structures. As an application, it was proved that time‐delay networks can be used to uniformly approximate arbitrarily well the members of a large class of causal nonlinear dynamic discrete‐time input–output maps. However, the proof is non‐constructive and provides no information concerning the determination of a structure that corresponds to a prescribed bound on the approximation error. Here we give some general results concerning the problem of finding the structure. Our setting is as follows. There is a large family 𝒢 of causal time‐invariant approximately‐finite‐memory input‐output maps G from a set S of real d‐vector‐valued discrete‐time inputs (with d⩾1) to the set of ℝ‐valued discrete‐time outputs, with both the inputs and outputs defined on the non‐negative integers 𝒵₊. We show that for each ϵ>0, any Gϵ𝒢 can be uniformly approximated by a structure map H(G, ·) to within tolerance ϵ, and we give analytical results and an example to illustrate how such a H(G, ·) can be determined in principle. Copyright © 2000 John Wiley & Sons, Ltd.     

PAC learning in non‐linear FIR models

The PAC learning theory creates a framework to assess the learning properties of static models for which the data are assumed to be independently and identically distributed (i.i.d.). The present paper first extends the idea of PAC learning to cover the learning of modelling tasks with m‐dependent data, and then applies the resulting framework to evaluate learning of non‐linear FIR models. Also, the learning properties of FIR modelling with radial basis function networks are further specified. These results include an upper bound on the size of the data set required to train an FIR radial basis function network, provided that the input data are uniformly distributed. Copyright © 2001 John Wiley & Sons, Ltd.     

A combined approach for the identification of continuous non‐linear systems

The identification of a non‐linear continuous output‐only system from a time series is considered for the case that the functional form of the model is not known beforehand. To estimate both functions and parameters, a combination of non‐parametric modelling based on non‐linear regression and parametric modelling based on a multiple shooting algorithm is proposed. This strategy to determine non‐linear differential equations is exemplified on experimental data from a chaotic circuit where an accurate reconstruction of the observed attractor is obtained. Copyright © 2003 John Wiley & Sons, Ltd.     

Electrical characterization of linear and non‐linear random networks and mixtures

A material composed of a mixture of distinct homogeneous media can be considered as a homogeneous one at a sufficiently large observation scale. The problem of mixture characterization has been exactly solved in case of linear random mixtures, that is, materials for which the various components are isotropic, linear and mixed together as an ensemble of particles having random shapes and positions. In the present work the authors briefly review the linear theory and then consider mixtures of non‐linear media. In particular they give formulas for obtaining their constitutive equations for current density, electrical displacement, and magnetic induction. These relations have been derived by means of heuristic considerations on random networks and they have been verified with simulations obtaining a high degree of accuracy. Copyright © 2003 John Wiley & Sons, Ltd.     

A robustification tool for adaptive non‐linear control

This paper presents a conceptually simple robustification approach for the adaptive control of a class of non‐linear systems with static and dynamic uncertainties. This approach generates a new class of robust adaptive non‐linear controllers and is based upon a combined application of the well‐known adaptive backstepping and recent non‐linear small‐gain techniques. The presented method is illustrated via a third‐ order chemical reactor with only temperature information, and under relaxed conditions. An adaptive output‐feedback stabilizer is obtained without resorting to any state observer. Copyright © 1999 John Wiley & Sons, Ltd.     

Current‐mode programmable piecewise‐linear neural synapses

Cellular Neural Networks with piecewise linear connection have been proposed by several authors as a generalization of the basic paradigm, which allows for more complex functionality. None of the prototypes realized to date, however, provides for such kind of synapses. As a feasibility study, a current‐mode subthreshold CMOS piecewise‐linear synapse circuit is developed in this paper. Copyright © 2003 John Wiley & Sons, Ltd.     

Synthesis of multiport resistors with piecewise‐linear characteristics: a mixed‐signal architecture

Non‐linear multiport resistors are the main ingredients in the synthesis of non‐linear circuits. Recently, a particular PWL representation has been proposed as a generic design platform (IEEE Trans. Circuits Syst.‐I 2002; 49 :1138–1149). In this paper, we present a mixed‐signal circuit architecture, based on standard modules, that allows the electronic integration of non‐linear multiport resistors using the mentioned PWL structure. The proposed architecture is fully programmable so that the unit can implement any user‐defined non‐linearity. Moreover, it is modular: an increment in the number of input variables can be accommodated through the addition of an equal number of input modules. Copyright © 2005 John Wiley & Sons, Ltd.     

Bifurcation analysis of a piecewise smooth system with non‐linear characteristics

In previous works, there are no results about the bifurcation analysis for a piecewise smooth system with non‐linear characteristics. The main purpose of this study is to calculate the bifurcation sets for a piecewise smooth system with non‐linear characteristics. We first propose a new method to track the bifurcation sets in the system. This method derives the composite discrete mapping, Poincaré mapping. As a result, it is possible to obtain the local bifurcation values in the parameter plane. As an illustrated example, we then apply this general methodology to the Rayleigh‐type oscillator containing a state‐ period‐dependent switch. In the circuit, we can find many subharmonic bifurcation sets including global bifurcations. We also show the bifurcation sets for the border‐collision bifurcations. Some theoretical results are verified by laboratory experiments. Copyright © 2005 John Wiley & Sons, Ltd.     

Uniform approximation of time‐invariant non‐linear systems

An Erratum has been published for this article in International Journal of Circuit Theory and Applications 2004; 32(6):633. It is shown that the elements of a large class of time‐invariant non‐linear input–output maps can be uniformly approximated arbitrarily well, over infinite time intervals, using a certain structure that can be implemented in many ways using, for example, radial basis functions, polynomial functions, piecewise linear functions, sigmoids, or combinations of these functions. For the special case in which these functions are taken to be certain polynomial functions, the input–output map of our structure is a generalized finite Volterra series. Results are given for the case in which inputs and outputs are defined on ?. The case in which inputs and outputs are defined on the half‐line ?₊ is also addressed, and in both cases inputs need not be functions that are continuous. Copyright © 2004 John Wiley & Sons, Ltd.     

Existence and uniqueness of solutions for DC networks containing non‐linear ideal op amps

In this paper we are concerned with networks obtained by connecting independent sources, linear resistors and non‐linear ideal op amps. A necessary and sufficient condition for the existence and uniqueness of solutions for every positive output saturation voltage of the op amps and every value of the independent sources is found. Copyright © 2001 John Wiley & Sons, Ltd.     

A new method for solving non‐linear carrier diffusion equation in axial direction of broad‐area lasers

The solution of non‐linear carrier diffusion equation associated with the axial direction of broad‐area laser has been achieved by a hybrid asymptotic‐numerical method that combines WKB approximation and the variation of constants method. The non‐linearity has been taken into account by using an iterative scheme: carrier lifetime has been linearized and calculated as a function of carrier density known from the previous iteration. Non‐uniform photon density has been taken into account. As the new method is based on analytical solutions, it is very fast and not vulnerable to large gradients of carrier concentration usually occurring in the vicinity of laser facets. Therefore, it can be useful in complicated self‐consistent thermal models of broad‐area lasers. The obtained results are compared with two simplified cases: solution of linear diffusion equation with constant coefficients and calculations neglecting the diffusion. Copyright © 2010 John Wiley & Sons, Ltd.     

An approximation for the input conductivity function of the non‐linear resistive grid

The 2‐term approximations for the input conductivity functions, i_in=f_in(v_in), of a grid of similar weakly non‐linear (parabolic) conductors, and the grid's symmetric cuts, measured between two close nodes, are derived, using a semi‐empirical method; the results of a relevant PSpice simulation are presented. The functions f_in(v_in) of the grid's symmetric cuts possess a common analytical feature. Simulation results show that the error in the calculation of the non‐linear terms in the input functions is less than 1 per cent. Copyright © 2001 John Wiley & Sons, Ltd.     

Adaptive output tracking for a class of non‐linear time‐delay systems

In this paper the output tracking control problem for a class of non‐linear time delay systems with some unknown constant parameters is addressed. Such a problem is solved in the case that the non‐linear time‐delay system has full delay relative degree and stable internal dynamics. It is supposed moreover that the output and its time derivatives until n?1, where n is the length of the state vector (euclidean part), do not depend explicitly on the unknown parameters. This work is the first step towards the application of the methodologies of adaptive control for non‐linear delayless systems, based on tools of differential geometry, to non‐linear time‐delay systems too. Copyright © 2004 John Wiley & Sons, Ltd.