A Maximum Principle via Malliavin calculus for combined stochastic control and impulse control of forward‐backward systems

We consider a combined stochastic control and impulse control problem of forward‐backward systems driven by Lévy processes, where both the system coefficients and the objective performance functional are allowed to be random, non‐Markovian; the information available to the controller is partial information. Applying a Malliavin calculus approach, we derive a maximum principle for this control problem, where the adjoint processes are explicitly represented by the parameters and the states of the system. Finally, we give two examples of applications. © 2015 Chinese Automatic Control Society and Wiley Publishing Asia Pty Ltd     

Networked Estimation of Multi‐Agent Systems Subject to Faults and Unreliable Information

In this paper, a novel framework for networked estimation of multi‐agent systems subject to presence of actuator faults is proposed. This framework is developed based on the notion of sub‐observers where within a group of sub‐observers each sub‐observer estimates certain states that are conditioned on a given input, output, and other state information. We model the overall estimation process by a weighted estimation (WE) digraph. By selecting an appropriate path in the WE digraph, an assigned supervisor can select and configure a set of sub‐observers to successfully estimate all the system states. In the presence of large intermittent disturbances, noise, and faults certain sub‐observers may become invalid, and consequently the supervisor reconfigures the set of sub‐observers by selecting a new path in the estimation digraph such that the impacts of these uncertainties are confined to only the local estimators. This will prevent the propagation of uncertainties on the estimation performance of the entire multi‐agent system. Simulation results provided for a five satellite formation flight system in deep space confirm the validity and applicability of our proposed analytical work.     

Optimal Terminal Iterative Learning Control for the Automatic Train Stop System

The train stop control is a typical set‐point control task, where only the final state (i.e., the terminal train stop position) is of concern and specified. For such a control problem, an optimal terminal iterative learning control (TILC) approach is presented in this paper, where the stopping position and initial braking speed are chosen as the terminal system output and the control input, respectively. The controller design only depends on the measured input/output (I/O) data without requiring any modeling information of the train operation system, and the learning gain is updated by the system I/O data iteratively to accommodate the system uncertainties. The monotonic convergence of the terminal tracking error is guaranteed by rigorous mathematical analysis. Extensive simulation results are provided to show the applicability and effectiveness of the proposed approach.     

Heuristic Dynamic Programming Using Echo State Network For Multivariable Tracking Control Of Wastewater Treatment Process

This paper proposes a heuristic dynamic programming (HDP) scheme to simultaneously control the dissolved oxygen concentration and the nitrate level in wastewater treatment processes (WWTP). Unlike traditional HDP schemes, the optimal control values are calculated in an analytical way by the proposed HDP controller. It can reduce the learning burden of the HDP controller to a great extent. The system model and the evaluation index J are approximated by two echo state networks (ESNs). Gradient‐based learning algorithms are employed to train both ESNs online, and the convergence of the training algorithm is investigated based on Lyapunov theory. The performance of the proposed ESN‐based HDP (E‐HDP) controller is tested and evaluated on a WWTP benchmark. Experimental results demonstrate that the proposed approach can achieve effective performance.     

Robust‐Adaptive Control Strategies for a Time Delay Bioelectrochemical Process Using Interval Observers

The paper addresses the design and the analysis of adaptive and robust‐adaptive control strategies for a complex recycled wastewater treatment bioprocess. The design procedures are developed under the realistic assumptions that the bacterial growth rates are unknown and the influent flow rates are time‐varying and uncertain, but some lower and upper bounds of these uncertainties are known. The proposed control structures are achieved by combining a linearizing control law with an appropriately (asymptotic or interval based) state observer and with a parameter estimator used for on‐line estimation of unknown kinetics. These approaches are applied to a complex time delay bioprocess resulting from the association of a recycling bioreactor with an electrochemical reactor. Numerical simulations are performed in order to validate the proposed algorithms.     

A new robust observer-based adaptive type-2 fuzzy control for a class of nonlinear systems

In this paper, a novel robust observer-based adaptive controller is presented using a proposed simplified type-2 fuzzy neural network (ST2FNN) and a new three dimensional type-2 membership function is presented. Proposed controller can be applied to the control of high-order nonlinear systems and adaptation of the consequent parameters and stability analysis are carried out using Lyapunov theorem. Moreover, a new adaptive compensator is presented to eliminate the effect of the external disturbance, unknown nonlinear functions approximation errors and sate estimation errors. In the proposed scheme, using the Lyapunov and Barbalat's theorem it is shown that the system is stable and the tracking error of the system converges to zero asymptotically. The proposed method is simulated on a flexible joint robot, two-link robot manipulator and inverted double pendulums system. Simulation results confirm that in contrast to other robust techniques, our proposed method is simple, give better performance in the presence of noise, external disturbance and uncertainties, and has less computational cost.     

A genetic fuzzy system based optimized zone based energy efficient routing protocol for mobile sensor networks (OZEEP)

Wireless sensor networks have become increasingly popular because of their ability to cater to multifaceted applications without much human intervention. However, because of their distributed deployment, these networks face certain challenges, namely, network coverage, continuous connectivity and bandwidth utilization. All of these correlated issues impact the network performance because they define the energy consumption model of the network and have therefore become a crucial subject of study. Well-managed energy usage of nodes can lead to an extended network lifetime. One way to achieve this is through clustering. Clustering of nodes minimizes the amount of data transmission, routing delay and redundant data in the network, thereby conserving network energy. In addition to these advantages, clustering also makes the network scalable for real world applications. However, clustering algorithms require careful planning and design so that balanced and uniformly distributed clusters are created in a way that the network lifetime is enhanced. In this work, we extend our previous algorithm, titled the zone-based energy efficient routing protocol for mobile sensor networks (ZEEP). The algorithm we propose optimizes the clustering and cluster head selection of ZEEP by using a genetic fuzzy system. The two-step clustering process of our algorithm uses a fuzzy inference system in the first step to select optimal nodes that can be a cluster head based on parameters such as energy, distance, density and mobility. In the second step, we use a genetic algorithm to make a final choice of cluster heads from the nominated candidates proposed by the fuzzy system so that the optimal solution generated is a uniformly distributed balanced set of clusters that aim at an enhanced network lifetime. We also study the impact and dominance of mobility with regard to the variables. However, before we arrived at a GFS-based solution, we also studied fuzzy-based clustering using different membership functions, and we present our understanding on the same. Simulations were carried out in MATLAB and ns2. The results obtained are compared with ZEEP.     

Particle swarm algorithm with adaptive constraint handling and integrated surrogate model for the management of petroleum fields

This paper deals with the development of effective techniques to automatically obtain the optimum management of petroleum fields aiming to increase the oil production during a given concession period of exploration. The optimization formulations of such a problem turn out to be highly multimodal, and may involve constraints. In this paper, we develop a robust particle swarm algorithm coupled with a novel adaptive constraint-handling technique to search for the global optimum of these formulations. However, this is a population-based method, which therefore requires a high number of evaluations of an objective function. Since the performance evaluation of a given management scheme requires a computationally expensive high-fidelity simulation, it is not practicable to use it directly to guide the search. In order to overcome this drawback, a Kriging surrogate model is used, which is trained offline via evaluations of a High-Fidelity simulator on a number of sample points. The optimizer then seeks the optimum of the surrogate model.