Optimal control of investments for quality of supply improvement in electrical energy distribution networks

This paper considers the problem of deciding multi-period investments for maintenance and upgrade of electrical energy distribution networks. After describing the network as a constrained hybrid dynamical system, optimal control theory is applied to optimize profit under a complex incentive/penalty mechanism imposed by public authorities. The dynamics of the system and the cost function are translated into a mixed integer optimization model, whose solution gives the optimal investment policy over the multi-period horizon. While for a reduced-size test problem the pure mixed-integer approach provides the best optimal control policy, for real-life large-scale scenarios a heuristic solution is also introduced. Finally, the uncertainty associated with the dynamical model of the network is taken care of by adopting ideas from stochastic programming.     

Event-driven optimization-based control of hybrid systems with integral continuous-time dynamics

In this paper we introduce a class of continuous-time hybrid dynamical systems called integral continuous-time hybrid automata (icHA) for which we propose an event-driven optimization-based control strategy. Events include both external actions applied to the system and changes of continuous dynamics (mode switches). The icHA formalism subsumes a number of hybrid dynamical systems with practical interest, e.g., linear hybrid automata. Different cost functions, including minimum-time and minimum-effort criteria, and constraints are examined in the event-driven optimal control formulation. This is translated into a finite-dimensional mixed-integer optimization problem, in which the event instants and the corresponding values of the control input are the optimization variables. As a consequence, the proposed approach has the advantage of automatically adjusting the attention of the controller to the frequency of event occurrence in the hybrid process. A receding horizon control scheme exploiting the event-based optimal control formulation is proposed as a feedback control strategy and proved to ensure either finite-time or asymptotic convergence of the closed-loop.     

Dynamic programming for constrained optimal control of discrete-time linear hybrid systems

In this paper we study the solution to optimal control problems for constrained discrete-time linear hybrid systems based on quadratic or linear performance criteria. The aim of the paper is twofold. First, we give basic theoretical results on the structure of the optimal state-feedback solution and of the value function. Second, we describe how the state-feedback optimal control law can be constructed by combining multiparametric programming and dynamic programming.     

An efficient algorithm for optimal control of PWA systems with polyhedral performance indices

We present an algorithm for the computation of explicit optimal control laws for piecewise affine (PWA) systems with polyhedral performance indices. The algorithm is based on dynamic programming (DP) and represents an extension of ideas initially proposed in Kerrigan and Mayne [(2003). Optimal control of constrained, piecewise affine systems with bounded disturbances. In Proceedings of the 41st IEEE conference on decision and control, Las Vegas, Nevada, USA, December], and Baoti? et al. [(2003). A new algorithm for constrained finite time optimal control of hybrid systems with a linear performance index. In Proceedings of European control conference, Cambridge, UK, September]. Specifically, we show how to exploit the underlying geometric structure of the optimization problem in order to significantly improve the efficiency of the off-line computations. An extensive case study is provided, which clearly indicates that the algorithm proposed in this paper may be preferable to other schemes published in the literature.     

Hybrid extended Fourier series for optimal control of nonlinear algebraic dynamical systems

The paper introduces a new method for finding optimal control of algebraic dynamic systems. The structure of algebraic dynamical systems is nonlinear with quadratic and bilinear terms. A new hybrid extended Fourier series is introduced, and state and control variables of the system are expanded by this series. Moreover, properties of new series are presented, and integration and product operational matrices are obtained. Using operational matrices, optimal control of the systems is converted to a set of simultaneous nonlinear algebraic relations. An illustrative example is included to compare our results with those in the literature.     

Design, implementation, and experimental validation of optimal power split control for hybrid electric trucks

Hybrid electric vehicles require an algorithm that controls the power split between the internal combustion engine and electric machine(s), and the opening and closing of the clutch. Optimal control theory is applied to derive a methodology for a real-time optimal-control-based power split algorithm. The presented strategy is adaptive for vehicle mass and road elevation, and is implemented on a standard Electronic Control Unit of a parallel hybrid electric truck. The implemented strategy is experimentally validated on a chassis dynamo meter. The fuel consumption is measured on 12 different trajectories and compared with a heuristic and a non-hybrid strategy. The optimal control strategy has a fuel consumption lower (up to 3%) than the heuristic strategy on all trajectories that are evaluated, except one. Compared to the non-hybrid strategy the fuel consumption reduction ranged from 7% to 16%.     

Dynamic buffer management using optimal control of hybrid systems

This paper studies a dynamic buffer management problem with one buffer inserted between two interacting components. The component to be controlled is assumed to have multiple power modes corresponding to different data processing rates. The overall system is modeled as a hybrid system and the buffer management problem is formulated as an optimal control problem. Different from many previous studies, the objective function of the proposed problem depends on the switching cost and the size of the continuous state space, making its solution much more challenging. By exploiting some particular features of the problem, the best mode sequence and the optimal switching instants are characterized analytically using a variational approach. Simulation results based on real data shows that the proposed method can significantly reduce the energy consumption compared with another heuristic scheme in several typical situations.     

Pseudospectral methods for solving infinite-horizon optimal control problems

An important aspect of numerically approximating the solution of an infinite-horizon optimal control problem is the manner in which the horizon is treated. Generally, an infinite-horizon optimal control problem is approximated with a finite-horizon problem. In such cases, regardless of the finite duration of the approximation, the final time lies an infinite duration from the actual horizon at t=+∞. In this paper we describe two new direct pseudospectral methods using Legendre–Gauss (LG) and Legendre–Gauss–Radau (LGR) collocation for solving infinite-horizon optimal control problems numerically. A smooth, strictly monotonic transformation is used to map the infinite time domain t∈[0,∞) onto a half-open interval τ∈[−1,1). The resulting problem on the finite interval is transcribed to a nonlinear programming problem using collocation. The proposed methods yield approximations to the state and the costate on the entire horizon, including approximations at t=+∞. These pseudospectral methods can be written equivalently in either a differential or an implicit integral form. In numerical experiments, the discrete solution exhibits exponential convergence as a function of the number of collocation points. It is shown that the map ?:[−1,+1)→[0,+∞) can be tuned to improve the quality of the discrete approximation.     

Active fault detection and control: Unified formulation and optimal design

A new unified formulation of the active fault detection and control problem for discrete-time stochastic systems and its optimal solution are proposed. The problem formulation stems from the optimal stochastic control problem and includes important special cases: an active detector and controller, an active detector and input signal generator, and an active detector with a given input signal generator. The optimal solution is derived using the so-called closed loop information processing strategy. This strategy respects the influence of the current decision and/or input on the future behavior of the observed system, allows penalizing future wrong decisions, and improves the quality of fault detection. The proposed formulation and obtained solution also provide better understanding of the active fault detection and its relation to the optimal stochastic control. The results are illustrated in numerical examples.     

Resolving actuator redundancy—optimal control vs. control allocation

This paper considers actuator redundancy management for a class of overactuated nonlinear systems. Two tools for distributing the control effort among a redundant set of actuators are optimal control design and control allocation. In this paper, we investigate the relationship between these two design tools when the performance indexes are quadratic in the control input. We show that for a particular class of nonlinear systems, they give exactly the same design freedom in distributing the control effort among the actuators. Linear quadratic optimal control is contained as a special case. A benefit of using a separate control allocator is that actuator constraints can be considered, which is illustrated with a flight control example.     

A unified framework for the numerical solution of optimal control problems using pseudospectral methods

A unified framework is presented for the numerical solution of optimal control problems using collocation at Legendre-Gauss (LG), Legendre-Gauss-Radau (LGR), and Legendre-Gauss-Lobatto (LGL) points. It is shown that the LG and LGR differentiation matrices are rectangular and full rank whereas the LGL differentiation matrix is square and singular. Consequently, the LG and LGR schemes can be expressed equivalently in either differential or integral form, while the LGL differential and integral forms are not equivalent. Transformations are developed that relate the Lagrange multipliers of the discrete nonlinear programming problem to the costates of the continuous optimal control problem. The LG and LGR discrete costate systems are full rank while the LGL discrete costate system is rank-deficient. The LGL costate approximation is found to have an error that oscillates about the true solution and this error is shown by example to be due to the null space in the LGL discrete costate system. An example is considered to assess the accuracy and features of each collocation scheme.     

An integrated state space partition and optimal control method of multi-model for nonlinear systems based on hybrid systems

Multilinear model approach turns out to be an ideal candidate for dealing with nonlinear systems control problem. However, how to identify the optimal active state subspace of each linear subsystem is an open problem due to that the closed-loop performance of nonlinear systems interacts with these subspaces ranges. In this paper, a new systematic method of integrated state space partition and optimal control of multi-model for nonlinear systems based on hybrid systems is initially proposed, which can deal with the state space partition and associated optimal control simultaneously and guarantee an overall performance of nonlinear systems consequently. The proposed method is based on the framework of hybrid systems which synthesizes the multilinear model, produced by nonlinear systems, in a unified criterion and poses a two-level structure. At the upper level, the active state subspace of each linear subsystem is determined under the optimal control index of a hybrid system over infinite horizon, which is executed off-line. At the low level, the optimal control is implemented online via solving the optimal control of hybrid system over finite horizon. The finite horizon optimal control problem is numerically computed by simultaneous method for speeding up computation. Meanwhile, the model mismatch produced by simultaneous method is avoided by using the strategy of receding-horizon. Simulations on CSTR (Continuous Stirred Tank Reactor) confirm that a superior performance can be obtained by using the presented method.     

Successive Chebyshev pseudospectral convex optimization method for nonlinear optimal control problems

This article aims at proposing a successive Chebyshev pseudospectral convex optimization method for solving general nonlinear optimal control problems (OCPs). First, Chebyshev pseudospectral discrete scheme is used to discretize a general nonlinear OCP. At the same time, a convex subproblem is formulated by using the first-order Taylor expansion to convexify the discretized nonlinear dynamic constraints. Second, a trust-region penalty term is added to the performance index of the subproblem, and a successive convex optimization algorithm is proposed to solve the subproblem iteratively. Noted that the trust-region penalty parameters can be adjusted according to the linearization error in iterative process, which improves convergence rate. Third, the Karush–Kuhn–Tucker conditions of the subproblem are derived, and furthermore, a proof is given to show that the algorithm will iteratively converge to the subproblem. Additionally, the global convergence of the algorithm is analyzed and proved, which is based on three key lemmas. Finally, the orbit transfer problem of spacecraft is used to test the performance of the proposed method. The simulation results demonstrate the optimal control is bang-bang form, which is consistent with the result of theoretical proof. Also, the algorithm is of efficiency, fast convergence rate, and high accuracy. Therefore, the proposed method provides a new approach for solving nonlinear OCPs online and has great potential in engineering practice.     

Solution for state constrained optimal control problems applied to power split control for hybrid vehicles

This paper presents a numerical solution for scalar state constrained optimal control problems. The algorithm rewrites the constrained optimal control problem as a sequence of unconstrained optimal control problems which can be solved recursively as a two point boundary value problem. The solution is obtained without quantization of the state and control space. The approach is applied to the power split control for hybrid vehicles for a predefined power and velocity trajectory and is compared with a Dynamic Programming solution. The computational time is at least one order of magnitude less than that for the Dynamic Programming algorithm for a superior accuracy.     

Stochastic optimal control of networked control systems with control packet dropouts

This paper considers the stochastic optimal control problem for networked control systems(NCSs)with control packet dropouts.The proportional plus up to the third-order derivative(PD3)compensation strategy is adopted to compensate for control packet dropouts at the actuator by using the past control packets stored in the buffer.Based on the strategy,a new NCS structure model with packet dropouts is provided,where the packet dropout is assumed to obey the Bernoulli random binary distribution.In terms of the given model,the stochastic optimal control law is proposed. Numerical examples illustrate the effectiveness of the results.     

Dynamic programming and viscosity solutions for the optimal control of quantum spin systems

The purpose of this paper is to describe the application of the notion of viscosity solutions to solve the Hamilton-Jacobi-Bellman (HJB) equation associated with an important class of optimal control problems for quantum spin systems. The HJB equation that arises in the control problems of interest is a first-order nonlinear partial differential equation defined on a Lie group. Hence we employ recent extensions of the theory of viscosity solutions to Riemannian manifolds in order to interpret possibly non-differentiable solutions to this equation. Results from differential topology on the triangulation of manifolds are then used develop a finite difference approximation method for numerically computing the solution to such problems. The convergence of these approximations is proven using viscosity solution methods. In order to illustrate the techniques developed, these methods are applied to an example problem.     

Annihilator structure of a principal ideal : Relation to optimal compensators

Given a linear, time-invariant, discrete-time plant, we consider the optimal control problem of minimizing, by choice of a stabilizing compensator, the seminorm of a selected closed-loop map in a basic feedback system. The seminorm can be selected to reflect any chosen performance feature and must satisfy only a mild condition concerning finite impulse responses. We show that if the plant has no poles or zeros on the unit circle, then the calculation of the minimum achievable seminorm is equivalent to the maximization of a linear objective over a convex set in a low-dimensional Euclidean space. Hence, for a wide variety of optimal control problems, one can compute the answer to an infinite-dimensional optimization by a finite-dimensional procedure. This allows the use of effective numerical methods for computation.     

The time-invariant linear-quadratic optimal control problem

This paper provides a review of one of the basic problems of systems theory—the general time-invariant optimal control problem involving linear systems and quadratic costs. The problem includes on one hand the regulator problem of optimal control and on the other, the theory of linear dissipative systems, itself central to network theory and to the stability theory of feedback systems. The theory is developed using simple properties of dynamical systems and involves a minimum of ‘hard’ analysis or algebra. It includes a full existence theory of the matrix quadratic equation, of interest in its own right.