Iterative performance improvement of fuzzy control systems for three tank systems

This paper suggests the performance improvement of fuzzy control systems (FCSs) for three tank systems using iterative feedback tuning (IFT). The stable design of Takagi–Sugeno–Kang fuzzy controllers is guaranteed by means of a stability theorem based on LaSalle’s global invariant set theorem formulated for a class of multi input-multi output (MIMO) nonlinear processes. An IFT algorithm characterized by setting the step size to guarantee the FCS stability is proposed. The theoretical approaches are applied in a case study that deals with the IFT-based stable design of fuzzy controllers dedicated to the level control of a cylindrical three tank system as a representative MIMO system. A set of experimental results for a laboratory setup illustrates the performance improvement.     

Model-Free control performance improvement using virtual reference feedback tuning and reinforcement Q-learning

This paper proposes the combination of two model-free controller tuning techniques, namely linear virtual reference feedback tuning (VRFT) and nonlinear state-feedback Q-learning, referred to as a new mixed VRFT-Q learning approach. VRFT is first used to find stabilising feedback controller using input-output experimental data from the process in a model reference tracking setting. Reinforcement Q-learning is next applied in the same setting using input-state experimental data collected under perturbed VRFT to ensure good exploration. The Q-learning controller learned with a batch fitted Q iteration algorithm uses two neural networks, one for the Q-function estimator and one for the controller, respectively. The VRFT-Q learning approach is validated on position control of a two-degrees-of-motion open-loop stable multi input-multi output (MIMO) aerodynamic system (AS). Extensive simulations for the two independent control channels of the MIMO AS show that the Q-learning controllers clearly improve performance over the VRFT controllers.     

Model-free constrained data-driven iterative reference input tuning algorithm with experimental validation

This paper presents the design and experimental validation of a new model-free data-driven iterative reference input tuning (IRIT) algorithm that solves a reference trajectory tracking problem as an optimization problem with control signal saturation constraints and control signal rate constraints. The IRIT algorithm design employs an experiment-based stochastic search algorithm to use the advantages of iterative learning control. The experimental results validate the IRIT algorithm applied to a non-linear aerodynamic position control system. The results prove that the IRIT algorithm offers the significant control system performance improvement by few iterations and experiments conducted on the real-world process and model-free parameter tuning.     

Stable and convergent iterative feedback tuning of fuzzy controllers for discrete-time SISO systems

This paper proposes new stability analysis and convergence results applied to the Iterative Feedback Tuning (IFT) of a class of Takagi–Sugeno–Kang proportional-integral-fuzzy controllers (PI-FCs). The stability analysis is based on a convenient original formulation of Lyapunov’s direct method for discrete-time systems dedicated to discrete-time input affine Single Input-Single Output (SISO) systems. An IFT algorithm which sets the step size to guarantee the convergence is suggested. An inequality-type convergence condition is derived from Popov’s hyperstability theory considering the parameter update law as a nonlinear dynamical feedback system in the parameter space and iteration domain. The IFT-based design of a low-cost PI-FC is applied to a case study which deals with the angular position control of a direct current servo system laboratory equipment viewed as a particular case of input affine SISO system. A comparison of the performance of the IFT-based tuned PI-FC and the performance of the PI-FC tuned by an evolutionary-based optimization algorithm shows the performance improvement and advantages of our IFT approach to fuzzy control. Real-time experimental results are included.