Nash-optimization enhanced distributed model predictive control applied to the Shell benchmark problem

This paper presents an efficient distributed model predictive control scheme based on Nash optimality, in which the on-line optimization of the whole system is decomposed into that of several small co-operative agents in distributed structures, thus it can significantly reduce computational complexity in model predictive control of large-scale systems. The relevant nominal stability and the performance on single-step horizon under the communication failure are investigated. The Shell heavy oil fractionator benchmark control problem is illustrated to verify the effectiveness of the proposed control algorithm.     

Hybrid autonomous control for multi mobile robots

Reinforcement learning can be an adaptive and flexible control method for autonomous system. It does not need a priori knowledge; behaviors to accomplish given tasks are obtained automatically by repeating trial and error. However, with increasing complexity of the system, the learning costs are increased exponentially. Thus, application to complex systems, like a many redundant d.o.f. robot and multi-agent system, is very difficult. In the previous works in this field, applications were restricted to simple robots and small multi-agent systems, and because of restricted functions of the simple systems that have less redundancy, effectiveness of reinforcement learning is restricted. In our previous works, we had taken these problems into consideration and had proposed new reinforcement learning algorithm, 'Q-learning with dynamic structuring of exploration space based on GA (QDSEGA)'. Effectiveness of QDSEGA for redundant robots has been demonstrated using a 12-legged robot and a 50-link manipulator. However, previous works on QDSEGA were restricted to redundant robots and it was impossible to apply it to multi mobile robots. In this paper, we extend our previous work on QDSEGA by combining a rule-based distributed control and propose a hybrid autonomous control method for multi mobile robots. To demonstrate the effectiveness of the proposed method, simulations of a transportation task by 10 mobile robots are carried out. As a result, effective behaviors have been obtained.     

Model predictive control for trajectory-tracking and formation of wheeled mobile robots

Neural Computing and Applications - Model predictive control (MPC) naturally guarantees optimal transient process and constraints satisfaction. Most mature MPC theories concern with linear...     

Lyapunov-based model predictive control for tracking of nonholonomic mobile robots under input constraints

This paper studies the tracking problem of nonholonomic wheeled robots subject to control input constraints. In order to take optimality considerations into account while designing saturated tracking controllers, a Lyapunov-based predictive tracking controller is developed, in which the contractive constraint is characterized by a backup global saturated tracking controller. Theoretical results on ensuring global feasibility and closed-loop stability of the controller are provided. In addition, the proposed methodology admits suboptimal solutions. Finally, numerical simulations are performed to verify the effectiveness of the proposed control strategy.

     

Tracking-error model-based predictive control for mobile robots in real time

In this paper, a model-predictive trajectory-tracking control applied to a mobile robot is presented. Linearized tracking-error dynamics is used to predict future system behavior and a control law is derived from a quadratic cost function penalizing the system tracking error and the control effort. Experimental results on a real mobile robot are presented and a comparison of the control obtained with that of a time-varying state-feedback controller is given. The proposed controller includes velocity and acceleration constraints to prevent the mobile robot from slipping and a Smith predictor is used to compensate for the vision-system dead-time. Some ideas for future work are also discussed.     

Robust tube-based predictive control for mobile robots in off-road conditions

This paper focuses on the design of a tube-based Model Predictive Control law for the control of constrained mobile robots in off-road conditions with longitudinal slip while ensuring robustness and stability. A time-varying trajectory tracking error model is used, where uncertainties are assumed to be bounded and additive. The robust tube-based MPC is compared with other motion control techniques through simulation and physical experiments. These tests show the satisfactory behavior of the presented control strategy.     

Line and circle formation of distributed physical mobile robots

The formation problem of distributed mobile robots was studied in the literature for idealized robots. Idealized robots are able to instantaneously move in any directions, and are equipped with perfect range sensors. In this study, we address the formation problem of distributed mobile robots that are subject to physical constraints. Mobile robots considered in this study have physical dimensions and their motions are governed by physical laws. They are equipped with sonar and infrared range sensors. The formation of lines and circles is investigated in detail. It is demonstrated that line and circle algorithms developed for idealized robots do not work well for physical robots. New line and circle algorithms, with consideration of physical robots and sensors, are presented and validated through extensive simulations. © 1997 John Wiley & Sons, Inc.     

Nonlinear formation control of unicycle-type mobile robots

We investigate formation control of a group of unicycle-type mobile robots at the dynamics level with a little amount of inter-robot communication. A combination of the virtual structure and path-tracking approaches is used to derive the formation architecture. Each individual robot has only position and orientation available for feedback. For each robot, a coordinate transformation is first derived to cancel the velocity quadratic terms. An observer is then designed to globally exponentially/asymptotically estimate the unmeasured velocities. An output feedback controller is designed for each robot. The controller is designed in such a way that the path derivative is left as a free input to synchronize the robots’ motion. Simulations illustrate the soundness of the proposed controller.     

Teleoperation of a platoon of distributed wheeled mobile robots with predictive display

We propose a novel teleoperation framework for multiple distributed non-holonomic mobile robots (WMR), each equipped with onboard sensing and computing using peer-to-peer communication. One of the WMRs is designated as the leader with the first-person view camera and SLAM, while the other WMRs maintain a certain desired formation relative to their respective fore-running WMR in a distributed manner. For this, we first utilize nonholonomic passive decomposition to split the platoon kinematics into that of the formation-keeping aspect and the collective tele-driving aspect. We then design the controls for these two aspects individually and distribute them into each WMR while incorporating their nonholonomic constraint and distribution requirement. We also propose a novel predictive display, which, by providing the user with the estimated current and predicted future pose of the platoon and future possibility of collision while incorporating the uncertainty inherent to the distribution, can significantly enhance the tele-driving performance. Experiments and user study are also performed.     

VCS-based motion planning for distributed mobile robots: collision avoidance and formation

This paper addresses decentralized motion planning among a homogeneous set of feedback-controlled mobile robots. It introduces the velocity obstacle, which describes the collision between robot and obstacle, and the hybrid interactive velocity obstacles are designed for collision checking between interacting robots. The (sub)goal selection algorithm is also studied for formation control, then the preferred velocity is designed for robot tracking its desired (sub)goal. Furthermore, the rules for the size regulation of obstacle are presented to avoid conservative motion planning and enhance the safety. Then, we establish a novel Velocity Change Space (VCS), map the velocity obstacles, the desired (sub)goal and the reachable velocity change window before collision in this space, and directly get the new velocity by a multi-objective optimization method. We apply VCS-based motion planning methods to distributed robots, and simulation is used to illustrate the good performances with respect to the un-conservative, foresighted and multi-objective optimal motion planning, especially the successful application in the formation control of the multi-robot system.     

The leader-follower formation control of nonholonomic mobile robots

In this paper, the leader-waypoint-follower formation is constructed based on relative motion states of nonholonomic mobile robots. Since the robots’ velocities are constrained, we proposed a geometrical waypoint in cone method so that the follower robots move to their desired waypoints effectively. In order to form and maintain the formation of multi-robots, we combine stable tracking control method with receding horizon (RH) tracking control method. The stable tracking control method aims to make the robot’s state errors stable and the RH tracking control method guarantees that the convergence of the state errors tends toward zero efficiently. Based on the methods mentioned above, the mobile robots formation can be maintained in any trajectory such as a straight line, a circle or a sinusoid. The simulation results based on the proposed approaches show each follower robot can move to its waypoint efficiently. To validate the proposed methods, we do the experiments with nonholonomic robots using only limited on-board sensor information.     

Autonomous mobile robot model predictive control

This paper presents model predictive control of an autonomous vehicle. Simulation and experimental results have been shown and compared with input–output linearization method. The results obtained show that the MPC is an efficient method that allows for accurate control and navigation of an autonomous vehicle. Model based predictive control is tested in simulations for motion on an inclined plane. This is done to prepare future work regarding the avoidance of the violation of the smoothness condition for exact linearization, while at the same time by modifying the input commands the geometric path planning results are conserved. The approach is presented for the wheel-ground slippage and tip-over avoidance of the three-wheeled vehicle for inclined plane motion. A complete three-dimensional dynamic model using Newtonian dynamics is also presented. Simulation results using a three-wheeled vehicle built in our laboratory illustrate the performance of the proposed controller.     

Adaptive actor-critic learning for the control of mobile robots by applying predictive models

In this paper, we propose two methods of adaptive actor-critic architectures to solve control problems of nonlinear systems. One method uses two actual states at time k and time k+1 to update the learning algorithm. The basic idea of this method is that the agent can directly take some knowledge from the environment to improve its knowledge. The other method only uses the state at time k to update the algorithm. This method is called, learning from prediction (or simulated experience). Both methods include one or two predictive models, which are assumed to be applied to construct predictive states and a model-based actor (MBA). Here, the MBA as an actor can be viewed as a network where the connection weights are the elements of the feedback gain matrix. In the critic part, two value-functions are realized as a pure static mapping, which can be reduced to a nonlinear current estimator by using the radial basis function neural networks (RBFNNs). Simulation results obtained for a dynamical model of nonholonomic mobile robots with two independent driving wheels are presented. They show the effectiveness of the proposed approaches for the trajectory tracking control problem.     

A robust distributed model predictive control algorithm

Although distributed model predictive control (DMPC) has received significant attention in the literature, the robustness of DMPC with respect to model errors has not been explicitly addressed. In this paper, a novel online algorithm that deals explicitly with model errors for DMPC is proposed. The algorithm requires decomposing the entire system into N subsystems and solving N convex optimization problems to minimize an upper bound on a robust performance objective by using a time-varying state-feedback controller for each subsystem. Simulations examples were considered to illustrate the application of the proposed method.     

Application of distributed predictive control to motion and coordination problems for unicycle autonomous robots

This paper presents a Distributed Predictive Control (DPC) approach for the solution of a number of motion and coordination problems for autonomous robots. The proposed scheme is characterized by a multilayer structure: at the higher layer the reference trajectories of the robots are computed as the solution of suitable optimization problems. It is shown that, at this level, the definition of the cost function to be minimized allows to consider many different problems, such as formation control, coverage and optimal sensing, containment control, inter-robot and obstacle collision avoidance, and patrolling in an unknown environment. At the lower layers of the control structure, proper state and control reference trajectories are defined and a robust Model Predictive Control (MPC) problem is solved by each robot. To reduce the computational burden required by the algorithm, collision and obstacle avoidance constraints are reformulated in linear terms, so that the optimization problem to be solved on-line is a Quadratic Programming (QP) one. A number of experimental and simulation results are reported to witness the flexibility and performances of the method.     

A distributed model predictive control (MPC) fault reconfiguration strategy for formation flying satellites

In this paper, an active distributed (also referred to as semi-decentralised) fault recovery control scheme is proposed that employs inaccurate and unreliable fault information into a model-predictive-control-based design. The objective is to compensate for the identified actuator faults that are subject to uncertainties and detection time delays, in the attitude control subsystems of formation flying satellites. The proposed distributed fault recovery scheme is developed through a two-level hierarchical framework. In the first level, or the agent level, the fault is recovered locally to maintain as much as possible the design specifications, feasibility, and tracking performance of all the agents. In the second level, or the formation level, the recovery is carried out by enhancing the entire team performance. The fault recovery performance of our proposed distributed (semi-decentralised) scheme is compared with two other alternative schemes, namely the centralised and the decentralised fault recovery schemes. It is shown that the distributed (semi-decentralised) fault recovery scheme satisfies the recovery design specifications and also imposes lower fault compensation control effort cost and communication bandwidth requirements as compared to the centralised scheme. Our proposed distributed (semi-decentralised) scheme also outperforms the achievable performance capabilities of the decentralised scheme. Simulation results corresponding to a network of four precision formation flight satellites are also provided to demonstrate and illustrate the advantages of our proposed distributed (semi-decentralised) fault recovery strategy.     

Handling communication disruptions in distributed model predictive control

In this work, we study distributed model predictive control (DMPC) of nonlinear systems subject to communication disruptions - communication channel noise and data losses - between distributed controllers. Specifically, we focus on a DMPC architecture in which one of the distributed controllers is responsible for ensuring closed-loop stability while the rest of the distributed controllers communicate and cooperate with the stabilizing controller to further improve the closed-loop performance. To handle communication disruptions, feasibility problems are incorporated in the DMPC architecture to determine if the data transmitted through the communication channel is reliable or not. Based on the results of the feasibility problems, the transmitted information is accepted or rejected by the stabilizing MPC. In order to ensure the stability of the closed-loop system under communication disruptions, each model predictive controller utilizes a stability constraint which is based on a suitable Lyapunov-based controller. The theoretical results are demonstrated through a nonlinear chemical process example.