A hierarchical approach on assembly sequence planning and optimal sequences analyzing

Assembly sequence planning (ASP) is a critical technology that bridges product design and realization. Deriving and fulfilling of the assembly precedence relations (APRs) are the essential points in assembly sequences reasoning. In this paper, focusing on APRs reasoning, ASP, and optimizing, a hierarchical ASP approach is proposed and its key technologies are studied systematically. APR inferring and the optimal sequences searching algorithms are designed and realized in an integrated software prototype system. The system can find out the geometric APRs correctly and completely based on the assembly CAD model. Combined with the process APRs, the geometric and engineering feasible assembly sequences can be inferred out automatically. Furthermore, an algorithm is designed by which optimal assembly sequences can be calculated out from the immense geometric and engineering feasible assembly sequences. The case study demonstrates that the approach and its algorithms may provide significant assistance in finding the optimal ASP and improving product assembling.     

Integral reinforcement learning and experience replay for adaptive optimal control of partially-unknown constrained-input continuous-time systems

In this paper, an integral reinforcement learning (IRL) algorithm on an actor–critic structure is developed to learn online the solution to the Hamilton–Jacobi–Bellman equation for partially-unknown constrained-input systems. The technique of experience replay is used to update the critic weights to solve an IRL Bellman equation. This means, unlike existing reinforcement learning algorithms, recorded past experiences are used concurrently with current data for adaptation of the critic weights. It is shown that using this technique, instead of the traditional persistence of excitation condition which is often difficult or impossible to verify online, an easy-to-check condition on the richness of the recorded data is sufficient to guarantee convergence to a near-optimal control law. Stability of the proposed feedback control law is shown and the effectiveness of the proposed method is illustrated with simulation examples.