Rapid Concept Learning for Mobile Robots

Concept learning in robotics is an extremely challenging problem: sensory data is often high-dimensional, and noisy due to specularities and other irregularities. In this paper, we investigate two general strategies to speed up learning, based on spatial decomposition of the sensory representation, and simultaneous learning of multiple classes using a shared structure. We study two concept learning scenarios: a hallway navigation problem, where the robot has to induce features such as opening or wall. The second task is recycling, where the robot has to learn to recognize objects, such as a trash can. We use a common underlying function approximator in both studies in the form of a feedforward neural network, with several hundred input units and multiple output units. Despite the high degree of freedom afforded by such an approximator, we show the two strategies provide sufficient bias to achieve rapid learning. We provide detailed experimental studies on an actual mobile robot called PAVLOV to illustrate the effectiveness of this approach.     

再励学习及其在移动机器人行为规划中的应用

再励学习（Reinforcement Learning,RL）是一种成功地结合动态编程和控制问题的机器智能方法,它将动态编程和有监督学习方法结合到机器学习系统中,通常用于解决预测和控制两类问题。提出了以矢量形式表示的评估函数,为了实现多维再励学习,用一专门的神经网络（Q网络）实现评判网络,研究其在移动机器人行为规划中的应用。     

Connectionist Learning in Behaviour-Based Mobile Robots: A Survey

This paper is a survey of some recentconnectionist approaches to the design and developmentof behaviour-based mobile robots. The research isanalysed in terms of principal connectionist learningmethods and neurological modeling trends. Possibleadvantages over conventionally programmed methods areconsidered and the connectionist achievements to dateare assessed. A realistic view is taken of theprospects for medium term progress and someobservations are made concerning the direction thismight profitably take.     

基于强化学习和模糊逻辑的移动机器人导航

自主导航是移动机器人的一项关键技术。该文采用强化学习结合模糊逻辑的方法实现了未知环境下自主式移动机机器人的导航控制。文中首先介绍了强化学习原理,然后设计了一种未知环境下机器人导航框架。该框架由避碰模块、寻找目标模块和行为选择模块组成。针对该框架,提出了一种基于强化学习和模糊逻辑的学习、规划算法：在对避碰和寻找目标行为进行独立学习后,利用超声波传感器得到的环境信息进行行为选择,使机器人在成功避碰的同时到达目标点。最后通过大量的仿真实验,证明了算法的有效性。     

A Multiple Models Approach for Adaptation and Learning in Mobile Robots Control

The paper proposes a multiple models based control methodology for the solution of the tracking problem for mobile robots. The proposed method utilizes multiple models of the robot for its identification in an adaptive and learning control framework. Radial Basis Function Networks (RBFNs) are considered for the multiple models in order to exploit the non-linear approximation capabilities of the nets for modeling the kinematic behaviour of the vehicle and for reducing unmodelled tracking errors contributions. The training of the nets and the control performance analysis have been done in a real experimental setup. The experimental results are satisfactory in terms of tracking errors and computational efforts and show the improvement in the tracking performance when the proposed methodology is used for tracking tasks in dynamical uncertain environments.     

Synthesis of Neural Networks and PID Control for Performance Improvement of Industrial Robots

In this article, an approach for improving the performance of industrialrobots using multilayer feedforward neural networks is presented. Thecontroller based on this approach consists of two main components: a PIDcontrol and a neural network. The function of the neural network is tocomplement the PID control for the specific purpose of improving theperformance of the system over time. Analytical and experimental resultsconcerning this synthesis of neural networks and PID control are presented.The analytical results assert that the performance of PID-controlledindustrial robots can be improved through proper utilization of the learningand generalization ability of neural networks. The experimental results,obtained through actual implementation using a commercial industrial robot,demonstrate the effectiveness of such control synthesis for practicalapplications. The results of this work suggest that neural networks could beadded to existing PID-controlled industrial robots for performanceimprovement.     

Learning from History for Behavior-Based Mobile Robots in Non-Stationary Conditions

Learning in the mobile robot domain is a very challenging task, especially in nonstationary conditions. The behavior-based approach has proven to be useful in making mobile robots work in real-world situations. Since the behaviors are responsible for managing the interactions between the robots and its environment, observing their use can be exploited to model these interactions. In our approach, the robot is initially given a set of behavior-producing modules to choose from, and the algorithm provides a memory-based approach to dynamically adapt the selection of these behaviors according to the history of their use. The approach is validated using a vision- and sonar-based Pioneer I robot in nonstationary conditions, in the context of a multirobot foraging task. Results show the effectiveness of the approach in taking advantage of any regularities experienced in the world, leading to fast and adaptable specialization for the learning robot.     

Learning from History for Behavior-Based Mobile Robots in Non-Stationary Conditions

Learning in the mobile robot domain is a very challenging task, especially in non-stationary conditions. The behavior-based approach has proven to be useful in making mobile robots work in real-world situations. Since the behaviors are responsible for managing the interactions between the robots and its environment, observing their use can be exploited to model these interactions. In our approach, the robot is initially given a set of behavior-producing modules to choose from, and the algorithm provides a memory-based approach to dynamically adapt the selection of these behaviors according to the history of their use. The approach is validated using a vision- and sonar-based Pioneer I robot in non-stationary conditions, in the context of a multi-robot foraging task. Results show the effectiveness of the approach in taking advantage of any regularities experienced in the world, leading to fas t and adaptable specialization for the learning robot.     

Training a Vision Guided Mobile Robot

This paper presents the design, implementation and evaluation of a trainable vision guided mobile robot. The robot, CORGI, has a CCD camera as its only sensor which it is trained to use for a variety of tasks. The techniques used for training and the choice of natural light vision as the primary sensor makes the methodology immediately applicable to tasks such as trash collection or fruit picking. For example, the robot is readily trained to perform a ball finding task which involves avoiding obstacles and aligning with tennis balls. The robot is able to move at speeds up to 0.8 ms^-1 while performing this task, and has never had a collision in the trained environment. It can process video and update the actuators at 11 Hz using a single $20 microprocessor to perform all computation. Further results are shown to evaluate the system for generalization across unseen domains, fault tolerance and dynamic environments.     

Training a Vision Guided Mobile Robot

This paper presents the design, implementation and evaluation of a trainable vision guided mobile robot. The robot, CORGI, has a CCD camera as its only sensor which it is trained to use for a variety of tasks. The techniques used for train ing and the choice of natural light vision as the primary sensor makes the methodology immediately applicable to tasks such as trash collection or fruit picking. For example, the robot is readily trained to perform a ball finding task which involves avoiding obstacles and aligning with tennis balls. The robot is able to move at speeds up to 0.8 ms^-1 while performing this task, and has never had a collision in the trained environment. It can process video and update the actuators at 11 Hz using a single $20 microprocessor to perform all computation. Further results are shown to evaluate the system for generalization across unseen domains, fault tolerance and dynamic environments.     

Global Level Path Planning for Mobile Robots in Dynamic Environments

This paper presents a self-adapting approach to global level path planning in dynamic environments. The aim of this work is to minimize risk and delays in possible applications of mobile robots (e.g., in industrial processes). We introduce a hybrid system that uses case-based reasoning as well as grid-based maps for decision-making. Maps are used to suggest several alternative paths between specific start and goal point. The casebase stores these solutions and remembers their characteristics. Environment representation and casebase design are discussed. To solve the problem of exploration vs. exploitation, a decision-making strategy is proposed that is based on the irreversibility of decisions. Forgetting strategies are discussed and evaluated in the context of case-based maintenance. The adaptability of the system is evaluated in a domain based on real sensor data with simulated occupancy probabilities. Forgetting strategies and decision-making strategies are evaluated in simulated environments. Experiments show that a robot is able to adapt in dynamic environments and can learn to use paths that are less risky to follow.     

Situated Learning of a Behavior-Based Mobile Robot Path Planner

1TaskDecompositionWebuildourpathplannerbaJsedonBrook'ssubsumptionarchitecturel1].InBrook'sapproach,theoveralltaskisdecomposedilltoseveralconcurrelitbehaviors,eachbehaviorhasitsownaPplicabilityconditionsspecifyingwhenitisappropriate,andapriorityorderingispresdefinedtoresolveconflictsamongbehaviors.Inpathplannillg,thetaskoftherobotistoaPproachatargetwhileavoidingobstacles.Wedecomposethetaskintothreebehaviors.TheyaJreAvoid,SteerandAdvance.Fig.1illustratestheoverallstructureofourpathplanner.…     

基于强化学习规则的两轮机器人自平衡控制

两轮机器人是一个典型的不稳定,非线性,强耦合的自平衡系统,在两轮机器人系统模型未知和没有先验经验的条件下,将强化学习算法和模糊神经网络有效结合,保证了函数逼近的快速性和收敛性,成功地实现两轮机器人的自学习平衡控制,并解决了两轮机器人连续状态空间和动作空间的强化学习问题;仿真和实验表明:该方法不仅在很短的时间内成功地完成对两轮机器人的平衡控制,而且在两轮机器人参数变化较大时,仍能维持两轮机器人的平衡。     

Mobile Robot Learning by Self-Observation

The aim of the project described in this paper was to investigate robot learning at a most fundamental level. The project focused on the transition between organisms with innate behaviors and organisms that have the most rudimentary capability of learning through their personal interaction with their environment. It was assumed that the innate behaviors gave basic survival competence but no learning ability. By observing the interaction between their innate behaviors and the organism's environment it was reasoned that the organism should be able to learn how to modify its actions in a way that improves its performance. If a learning system is given more information than it requires then, when it is successful, it is difficult to say which pieces of information contribute to the success. For this reason the information available to the learning system was kept to an absolute minimum. In order to provide a practical test of the learning scheme developed in this project, the robot environment EDEN was constructed. Within EDEN a robot's actions influence its internal energy reserves. The environment incorporates sources of energy, and it also involves situations that use additional energy or reduce energy consumption. A successful learning scheme was developed purely based on the recorded history of the robot's interactions with its environment and the knowledge that the robot's innate behavior was reactive. This learning scheme allowed the robot to improve its energy management by exhibiting classical conditioning and a restricted form of operant conditioning.     

Online Learning and Adaptation of Autonomous Mobile Robots for Sustainable Agriculture

In this paper we will introduce the application of our newly patented double hierarchical Fuzzy-Genetic system (British patent 99-10539.7) to produce an intelligent autonomous outdoor agricultural mobile robot capable of learning and calibrating its controller online in a short time interval and implementing a life long learning strategy. The online and life long learning strategy allow the outdoor robots to increase their experience and adapt their controllers in the face of the changing and dynamic unstructured outdoor agricultural environments. Such characteristics permit prolonged periods of operation within dynamic agricultural environments, which is an essential feature for the realization of a platform vehicle for use in sustainable agriculture and organic farming.     

移动机器人中通信的串口解决方案

对移动机器人的通信需求进行了归纳分类，阐述了串口操作中的几个关键技术，介绍了设计的一个串行通信类，并具体介绍了设计的针对移动机器人、基于无线传输、以消息和文件两种传输格式实现的串口通信协议。     

基于模糊神经网络的机器人滑模自适应控制

滑模控制（SMC）响应快,对系统参数和外部扰动呈不变性,可保证系统的渐近稳定性,但其缺点是控制存在很强的抖动;而模糊神经网络（FNN）具有模糊系统和神经网络共同的特点。将滑模控制和模糊神经网络控制有机结合,利用简单得到的学习信号对模糊神经网络进行在线学习,通过平滑切换函数实现直接自适应控制策略。对两连杆机械手的仿真研究表明,在存在模型误差和外部扰动的情况下,该方案既能达到高精度快速跟踪的目的,又能有效减小滑模控制的抖动问题。     

移动机器人同步定位与地图构建研究进展

同步定位与地图构建（Simultaneous localization and mapping, SLAM）作为能使移动机器人实现全自主导航的工具近来倍受关注.本文对该领域的最新进展进行综述,特别侧重于一些旨在降低计算复杂度的简化算法的分析上,同时对它们进行分类,并指出其优点和不足.本文首先建立了SLAM问题的一般模型,指出了解决SLAM问题的难点;然后详细分析了基于EKF的一些简化算法和基于其他估计思想的方法;最后,对于多机器人SLAM和主动SLAM等前沿课题进行了讨论,并指出了今后的研究方向.