一种基于可传递置信模型的分布智能体决策融合方法*

在分析与研究对抗性多机器人系统决策问题的基础上,提出了一种基于可传递置信模型的多智能体决策融合方法;构建了决策融合体系架构,分别设计了基于证据推理的观测智能体模型,基于TBM的决策智能体模型以及决策融合中心模型,给出了相应的算法。通过在机器人足球中的应用及仿真实验,体现了本方法在对抗性多机器人系统中决策制定的良好性能及效果。     

RoboCup中阵型策略的实现

机器人足球仿真比赛是检验各种多智能体系统理论的标准平台,在这个极为复杂的多智能体环境中,多个智能体需要通过协作完成共同目标,而协作可通过共享阵型获得.阵型是多智能体协作行为所要求的,它使多个智能体以有序、智能的方式进行协作.为适应RoboCup实时动态环境下多智能体间的协作需求,文中以阵型为研究对象,提出基于不同阵型转换和基于单一阵型调整的阵型策略并将其应用到机器人足球仿真比赛中,仿真结果表明结合应用这两种阵型策略提高了仿真球队的协作攻防效果.     

混合分布式任务分配机制在足球机器人系统中的应用研究

在分析各种多智能体任务分配机制的优缺点的基础上,结合基于市场法的任务分配机制和基于规则的任务分配机制,提出了一种混合分布式的多机器人任务分配机制用于足球机器人系统的角色分配。该角色分配算法在动态地分配角色的同时能够有效地避免角色的非期望震荡。仿真和实际比赛均验证了该算法的有效性。     

BP神经网络在机器人足球比赛系统中的应用

足球机器人的决策系统是一个多智能体协调控制系统,控制机器人运动需对机器人未来的方位进行实时预测。为了解决RoboCup小型组比赛系统的延迟和准确定位问题,将BP神经网络应用于决策系统的局势预测中。建立了基于BP神经网络的线性预测模型,确定了神经网络的拓扑结构,并将训练好的网络应用于现有比赛系统,预测机器人的就位效率、协调及配合能力,进行仿真实验。实验证明,方法对机器人的位置、方向等预测比较准确,证明了预测算法的可行性和优越性。     

多智能体强化学习及其在足球机器人角色分配中的应用

足球机器人系统是一个典型的多智能体系统, 每个机器人球员选择动作不仅与自身的状态有关, 还要受到其他球员的影响, 因此通过强化学习来实现足球机器人决策策略需要采用组合状态和组合动作. 本文研究了基于智能体动作预测的多智能体强化学习算法, 使用朴素贝叶斯分类器来预测其他智能体的动作. 并引入策略共享机制来交换多智能体所学习的策略, 以提高多智能体强化学习的速度. 最后, 研究了所提出的方法在足球机器人动态角色分配中的应用, 实现了多机器人的分工和协作.     

基于需求的多机器人决策算法

提出一种基于需求函数的多机器人协作控制算法,在以机器人足球仿真比赛环境作 为平台所做的实验中有效地完成了协作任务,是一种十分有效的多机器人决策方法．     

基于人工生命行为选择的智能体决策的研究

人工生命行为选择是人工生命研究领域的重要问题之一,智能体作为人工生命体的一种形式,决策系统相当于是智能体的“大脑”。文章以足球机器人作为智能体的研究原型,分析了机器人足球决策系统的现状,根据仿人智能控制思想和人工生命行为选择模型,建立了基于人工生命的智能体决策系统,并借助机器人足球比赛这样一个标准任务平台,投入实际比赛中,证明结果是可行的和有效的。     

RoboCup机器人足球仿真比赛的关键技术

多智能体系统是分布式人工智能的一个主要领域。机器人足球仿真比赛是MAS的理想测试平台。该文总结了几个机器人足球仿真队的主要技术特点和对它们进行的研究，并提出了今后的研究方向，以促进机器人足球仿真技术的推广。     

基于换位思考模型的多智能体协作研究及在RoboCup中的应用

机器人世界杯(RoboCup)是一个典型的多智能体系统.为了提高多智能体协作的效率,提出一种新的基于换位思考模型的多智能体协作研究方法.首先,教练智能体获取仿真比赛环境中球员智能体的无噪音信息,对所有队友智能体建模;然后,应用高斯分布计算队友智能体的当前行为模式,并把当前模式反馈给仿真环境;最后,球员智能体根据换位思考模型计算得到的模式做出相应决策.该模型已经应用于HfutEngine2D仿真球队中,在RoboCup仿真比赛中获得2007年中国公开赛亚军,2008年机器人世界杯第7的好成绩.     

集控式足球机器人系统关键技术研究

足球机器人比赛是机器人研究的一个新热点,它为人工智能理论和算法的研究提供了一个实验平台,其研究的领域涵盖了人工智能、自动控制、机器人视觉、无线通信、机器学习和多智能体合作与协调等。集控式足球机器人系统通常可以划分为4个子系统,即视觉、决策、通信和车型机器人。结合研究经验,介绍了集控式足球机器人各个子系统的关键技术。     

Balanced reactive-deliberative architecture for multi-agent system for simulation league of RoboCup

This paper presents an architecture for a multi-agent system for the RoboCup simulation league. It consists of a dynamic dual behavior-based architecture for an intelligent agent, a behavior-based decision algorithm, and a dynamic role-based multi-agent cooperation model. A new concept called confidence function is introduced to balance reactivity and deliberation. This architecture was implemented in a team, and match results demonstrate its validity.     

Experiences Acquired in the Design of RoboCup Teams: A Comparison of Two Fielded Teams

Increasingly, multi-agent systems are being designed for a variety of complex, dynamic domains. Effective agent interactions in such domains raise some of the most fundamental research challenges for agent-based systems, in teamwork, multi-agent learning and agent modelling. The RoboCup research initiative, particularly the simulation league, has been proposed to pursue such multi-agent research challenges, using the common testbed of simulation soccer. Despite the significant popularity of RoboCup within the research community, general lessons have not often been extracted from participation in RoboCup. This is what we attempt to do here. We have fielded two teams, ISIS97 and ISIS98, in RoboCup competitions. These teams have been in the top four teams in these competitions. We compare the teams, and attempt to analyze and generalize the lessons learned. This analysis reveals several surprises, pointing out lessons for teamwork and for multi-agent learning.     

RoboCup仿真比赛中的Multi-Agent层次协作模型

本文针对RoboCup仿真比赛的多智能体协作问题，分析了目前在RoboCup中的几个典型多智能体协作模型，提出一种三层的Multi—Agent层次协作模型，它包括全局层、局部层和个体层。实战证明该模型是合理的、有效的。     

一种基于行为的双层动态智能体结构及其在RoboCup中的应用

该文针对目前智能体结构模型的问题,提出了一种基于行为的双层动态智能体结构模型,它是一种混合结构模型,包括有反应式结构和慎思结构,并采用自信度来连接这两种结构,既可以提高在实时动态环境下智能体反应的敏捷性,也使自主机器人能够在动态环境下识别任务。这种混合结构模式已成功地应用于RoboCup仿真机器人足球赛中,并取得了比较好的成绩。     

Building agent teams using an explicit teamwork model and learning

Multi-agent collaboration or teamwork and learning are two critical research challenges in a large number of multi-agent applications. These research challenges are highlighted in RoboCup, an international project focused on robotic and synthetic soccer as a common testbed for research in multi-agent systems. This article describes our approach to address these challenges, based on a team of soccer-playing agents built for the simulation league of RoboCup—the most popular of the RoboCup leagues so far.To address the challenge of teamwork, we investigate a novel approach based on the (re)use of a domain-independent, explicit model of teamwork, an explicitly represented hierarchy of team plans and goals, and a team organization hierarchy based on roles and role-relationships. This general approach to teamwork, shown to be applicable in other domains beyond RoboCup, both reduces development time and improves teamwork flexibility. We also demonstrate the application of off-line and on-line learning to improve and specialize agents' individual skills in RoboCup. These capabilities enabled our soccer-playing team, ISIS, to successfully participate in the first international RoboCup soccer tournament (RoboCup'97) held in Nagoya, Japan, in August 1997. ISIS won the third-place prize in over 30 teams that participated in the simulation league.     

Q学习在RoboCup前场进攻动作决策中的应用

RoboCup是世界上规模最大的机器人足球大赛,包括软件仿真与硬件实体两类项目的比赛。RoboCup仿真2D作为软件仿真项目的重要组成部分,成为研究人工智能和多Agent智能体协作的优秀实验平台。将Q学习应用到RoboCup仿真2D比赛的前场进攻动作决策中,通过引入区域划分,基于区域划分的奖惩函数和对真人足球赛中动作决策的模拟,在经过大量周期的学习训练后,使Agent能够进行自主动作决策,从而加强了多Agent的前场进攻实力。     

机器学习在RoboCup中的应用研究

RoboCup is a particularly good domain for studying multi-agent systems.A wide variety of MAS issues can be studied in robotic soccer,in which the theory,algorithm and architecture of agent system can be evaluated.Because of the inherent complexity of MAS,there are many interests in using machine learning techniques to handle it.This paper investigates and discusses the machine-learning techniques used in RoboCup.The background is firstly presented and the application of machine learning in RoboCup is lately demonstrated with some top simulation teams.The machine-learning system in NDSocTeam is also introduced.Finally some open issues in this field are pointed out.     

Cooperative behavior based on a subjective map with shared information in a dynamic environment

This paper proposes a subjective map representation that enables a robot in a multi-agent system to make decisions in a dynamic, hostile environment. A typical situation can be found in the Sony four-legged robot league of the RoboCup competition. The subjective map is a map of the environment that each agent maintains regardless of the objective consistency of the representation among the agents. Due to the map's subjectivity, it is not affected by incorrect information acquired by other agents. The method is compared with conventional methods with or without information sharing.     

一种基于对手行为预测的多智能体合作研究

在动态对抗性环境下竞争的多智能体系统里,能够对对手行为进行及时而准确的预测,从而采取相应对策,是战胜对手的必要条件。本文提出了一种预测对手行为的新方法,并在此基础上实现了多智能体的合作。最后以RoboCup仿真比赛作为实验平台证明了该方法的可行性和有效性。     

Working with robots in disasters

The Robot World Cup Initiative (RoboCup) is an international research and education initiative. It was started in order to foster artificial intelligence search. RoboCupRescue's domain is search and rescue operations in urban disasters. The RoboCup Rescue league consists of two projects: the simulation project and the robotics and infrastructure project. A multi-agent-based approach to disaster simulation provides many research themes and supports rescue operations in real situations. Simulation Project, not only agent implementation, but also the evaluation of the social agents' performance, the architecture of the distribution system, and the quality of communications, etc. The following features are important in this project to promote the research and provide verification methods.