认知无线Mesh网络中基于协作学习自动机的自适应信道分配算法*

在认知无线Mesh网络多信道环境中处理繁重的数据业务是一项具有挑战性的任务。为了解决这个问题,提出了一种新的基于协作学习自动机(Learning automata,LA)的自适应信道分配算法(CLACAA)。在所提出的算法中,LA被部署在邻近的互相协作的次用户上。首先,为了LA能自适应地更新其动作概率向量,设计了一种线性奖赏无为方案;其次,定义了一种新的信道利用率因子用于信道选择,以解决信道冲突发生的问题;最后,给出了当信道由于大量输入请求而过载时的信道切换方案。实验仿真结果表明,该算法在提升网络吞吐量和数据传输率,降低切换时延和缓冲时延上有明显的优势。     

基于节点生长k-均值聚类算法的强化学习方法

处理连续状态强化学习问题,主要方法有两类:参数化的函数逼近和自适应离散划分.在分析了现有对连续状态空间进行自适应划分方法的优缺点的基础上,提出了一种基于节点生长k均值聚类算法的划分方法,分别给出了在离散动作和连续动作两种情况下该强化学习方法的算法步骤.在离散动作的MountainCar问题和连续动作的双积分问题上进行仿真实验.实验结果表明,该方法能够根据状态在连续空间的分布,自动调整划分的精度,实现对于连续状态空间的自适应划分,并学习到最佳策略.     

学习自动机结合节点功率自适应调整的WSN目标覆盖方案

针对大多数现有无线传感器网络(Wireless Sensor Network, WSN)目标覆盖方案没有考虑传感器功率(传感范围)可调的问题,提出一种基于学习自动机(Learning Automata, LA)和节点功率自适应调整的WSN的目标覆盖方案。利用LA算法根据节点能量自适应调整节点的发射功率,构建能够覆盖所有目标的覆盖集,并通过精简过程获得最小覆盖集,从而减低节点的能耗,提高网络的生命周期。通过实验研究了传感器数量和目标数量对网络寿命的影响,并将该方案与基于贪婪算法、遗传算法的方案进行比较,结果表明,该方案能够获得更多的覆盖集和更长的网络寿命。     

一种连续属性离散化的新方法

提出了一种基于聚类方法、结合粗集理论的连续属性离散化方法。在粗集理论中有一个重要概念：属性重要度（Attribute significance)，它常用来作为生成好的约简所采用的启发式评价函数。受此启发，在连续属性离散化方法中可把它用于属性选择，即从已离散化的属性集中选择出属性重要度最高的属性，再把它和待离散化的连续属性一起进行聚类学习，得到该连续属性的离散区间。文中介绍了该方法的算法描述，并通过实验与其他算法进行了比较。实验结果表明，由于这种方法在离散化过程中结合了粗集理论的思想,考虑了属性间的相互影响，从而产生了比较合理的划分点，提高了规则的分类精度。     

异构传感器网络中基于差分进化的调度算法

为提高异构有向传感器网络的节点调度效率,基于学习自动机提出一种参数自适应的差分进化算法。将节点调度问题转化为集合覆盖问题,利用学习自动机与环境的交互实现差分算法控制参数的自适应选择,同时采用自适应的变异策略增强算法解决集合覆盖问题时的寻优能力。仿真结果表明,相比原始差分进化算法,该算法拓展了参数自适应性,优化能力更强,并且能够延长异构有向传感器网络的生存时间。     

一种模糊强化学习算法及其在RoboCup中的应用

传统的强化学习算法只能解决离散状态空间和动作空间的学习问题。论文提出一种模糊强化学习算法,通过模糊推理系统将连续的状态空间映射到连续的动作空间,然后通过学习得到一个完整的规则库。这个规则库为Agent的行为选择提供了先验知识,通过这个规则库可以实现动态规划。作者在RoboCup环境中验证了这个算法,实现了踢球策略的优化。     

一种基于信息熵离散化算法的研究

该文研究连续属性的离散化问题。首先,详细介绍了基于熵的离散化算法（EBD）,并对其存在的问题进行了分析。随后,给出了用于度量区间密度的定义;接着,在自适应思想的启发下,对EBD算法进行了改进,提出了基于熵的变阀值离散化算法,区间密度的引入使得该算法能够随样本集在区间上密度的变化适当调整熵的阀值。实验结果表明,与EBD算法相比,改进算法不仅保持简单性、一致性和精确性,而且容易操作。     

区间值属性决策树学习算法*

该文提出了一种区间值属性决策树的学习算法.区间值属性的值域不同于离散情况下的无序集和连续情况下的全序集,而是一种半序集.作为ID3算法在区间值意义下的推广,算法通过一种分割信息熵的极小化来选取扩展属性.通过非平稳点分析,减少了分割信息熵的计算次数,使算法的效率得到了提高.     

接口自动机的良构性检测算法及其实现

针对构件式系统中任一构件的非良构性会导致系统不能正常运行的问题,提出一种基于接口自动机（IA）来分析和检测构件良构性（well-formedness）的算法,并据此实现了一个构件良构性检测原型系统。该算法首先构造与接口自动机同构的可达图;其次,基于可达图通过深度优先遍历生成一条覆盖所有迁移的有序集;最后,根据该有序集检测在外界环境满足其输入假设的情况下,每个属于方法的活动到其对应返回活动的路径的自治无异常可达性,从而实现接口自动机的良构性检测。根据所提算法在Eclipse平台设计并实现了构件良构性检测原型系统T-CWFC,该系统通过JFLAP建立构件的接口自动机模型并构造其可达图,进而对接口自动机作良构性检测并输出相关检测信息。最后通过对一组构件的良构性检测实验验证了算法的有效性。     

一种改进的连续属性模糊离散化方法

连续属性离散化是知识系统中的一个重要环节,一个好的离散化方法能够简化知识的描述和便于对知识系统的处理。而求取连续属性值的最优断点集合是一个NP难题。提出一种连续属性模糊离散化的Norm-FD方法：根据正态分布特点采用正态离散化算法（Norm-D算法）,使其离散结果达到需要离散区间数,根据属性值和与其相邻的区间关系将具体属性值用F-Inter算法转化为用隶属度、分区号和偏向系数三个参数表示。     

Asynchronous cellular learning automata

Cellular learning automata is a combination of cellular automata and learning automata. The synchronous version of cellular learning automata in which all learning automata in different cells are activated synchronously, has found many applications. In some applications a type of cellular learning automata in which learning automata in different cells are activated asynchronously (asynchronous cellular learning automata) is needed. In this paper, we introduce asynchronous cellular learning automata and study its steady state behavior. Then an application of this new model to cellular networks has been presented.     

Exactly Learning Automata of Small Cover Time

We present algorithms for exactly learning unknown environments that can be described by deterministic finite automata. The learner performs a walk on the target automaton, where at each step it observes the output of the state it is at, and chooses a labeled edge to traverse to the next state. The learner has no means of a reset, and does not have access to a teacher that answers equivalence queries and gives the learner counterexamples to its hypotheses. We present two algorithms: The first is for the case in which the outputs observed by the learner are always correct, and the second is for the case in which the outputs might be corrupted by random noise. The running times of both algorithms are polynomial in the cover time of the underlying graph of the target automaton.     

Automatic data clustering using continuous action-set learning automata and its application in segmentation of images

Most of the proposed algorithms to solve the dynamic clustering problem are based on nature inspired meta-heuristic algorithms. In this paper a different reinforcement based optimization approach called continuous action-set learning automata (CALA) is used and a novel dynamic clustering approach called ACCALA is proposed. CALA is an optimization tool interacting with a random environment and learn the optimal action from the environment feedbacks. In this paper the dynamic clustering problem considered as a noisy optimization problem and the team of CALAs is used to solve this noisy optimization problem. To build such a team of CALAs this paper proposed a new representation of CALAs. Each automaton in this team uses its continuous action-set and defining a suitable action-set for each automaton has a great impact on the CALAs search behavior. In this paper we used the statistical property of data-sets and proposed a new method to automatically find an action-set for each automaton. The performance of ACCALA is evaluated and the results are compared with seven well-known automatic clustering techniques. Also ACCALA is used to perform automatic segmentation. The experimental results are promising and show that the proposed algorithm produced compact and well-separated clusters.     

Model learning: a survey of foundations,tools and applications

Software systems are present all around us and playing their vital roles in our daily life. The correct functioning of these systems is of prime concern. In addition to classical testing techniques, formal techniques like model checking are used to reinforce the quality and reliability of software systems. However, obtaining of behavior model, which is essential for model-based techniques, of unknown software systems is a challenging task. To mitigate this problem, an emerging black-box analysis technique, called Model Learning, can be applied. It complements existing model-based testing and verification approaches by providing behavior models of blackbox systems fully automatically. This paper surveys the model learning technique, which recently has attracted much attention from researchers, especially from the domains of testing and verification. First, we review the background and foundations of model learning, which form the basis of subsequent sections. Second, we present some well-known model learning tools and provide their merits and shortcomings in the form of a comparison table. Third, we describe the successful applications of model learning in multidisciplinary fields, current challenges along with possible future works, and concluding remarks.     

A NEW DISTRIBUTED JOB SCHEDULING ALGORITHM FOR GRID SYSTEMS

Job scheduling is one of the key issues in the design of grid environments. The performance of the grid system severely degrades if a method does not exist to efficiently schedule the user jobs. In this article, a fully distributed, learning automata–based job scheduling algorithm is proposed for grid environments. The proposed method is composed of two types of procedures: in the first, a procedure is run at the grid nodes and in the second, the procedure is run at the schedulers. The proposed algorithm synchronizes the performance of the schedulers by the learning automata that select their actions using the pseudo-random number generators with the same seed. In this method, the grid computational capacity that is allocated to each scheduler is proportional to its workload. To show the efficiency of the proposed method, several simulation experiments were conducted under different grid scenarios. The obtained results show that the proposed algorithm outperforms several well-known methods in terms of makespan, flow time, and load balancing.     

Multi swarm bare bones particle swarm optimization with distribution adaption

Bare bones PSO is a simple swarm optimization approach that uses a probability distribution like Gaussian distribution in the position update rules. However, due to its nature, Bare bones PSO is highly prone to premature convergence and stagnation. The characteristics of the probability distribution functions used in the update rule have a tense impact on the performance of the bare bones PSO. As a result, this paper investigates the use of different methods for estimating the probability distributions used in the update rule. Four methods or strategies are developed that are using Gaussian or multivariate Gaussian distributions. The choice of an appropriate updating strategy for each particle greatly depends on the characteristics of the fitness landscape that surrounds the swarm. To deal with issue, the cellular learning automata model is incorporated with the proposed bare bones PSO, which is able to adaptively learn suitable updating strategies for the particles. Through the interactions among its elements and the learning capabilities of its learning automata, cellular learning automata gradually learns to select the best updating rules for the particles based on their surrounding fitness landscape. This paper also, investigates a new and simple method for adaptively refining the covariance matrices of multivariate Gaussian distributions used in the proposed updating strategies. The proposed method is compared with some other well-known particle swarm approaches. The results indicate the superiority of the proposed approach in terms of the accuracy of the achieved results and the speed in finding appropriate solutions.     

主动自动机学习中的等价查询算法优化

模型学习是一种获取黑盒软件系统行为模型的有效方法,可分为主动学习和被动学习.主动学习是基于字母表构造测试用例,通过与黑盒系统主动交互,可在多项式时间内得到目标系统的最小完备自动机,其中等价查询仍是开发和应用主动自动机学习工具的障碍之一.通过探讨反例对于学习算法的影响,定义假设的比较规则,提出测试用例构造的两个原则,同时依据原则对Wp-method等价查询算法改进,产生更优的假设,有效降低查询的数量,并基于LearnLib开源工具,分别以3类自动机为实验对象验证原则和改进算法的有效性.     

A cellular learning automata-based deployment strategy for mobile wireless sensor networks

One important problem which may arise in designing a deployment strategy for a wireless sensor network is how to deploy a specific number of sensor nodes throughout an unknown network area so that the covered section of the area is maximized. In a mobile sensor network, this problem can be addressed by first deploying sensor nodes randomly in some initial positions within the area of the network, and then letting sensor nodes to move around and find their best positions according to the positions of their neighboring nodes. The problem becomes more complicated if sensor nodes have no information about their positions or even their relative distances to each other. In this paper, we propose a cellular learning automata-based deployment strategy which guides the movements of sensor nodes within the area of the network without any sensor to know its position or its relative distance to other sensors. In the proposed algorithm, the learning automaton in each node in cooperation with the learning automata in the neighboring nodes controls the movements of the node in order to attain high coverage. Experimental results have shown that in noise-free environments, the proposed algorithm can compete with the existing algorithms such as PF, DSSA, IDCA, and VEC in terms of network coverage. It has also been shown that in noisy environments, where utilized location estimation techniques such as GPS-based devices and localization algorithms experience inaccuracies in their measurements, or the movements of sensor nodes are not perfect and follow a probabilistic motion model, the proposed algorithm outperforms the existing algorithms in terms of network coverage.