On coevolutionary genetic algorithms

 The use of evolutionary computing techniques in coevolutionary/multi-agent systems is becoming increasingly popular. This paper presents simple models of the genetic algorithm in such systems, with the aim of examining the effects of different types of interdependence between individuals. Using the model it is shown that, for a fixed amount of interdependence between coevolving individuals, the existence of partner gene variance and the level at which fitness is applied can have significant effects, as does the evaluation partnering strategy used.     

Designing linear distributed algorithms with memory for fast convergence

Motivated by both distributed computation and decentralized control applications, we studied the distributed linear iterative algorithms with memory. Specifically, we showed that the system of linear equations G x = b can be solved through a distributed linear iteration for arbitrary invertible G using only a single memory element at each processor. Further, we demonstrated that the memoried distributed algorithm can be designed to achieve much faster convergence than a memoryless distributed algorithm. Two small simulation examples were included to illustrate the results. Copyright © 2011 John Wiley & Sons, Ltd.     

Simple models of coevolutionary genetic algorithms

The use of evolutionary computing techniques in coevolutionary/multiagent systems is becoming increasingly popular. This paper presents some simple models of the genetic algorithm in such systems, with the aim of examining the effects of different types of interdependence between individuals. Using the models, it is shown that for a fixed amount of interdependence between homogeneous coevolving individuals, the existence of partner gene variance, gene symmetry, and the level at which fitness is applied can have significant effects. Similarly, for heterogeneous coevolving systems with fixed interdependence, partner gene variance and fitness application are also found to have a significant effect, as is the partnering strategy used.     

合作型协同演化算法研究进展

合作型协同演化算法是近年来计算智能研究的热点。它运用生物协同演化的思想,通过构建两个或者多个种群,建立它们之间的合作关系。两个或多个种群通过相互合作来提高各自的性能,适应复杂系统的动态演化环境以及大规模演化环境,从而达到种群优化的目的。主要介绍了合作型协同演化算法的研究状况以及国内外研究进展,详细介绍了它的基本结构及对应的研究、基本算法及一些新兴算法,同时介绍了一些在现实生活中的应用,展望了合作型协同演化算法的发展前景。     

Local convergence analysis of FastICA and related algorithms

The FastICA algorithm is one of the most prominent methods to solve the problem of linear independent component analysis (ICA). Although there have been several attempts to prove local convergence properties of FastICA, rigorous analysis is still missing in the community. The major difficulty of analysis is because of the well-known sign-flipping phenomenon of FastICA, which causes the discontinuity of the corresponding FastICA map on the unit sphere. In this paper, by using the concept of principal fiber bundles, FastICA is proven to be locally quadratically convergent to a correct separation. Higher order local convergence properties of FastICA are also investigated in the framework of a scalar shift strategy. Moreover, as a parallelized version of FastICA, the so-called QR FastICA algorithm, which employs the QR decomposition (Gram-Schmidt orthonormalization process) instead of the polar decomposition, is shown to share similar local convergence properties with the original FastICA.     

分布式进化算法的性能测试与分析

针对分布式进化算法设计过程中由于缺乏对性能影响因素的分析而导致算法无法达到预期加速比的问题,提出一种全面的性能分析方法。根据分布式进化算法的组成结构,将影响分布式进化算法性能的因素分为进化操作开销、适应值计算开销和通信开销三个部分。首先研究进化算法在不同个体编码维数下进化操作开销的特性;其次,在进化操作开销相对固定的情况下,通过使用操作系统的延时函数控制适应值计算开销,通过改变个体编码维数控制通信开销;最后,应用控制变量方法,逐一测试各因素对算法加速比的影响。实验结果展现了三种因素的相互制约关系,给出了分布式进化算法获得更好加速比的条件。     

Performance analysis of distributed deadlock detection algorithms

The paper presents a probabilistic performance analysis of a deadlock detection algorithm in distributed systems. Although there has been extensive study on deadlock detection algorithms in distributed systems, little attention has been paid to the study of the performance of these algorithms. Most work on performance study has been achieved through simulation but not through an analytic model. Min (1990), to the best of our knowledge, made the sole attempt to evaluate the performance of distributed deadlock detection algorithms analytically. Being different from Min's, our analytic approach takes the time-dependent behavior of each process into consideration rather than simply taking the mean-value estimation. Furthermore, the relation among the times when deadlocked processes become blocked is studied, which enhances the accuracy of the analysis. We measure performance metrics such as duration of deadlock, the number of algorithm invocations, and the mean waiting time of a blocked process. It is shown that the analytic estimates are nearly consistent with simulation results     

A convergence analysis of generalized hill climbing algorithms

Generalized hill climbing (GHC) algorithms provide a well-defined framework for describing the performance of local search algorithms for discrete optimization problems. Necessary and sufficient convergence conditions for GHC algorithms are presented. These convergence conditions are derived using a new iteration classification scheme for GHC algorithms. The implications of the necessary and the sufficient convergence conditions fur GHC algorithms with respect to existing convergence theory for simulated annealing are also discussed     

Sufficient conditions for the convergence of a class of nonlinear distributed consensus algorithms

This paper is concerned with the convergence of a class of continuous-time nonlinear consensus algorithms for single integrator agents. In the consensus algorithms studied here, the control input of each agent is assumed to be a state-dependent combination of the relative positions of its neighbors in the information flow graph. Using a novel approach based on the smallest order of the nonzero derivative, it is shown that under some mild conditions the convex hull of the agents has a contracting property. A set-valued LaSalle-like approach is subsequently employed to show the convergence of the agents to a common point. The results are shown to be more general than the ones reported in the literature in some cases. An illustrative example demonstrates how the proposed convergence conditions can be verified.     

Fitness function shaping in multiagent cooperative coevolutionary algorithms

Coevolution is a promising approach to evolve teams of agents which must cooperate to achieve some system objective. However, in many coevolutionary approaches, credit assignment is often subjective and context dependent, as the fitness of an individual agent strongly depends on the actions of the agents with which it collaborates. In order to alleviate this problem, we introduce a cooperative coevolutionary algorithm which biases the evolutionary search as well as shapes agent fitness functions to promote behavior that benefits the system-level performance. More specifically, we bias the search using a hall of fame approximation of optimal collaborators, and shape the agent fitness using the difference evaluation function. Our results show that shaping agent fitness with the difference evaluation improves system performance by up to 50 %, and adding an additional fitness bias improves performance by up to 75 % in our experiments. Finally, an analysis of system performance as a function of computational cost demonstrates that this algorithm makes extremely efficient use of computational resources, having a higher performance as a function of computational cost than any other algorithm tested.     

A distributed Cooperative coevolutionary algorithm for multiobjective optimization

Recent advances in evolutionary algorithms show that coevolutionary architectures are effective ways to broaden the use of traditional evolutionary algorithms. This paper presents a cooperative coevolutionary algorithm (CCEA) for multiobjective optimization, which applies the divide-and-conquer approach to decompose decision vectors into smaller components and evolves multiple solutions in the form of cooperative subpopulations. Incorporated with various features like archiving, dynamic sharing, and extending operator, the CCEA is capable of maintaining archive diversity in the evolution and distributing the solutions uniformly along the Pareto front. Exploiting the inherent parallelism of cooperative coevolution, the CCEA can be formulated into a distributed cooperative coevolutionary algorithm (DCCEA) suitable for concurrent processing that allows inter-communication of subpopulations residing in networked computers, and hence expedites the computational speed by sharing the workload among multiple computers. Simulation results show that the CCEA is competitive in finding the tradeoff solutions, and the DCCEA can effectively reduce the simulation runtime without sacrificing the performance of CCEA as the number of peers is increased.     

Network-based distributed planning using coevolutionary agents: architecture and evaluation

A novel evolutionary planning framework (coevolutionary virtual design environment) particularly suited to distributed network-enabled design and manufacturing organizations is presented. The approach utilizes distributed evolutionary agents and mobile agents as principal object-oriented software entities that support a network-efficient evolutionary exploration of planning alternatives in which successive populations systematically select planning alternatives that reduce cost and increase throughput. This paper presents the architecture of the coevolutionary virtual design environment, and examines the network-based performance of the coevolutionary algorithms that execute in this environment. Simulation analysis examines the percentage convergence error and percentage computational advantage comparing the distributed network-based implementation to a centralized network-based implementation. The algorithms and architectures are evaluated in a realistic network setting and analyzed using models of network delays and processing times.     

Comparison between two coevolutionary feature weighting algorithms in clustering

Feature weighting is an aspect of increasing importance in clustering because data are becoming more and more complex nowadays. In this paper, we propose two new feature weighting methods based on coevolutive algorithms. The first one is inspired by the Lamarck theory (inheritance of acquired characteristics) and uses the distance-based cost function defined in the LKM algorithm as fitness function. The second method uses a fitness function based on a new partitioning quality measure. It does not need a distance-based measure. We compare classical hill-climbing optimization with these new genetic algorithms on three data sets from UCI. Results show that the proposed methods are better than the hill-climbing based algorithms. We also present a process of hyperspectral remotely sensed image classification. The experiments, corroborated by geographers, highlight the benefits of using coevolutionary feature weighting methods to improve knowledge discovery process.     

Virtual player design using self-learning via competitive coevolutionary algorithms

The Google Artificial Intelligence (AI) Challenge is an international contest the objective of which is to program the AI in a two-player real time strategy (RTS) game. This AI is an autonomous computer program that governs the actions that one of the two players executes during the game according to the state of play. The entries are evaluated via a competition mechanism consisting of two-player rounds where each entry is tested against others. This paper describes the use of competitive coevolutionary (CC) algorithms for the automatic generation of winning game strategies in Planet Wars, the RTS game associated with the 2010 contest. Three different versions of a prime algorithm have been tested. Their common nexus is not only the use of a Hall-of-Fame (HoF) to keep note of the winners of past coevolutions but also the employment of an archive of experienced players, termed the hall-of-celebrities (HoC), that puts pressure on the optimization process and guides the search to increase the strength of the solutions; their differences come from the periodical updating of the HoF on the basis of quality and diversity metrics. The goal is to optimize the AI by means of a self-learning process guided by coevolutionary search and competitive evaluation. An empirical study on the performance of a number of variants of the proposed algorithms is described and a statistical analysis of the results is conducted. In addition to the attainment of competitive bots we also conclude that the incorporation of the HoC inside the primary algorithm helps to reduce the effects of cycling caused by the use of HoF in CC algorithms.     

On the convergence of the holistic analysis for EDF distributed systems

Dynamic scheduling techniques, and EDF (Earliest Deadline First) in particular, have demonstrated their ability to increase the schedulability of real time systems compared to fixed-priority scheduling. In distributed systems, the scheduling policies of the processing nodes tend to be the same as in stand-alone systems and, although few EDF networks exist, it is foreseen that dynamic scheduling will gradually develop into real-time networks. There are some response time analysis techniques for EDF scheduled distributed systems, mostly derived from the holistic analysis developed by Spuri. A major factor influencing the response time is the release jitter of each task, which is the maximum variation suffered by the release time of the task jobs. The convergence of the holistic analysis in the context of EDF distributed systems with shared resources had not been studied until now. There is a circular dependency between the task release jitter values, response times and the preemption level ceilings of shared resources. In this paper we present an extension of Spuri’s algorithm and we demonstrate that its iterative formulas are non-decreasing, even in the presence of shared resources. This result enables us to assert that the new algorithm converges towards a solution for the response times of the tasks and messages in a distributed system.¹     

Hierarchical distributed genetic algorithms

Genetic algorithm behavior is determined by the exploration/exploitation balance kept throughout the run. When this balance is disproportionate, the premature convergence problem will probably appear, causing a drop in the genetic algorithm's efficacy. One approach presented for dealing with this problem is the distributed genetic algorithm model. Its basic idea is to keep, in parallel, several subpopulations that are processed by genetic algorithms, with each one being independent from the others. Furthermore, a migration operator produces a chromosome exchange between the subpopulations. Making distinctions between the subpopulations of a distributed genetic algorithm by applying genetic algorithms with different configurations, we obtain the so-called heterogeneous distributed genetic algorithms. In this paper, we present a hierarchical model of distributed genetic algorithms in which a higher level distributed genetic algorithm joins different simple distributed genetic algorithms. Furthermore, with the union of the hierarchical structure presented and the idea of the heterogeneous distributed genetic algorithms, we propose a type of heterogeneous hierarchical distributed genetic algorithms, the hierarchical gradual distributed genetic algorithms. Experimental results show that the proposals consistently outperform equivalent sequential genetic algorithms and simple distributed genetic algorithms. ©1999 John Wiley & Sons, Inc.     

Modeling and analysis of scheduling for distributed real-time embedded systems

Aimed at the deficiencies of resources based time Petri nets (RBTPN) in doing scheduling analysis for distributed real-time embedded systems, the assemblage condition of complex scheduling sequences is presented to easily compute scheduling length and simplify scheduling analysis. Based on this, a new hierarchical RBTPN model is proposed. The model introduces the definition of transition border set, and represents it as an abstract transition. The abstract transition possesses all resources of the set, and has the highest priority of each resource; the execution time of abstract transition is the longest time of all possible scheduling sequences. According to the characteristics and assemblage condition of RBTPN, the refinement conditions of transition border set are given, and the conditions ensure the correction of scheduling analysis. As a result, it is easy for us to understand the scheduling model and perform scheduling analysis.     

A coevolutionary approach to adapt the genotype-phenotype map in genetic algorithms

This article introduces a coevolutionary approach to genetic algorithms (GAs) for exploring not only within a part of the solution space defined by the genotype-pheno-type map, but also the map itself. In canonical GAs with a fixed map, how large an area of the solution space can be covered by possible genomes, and consequently how better solutions can be found by a GA, rely on how well the geotype-phenotype map in designed, but it is difficult for designers of the algorithms to design the map without a priori knowledge of the solution space. In the proposed algorithm, the genotype-phenotype map is improved adaptively during the search process for solution candidates. It is applied to 3-bit deceptive problems such as of typical combinatorial optimazation problems. These are well known because their difficulty for GAs can be controlled by the genotype-phenotype map, and this shows a fairly good performance compared with a conventional GA. This work was presented in part at the Sixth International Symposium on Artificial Life and Robotics, Tokyo, January 15–17, 2001.     

Recursive least-squares identification algorithms with incompleteexcitation: convergence analysis and application to adaptivecontrol

The convergence properties of a fairly general class of adaptive recursive least-squares algorithms are studied under the assumption that the data generation mechanism is deterministic and time invariant. First, the (open-loop) identification case is considered. By a suitable notion of excitation subspace, the convergence analysis of the identification algorithm is carried out with no persistent excitation hypothesis, i.e. it is proven that the projection of the parameter error on the excitation subspace tends to zero, while the orthogonal component of the error remains bounded. The convergence of an adaptive control scheme based on the minimum variance control law is then dealt with. It is shown that under the standard minimum-phase assumption, the tracking error converges to zero whenever the reference signal is bounded. Furthermore, the control variable turns out to be bounded     

Exponential convergence of adaptive identification and control algorithms

Output and equation error adaptive identification algorithms are shown to be exponentially convergent under a deterministic or stochastic persistently exciting (or spanning) condition on the system inputs together with several other standard conditions. An adaptive control algorithm is shown to be exponentially convergent under a deterministic or stochastic persistently exciting condition on the reference trajectory together with some standard conditions.