Benchmarking hybrid algorithms for distributed constraint optimisation games

In this paper, we consider algorithms for distributed constraint optimisation problems (DCOPs). Using a potential game characterisation of DCOPs, we decompose eight DCOP algorithms, taken from the game theory and computer science literatures, into their salient components. We then use these components to construct three novel hybrid algorithms. Finally, we empirical evaluate all eleven algorithms, in terms of solution quality, timeliness and communication resources used, in a series of graph colouring experiments. Our experimental results show the existence of several performance trade-offs (such as quick convergence to a solution, but with a cost of high communication needs), which may be exploited by a system designer to tailor a DCOP algorithm to suit their mix of requirements.     

An overview of population-based algorithms for multi-objective optimisation

In this work we present an overview of the most prominent population-based algorithms and the methodologies used to extend them to multiple objective problems. Although not exact in the mathematical sense, it has long been recognised that population-based multi-objective optimisation techniques for real-world applications are immensely valuable and versatile. These techniques are usually employed when exact optimisation methods are not easily applicable or simply when, due to sheer complexity, such techniques could potentially be very costly. Another advantage is that since a population of decision vectors is considered in each generation these algorithms are implicitly parallelisable and can generate an approximation of the entire Pareto front at each iteration. A critique of their capabilities is also provided.     

Tri-level regression testing using nature-inspired algorithms

Innovations in Systems and Software Engineering - A software needs to be updated to survive in the customers’ ever-changing demands and the competitive market. The modifications may produce...     

Enhancing GPU parallelism in nature-inspired algorithms

We present GPU implementations of two different nature-inspired optimization methods for well-known optimization problems. Ant Colony Optimization (ACO) is a two-stage population-based method modelled on the foraging behaviour of ants, while P systems provide a high-level computational modelling framework that combines the structure and dynamic aspects of biological systems (in particular, their parallel and non-deterministic nature). Our methods focus on exploiting data parallelism and memory hierarchy to obtain GPU factor gains surpassing 20x for any of the two stages of the ACO algorithm, and 16x for P systems when compared to sequential versions running on a single-threaded high-end CPU. Additionally, we compare performance between GPU generations to validate hardware enhancements introduced by Nvidia’s Fermi architecture.     

Benchmarking template-based tracking algorithms

For natural interaction with augmented reality (AR) applications, good tracking technology is key. But unlike dense stereo, optical flow or multi-view stereo, template-based tracking which is most commonly used for AR applications lacks benchmark datasets allowing a fair comparison between state-of-the-art algorithms. Until now, in order to evaluate objectively and quantitatively the performance and the robustness of template-based tracking algorithms, mainly synthetically generated image sequences were used. The evaluation is therefore often intrinsically biased. In this paper, we describe the process we carried out to perform the acquisition of real-scene image sequences with very precise and accurate ground truth poses using an industrial camera rigidly mounted on the end effector of a high-precision robotic measurement arm. For the acquisition, we considered most of the critical parameters that influence the tracking results such as: the texture richness and the texture repeatability of the objects to be tracked, the camera motion and speed, and the changes of the object scale in the images and variations of the lighting conditions over time. We designed an evaluation scheme for object detection and interframe tracking algorithms suited for AR and other computer vision applications and used the image sequences to apply this scheme to several state-of-the-art algorithms. The image sequences are freely available for testing, submitting and evaluating new template-based tracking algorithms, i.e. algorithms that detect or track a planar object in an image sequence given only one image of the object (called the template).     

.连续属性离散化算法比较研究*

探讨了贪心及其改进算法、基于属性重要性、基于信息熵和基于聚类四类连续属性离散化算法,并通过实验验证这四类算法的离散化效果.实验结果表明,数据集离散化的效果不仅取决于使用算法,而且与数据集连续属性的分布和决策数据值的分类也有密切关系.     

Benchmarking numerical accuracy of statistical algorithms

In this paper, we discuss benchmark data sets proposed by Anscombe and Longley for measuring the numerical accuracy of statistical algorithms. We show that these benchmarks present an unduly optimistic assessment of numerical accuracy. We demonstrate that the cause of this unwarranted optimism is the use of integer values in the benchmarks. Alternative benchmarks are proposed which avoid the problems brought about by the integer values and provide a more realistic assessment of numerical accuracy under varying data conditions.     

Benchmarking and comparing multi-exposure image fusion algorithms

Multi-exposure image fusion (MEF) is an important area in computer vision and has attracted increasing interests in recent years. Apart from conventional algorithms, deep learning techniques have also been applied to MEF. However, although many efforts have been made on developing MEF algorithms, the lack of benchmarking studies makes it difficult to perform fair and comprehensive performance comparison among MEF algorithms, thus hindering the development of this field significantly. In this paper, we fill this gap by proposing a benchmark of multi-exposure image fusion (MEFB), which consists of a test set of 100 image pairs, a code library of 21 algorithms, 20 evaluation metrics, 2100 fused images, and a software toolkit. To the best of our knowledge, this is the first benchmarking study in the field of MEF. This paper also gives a literature review on MEF methods with a focus on deep learning-based algorithms. Extensive experiments have been conducted using MEFB for comprehensive performance evaluation and for identifying effective algorithms. We expect that MEFB will serve as an effective platform for researchers to compare the performance of MEF algorithms.     

Evolutionary algorithms for continuous-space optimisation

From a global viewpoint, evolutionary algorithms (EAs) working on continuous search-spaces can be regarded as homogeneous Markov chains (MCs) with discrete time and continuous state. We analyse from this viewpoint the (1?+?1)EA on the inclined plane fitness landscape, and derive a closed-form expression for the probability of occupancy of an arbitrary target zone, at an arbitrary iteration of the EA. For the hitting-time of an arbitrary target zone, we provide lower and upper bounds, as well as an asymptotic limit. Discretization leads to an MC with discrete time, whose simple structure is exploited to carry out efficient numerical investigations of the theoretical results obtained. The numerical results thoroughly confirm the theoretical ones, and also suggest various conjectures which go beyond the theory.     

S. I: hybridization of neural computing with nature-inspired algorithms

Neural Computing and Applications -     

Empirical analysis of five nature-inspired algorithms on real parameter optimization problems

In the past few years nature-inspired algorithms are seen as potential tools to solve computationally hard problems. Tremendous success of these algorithms in providing near optimal solutions has inspired the researchers to develop new algorithms. However, very limited efforts have been made to identify the best algorithms for diverse classes of problems. This work attempts to assess the efficacy of five contemporary nature-inspired algorithms i.e. bat algorithm (BA), artificial bee colony algorithm (ABC), cuckoo search algorithm (CS), firefly algorithm (FA) and flower pollination algorithm (FPA). The work evaluates the performance of these algorithms on CEC2014 30 benchmark functions which include unimodal, multimodal, hybrid and composite problems over 10, 30, 50 and 100 dimensions. Control parameters of all algorithms are self-adapted so as to obtain best results over benchmark functions. The algorithms have been evaluated along three perspectives (a) statistical significance using Wilcoxon rank sum test (b) computational time complexity (c) convergence rate of algorithms. Experimental results and analysis revealed that ABC algorithm perform best for majority of the problems on high dimension, while on small dimension, CS is the best choice. FPA attain the next best position follow by BA and FA for all kinds of functions. Self adaptation of above algorithms also revealed the best values of input parameters for various algorithms. This study may aid experts and scientists of computational intelligence to solve intricate optimization problems.     

Memetic algorithms based on local search chains for large scale continuous optimisation problems: MA-SSW-Chains

Nowadays, large scale optimisation problems arise as a very interesting field of research, because they appear in many real-world problems (bio-computing, data mining, etc.). Thus, scalability becomes an essential requirement for modern optimisation algorithms. In a previous work, we presented memetic algorithms based on local search chains. Local search chain concerns the idea that, at one stage, the local search operator may continue the operation of a previous invocation, starting from the final configuration reached by this one. Using this technique, it was presented a memetic algorithm, MA-CMA-Chains, using the CMA-ES algorithm as its local search component. This proposal obtained very good results for continuous optimisation problems, in particular with medium-size (with up to dimension 50). Unfortunately, CMA-ES scalability is restricted by several costly operations, thus MA-CMA-Chains could not be successfully applied to large scale problems. In this article we study the scalability of memetic algorithms based on local search chains, creating memetic algorithms with different local search methods and comparing them, considering both the error values and the processing cost. We also propose a variation of Solis Wets method, that we call Subgrouping Solis Wets algorithm. This local search method explores, at each step of the algorithm, only a random subset of the variables. This subset changes after a certain number of evaluations. Finally, we propose a new memetic algorithm based on local search chains for high dimensionality, MA-SSW-Chains, using the Subgrouping Solis Wets’ algorithm as its local search method. This algorithm is compared with MA-CMA-Chains and different reference algorithms, and it is shown that the proposal is fairly scalable and it is statistically very competitive for high-dimensional problems.     

A survey of dynamic parameter setting methods for nature-inspired swarm intelligence algorithms

Neural Computing and Applications - Parameter settings for nature-inspired optimization algorithms are essential for their effective performance. Evolutionary algorithms and swarm intelligence...     

A developed system based on nature-inspired algorithms for DNA motif finding process

In this paper, recent algorithms are suggested to repair the issue of motif finding. The proposed algorithms are cuckoo search, modified cuckoo search and finally a hybrid of gravitational search and particle swarm optimization algorithm. Motif finding is the technique of handling expressive motifs successfully in huge DNA sequences. DNA motif finding is important because it acts as a significant function in understanding the approach of gene regulation. Recent results of existing motifs finding programs display low accuracy and can not be used to find motifs in different types of datasets. Practical tests are implemented first on synthetic datasets and then on benchmark real datasets that are based on nature-inspired algorithms. The results revealed that the hybridization of gravitational search algorithm and particle swarm algorithms provides higher precision and recall values and provides average enhancement of F-score up to 0.24, compared to other existing algorithms and tools, and also that cuckoo search and modified cuckoo search have been able to successfully locate motifs in DNA sequences.

     

Comparison study on nature-inspired optimization algorithms for optimization back analysis of underground engineering

Optimization back analysis is the most common approach to displacement back analysis for underground engineering. However, this is a non-convex problem that requires the use of nature-inspired global optimization algorithms. Therefore, the present study will investigate on the suitability of six state-of-the-art nature-inspired algorithms for elastic back analysis and elastic–plastic back analysis. These algorithms include improved genetic algorithm, immunized evolutionary programming, particle swarm optimization, continuous ant colony optimization, artificial bee colony and black hole algorithm. Numerical results indicate that immunized evolutionary programming is overall the best algorithm followed by the black hole algorithm; while, the improved genetic algorithm is the worst optimizer. Meanwhile, using elastic back analysis, the sensitivity analysis of the main input parameters for these nature-inspired optimization algorithms has been conducted. At last, the comparative results have been verified by using in one real underground roadway in Huainan coal mine of China.

     

Robust design optimisation using multi-objective evolutionary algorithms

In this paper, a new robust design method is investigated with a hierarchical asynchronous parallel multi-objective evolutionary algorithms in an optimisation framework environment to solve single and multi-point design optimisation problems in aerodynamics. The single design techniques produce solutions that perform well for the selected design point but have poor off-design performance. Here, it is shown how the approach can provide robust solutions using game theory in the sense that they are less sensitive to little changes of input parameters. Starting from a statistical definition of stability, the method captures, simultaneously Pareto non-dominated solutions with respect to performance and stability criteria, offering alternative choices to the designer.     

A survey on nature-inspired optimization algorithms with fuzzy logic for dynamic parameter adaptation

Metaheuristic optimization algorithms have become a popular choice for solving complex problems which are otherwise difficult to solve by traditional methods. However, these methods have the problem of the parameter adaptation and many researchers have proposed modifications using fuzzy logic to solve this problem and obtain better results than the original methods. In this study a comprehensive review is made of the optimization techniques in which fuzzy logic is used to dynamically adapt some important parameters in these methods. In this paper, the survey mainly covers the optimization methods of Particle Swarm Optimization (PSO), Gravitational Search Algorithm (GSA), and Ant Colony Optimization (ACO), which in the last years have been used with fuzzy logic to improve the performance of the optimization methods.     

Ship steering control system optimisation using genetic algorithms

The optimisation of non-linear control systems by genetic algorithm is studied in this paper. It involves the performance of two systems for regulating the motion of a ship model. These systems allow Course Changing and Track Keeping through the implementation of a sliding mode controller. The genetic algorithm is used to optimise the performance of the complete system under various operating conditions by optimising the parameters of the sliding mode controller. The type of vessel considered is an oil tanker.     

Landmark-based music recognition system optimisation using genetic algorithms

Audio fingerprinting allows us to label an unidentified music fragment within a previously generated database. The use of spectral landmarks aims to obtain a robustness that lets a certain level of noise be present in the audio query. This group of audio identification algorithms holds several configuration parameters whose values are usually chosen based upon the researcher’s knowledge, previous published experimentation or just trial and error methods. In this paper we describe the whole optimisation process of a Landmark-based Music Recognition System using genetic algorithms. We define the actual structure of the algorithm as a chromosome by transforming its high relevant parameters into various genes and building up an appropriate fitness evaluation method. The optimised output parameters are used to set up a complete system that is compared with a non-optimised one by designing an unbiased evaluation model.     

Novel algorithms of particle swarm optimisation with decision criteria

The particle swarm optimisation (PSO) is a stochastic, optimisation technique based on the movement and intelligence of swarms. In this paper, three new effective optimisation algorithms BPSO, HPSO and WPSO, by incorporating some decision criteria into PSO, have been proposed and analysed both in terms of their efficiency, resistance to the problem of premature convergence and the ability to avoid local optima. In the new algorithms, for each particle except position, two sets of velocities are generated and the profit matrix is constructed. Using the decision criteria the best strategy is selected. Simulations for benchmark test nonlinear function show that the algorithms in which the decision criteria have been applied, are beneficial over classical PSO in terms of their performance and efficiency.