A comparative study on heuristic algorithms for generating fuzzydecision trees

Fuzzy decision tree induction is an important way of learning from examples with fuzzy representation. Since the construction of optimal fuzzy decision tree is NP-hard, the research on heuristic algorithms is necessary. In this paper, three heuristic algorithms for generating fuzzy decision trees are analyzed and compared. One of them is proposed by the authors. The comparisons are twofold. One is the analytic comparison based on expanded attribute selection and reasoning mechanism; the other is the experimental comparison based on the size of generated trees and learning accuracy. The purpose of this study is to explore comparative strengths and weaknesses of the three heuristics and to show some useful guidelines on how to choose an appropriate heuristic for a particular problem.     

A comparative study of heuristic algorithms on Economic Lot Scheduling Problem

The Economic Lot Scheduling Problem (ELSP) has been well-researched for more than 40 years. As the ELSP has been generally seen as NP-hard, researchers have focused on the development of efficient heuristic approaches. In this paper, we consider the time-varying lot size approach to solve the ELSP. A computational study of the existing solution algorithms, Dobson’s heuristic, Hybrid Genetic algorithm, Neighborhood Search heuristics, Tabu Search and the newly proposed Simulated Annealing algorithm are presented. The reviewed methods are first tested on two well-known problems, those of Bomberger’s [Bomberger, E. E. (1966). A dynamic programming approach to a lot size scheduling problem. Management Science 12, 778–784] and Mallya’s [Mallya, R (1992). Multi-product scheduling on a single machine: A case study. OMEGA: International Journal of Management Science 20, 529–534] problems. We show the Simulated Annealing algorithm finds the best known solution to these problems. A similar comparison study is performed on various problem sets previously suggested in the literature. The results show that the Simulated Annealing algorithm outperforms Dobson’s heuristic, Hybrid Genetic algorithm and Neighborhood search heuristics on these problem sets. The Simulated Annealing algorithm also shows faster convergence than the best known Tabu Search algorithm, yet results in solutions of a similar quality. Finally, we report the results of the design of experiment study which compares the robustness of the mentioned meta-heuristic techniques.     

A sociologically inspired heuristic for optimization algorithms: A case study on ant systems

This paper discusses how social network theory can provide optimization algorithms with social heuristics. The foundations of this approach were used in the SAnt-Q (Social Ant-Q) algorithm, which combines theory from different fields to build social structures for state-space search, in terms of the ways that interactions between states occur and reinforcements are generated. Social measures are therefore used as a heuristic to guide exploration and approximation processes. Trial and error optimization techniques are based on reinforcements and are often used to improve behavior and coordination between individuals in a multi-agent system, although without guarantees of convergence in the short term. Experiments show that identifying different social behavior within the social structure that incorporates patterns of occurrence between states explored helps to improve ant coordination and optimization process within Ant-Q and SAnt-Q, giving better results that are statistically significant.     

A comparative runtime analysis of heuristic algorithms for satisfiability problems

The satisfiability problem is a basic core NP-complete problem. In recent years, a lot of heuristic algorithms have been developed to solve this problem, and many experiments have evaluated and compared the performance of different heuristic algorithms. However, rigorous theoretical analysis and comparison are rare. This paper analyzes and compares the expected runtime of three basic heuristic algorithms: RandomWalk, (1+1) EA, and hybrid algorithm. The runtime analysis of these heuristic algorithms on two 2-SAT instances shows that the expected runtime of these heuristic algorithms can be exponential time or polynomial time. Furthermore, these heuristic algorithms have their own advantages and disadvantages in solving different SAT instances. It also demonstrates that the expected runtime upper bound of RandomWalk on arbitrary k-SAT (k?3) is O(n(k−1)), and presents a k-SAT instance that has Θ(n(k−1)) expected runtime bound.     

A comparative study of some concurrency control algorithms for cluster-based communication networks

This paper presents a comparative study of some concurrency control algorithms for distributed databases of computer clusters which emphasize high availability and high performance requirements. For this purpose, we have analyzed some concurrency control algorithms which are used in commercial DBMSs, such as the pessimistic locking algorithm as it verifies transaction conflicts early in their execution phase, and the optimistic algorithm which investigates the presence of conflicts after the execution phase. A new algorithm is proposed and implemented by a simulation program. The three algorithms were tested using different configurations. Simulation results showed that the locking algorithm performed better than the optimistic method in presence of conflicts between transactions, while the optimistic algorithm provided better results in the absence of conflicts. Furthermore, in a distributed database with a certain probability of conflicts, the locking algorithm can be used to guarantee strong consistency and an acceptable level of performance. However, if this probability is negligible, the system performance can be improved by using the optimistic algorithm. The proposed algorithm offers improved performance in numerous cases. As a result, it can be used in a distributed database to guarantee a satisfactory level of performance in the presence of conflicts.     

A comparative study of image processing algorithms

We compared the performances of the well-known image processing algorithms run on a set of reference images. For this, the algorithm-distorted images are compared against “ground truth” images.     

A comparative study of staff removal algorithms

This paper presents a quantitative comparison of different algorithms for the removal of stafflines from music images. It contains a survey of previously proposed algorithms and suggests a new skeletonization based approach. We define three different error metrics, compare the algorithms with respect to these metrics and measure their robustness with respect to certain image defects. Our test images are computer-generated scores on which we apply various image deformations typically found in real-world data. In addition to modern western music notation our test set also includes historic music notation such as mensural notation and lute tablature. Our general approach and evaluation methodology is not specific to staff removal, but applicable to other segmentation problems as well.     

A comparative study of task communication in ada

A previous paper compared the mechanisms for process communication in Hoare's communicating sequential processes and in Brinch Hansen's distributed processes, by both qualitative and quantitative analyses. This paper extends these analyses to the corresponding features for communication between tasks in Ada. The similarity between Ada's features and Hoare's proposals is confirmed, but some limitations on non-determinism in Ada are noted.     

Practical fusion algorithms for rotation matrices: A comparative study

Many computer vision, sensor fusion, and robotic applications require the estimation of a 3 × 3 rotation matrix from a set of measured or computed 3 × 3 noisy rotation matrices. This article classifies solution methods into three categories: nonlinear least squares, linear optimal, and linear suboptimal algorithms. Their performance is compared through simulation studies. It is shown that the linear suboptimal algorithms proposed in this article have an accuracy comparable to that of the optimal algorithms and are about five times faster. Furthermore, a particular nonlinear optimization algorithm is presented that has computational complexity similar to that of the linear optimal procedures. © 1992 John Wiley & Sons, Inc.     

A comparative study on face detection and tracking algorithms

Face localization is the first stage in many vision based applications and in human-computer interaction. The problem is to define the face location of a person in a color image. The four boosted classifiers embbeded in OpenCV, based on Haar-like features, are compared in terms of speed and efficiency. Skin color distribution is estimated using a non parametric approach. To avoid drifting in color estimate, this model is not updated during the sequence but renewed whenever the face is detected again, that gives the ability to our system to cope with different lighting conditions in a more robust way. Skin color model is then used to localize the face represented by an ellipse: connected component segmentation and a statistical approach, namely the coupled Camshift of Bradsky, are compared in terms of efficiency and speed. The pursuit algorithms are tested on various video sequences, corresponding to various scenarios in terms of illumination, face pose, face size and background complexity (distractor effects).     

A convex characterization of distributed control problems in spatially invariant systems with communication constraints

In this paper we consider the problem of distributed controller design in spatially invariant systems for which communication among sites is limited. In particular, the controller is constrained so that information is propagated with a delay that depends on the distance between subsystems—a structure we refer to as “funnel” causality. We show that the problem of optimal design can be cast as a convex problem provided that the plant has a similar funnel-causality structure, and the propagation speeds in the controller are at least as fast as those in the plant. As an example, we consider the case of the wave dynamics with limited propagation speed control.     

A comparative study of English viseme recognition methods and algorithms

Multimedia Tools and Applications - An elementary visual unit – the viseme is concerned in the paper in the context of preparing the feature vector as a main visual input component of...     

BubbleSearch: A simple heuristic for improving priority-based greedy algorithms

We introduce BubbleSearch, a general approach for extending priority-based greedy heuristics. Following the framework recently developed by Borodin et al., we consider priority algorithms, which sequentially assign values to elements in some fixed or adaptively determined order. BubbleSearch extends priority algorithms by selectively considering additional orders near an initial good ordering. While many notions of nearness are possible, we explore algorithms based on the Kendall-tau distance (also known as the BubbleSort distance) between permutations. Our contribution is to elucidate the BubbleSearch paradigm and experimentally demonstrate its effectiveness.     

A comparative study of two search strategies for connected wordrecognition: dynamic programming and heuristic search

A most successful approach to recognizing continuous speech is to model the recognition problem as one of finding an optimal path through a finite state network. A comparison of two search strategies for finding the optimal path, dynamic programming and heuristic search, is presented. The comparison is based on theoretical considerations and experimental tests on a digit string task     

两种流形学习算法的对比研究

介绍了局部线性嵌套和等距映射两种最基本的非线性降维方法,对比测试了两种降维方法在不同参数下的执行效果与效率,总结了两种降维方法所适合的数据特点,并应用于图像识别中,比较了两者在图像识别中的识别率.     

基于电力线载波通信技术的自动抄表系统路由算法

由于电力线信道环境的特殊性,使电力线载波抄表系统中存在着抄表距离有限、通信成功率不高等问题。针对此问题,介绍两种路由算法——点名请求算法和数据收集算法,分别用于自动抄表中实现监控电表和例行抄读业务。     

A model and heuristic algorithms for multi-unit nondiscriminatory combinatorial auction

Single unit combinatorial auction problem (CAP) and its multi-unit extension have received a lot of attention recently. This paper introduces yet another variant of CAP which generalizes the multi-unit CAP further to allow bids on collections of items that can come from bidder defined classes of items. A bidder may be indifferent to some items with different brands, specifications or qualities and consider them as substitutable. In this case, these items can be put in a class and hence the bids can be made by referring to the items in such classes. This model enables the bidder to express his requests by using less number of bids in case he does not discriminate between different items. Because of this, we call this problem multi-unit nondiscriminatory combinatorial auction (MUNCA) problem. An integer programming formulation is given for this problem. Since this problem is NP-hard, two fast heuristic algorithms have also been designed. The heuristics give quite good solutions when compared to the optimal solution.     

Classification of adaptive memetic algorithms: a comparative study.

Adaptation of parameters and operators represents one of the recent most important and promising areas of research in evolutionary computations; it is a form of designing self-configuring algorithms that acclimatize to suit the problem in hand. Here, our interests are on a recent breed of hybrid evolutionary algorithms typically known as adaptive memetic algorithms (MAs). One unique feature of adaptive MAs is the choice of local search methods or memes and recent studies have shown that this choice significantly affects the performances of problem searches. In this paper, we present a classification of memes adaptation in adaptive MAs on the basis of the mechanism used and the level of historical knowledge on the memes employed. Then the asymptotic convergence properties of the adaptive MAs considered are analyzed according to the classification. Subsequently, empirical studies on representatives of adaptive MAs for different type-level meme adaptations using continuous benchmark problems indicate that global-level adaptive MAs exhibit better search performances. Finally we conclude with some promising research directions in the area.     

A comparative study of the multi-objective optimization algorithms for coal-fired boilers

Combustion optimization has been proved to be an effective way to reduce the NOx emissions and unburned carbon in fly ash by carefully setting the operational parameters of boilers. However, there is a trade-off relationship between NOx emissions and the boiler economy, which could be expressed by Pareto solutions. The aim of this work is to achieve multi-objective optimization of the coal-fired boiler to obtain well distributed Pareto solutions. In this study, support vector regression (SVR) was employed to build NOx emissions and carbon burnout models. Thereafter, the improved Strength Pareto Evolutionary Algorithm (SPEA2), the new Multi-Objective Particle Swarm Optimizer (OMOPSO), the Archive-Based hYbrid Scatter Search method (AbYSS), and the cellular genetic algorithm for multi-objective optimization (MOCell) were used for this purpose. The results show that the hybrid algorithms by combining SVR can obtain well distributed Pareto solutions for multi-objective optimization of the boiler. Comparison of various algorithms shows MOCell overwhelms the others in terms of the quality of solutions and convergence rate.     

Design of optimal controllers for spatially invariant systems with finite communication speed

We consider the problem of designing optimal distributed controllers whose impulse response has limited propagation speed. We introduce a state-space framework in which all spatially invariant systems with this property can be characterized. After establishing the closure of such systems under linear fractional transformations, we formulate the H₂ optimal control problem using the model-matching framework. We demonstrate that, even though the optimal control problem is non-convex with respect to some state-space design parameters, a variety of numerical optimization algorithms can be employed to relax the original problem, thereby rendering suboptimal controllers. In particular, for the case in which every subsystem has scalar input disturbance, scalar measurement, and scalar actuation signal, we investigate the application of the Steiglitz–McBride, Gauss–Newton, and Newton iterative schemes to the optimal distributed controller design problem. We apply this framework to examples previously considered in the literature to demonstrate that, by designing structured controllers with infinite impulse response, superior performance can be achieved compared to finite impulse response structured controllers of the same temporal degree.