Multi-criterion Pareto based particle swarm optimized polynomial neural network for classification: A review and state-of-the-art

In this paper, we proposed a multi-objective Pareto based particle swarm optimization (MOPPSO) to minimize the architectural complexity and maximize the classification accuracy of a polynomial neural network (PNN). To support this, we provide an extensive review of the literature on multi-objective particle swarm optimization and PNN. Classification using PNN can be considered as a multi-objective problem rather than as a single objective one. Measures like classification accuracy and architectural complexity used for evaluating PNN based classification can be thought of as two different conflicting criterions. Using these two metrics as the criteria of classification problem, the proposed MOPPSO technique attempts to find out a set of non-dominated solutions with less complex PNN architecture and high classification accuracy. An extensive experimental study has been carried out to compare the importance and effectiveness of the proposed method with the chosen state-of-the-art multi-objective particle swarm optimization (MOPSO) algorithm using several benchmark datasets. A comprehensive bibliography is included for further enhancement of this area.     

A comprehensive survey on functional link neural networks and an adaptive PSO–BP learning for CFLNN

This paper proposed a hybrid genetic based functional link artificial neural network (HFLANN) with simultaneous optimization of input features for the purpose of solving the problem of classification in data mining. The aim of the proposed approach is to choose an optimal subset of input features using genetic algorithm by eliminating features with little or no predictive information and increase the comprehensibility of resulting HFLANN. Using the functionally expanded of selected features, HFLANN overcomes the nonlinearity nature of problems, which is commonly encountered in single-layer neural networks. The features like simplicity of the architecture and low computational complexity of the network encourage us to use it in classification task of data mining. Further, the issue of statistical tests for comparison of algorithms on multiple datasets, which is even more essential to typical machine learning and data mining studies, has been all but ignored. In this work, we recommend a set of simple, yet safe and robust parametric and nonparametric tests for statistical comparisons of HFLANN with FLANN and RBF classifiers over multiple datasets by an extensive simulation studies.     

DE+RBFNs based classification: A special attention to removal of inconsistency and irrelevant features

A novel approach for the classification of both balanced and imbalanced dataset is developed in this paper by integrating the best attributes of radial basis function networks and differential evolution. In addition, a special attention is given to handle the problem of inconsistency and removal of irrelevant features. Removing data inconsistency and inputting optimal and relevant set of features to a radial basis function network may greatly enhance the network efficiency (in terms of accuracy), at the same time compact its size. We use Bayesian statistics for making the dataset consistent, information gain theory (a kind of filter approach) for reducing the features, and differential evolution for tuning center, spread and bias of radial basis function networks. The proposed approach is validated with a few benchmarked highly skewed and balanced dataset retrieved from University of California, Irvine (UCI) repository. Our experimental result demonstrates promising classification accuracy, when data inconsistency and feature selection are considered to design this classifier.     

An improved swarm optimized functional link artificial neural network (ISO-FLANN) for classification

Multilayer perceptron (MLP) (trained with back propagation learning algorithm) takes large computational time. The complexity of the network increases as the number of layers and number of nodes in layers increases. Further, it is also very difficult to decide the number of nodes in a layer and the number of layers in the network required for solving a problem a priori. In this paper an improved particle swarm optimization (IPSO) is used to train the functional link artificial neural network (FLANN) for classification and we name it ISO-FLANN. In contrast to MLP, FLANN has less architectural complexity, easier to train, and more insight may be gained in the classification problem. Further, we rely on global classification capabilities of IPSO to explore the entire weight space, which is plagued by a host of local optima. Using the functionally expanded features; FLANN overcomes the non-linear nature of problems. We believe that the combined efforts of FLANN and IPSO (IPSO + FLANN = ISO ? FLANN) by harnessing their best attributes can give rise to a robust classifier. An extensive simulation study is presented to show the effectiveness of proposed classifier. Results are compared with MLP, support vector machine(SVM) with radial basis function (RBF) kernel, FLANN with gradiend descent learning and fuzzy swarm net (FSN).     

A hybrid genetic based functional link artificial neural network with a statistical comparison of classifiers over multiple datasets

This paper proposed a hybrid genetic based functional link artificial neural network (HFLANN) with simultaneous optimization of input features for the purpose of solving the problem of classification in data mining. The aim of the proposed approach is to choose an optimal subset of input features using genetic algorithm by eliminating features with little or no predictive information and increase the comprehensibility of resulting HFLANN. Using the functionally expanded of selected features, HFLANN overcomes the nonlinearity nature of problems, which is commonly encountered in single-layer neural networks. The features like simplicity of the architecture and low computational complexity of the network encourage us to use it in classification task of data mining. Further, the issue of statistical tests for comparison of algorithms on multiple datasets, which is even more essential to typical machine learning and data mining studies, has been all but ignored. In this work, we recommend a set of simple, yet safe and robust parametric and nonparametric tests for statistical comparisons of HFLANN with FLANN and RBF classifiers over multiple datasets by an extensive simulation studies.     

Optimization of Hot Rolled Coil Widths Using a Genetic Algorithm

This paper focuses on the assortment problem in the steel industry; with the help of the genetic algorithm, it attempts to determine the optimum width of the parent stock given a set of forecasted customer widths so that the trim loss is minimized. For each given set of forecasted customer widths, an attempt is made to find a single width of the mother coil to be manufactured and kept in stock. In the genetic algorithm, six different selection schemes are considered. A number of test problems are taken up for different selection schemes. Evaluated against the maximum fitness value, the optimal mother coil width, and the generation number at which they are achieved, the elitism selection scheme shows consistently good results in all the test problems compared with the other selection mechanisms.