Parameter estimation in mathematical models using the real coded genetic algorithms

In this study, parameter estimation in mathematical models using the real coded genetic algorithms (RCGA) approach is presented. Although the RCGA is similar with the binary coded genetic algorithms (BCGA) in terms of genetic process, it has few advantages such as high precision, non-existence of Hamming’s cliff etc., over the BCGA. In this approach, creating initial population and selection procedure are almost the same with the BCGA, but crossover and mutation operations. The proposed approach is implemented on the second order ordinary differential equations modeling the enzyme effusion problem and it is compared with previous approaches. The results indicate that the proposed approach produced better estimated results with respect to previous findings.     

一种改进的实数编码混合遗传算法

为解决简单遗传算法的不成熟收敛和收敛速度慢的问题,针对实数编码遗传算法提出了初始种群的网格分布法,单步遗传操作后的最优个体保留策略,以及改进的动态交叉和自适应变异概率等,并应用上代最优个体替换当代最差个体的种群进化方法和近亲交叉回避机制等措施对其进行了综合改进。算例表明,该改进算法能有效实现全局优化,提高进化效率,对求解复杂的优化问题具有广泛的适应性。     

Evolving comprehensible neural network trees using genetic algorithms

This paper presents a comprehensible neural network tree (CNNTREE). CNNTREE is a proposed general modular neural network structure, where each node in this tree is a comprehensible expert neural network (CENN). One advantage of using CNNTREE is that it is a “gray box”; because it can be interpreted easily for symbolic systems; where each node in the CNNTREE is equivalent for symbolic operator in the symbolic system. Another advantage of CNNTREE is that it can be trained as any normal multi layer feed forward neural network. An evolutionary algorithm is given for designing the CNNTREE. Back propagation is also checked as local learning algorithm that fits for real time learning constraints. The tree generalization and training performance are examined using experiments with a digit recognition problem. The article is published in the original. Elsayed Mostafa. Received the B.Sc. degree in electrical (Communication) Eng., Cairo University at 1967. Dipl.-Ing, and Dr-Ing. from Stuttgart University at 1977, 1981 respectively. He is a member of ECS and EEES. He is currently a professor of electronic circuits, Faculty of Engineering, University of Helwan. Amr Kamel. Graduated from Computer Department, Faculty of Engineering of Ain Shams University, Egypt in 1999, and studying M.Sc. degree in computer engineering from the Faculty of Engineering of Helwan University. His special fields of interest include neural networks and genetic algorithms. Alaa Hamdy. Was born in Giza in Egypt, on August 17, 1966. He graduated from the Telecommunications and Electronics Department, Faculty of Engineering and Technology of Helwan University, Cairo, Egypt in 1989. He received the M.Sc. degree in computer engineering from the same university in 1996 and the Ph.D. degree from the Faculty of Electrical Engineering, Poznan University of Technology, Poland in 2004. Currently he is working as a lecturer in the Faculty of Engineering of Helwan University. His special fields of interest, include image processing, pattern analysis, and machine vision.     

Evolving artificial neural network and imperialist competitive algorithm for prediction oil flow rate of the reservoir

Multiphase flow meters (MPFMs) are utilized to provide quick and accurate well test data in numerous numbers of oil production applications like those in remote or unmanned locations topside exploitations that minimize platform space and subsea applications. Flow rates of phases (oil, gas and water) are most important parameter which is detected by MPFMs. Conventional MPFM data collecting is done in long periods; because of radioactive sources usage as detector and unmanned location due to wells far distance. In this paper, based on a real case of MPFM, a new method for oil rate prediction of wells base on Fuzzy logic, Artificial Neural Networks (ANN) and Imperialist Competitive Algorithm is presented. Temperatures and pressures of lines have been set as input variable of network and oil flow rate as output. In this case a 1600 data set of 50 wells in one of the northern Persian Gulf oil fields of Iran were used to build a database. ICA-ANN can be used as a reliable alternative way without personal and environmental problems. The performance of the ICA-ANN model has also been compared with ANN model and Fuzzy model. The results prove the effectiveness, robustness and compatibility of the ICA-ANN model.     

A neurocomputing model for real coded genetic algorithm with the minimal generation gap

This paper proposes using neural networks (NN) to implement a real coded genetic algorithm (GA) with the center of gravity crossover (CGX) and the minimal generation gap (MGG) model. With all genetic operations of GA including selection, crossover, mutation and evaluation implemented with NN modules, this approach can realize in parallel genetic operations on the whole chromosome to achieve the maximum parallel realization potential of the MGG model of the GA. At the same time expensive hardware for field programmable gate arrays (FPGA) and the high speed memory of hardware for GA can be avoided. The performance of our solution is validated with a suite of benchmark test functions. This paper suggests that implementing GA with NN is a promising research direction for greatly reducing the running time of GA.     

Hybrid real coded genetic algorithm solution to economic dispatch problem

This paper presents a new, two-phase hybrid real coded genetic algorithm (GA) based technique to solve economic dispatch (ED) problem with multiple fuel options. The proposed hybrid scheme is developed in such a way that a simple real coded GA is acting as a base level search, which makes a quick decision to direct the search towards the optimal region, and local optimization by direct search and systematic reduction in size of the search region method is next employed to do the fine tuning. Constraint satisfaction technique has been employed to improve the solution quality and reduce the computational expenses. In order to validate the effectiveness of the proposed hybrid real coded genetic algorithm, the result of 10-generation unit ED problem with multiple fuel options is considered. The result shows that the proposed hybrid algorithm not only improves the solution accuracy and reliability but also makes the algorithm more efficient in terms of number of function evaluations and computation time. The simulation study clearly demonstrates that the proposed hybrid real coded genetic algorithm is practical and valid for real-time applications.     

Evolving artificial neural network structure using grammar encoding and colonial competitive algorithm

Generalization performance of support vector machines (SVM) with Gaussian kernel is influenced by its model parameters, both the error penalty parameter and the Gaussian kernel parameter. After researching the characteristics and properties of the parameter simultaneous variation of support vector machines with Gaussian kernel by the parameter analysis table, a new area distribution model is proposed, which consists of optimal straight line, reference point of area boundary, optimal area, transition area, underfitting area, and overfitting area. In order to improve classification performance of support vector machines, a genetic algorithm based on change area search is proposed. Comparison experiments show that the test accuracy of the genetic algorithm based on change area search is better than that of the two-linear search method.     

实码加速遗传算法在改进TOPSIS法中的应用

为改进TOPSIS法,分别以方案点靠近理想点和远离负理想点为目标,构建非线性规划模型。运用实码加速遗传算法（RAGA）进行求解,可较方便地获得兼具决策方法适应性和决策者偏好的指标综合权重。由此,基于RAGA的改进TOPSIS法可在一定程度上克服传统TOPSIS法的不足。应用实例证明了该方法的可行性和有效性。     

Constructing neural network sediment estimation models using a data-driven algorithm

Artificial neural network (ANN) models are designed for suspended sediment estimation using statistical pre-processing of the data. Statistical properties such as cross-, auto- and partial auto-correlation of the data series are used for identifying a unique input vector to the ANN that best represents the sediment estimation process for a basin. The methodology is evaluated using the flow and sediment data from the stations Quebrada Blanca and Rio Valenciano in USA. The result of the study indicates that the statistical pre-processing of the data could significantly reduce the effort and computational time required in developing an ANN model. Three ANN training algorithms are also compared with each other for the selected input vector.     

遗传算法优化神经网络权值盲均衡算法的研究

将遗传算法与神经网络盲均衡算法相结合,提出了两段式优化神经网络权值的方案。首先利用遗传算法全局搜索能力强的特点优化初始权值,然后发挥BP算法局部搜索速度快的特点得到最佳权值。经计算机仿真表明,该算法与传统BP神经网络盲均衡算法相比,收敛速度加快,稳态剩余误差减小,误码率降低。     

Structure optimization of neural network for dynamic system modeling using multi-objective genetic algorithm

The problem of constructing an adequate and parsimonious neural network topology for modeling non-linear dynamic system is studied and investigated. Neural networks have been shown to perform function approximation and represent dynamic systems. The network structures are usually guessed or selected in accordance with the designer’s prior knowledge. However, the multiplicity of the model parameters makes it troublesome to get an optimum structure. In this paper, an alternative algorithm based on a multi-objective optimization algorithm is proposed. The developed neural network model should fulfil two criteria or objectives namely good predictive accuracy and minimum model structure. The result shows that the proposed algorithm is able to identify simulated examples correctly, and identifies the adequate model for real process data based on a set of solutions called the Pareto optimal set, from which the best network can be selected.     

Nearly optimal neural network stabilization of bipedal standing using genetic algorithm

In this work, stability control of bipedal standing is investigated. The biped is simplified as an inverted pendulum with a foot-link. The controller consists of a general regression neural network (GRNN) feedback control, which stabilizes the inverted pendulum in a region around the upright position, and a PID feedback control, which keeps the pendulum at the upright position. The GRNN controller is also designed to minimize an energy-related cost function while satisfying the constraints between the foot-link and the ground. The optimization has been carried out using the genetic algorithm (GA) and the GRNN is directly trained during optimization iteration process to provide the closed loop feedback optimal controller. The stability of the controlled system is analyzed using the concept of Lyapunov exponents, and a stability region is determined. Simulation results show that the controller can keep the inverted pendulum at the upright position while nearly minimizing an energy-related cost function and keeping the foot-link stationary on the ground. The work contributes to bipedal balancing control, which is important to the development of bipedal robots.     

Optimized scenario for rainfall forecasting using genetic algorithm coupled with artificial neural network

Rainfall forecasting plays many important role in water resources studies such as river training works and design of flood warning systems. Recent advancement in artificial intelligence and in particular techniques aimed at converting input to output for highly nonlinear, non-convex and dimensionalized processes such as rainfall field, provide an alternative approach for developing rainfall forecasting model. Artificial neural networks (ANNs), which perform a nonlinear mapping between inputs and outputs, are such a technique. Current literatures on artificial neural networks show that the selection of network architecture and its efficient training procedure are major obstacles for their daily usage. In this paper, feed-forward type networks will be developed to simulate the rainfall field and a so-called back propagation (BP) algorithm coupled with genetic algorithm (GA) will be used to train and optimize the networks. The technique will be implemented to forecast rainfall for a number of times using rainfall hyetograph of recording rain gauges in the Upper Parramatta catchment in the western suburbs of Sydney, Australia. Results of the study showed the structuring of ANN network with the input parameter selection, when coupled with GA, performed better compared to similar work of using ANN alone.     

Digit and command interpretation for electronic book using neural network and genetic algorithm

This paper presents the interpretation of digits and commands using a modified neural network and the genetic algorithm. The modified neural network exhibits a node-to-node relationship which enhances its learning and generalization abilities. A digit-and-command interpreter constructed by the modified neural networks is proposed to recognize handwritten digits and commands. A genetic algorithm is employed to train the parameters of the modified neural networks of the digit-and-command interpreter. The proposed digit-and-command interpreter is successfully realized in an electronic book. Simulation and experimental results will be presented to show the applicability and merits of the proposed approach.     

VEP optimal channel selection using genetic algorithm for neural network classification of alcoholics.

In this letter, neural networks (NNs) classify alcoholics and nonalcoholics using features extracted from visual evoked potential (VEP). A genetic algorithm (GA) is used to select the minimum number of channels that maximize classification performance. GA population fitness is evaluated using fuzzy ARTMAP (FA) NN, instead of the widely used multilayer perceptron (MLP). MLP, despite its effective classification, requires long training time (on the order of 10(3) times compared to FA). This causes it to be unsuitable to be used with GA, especially for on-line training. It is shown empirically that the optimal channel configuration selected by the proposed method is unbiased, i.e., it is optimal not only for FA but also for MLP classification. Therefore, it is proposed that for future experiments, these optimal channels could be considered for applications that involve classification of alcoholics.     

基于遗传算法的人工神经网络

为克服和改进传统的BP算法的不足,发挥神经网络和遗传算法各自的优势,提出了一种基于遗传算法的神经网络二次训练方法,将遗传算法应用于神经网络的权值训练中,并用神经网络二次训练得到最终结果,降低了计算时间,是一种比较有效的方法。     

Sunflower biomass estimation using a scattering model and a neural network algorithm

Inversion of biomass for sunflower fields using radar backscattering data has been carried out with neural network algorithms. An electromagnetic model is used to generate the scattering coefficients for training and testing of the net. The model is validated with experimental data obtained from the Montespertoli test site during the Remote Sensing Campaign Mac-Europe 91. The inversion results show that the neural network is capable of performing the retrieval with good accuracy. By optimizing the structural complexity of the net, a better inversion result is obtained.     

Design of highly effective multilayer feedforward neural network by using genetic algorithm

This paper presents a highly effective and precise neural network method for choosing the activation functions (AFs) and tuning the learning parameters (LPs) of a multilayer feedforward neural network by using a genetic algorithm (GA). The performance of the neural network mainly depends on the learning algorithms and the network structure. The backpropagation learning algorithm is used for tuning the network connection weights, and the LPs are obtained by the GA to provide both fast and reliable learning. Also, the AFs of each neuron in the network are automatically chosen by a GA. The present study consists of 10 different functions to accomplish a better convergence of the desired input–output mapping. Test studies are performed to solve a set of two-dimensional regression problems for the proposed genetic-based neural network (GNN) and conventional neural network having sigmoid AFs and constant learning parameters. The proposed GNN has also been tested by applying it to three real problems in the fields of environment, medicine, and economics. Obtained results prove that the proposed GNN is more effective and reliable when compared with the classical neural network structure.     

基于快速、 高精度遗传算法神经网络的薄互储层参数预测

针对传统遗传算法（GA）和人工神经网络BP算法各自存在的不足，引入自适应机制的浮点数编码的遗传算法，并将其与BP网中的梯度下降法相结合，进行混合交互运算，形成GA－BP混合算法。该算法使网络具有较快的收敛速度和较高的逼近精度，能较好地解决综合多种地震信息进行薄互集层参数预测的精度和收敛度问题，并通过实例验证了此方法的正确性和实用性。