A comparison of standard spell checking algorithms and a novel binary neural approach

In this paper, we propose a simple, flexible, and efficient hybrid spell checking methodology based upon phonetic matching, supervised learning, and associative matching in the AURA neural system. We integrate Hamming Distance and n-gram algorithms that have high recall for typing errors and a phonetic spell-checking algorithm in a single novel architecture. Our approach is suitable for any spell checking application though aimed toward isolated word error correction, particularly spell checking user queries in a search engine. We use a novel scoring scheme to integrate the retrieved words from each spelling approach and calculate an overall score for each matched word. From the overall scores, we can rank the possible matches. We evaluate our approach against several benchmark spellchecking algorithms for recall accuracy. Our proposed hybrid methodology has the highest recall rate of the techniques evaluated. The method has a high recall rate and low-computational cost.     

A new convex objective function for the supervised learning of single-layer neural networks

This paper proposes a novel supervised learning method for single-layer feedforward neural networks. This approach uses an alternative objective function to that based on the MSE, which measures the errors before the neuron's nonlinear activation functions instead of after them. In this case, the solution can be easily obtained solving systems of linear equations, i.e., requiring much less computational power than the one associated with the regular methods. A theoretical study is included to proof the approximated equivalence between the global optimum of the objective function based on the regular MSE criterion and the one of the proposed alternative MSE function.Furthermore, it is shown that the presented method has the capability of allowing incremental and distributed learning. An exhaustive experimental study is also presented to verify the soundness and efficiency of the method. This study contains 10 classification and 16 regression problems. In addition, a comparison with other high performance learning algorithms shows that the proposed method exhibits, in average, the highest performance and low-demanding computational requirements.     

A novel compensation-based recurrent fuzzy neural network and its learning algorithm

Based on detailed study on several kinds of fuzzy neural networks, we propose a novel compensation-based recurrent fuzzy neural network (CRFNN) by adding recurrent element and compensatory element to the conventional fuzzy neural network. Then, we propose a sequential learning method for the structure identification of the CRFNN in order to confirm the fuzzy rules and their correlative parameters effectively. Furthermore, we improve the BP algorithm based on the characteristics of the proposed CRFNN to train the network. By modeling the typical nonlinear systems, we draw the conclusion that the proposed CRFNN has excellent dynamic response and strong learning ability. Supported by the National High-Tech Research and Development Program of China (Grant No. 2006AA05A107) and Special Fund of Jiangsu Province for Technology Transfer (Grant No. BA2007008)     

Chaos control and associative memory of a time-delay globally coupled neural network using symmetric map

A chaotic neural network called time-delay globally coupled neural network using symmetric map (TDSG) is proposed for information processing applications. Firstly, its rich dynamic behaviors are exhibited and the output stability is demonstrated by using a parameter modulated control method. Secondly, the associative memory of TDSG is investigated by the control method. It is observed that the stable output sequence only contains stored pattern and its reverse pattern and the TDSG finally converges to the stored pattern which has the smallest Hamming distance to the initial patterns with noise. At last, strong information recovery ability of the TDSG is illustrated by comparative experiments.     

A simulational comparison of intelligent control algorithms on a direct drive manipulator

This paper investigates the control of nonlinear systems by neural networks and fuzzy logic. As the control methods, Gaussian neuro-fuzzy variable structure (GNFVS), feedback error learning architecture (FELA) and direct inverse modeling architecture (DIMA) are studied, and their performances are comparatively evaluated on a two degrees of freedom direct drive robotic manipulator with respect to trajectory tracking performance, computational complexity, design complexity, RMS errors, necessary training time in learning phase and payload variations.     

A new discretization algorithm based on range coefficient of dispersion and skewness for neural networks classifier

In this paper we propose a new static, global, supervised, incremental and bottom-up discretization algorithm based on coefficient of dispersion and skewness of data range. It automates the discretization process by introducing the number of intervals and stopping criterion. The results obtained using this discretization algorithm show that the discretization scheme generated by the algorithm almost has minimum number of intervals and requires smallest discretization time. The feedforward neural network with conjugate gradient training algorithm is used to compute the accuracy of classification from the data discretized by this algorithm. The efficiency of the proposed algorithm is shown in terms of better discretization scheme and better accuracy of classification by implementing it on six different real data sets.     

A novel analysis and design of a neural network assisted nonlinear controller for a bioreactor

A novel approach is presented for the analysis and the design of a controller for a bioreactor. It is based on the model reference control theory, assisted by a neural network identifier. The control objectives specified in the paper require the controller to be a nonlinear one, however, it is shown that it is stable in the sense of bounded input bounded output and locally stabilizing in the sense of Lyapunov. The feasibility and the efficacy of the proposed approach are tested on the benchmark problem. Copyright © 1999 John Wiley & Sons, Ltd.     

A novel hybrid learning algorithm for full Bayesian approach of artificial neural networks

The Bayesian neural networks are useful tools to estimate the functional structure in the nonlinear systems. However, they suffer from some complicated problems such as controlling the model complexity, the training time, the efficient parameter estimation, the random walk, and the stuck in the local optima in the high-dimensional parameter cases. In this paper, to alleviate these mentioned problems, a novel hybrid Bayesian learning procedure is proposed. This approach is based on the full Bayesian learning, and integrates Markov chain Monte Carlo procedures with genetic algorithms and the fuzzy membership functions. In the application sections, to examine the performance of proposed approach, nonlinear time series and regression analysis are handled separately, and it is compared with the traditional training techniques in terms of their estimation and prediction abilities.     

A comparison of experimental designs in the development of a neural network simulation metamodel

In this case study, we investigate the effects of experimental design on the development of artificial neural networks as simulation metamodels. A simple, deterministic combat model developed within the paradigm of system dynamics provides the underlying simulation. The neural network metamodels are developed using six different experimental design approaches. These include a traditional full factorial design, a random sampling design, a central composite design, a modified Latin Hypercube design and designs supplemented with domain knowledge. The results from this case study show how much impact the experimental design chosen for the neural network training set can have on the predictive accuracy achieved by the metamodel. We compare the networks in terms of various performance measures. The neural network developed from the modified Latin Hypercube design supplemented with domain knowledge produces the best performance, outperforming networks developed from other designs of the same size.     

A comparison of dispatching rules and genetic algorithms for job shop schedules of standard hydraulic cylinders

Hydraulic cylinders perform straight-line reciprocating movements, and they have been used widely in various forms in many different industries. In this paper, we select a sample of the various types of standard hydraulic cylinders. Each cylinder’s near-optimal processing time and the processing order of the cylinder’s parts are investigated using two different techniques. First, we study typical procedures, known as ‘Dispatching Rules’, which would be used in a job shop to resolve scheduling problems. Second, we investigate another kind of technique, called ‘Genetic Algorithms’. The goal of this paper, we show that efficient scheduling solutions are calculated by using dispatching rules and genetic algorithms for manufacturing standard hydraulic cylinders, and we propose that a way to use dispatching rules in association with genetic algorithms should be considered for resolving job shop scheduling problems.     

A comparison of neural network and multiple regression analysis in modeling capital structure

Empirical studies of the variation in debt ratios across firms have used statistical models singularly to analyze the important determinants of capital structure. Researchers, however, rarely employ non-linear models to examine the determinants and make little effort to identify a superior prediction model. This study adopts multiple linear regressions and artificial neural networks (ANN) models with seven explanatory variables of corporation’s feature and three external macro-economic control variables to analyze the important determinants of capital structures of the high-tech and traditional industries in Taiwan, respectively. Results of this study show that the determinants of capital structure are different in both industries. The major different determinants are business-risk and growth opportunities. Based on the values of RMSE, the ANN models achieve a better fit and forecast than the regression models for debt ratio, and ANNs are cable of catching sophisticated non-linear integrating effects in both industries. It seems that the relationships between debt ratio and independent variables are not linear. Managers can apply these results for their dynamic adjustment of capital structure in achieving optimality and maximizing firm’s value.     

A new robust training algorithm for a class of single-hidden layer feedforward neural networks

A robust training algorithm for a class of single-hidden layer feedforward neural networks (SLFNs) with linear nodes and an input tapped-delay-line memory is developed in this paper. It is seen that, in order to remove the effects of the input disturbances and reduce both the structural and empirical risks of the SLFN, the input weights of the SLFN are assigned such that the hidden layer of the SLFN performs as a pre-processor, and the output weights are then trained to minimize the weighted sum of the output error squares as well as the weighted sum of the output weight squares. The performance of an SLFN-based signal classifier trained with the proposed robust algorithm is studied in the simulation section to show the effectiveness and efficiency of the new scheme.     

A comparison between functional networks and artificial neural networks for the prediction of fishing catches

In recent years, functional networks have emerged as an extension of artificial neural networks (ANNs). In this article, we apply both network techniques to predict the catches of the Prionace Glauca (a class of shark) and the Katsowonus Pelamis (a variety of tuna, more commonly known as the Skipjack). We have developed an application that will help reduce the search time for good fishing zones and thereby increase the fleets competitivity. Our results show that, thanks to their superior learning and generalisation capacities, functional networks are more efficient than ANNs. Our data proceeds from remote sensors. Their spectral signatures allow us to calculate products that are useful for ecological modelling. After an initial phase of digital image processing, we created a database that provides all the necessary patterns to train both network types.     

A comparison of linear and neural network ARX models applied to a prediction of the indoor temperature of a building

A neural network auto regressive with exogenous input (NNARX) model is used to predict the indoor temperature of a residential building. Firstly, the optimal regressor of a linear ARX model is identified by minimising Akaikes final prediction error (FPE). This regressor is then used as the input vector of a fully connected feedforward neural network with one hidden layer of ten units and one output unit. Results show that the NNARX model outperforms the linear model considerably: the sum of the squared error (SSE) is 15.0479 with the ARX model and 2.0632 with the NNARX model. The optimal network topology is subsequently determined by pruning the fully connected network according to the optimal brain surgeon (OBS) strategy. With this procedure near 73% of connections were removed and, as a result, the performance of the network has been improved: the SSE is equal to 0.9060.     

连续小波过程神经网络及其仿真研究

在小波分析和过程神经网络理论的基础上，提出了连续小波过程神经网络模型，其隐层为过程神经元，隐层激活函数采用小波函数．该网络结合了小波变换良好的时一频局域化性质及过程神经网络可以处理连续输入信号的特点，因而学习能力强，精度高．给出了小波过程神经网络学习算法，并以航空发动机滑油系统状态监测为例，分别利用传统BP网络和小波过程神经网络进行预测．结果表明，小波过程神经网络收敛速度快，精度高，优于BP网络的预测能力，同时也为航空发动机滑油系统状态监测问题提供了一种有效的方法．     

A hybrid learning algorithm for a class of interval type-2 fuzzy neural networks

In real life, information about the world is uncertain and imprecise. The cause of this uncertainty is due to: deficiencies on given information, the fuzzy nature of our perception of events and objects, and on the limitations of the models we use to explain the world. The development of new methods for dealing with information with uncertainty is crucial for solving real life problems. In this paper three interval type-2 fuzzy neural network (IT2FNN) architectures are proposed, with hybrid learning algorithm techniques (gradient descent backpropagation and gradient descent with adaptive learning rate backpropagation). At the antecedents layer, a interval type-2 fuzzy neuron (IT2FN) model is used, and in case of the consequents layer an interval type-1 fuzzy neuron model (IT1FN), in order to fuzzify the rule’s antecedents and consequents of an interval type-2 Takagi-Sugeno-Kang fuzzy inference system (IT2-TSK-FIS). IT2-TSK-FIS is integrated in an adaptive neural network, in order to take advantage the best of both models. This provides a high order intuitive mechanism for representing imperfect information by means of use of fuzzy If-Then rules, in addition to handling uncertainty and imprecision. On the other hand, neural networks are highly adaptable, with learning and generalization capabilities. Experimental results are divided in two kinds: in the first one a non-linear identification problem for control systems is simulated, here a comparative analysis of learning architectures IT2FNN and ANFIS is done. For the second kind, a non-linear Mackey-Glass chaotic time series prediction problem with uncertainty sources is studied. Finally, IT2FNN proved to be more efficient mechanism for modeling real-world problems.     

A novel hybrid classification model of artificial neural networks and multiple linear regression models

The classification problem of assigning several observations into different disjoint groups plays an important role in business decision making and many other areas. Developing more accurate and widely applicable classification models has significant implications in these areas. It is the reason that despite of the numerous classification models available, the research for improving the effectiveness of these models has never stopped. Combining several models or using hybrid models has become a common practice in order to overcome the deficiencies of single models and can be an effective way of improving upon their predictive performance, especially when the models in combination are quite different. In this paper, a novel hybridization of artificial neural networks (ANNs) is proposed using multiple linear regression models in order to yield more general and more accurate model than traditional artificial neural networks for solving classification problems. Empirical results indicate that the proposed hybrid model exhibits effectively improved classification accuracy in comparison with traditional artificial neural networks and also some other classification models such as linear discriminant analysis (LDA), quadratic discriminant analysis (QDA), K-nearest neighbor (KNN), and support vector machines (SVMs) using benchmark and real-world application data sets. These data sets vary in the number of classes (two versus multiple) and the source of the data (synthetic versus real-world). Therefore, it can be applied as an appropriate alternate approach for solving classification problems, specifically when higher forecasting accuracy is needed.     

基于神经网络建模和遗传算法的重油脱盐系统优化研究

概述了重油脱盐系统的BP神经网络建模以及基于遗传算法的系统优化过程,将遗传算法与惩罚函数法相结合应用于约束优化的问题,改善了遗传算法的局限性。同时为了将不等式约束优化问题转化为单目标优化问题,对惩罚函数法进行了改进。结果表明：此方法可以有效解决静电脱盐问题。     

A Theoretical and Empirical Study of a Noise-Tolerant Algorithm to Learn Geometric Patterns

Developing the ability to recognize a landmark from a visual image of a robot's current location is a fundamental problem in robotics. We describe a way in which the landmark matching problem can be mapped to that of learning a one-dimensional geometric pattern. The first contribution of our work is an efficient noise-tolerant algorithm (designed using the statistical query model) to PAC learn the class of one-dimensional geometric patterns. The second contribution of our work is an empirical study of our algorithm that provides some evidence that statistical query algorithms may be valuable for use in practice for handling noisy data.     

A concise functional neural network computing the largest modulus eigenvalues and their corresponding eigenvectors of a real skew matrix

Quick extraction of the largest modulus eigenvalues of a real antisymmetric matrix is important for some engineering applications. As neural network runs in concurrent and asynchronous manner in essence, using it to complete this calculation can achieve high speed. This paper introduces a concise functional neural network (FNN), which can be equivalently transformed into a complex differential equation, to do this work. After obtaining the analytic solution of the equation, the convergence behaviors of this FNN are discussed. Simulation result indicates that with general initial complex values, the network will converge to the complex eigenvector which corresponds to the eigenvalue whose imaginary part is positive, and modulus is the largest of all eigenvalues. Comparing with other neural networks designed for the like aim, this network is applicable to real skew matrices.