Application of neural networks to heuristic scheduling algorithms

This paper considers the use of artificial neural networks (ANNs) to model six different heuristic algorithms applied to the n job, m machine real flowshop scheduling problem with the objective of minimizing makespan. The objective is to obtain six ANN models to be used for the prediction of the completion times for each job processed on each machine and to introduce the fuzziness of scheduling information into flowshop scheduling. Fuzzy membership functions are generated for completion, job waiting and machine idle times. Different methods are proposed to obtain the fuzzy parameters. To model the functional relation between the input and output variables, multilayered feedforward networks (MFNs) trained with error backpropagation learning rule are used. The trained network is able to apply the learnt relationship to new problems. In this paper, an implementation alternative to the existing heuristic algorithms is provided. Once the network is trained adequately, it can provide an outcome (solution) faster than conventional iterative methods by its generalizing property. The results obtained from the study can be extended to solve the scheduling problems in the area of manufacturing.     

Dynamic classification of ballistic missiles using neural networks and hidden Markov models

This paper addresses dynamic classification of different ranges of ballistic missiles (BM) for air defense application based on kinematic attributes acquired by radars for taking appropriate measures to intercept them. The problem of dynamic classification is formulated using real-time neural network (RTNN) and hidden Markov model (HMM). The idea behind these algorithms is to calculate the output in one pass rather than training and computing over large number of iterations. Besides, to meet the conflicting requirements of classifying small as well as long-range trajectories, we are also proposing a formulation for partitioning the trajectory by using moving window concept. This concept allows us to use parameters in localized frame which helps in handling wide-range of trajectories to fit into the same network. These algorithms are evaluated using the simulated data generated from 6 degree-of-freedom (6DOF) mathematical model, which models missile trajectories. Experimental results show that both the networks are classifying above 95% with real-time neural network outperforming HMM in terms of time of computation on same data. The small classification time enables the use of real-time classification neural network in complex scenario of multi-radar, multi-target engagement by interceptor missiles. To the best of our knowledge this is the first time an attempt is made to classify ballistic missiles using RTNN and HMM.     

Applications of artificial neural networks to the nonlinear combination of forecasts

Abstract: This paper proposes artificial neural networks (ANN) as a tool for nonlinear combination of forecasts. In this study, three forecasting models are used for individual forecasts, and then two linear combining methods are used to compare with the ANN combining method. The comparative experiment using real-world data shows that the prediction by the ANN method outperforms those by linear combining methods. The paper suggests that the ANN method can be used as an alternative to conventional linear combining methods to achieve greater forecasting accuracy.     

Artificial neural network-based techniques for the retrieval of SWE and snow depth from SSM/I data

The retrieval of snow water equivalent (SWE) and snow depth is performed by inverting Special Sensor Microwave Imager (SSM/I) brightness temperatures at 19 and 37 GHz using artificial neural network ANN-based techniques. The SSM/I used data, which consist of Pathfinder Daily EASE-Grid brightness temperatures, were supplied by the National Snow and Ice Data Centre (NSIDC). They were gathered during the period of time included between the beginning of 1996 and the end of 1999 all over Finland. A ground snow data set based on observations of the Finnish Environment Institute (SYKE) and the Finnish Meteorological Institute (FMI) was used to estimate the performances of the technique. The ANN results were confronted with those obtained using the spectral polarization difference (SPD) algorithm, the HUT model-based iterative inversion and the Chang algorithm, by comparing the RMSE, the R², and the regression coefficients. In general, it was observed that the results obtained through ANN-based technique are better than, or comparable to, those obtained through other approaches, when trained with simulated data. Performances were very good when the ANN were trained with experimental data.     

Application of wavelet neural network in the acoustic logging-while-drilling waveform data processing

Logging-While-Drilling （LWD） is a new well logging technology of petroleum engineering in recent years. Limited by data transmission technology, a large of logging data must be stored in downhole firstly, but the space of the downhole memory is restricted, so an efficient data compression algorithm is demanded imminently. A compression algorithm based on wavelet neural network for acoustic LWD waveform data is presented. The experiment shows that the algorithm has fast network convergent velocity and high compression ratio. The algorithm can meet the need of the real-time acoustic logging data processing.     

链式数据重组与神经网络在经济预测中的应用

建立经济模型和基于模型对宏观经济进行预测,是经济运行质量评价、仿真、制定发展规划等所必不可少的.针对宏观经济预测的特殊性:样本少、时变性,提出了反向传播(BP)神经网络的链式数据重组训练方法,并用于实际经济预测.和原数据用于预测的结果相比,达到了较高的预测精度.同时,解决了BP神经网络难以确定隐结点数的问题.     

Generalization performance of support vector machines and neural networks in runoff modeling

Effective one-day lead runoff prediction is one of the significant aspects of successful water resources management in arid region. For instance, reservoir and hydropower systems call for real-time or on-line site-specific forecasting of the runoff. In this research, we present a new data-driven model called support vector machines (SVMs) based on structural risk minimization principle, which minimizes a bound on a generalized risk (error), as opposed to the empirical risk minimization principle exploited by conventional regression techniques (e.g. ANNs). Thus, this stat-of-the-art methodology for prediction combines excellent generalization property and sparse representation that lead SVMs to be a very promising forecasting method. Further, SVM makes use of a convex quadratic optimization problem; hence, the solution is always unique and globally optimal. To demonstrate the aforementioned forecasting capability of SVM, one-day lead stream flow of Bakhtiyari River in Iran was predicted using the local climate and rainfall data. Moreover, the results were compared with those of ANN and ANN integrated with genetic algorithms (ANN-GA) models. The improvements in root mean squared error (RMSE) and squared correlation coefficient (R²) by SVM over both ANN models indicate that the prediction accuracy of SVM is at least as good as that of those models, yet in some cases actually better, as well as forecasting of high-value discharges.     

Artificial neural network models for the prediction of surface roughness in electrical discharge machining

In the present paper Artificial Neural Networks (ANNs) models are proposed for the prediction of surface roughness in Electrical Discharge Machining (EDM). For this purpose two well-known programs, namely Matlab^® with associated toolboxes, as well as Netlab^®, were emplo- yed. Training of the models was performed with data from an extensive series of EDM experiments on steel grades; the proposed models use the pulse current, the pulse duration, and the processed material as input parameters. The reported results indicate that the proposed ANNs models can satisfactorily predict the surface roughness in EDM. Moreover, they can be considered as valuable tools for the process planning for EDMachining.     

A recursive algorithm based on the extended Kalman filter for the training of feedforward neural models

The extended Kalman filter (EKF) is a well-known tool for the recursive parameter estimation of static and dynamic nonlinear models. In particular, the EKF has been applied to the estimation of the weights of feedforward and recurrent neural network models, i.e. to their training, and shown to be more efficient than recursive and nonrecursive first-order training algorithms; nevertheless, these first applications to the training of neural networks did not fully exploit the potentials of the EKF. In this paper, we analyze the specific influence of the EKF parameters for modeling problems, and propose a variant of this algorithm for the training of feedforward neural models which proves to be very efficient as compared to nonrecursive second-order algorithms. We test the proposed EKF algorithm on several static and dynamic modeling problems, some of them being benchmark problems, and which bring out the properties of the proposed algorithm.     

Improving forecasts of GARCH family models with the artificial neural networks: An application to the daily returns in Istanbul Stock Exchange

In the study, we discussed the ARCH/GARCH family models and enhanced them with artificial neural networks to evaluate the volatility of daily returns for 23.10.1987–22.02.2008 period in Istanbul Stock Exchange. We proposed ANN-APGARCH model to increase the forecasting performance of APGARCH model. The ANN-extended versions of the obtained GARCH models improved forecast results. It is noteworthy that daily returns in the ISE show strong volatility clustering, asymmetry and nonlinearity characteristics.     

A hybrid approach for training recurrent neural networks: application to multi-step-ahead prediction of noisy and large data sets

Noisy and large data sets are extremely difficult to handle and especially to predict. Time series prediction is a problem, which is frequently addressed by researchers in many engineering fields. This paper presents a hybrid approach to handle a large and noisy data set. In fact, a Self Organizing Map (SOM), combined with multiple recurrent neural networks (RNN) has been trained to predict the components of noisy and large data set. The SOM has been developed to construct incrementally a set of clusters. Each cluster has been represented by a subset of data used to train a recurrent neural network. The back propagation through time has been deployed to train the set of recurrent neural networks. To show the performances of the proposed approach, a problem of instruction addresses prefetching has been treated.     

Application of the Gaussian mixture model to drug dissolution profiles prediction

In this paper, the radial basis function-based Gaussian mixture model (GMM) is applied to model and predict drug dissolution profiles in a time-series approach. The Parzen-window method is embedded into the GMM for determining whether the network predictions are derived from interpolation or extrapolation of the training data. A benchmark study on time-series prediction is first used to evaluate and compare the GMM performance with those from other models. The GMM is then used to predict dissolution profiles of a matrix-controlled release theophylline pellet preparation. Performance of the GMM is assessed using the difference and similarity factors, as recommended by the United States Food and Drug Administration for dissolution profile comparison. In addition, bootstrapping is employed to estimate the confidence intervals of the network predictions. The experimental results are analyzed and compared, and implications of the GMM for pharmaceutical product formulation tasks are discussed.     

An artificial neural network approach to the problem of wireless sensors network localization

One of the imperative problems in the realm of wireless sensor networks is the problem of wireless sensors localization. Despite the fact that much research has been conducted in this area, many of the proposed approaches produce unsatisfactory results when exposed to the harsh, uncertain, noisy conditions of a manufacturing environment. In this study, we develop an artificial neural network approach to moderate the effect of the miscellaneous noise sources and harsh factory conditions on the localization of the wireless sensors. Special attention is given to investigate the effect of blockage and ambient conditions on the accuracy of mobile node localization. A simulator, simulating the noisy and dynamic shop conditions of manufacturing environments, is employed to examine the neural network proposed. The neural network performance is also validated through some actual experiments in real-world environment prone to different sources of noise and signal attenuation. The simulation and experimental results demonstrate the effectiveness and accuracy of the proposed methodology.     

Formulating an approach to develop a system for the temporal analysis of clinical trial data: The POSCH AI project

The architecture and requirements of a prototypical system to help in the statistical investigation of causal relationships in a large clinical trial database are discussed. The suitability of techniques from artificial intelligence (AI), statistical analysis, and neural networks are being studied. Back-propagation experiments indicate that it works about as well as other methods but it is doubtful how useful it will be for discovering relationships in the POSCH dataset. Structure discovery techniques from artificial intelligence are being investigated.