Empirical comparisons of feed-forward connectionist and conventional regression models for prediction of first lactation 305-day milk yield in Karan Fries dairy cows

In this paper, two connectionist models are proposed based on different learning paradigms, viz., back propagation neural networks (BPNN) and radial basis function neural networks (RBFNN) to predict the first lactation 305-day milk yield (FLMY305) in Karan Fries (KF) dairy cattle. Also, a conventional multiple linear regression (MLR) model is developed for the prediction. In this study, all the models have been developed using a scientifically determined optimum dataset of representative breeding traits of the cattle. The prediction performances of the connectionist models are compared with that of the conventional model. This study shows that the RBFNN model performs relatively better than the MLR model. However, the BPNN model performs more or less in the close vicinity of the conventional MLR model. Hence, it is inferred that the connectionist models have potential as an alternative to the conventional models for predicting FLMY305 in KF cattle.     

A nonmonotone scaled conjugate gradient algorithm for large-scale unconstrained optimization

This paper proposes a nonmonotone scaled conjugate gradient algorithm for solving large-scale unconstrained optimization problems, which combines the idea of scaled memoryless Broyden–Fletcher–Goldfarb–Shanno preconditioned conjugate gradient method with the nonmonotone technique. An attractive property of the proposed method is that the search direction always provides sufficient descent step at each iteration. This property is independent of the line search used. Under appropriate assumptions, the method is proven to possess global convergence for nonconvex smooth functions, and R-linear convergence for strongly convex functions. Preliminary numerical results and related comparisons show the efficiency of the proposed method in practical computation.     

Development of a hybrid PSO–ANN model for estimating glucose and xylose yields for microwave-assisted pretreatment and the enzymatic hydrolysis of lignocellulosic biomass

In this paper, two artificial intelligent systems, the artificial neural network (ANN) and particle swarm optimization (PSO), were combined to form a hybrid PSO–ANN model that was used to improve estimates of glucose and xylose yields from the microwave–acid pretreatment and enzymatic hydrolysis of lignocellulosic biomass based on pretreatment parameters. ANN is a powerful tool capable of determining the relationship between the desired input and output data while PSO was used as a robust population-based search algorithm to optimize the performance of the ANN model. Specifically, it was used to determine the optimum number of neurons in the hidden layer and the best value of the learning rate of the ANN model. The optimization method includes minimizing the fitness function mean absolute error that was found to be 0.0176. The PSO algorithm suggested an optimum number of neurons in the hidden layer as 15 and a learning rate of 0.761 these consequently used to construct the ANN model. After constructing the hybrid PSO–ANN model, the performance of the intelligent system was examined by determining the regression coefficient (R ²) for estimating the experimental values of glucose and xylose and compared to the results from a response surface methodology (RSM) model. The results of R ² of the hybrid PSO–ANN model for glucose and xylose were 0.9939 and 0.9479, respectively, while the RSM model results for the same sugars were 0.8901 and 0.8439. This analysis reveals that the hybrid PSO–ANN model offers a higher degree of accuracy in comparison with the more commonly used RSM model.

     

Prediction of performance and exhaust emissions of a diesel engine fueled with biodiesel produced from waste frying palm oil

Biodiesel is receiving increasing attention each passing day because of its fuel properties and compatibility with the petroleum-based diesel fuel (PBDF). Therefore, in this study, the prediction of the engine performance and exhaust emissions is carried out for five different neural networks to define how the inputs affect the outputs using the biodiesel blends produced from waste frying palm oil. PBDF, B100, and biodiesel blends with PBDF, which are 50% (B50), 20% (B20) and 5% (B5), were used to measure the engine performance and exhaust emissions for different engine speeds at full load conditions. Using the artificial neural network (ANN) model, the performance and exhaust emissions of a diesel engine have been predicted for biodiesel blends. According to the results, the fifth network is sufficient for all the outputs. In the fifth network, fuel properties, engine speed, and environmental conditions are taken as the input parameters, while the values of flow rates, maximum injection pressure, emissions, engine load, maximum cylinder gas pressure, and thermal efficiency are used as the output parameters. For all the networks, the learning algorithm called back-propagation was applied for a single hidden layer. Scaled conjugate gradient (SCG) and Levenberg–Marquardt (LM) have been used for the variants of the algorithm, and the formulations for outputs obtained from the weights are given in this study. The fifth network has produced R² values of 0.99, and the mean % errors are smaller than five except for some emissions. Higher mean errors are obtained for the emissions such as CO, NO_x and UHC. The complexity of the burning process and the measurement errors in the experimental study can cause higher mean errors.     

Conjugate gradient methods for the Rayleigh quotient minimization of generalized eigenvalue problems

Here we consider a modified version of the Rayleigh quotient conjugate gradient method of Bradbury and Fletcher for the computation of the smallest eigenvalue and a corresponding eigenvector ofAx=λBx, whereA andB are real symmetric andB is positive definite. Global convergence to an eigenpair is proved and, under certain conditions, convergence to the lowest eigenpair is obtained.     

Prediction of seismic slope stability through combination of particle swarm optimization and neural network

One of the main concerns in geotechnical engineering is slope stability prediction during the earthquake. In this study, two intelligent systems namely artificial neural network (ANN) and particle swarm optimization (PSO)–ANN models were developed to predict factor of safety (FOS) of homogeneous slopes. Geostudio program based on limit equilibrium method was utilized to obtain 699 FOS values with different conditions. The most influential factors on FOS such as slope height, gradient, cohesion, friction angle and peak ground acceleration were considered as model inputs in the present study. A series of sensitivity analyses were performed in modeling procedures of both intelligent systems. All 699 datasets were randomly selected to 5 different datasets based on training and testing. Considering some model performance indices, i.e., root mean square error, coefficient of determination (R ²) and value account for (VAF) and using simple ranking method, the best ANN and PSO–ANN models were selected. It was found that the PSO–ANN technique can predict FOS with higher performance capacities compared to ANN. R ² values of testing datasets equal to 0.915 and 0.986 for ANN and PSO–ANN techniques, respectively, suggest the superiority of the PSO–ANN technique.     

Early prostate cancer diagnosis by using artificial neural networks and support vector machines

The aim of this study is to design a classifier based expert system for early diagnosis of the organ in constraint phase to reach informed decision making without biopsy by using some selected features. The other purpose is to investigate a relationship between BMI (body mass index), smoking factor, and prostate cancer. The data used in this study were collected from 300 men (100: prostate adenocarcinoma, 200: chronic prostatism or benign prostatic hyperplasia). Weight, height, BMI, PSA (prostate specific antigen), Free PSA, age, prostate volume, density, smoking, systolic, diastolic, pulse, and Gleason score features were used and independent sample t-test was applied for feature selection. In order to classify related data, we have used following classifiers; scaled conjugate gradient (SCG), Broyden–Fletcher–Goldfarb–Shanno (BFGS), and Levenberg–Marquardt (LM) training algorithms of artificial neural networks (ANN) and linear, polynomial, and radial based kernel functions of support vector machine (SVM). It was determined that smoking is a factor increases the prostate cancer risk whereas BMI is not affected the prostate cancer. Since PSA, volume, density, and smoking features were to be statistically significant, they were chosen for classification. The proposed system was designed with polynomial based kernel function, which had the best performance (accuracy: 79%). In Turkish Family Health System, family physician to whom patients are applied firstly, would contribute to extract the risk map of illness and direct patients to correct treatments by using expert system such proposed.     

Performance of radial basis and LM-feed forward artificial neural networks for predicting daily watershed runoff

This study investigated the effects of upstream stations’ flow records on the performance of artificial neural network (ANN) models for predicting daily watershed runoff. As a comparison, a multiple linear regression (MLR) analysis was also examined using various statistical indices. Five streamflow measuring stations on the Cahaba River, Alabama, were selected as case studies. Two different ANN models, multi layer feed forward neural network using Levenberg–Marquardt learning algorithm (LMFF) and radial basis function (RBF), were introduced in this paper. These models were then used to forecast one day ahead streamflows. The correlation analysis was applied for determining the architecture of each ANN model in terms of input variables. Several statistical criteria (RMSE, MAE and coefficient of correlation) were used to check the model accuracy in comparison with the observed data by means of K-fold cross validation method. Additionally, residual analysis was applied for the model results. The comparison results revealed that using upstream records could significantly increase the accuracy of ANN and MLR models in predicting daily stream flows (by around 30%). The comparison of the prediction accuracy of both ANN models (LMFF and RBF) and linear regression method indicated that the ANN approaches were more accurate than the MLR in predicting streamflow dynamics. The LMFF model was able to improve the average of root mean square error (RMSE_ave) and average of mean absolute percentage error (MAPE_ave) values of the multiple linear regression forecasts by about 18% and 21%, respectively. In spite of the fact that the RBF model acted better for predicting the highest range of flow rate (flood events, RMSE_ave/RBF = 26.8 m³/s vs. RMSE_ave/LMFF = 40.2 m³/s), in general, the results suggested that the LMFF method was somehow superior to the RBF method in predicting watershed runoff (RMSE/LMFF = 18.8 m³/s vs. RMSE/RBF = 19.2 m³/s). Eventually, statistical differences between measured and predicted medians were evaluated using Mann-Whitney test, and differences in variances were evaluated using the Levene's test.     

A combination of Genetic Algorithm,Particle Swarm Optimization and Neural Network for palmprint recognition

In this study, a new approach to the palmprint recognition phase is presented. 2D Gabor filters are used for feature extraction of palmprints. After Gabor filtering, standard deviations are computed in order to generate the palmprint feature vector. Genetic Algorithm-based feature selection is used to select the best feature subset from the palmprint feature set. An Artificial Neural Network (ANN) based on hybrid algorithm combining Particle Swarm Optimization (PSO) algorithm with back-propagation algorithms has been applied to the selected feature vectors for recognition of the persons. Network architecture and connection weights of ANN are evolved by a PSO method, and then, the appropriate network architecture and connection weights are fed into ANN. Recognition rate equal to 96% is obtained by using conjugate gradient descent algorithm.

     

ANN based simulation and experimental verification of analytical four- and five-parameters models of PV modules

In this article, artificial neural network (ANN) is adopted to predict photovoltaic (PV) panel behaviors under realistic weather conditions. ANN results are compared with analytical four and five parameter models of PV module. The inputs of the models are the daily total irradiation, air temperature and module voltage, while the outputs are the current and power generated by the panel. Analytical models of PV modules, based on the manufacturer datasheet values, are simulated through Matlab/Simulink environment. Multilayer perceptron is used to predict the operating current and power of the PV module. The best network configuration to predict panel current had a 3–7–4–1 topology. So, this two hidden layer topology was selected as the best model for predicting panel current with similar conditions. Results obtained from the PV module simulation and the optimal ANN model has been validated experimentally. Results showed that ANN model provide a better prediction of the current and power of the PV module than the analytical models. The coefficient of determination (R²), mean square error (MSE) and the mean absolute percentage error (MAPE) values for the optimal ANN model were 0.971, 0.002 and 0.107, respectively. A comparative study among ANN and analytical models was also carried out. Among the analytical models, the five-parameter model, with MAPE = 0.112, MSE = 0.0026 and R² = 0.919, gave better prediction than the four-parameter model (with MAPE = 0.152, MSE = 0.0052 and R² = 0.905). Overall, the 3–7–4–1 ANN model outperformed four-parameter model, and was marginally better than the five-parameter model.     

Prediction of feed abrasive value by artificial neural networks and multiple linear regression

In order to evaluate rapid testing methods based on the relationship between feed abrasive value (FAV) and physicochemical properties (particle size, bulk density, dry matter (DM), soluble dry matter, water-holding capacity (WHC), ash, crud protein, neutral detergent fiber (NDF), physically effective NDF and non-fibrous carbohydrates (NFC)), 100 empirical dataset were used. Relationships were investigated using multiple linear regression (MLR) and artificial neural networks (ANNs). The mean relative error was significantly (P?<?0.01) lower for ANN than MLR model. Globally, the non-linear ANN model approach is shown to provide a better prediction of FAV than linear multiple regression.     

Nonlinear regression in environmental sciences using extreme learning machines: A comparative evaluation

The extreme learning machine (ELM), a single-hidden layer feedforward neural network algorithm, was tested on nine environmental regression problems. The prediction accuracy and computational speed of the ensemble ELM were evaluated against multiple linear regression (MLR) and three nonlinear machine learning (ML) techniques – artificial neural network (ANN), support vector regression and random forest (RF). Simple automated algorithms were used to estimate the parameters (e.g. number of hidden neurons) needed for model training. Scaling the range of the random weights in ELM improved its performance. Excluding large datasets (with large number of cases and predictors), ELM tended to be the fastest among the nonlinear models. For large datasets, RF tended to be the fastest. ANN and ELM had similar skills, but ELM was much faster than ANN except for large datasets. Generally, the tested ML techniques outperformed MLR, but no single method was best for all the nine datasets.     

Modeling glass-forming ability of bulk metallic glasses using computational intelligent techniques

Modeling the glass-forming ability (GFA) of bulk metallic glasses (BMGs) is one of the hot issues ever since bulk metallic glasses (BMGs) are discovered. It is very useful for the development of new BMGs for various engineering applications, if GFA criterion modeled precisely. In this paper, we have proposed support vector regression (SVR), artificial neural network (ANN), general regression neural network (GRNN), and multiple linear regression (MLR) based computational intelligent (CI) techniques that model the maximum section thickness (D_max) parameter for glass forming alloys. For this study, a reasonable large number of BMGs alloys are collected from the current literature of material science. CI models are developed using three thermal characteristics of glass forming alloys i.e., glass transition temperature (T_g), the onset crystallization temperature (T_x), and liquidus temperature (T_l). The R²-values of GRNN, SVR, ANN, and MLR models are computed to be 0.5779, 0.5606, 0.4879, and 0.2611 for 349 BMGs alloys, respectively. We have investigated that GRNN model is performing better than SVR, ANN, and MLR models. The performance of proposed models is compared to the existing physical modeling and statistical modeling based techniques. In this study, we have investigated that proposed CI approaches are more accurate in modeling the experimental D_max than the conventional GFA criteria of BMGs alloys.     

Estimation of pressuremeter modulus and limit pressure of clayey soils by various artificial neural network models

The main purpose of the present study is to develop some artificial neural network (ANN) models for the prediction of limit pressure (P _L) and pressuremeter modulus (E _M) for clayey soils. Moisture content, plasticity index, and SPT values are used as inputs in the ANN models. To get plausible results, the number of hidden layer neurons in all models is varied between 1 and 5. In addition, both linear and nonlinear activation functions are considered for the neurons in output layers while a nonlinear activation function is employed for the neurons in the hidden layers of all models. Logistic activation function is used as a nonlinear activation function. During the modeling studies, total eight different ANN models are constructed. The ANN models having two outputs produced the worst results, independent from activation function. However, for P _L, the best results are obtained from the feed-forward neural network with five neurons in the hidden layer, and logistic activation function is employed in the output neuron. For E _M, the best model producing the most acceptable results is Elman recurrent network model, which has 4 neurons in the neurons in the hidden layer, and linear activation function is used for the output neuron. Finally, the results show that the ANN models produce the more accurate results than the regression-based models. In the literature, when empirical equations based on regression analysis were used, the best root mean square error (RMSE) values obtained to date for P _L and E _M have been 0.43 and 5.65, respectively. In this study, RMSE values for P _L and E _M were found to be 0.20 and 2.99, respectively, by using ANN models. It was observed that using ANN approach drastically increases the prediction accuracy in terms of RMSE criterion.     

Research on axial bearing capacity of rectangular concrete-filled steel tubular columns based on artificial neural networks

Design of rectangular concrete-filled steel tubular (CFT) columns has been a big concern owing to their complex constraint mechanism. Generally, most existing methods are based on simplified mechanical model with limited experimental data, which is not reliable under many conditions, e.g., columns using high strength materials. Artificial neural network (ANN) models have shown the effectiveness to solve complex problems in many areas of civil engineering in recent years. In this paper, ANN models were employed to predict the axial bearing capacity of rectangular CFT columns based on the experimental data. 305 experimental data from articles were collected, and 275 experimental samples were chosen to train the ANN models while 30 experimental samples were used for testing. Based on the comparison among different models, artificial neural network model1 (ANN1) and artificial neural network model2 (ANN2) with a 20-neuron hidden layer were chosen as the fit prediction models. ANN1 has five inputs: the length (D) and width (B) of cross section, the thickness of steel (t), the yield strength of steel (f _y), the cylinder strength of concrete (f′_c). ANN2 has ten inputs: D, B, t, f _y, f′_c, the length to width ratio (D/B), the length to thickness ratio (D/t), the width to thickness ratio (B/t), restraint coefficient (ξ), the steel ratio (α). The axial bearing capacity is the output data for both models.The outputs from ANN1 and ANN2 were verified and compared with those from EC4, ACI, GJB4142 and AISC360-10. The results show that the implemented models have good prediction and generalization capacity. Parametric study was conducted using ANN1 and ANN2 which indicates that effect law of basic parameters of columns on the axial bearing capacity of rectangular CFT columns differs from design codes.The results also provide convincing design reference to rectangular CFT columns.     

Sequence Input-Based Quantum-Inspired Neural Networks with Applications

To enhance the approximation and generalization ability of artificial neural networks (ANNs) by employing the principle of quantum rotation gate and controlled-not gate, a quantum-inspired neuron with sequence input is proposed. In the proposed model, the discrete sequence input is represented by the qubits, which, as the control qubits of the controlled-not gate after being rotated by the quantum rotation gates, control the target qubit for reverse. The model output is described by the probability amplitude of state \(|1\rangle \) in the target qubit. Then a quantum-inspired neural networks (QINN) is designed by employing the quantum-inspired neurons to the hidden layer and the common neurons to the output layer. The algorithm of QINN is derived by employing the Levenberg–Marquardt algorithm. Simulation results of some benchmark problems show that, under a certain condition, the QINN is obviously superior to the classical ANN.     

ANN-based GA for generating the sizing curve of stand-alone photovoltaic systems

Recent advances in artificial intelligence techniques have allowed the application of such technologies in real engineering problems. In this paper, an artificial neural network-based genetic algorithm (ANN-GA) model was developed for generating the sizing curve of stand-alone photovoltaic (SAPV) systems. Due to the high computing time needed for generating the sizing curves and complex architecture of the neural networks, the genetic algorithm is used in order to find the optimal architecture of the ANN (number of hidden layers and the number of neurons within each hidden layer). Firstly, a numerical method is used for generating the sizing curves for different loss of load probability (LLP) corresponding to 40 sites located in Algeria. The inputs of ANN-GA are the geographical coordinates and the LLP while the output is the sizing curve represented by C_A = f(C_S) (i.e., 30-points were taken from each sizing curve). Subsequently, the proposed ANN-GA model has been trained by using a set of 36 sites, whereas data for 4 sites (randomly selected) which are not included in the training dataset have been used for testing the ANN-GA model. The results obtained are compared and tested with those of the numerical method in order to show the effectiveness of the proposed approach.     

The experimental investigation of the effects of uncoated,PVD- and CVD-coated cemented carbide inserts and cutting parameters on surface roughness in CNC turning and its prediction using artificial neural networks

In this study the machining of AISI 1030 steel (i.e. orthogonal cutting) uncoated, PVD- and CVD-coated cemented carbide insert with different feed rates of 0.25, 0.30, 0.35, 0.40 and 0.45 mm/rev with the cutting speeds of 100, 200 and 300 m/min by keeping depth of cuts constant (i.e. 2 mm), without using cooling liquids has been accomplished. The surface roughness effects of coating method, coating material, cutting speed and feed rate on the workpiece have been investigated. Among the cutting tools—with 200 mm/min cutting speed and 0.25 mm/rev feed rate—the TiN coated with PVD method has provided 2.16 μm, TiAlN coated with PVD method has provided 2.3 μm, AlTiN coated with PVD method has provided 2.46 μm surface roughness values, respectively. While the uncoated cutting tool with the cutting speed of 100 m/min and 0.25 mm/rev feed rate has yielded the surface roughness value of 2.45 μm. Afterwards, these experimental studies were executed on artificial neural networks (ANN). The training and test data of the ANNs have been prepared using experimental patterns for the surface roughness. In the input layer of the ANNs, the coating tools, feed rate (f) and cutting speed (V) values are used while at the output layer the surface roughness values are used. They are used to train and test multilayered, hierarchically connected and directed networks with varying numbers of the hidden layers using back-propagation scaled conjugate gradient (SCG) and Levenberg–Marquardt (LM) algorithms with the logistic sigmoid transfer function. The experimental values and ANN predictions are compared by statistical error analyzing methods. It is shown that the SCG model with nine neurons in the hidden layer has produced absolute fraction of variance (R²) values about 0.99985 for the training data, and 0.99983 for the test data; root mean square error (RMSE) values are smaller than 0.00265; and mean error percentage (MEP) are about 1.13458 and 1.88698 for the training and test data, respectively. Therefore, the surface roughness value has been determined by the ANN with an acceptable accuracy.