Prediction of performance and emission characteristics in a biodiesel engine using WCO ester: a comparative study of neural networks

In this study, the applicability of Artificial Neural Networks (ANNs) has been investigated for predicting the performance and emission characteristics of a diesel engine fuelled with Waste cooking oil (WCO). ANN modeling was done using multilayer perception (MLP) and radial basis functions (RBF). In the radial basis functions, centers were initialized by two different methods namely random selection method and using clustering algorithm. In the clustering method, center initialization was done using FCM (Fuzzy \(c\) means) and CDWFCM (cluster dependent weighted fuzzy \(c\) means) algorithms. The networks were trained using the experimental data, wherein load percentage, compression ratio, blend percentage, injection timing and injection pressure were taken as the input parameters and brake thermal efficiency, brake specific energy consumption, exhaust gas temperature and engine emissions were used as the output parameters. The investigation showed that ANN predicted results matched well with the experimental results over a wide range of operating conditions for both models. A comparison was made between ANN models and regression models. ANN performed better than the regression models. Similarly a comparison of MLP and RBF indicated that RBF with CDWFCM performed better than MLP networks with lower Mean Relative Error (MRE) and higher accuracy of prediction.     

Proposing two new metaheuristic algorithms of ALO-MLP and SHO-MLP in predicting bearing capacity of circular footing located on horizontal multilayer soil

In this study, for the issue of shallow circular footing’s bearing capacity (also shown as F_ult), we used the merits of artificial neural network (ANN), while optimized it by two metaheuristic algorithms (i.e., ant lion optimization (ALO) and the spotted hyena optimizer (SHO)). Several studies demonstrated that ANNs have significant results in terms of predicting the soil’s bearing capacity. Nevertheless, most models of ANN learning consist of different disadvantages. Accordantly, we focused on the application of two hybrid models of ALO–MLP and SHO–MLP for predicting the F_ult placed in layered soils. Moreover, we performed an Extensive Finite Element (FE) modeling on 16 sets of soil layer (soft soil placed onto stronger soil and vice versa) considering a database that consists of 703 testing and 2810 training datasets for preparing the training and testing datasets. The independent variables in terms of ALO and SHO algorithms have been optimized by taking into account a trial and error process. The input data layers consisted of (i) upper layer foundation/thickness width (h/B) ratio, (ii) bottom and topsoil layer properties (for example, six of the most important properties of soil), (iii) vertical settlement (s), (iv) footing width (B), where the main target was taken F_ult. According to RMSE and R², values of (0.996 and 0.034) and (0.994 and 0.044) are obtained for training dataset and values of (0.994 and 0.040) and (0.991 and 0.050) are found for the testing dataset of proposed SHO–MLP and ALO–MLP best-fit prediction network structures, respectively. This proves higher reliability of the proposed hybrid model of SHO–MLP in approximating shallow circular footing bearing capacity.

     

Application of integrated soft computing techniques for optimisation of hybrid CO2 laser–MIG welding process

In this paper, artificial neural networks (ANNs), genetic algorithm (GA), simulated annealing (SA) and Quasi Newton line search techniques have been combined to develop three integrated soft computing based models such as ANN–GA, ANN–SA and ANN–Quasi Newton for prediction modelling and optimisation of welding strength for hybrid CO₂ laser–MIG welded joints of aluminium alloy. Experimental dataset employed for the purpose has been generated through full factorial experimental design. Laser power, welding speeds and wires feed rate are considered as controllable input parameters. These soft computing models employ a trained ANN for calculation of objective function value and thereby eliminate the need of closed form objective function. Among 11 tested networks, the ANN with best prediction performance produces maximum percentage error of only 3.21%. During optimisation ANN–GA is found to show best performance with absolute percentage error of only 0.09% during experimental validation. Low value of percentage error indicates efficacy of models. Welding speed has been found as most influencing factor for welding strength.     

A comparative study of fault density prediction in aspect-oriented systems using MLP,RBF, KNN,RT, DENFIS and SVR models

This paper investigates and empirically evaluates and compares six popular computational intelligence models in the context of fault density prediction in aspect-oriented systems. These models are multi-layer perceptron (MLP), radial basis function (RBF), k-nearest neighbor (KNN), regression tree (RT), dynamic evolving neuro-fuzzy inference system (DENFIS), and support vector regression (SVR). The models were trained and tested, using leave-one-out procedure, on a dataset that consists of twelve aspect-level metrics (explanatory variables) that measure different structural properties of an aspect. It was observed that the DENFIS, SVR, and RT models were more accurate in predicting fault density compared to the MLP, RBF, and KNN models. The MLP model was the worst model, and all the other models were significantly better than it.     

Adaptive Network-Based Fuzzy Inference Systems Coupled with Genetic Algorithms for Predicting Soil Permeability Coefficient

This paper extends hybrid-type optimization models of genetic algorithm adaptive network-based fuzzy inference system (GA-ANFIS) for predicting the soil permeability coefficient (SPC) of different types of soil. In these models, GA optimizes parameters of a subtractive clustering technique that controls the structure of the ANFIS model’s fuzzy rule base. Simultaneously, a hybrid leaning algorithm is employed in the ANFIS, as a trained fuzzy inference system (FIS), which optimally determines the parameter sets of the examined FISs in ANFIS. Using an updated large database of SPCs consisting of 338 fine-grained, 178 mixed and 94 granular soil samples, GA-ANFIS framework constructs different models of predicting the permeability coefficient of respectively fine-grained, mixed and granular soils. A fuzzy C-mean technique has been used to cluster the entire data samples of each type of soil and divide them uniformly into training and testing data sets. Different prediction models of SPC have been trained and tested for each of the three soil types, and the appropriate models have been selected. The selected models have been compared with ANN and modified-by-GA empirical prediction models. Results show that the constructed GA-ANFIS models outperform the other models in terms of the prediction accuracy and the generalization capability.     

Generalization performance of support vector machines and neural networks in runoff modeling

Effective one-day lead runoff prediction is one of the significant aspects of successful water resources management in arid region. For instance, reservoir and hydropower systems call for real-time or on-line site-specific forecasting of the runoff. In this research, we present a new data-driven model called support vector machines (SVMs) based on structural risk minimization principle, which minimizes a bound on a generalized risk (error), as opposed to the empirical risk minimization principle exploited by conventional regression techniques (e.g. ANNs). Thus, this stat-of-the-art methodology for prediction combines excellent generalization property and sparse representation that lead SVMs to be a very promising forecasting method. Further, SVM makes use of a convex quadratic optimization problem; hence, the solution is always unique and globally optimal. To demonstrate the aforementioned forecasting capability of SVM, one-day lead stream flow of Bakhtiyari River in Iran was predicted using the local climate and rainfall data. Moreover, the results were compared with those of ANN and ANN integrated with genetic algorithms (ANN-GA) models. The improvements in root mean squared error (RMSE) and squared correlation coefficient (R²) by SVM over both ANN models indicate that the prediction accuracy of SVM is at least as good as that of those models, yet in some cases actually better, as well as forecasting of high-value discharges.     

Evaluation and prediction of flyrock resulting from blasting operations using empirical and computational methods

Mines, quarries and construction sites face environmental impacts, such as flyrock, due to blasting operations. Flyrock may cause damage to structures and injury to human. Therefore, flyrock prediction is required to determine safe blasting zone. In this regard, 232 blasting operations were investigated in five granite quarries, Malaysia. Blasting parameters comprising maximum charge per delay and powder factor were prepared to predict flyrock using empirical and intelligent methods. An empirical graph was proposed to predict flyrock distance for different powder factor values. In addition, using the same datasets, two intelligent systems, namely artificial neural network (ANN) and adaptive neuro-fuzzy inference system (ANFIS) were used to predict flyrock. Considering some model performance indices including coefficient of determination (R ²), value account for and root mean squared error and also using simple ranking procedure, the best flyrock prediction models were selected. It was found that the ANFIS model can predict flyrock with higher performance capacity compared to ANN predictive model. R ² values of testing datasets are 0.925 and 0.964 for ANN and ANFIS techniques, respectively, suggesting the superiority of the ANFIS technique in predicting flyrock.     

Neural network and neuro-fuzzy assessments for scour depth around bridge piers

The mechanism of flow around a pier structure is so complicated that it is difficult to establish a general empirical model to provide accurate estimation for scour. Interestingly, each of the proposed empirical formula yields good results for a particular data set. Hence, in this study, alternative approaches, artificial neural networks (ANNs) and adaptive neuro-fuzzy inference system (ANFIS), are proposed to estimate the equilibrium and time-dependent scour depth with numerous reliable data base. Two ANN models, multi-layer perception using back-propagation algorithm (MLP/BP) and radial basis using orthogonal least-squares algorithm (RBF/OLS), were used. The equilibrium scour depth was modeled as a function of five variables; flow depth, mean velocity, critical flow velocity, mean grain diameter and pier diameter. The time variation of scour depth was also modeled in terms of equilibrium scour depth, equilibrium scour time, scour time, mean flow velocity and critical flow velocity. The training and testing data are selected from the experimental data of several valuable references. Numerical tests indicate that MLP/BP model provide a better prediction of scour depth than RBF/OLS and ANFIS models as well as the previous empirical approaches. Finally, sensitivity analysis shows that pier diameter has a greater influence on equilibrium scour depth than the other independent parameters.     

Multiple regression,ANN and ANFIS models for prediction of backbreak in the open pit blasting

Backbreak is one of the undesirable effects of blasting operations causing instability in mine walls, falling down the machinery, improper fragmentation and reduction in efficiency of drilling. Backbreak can be affected by various parameters such as the rock mass properties, blasting geometry and explosive properties. In this study, the application of the artificial neural network (ANN), an adaptive neuro-fuzzy inference system (ANFIS) for prediction of backbreak, was described and compared with the traditional statistical model of multiple regression. The performance of these models was assessed through the root mean square error, correlation coefficient (R ²) and mean absolute percentage error. As a result, it was found that the constructed ANFIS exhibited a higher performance than the ANN and multiple regression for backbreak prediction.     

A novel approach to predict shear strength of tilted angle connectors using artificial intelligence techniques

Shear connectors play a prominent role in the design of steel-concrete composite systems. The behavior of shear connectors is generally determined through conducting push-out tests. However, these tests are costly and require plenty of time. As an alternative approach, soft computing (SC) can be used to eliminate the need for conducting push-out tests. This study aims to investigate the application of artificial intelligence (AI) techniques, as sub-branches of SC methods, in the behavior prediction of an innovative type of C-shaped shear connectors, called Tilted Angle Connectors. For this purpose, several push-out tests are conducted on these connectors and the required data for the AI models are collected. Then, an adaptive neuro-fuzzy inference system (ANFIS) is developed to identify the most influencing parameters on the shear strength of the tilted angle connectors. Totally, six different models are created based on the ANFIS results. Finally, AI techniques such as an artificial neural network (ANN), an extreme learning machine (ELM), and another ANFIS are employed to predict the shear strength of the connectors in each of the six models. The results of the paper show that slip is the most influential factor in the shear strength of tilted connectors and after that, the inclination angle is the most effective one. Moreover, it is deducted that considering only four parameters in the predictive models is enough to have a very accurate prediction. It is also demonstrated that ELM needs less time and it can reach slightly better performance indices than those of ANN and ANFIS.

     

Combining cluster analysis with classifier ensembles to predict financial distress

The ability to accurately predict business failure is a very important issue in financial decision-making. Incorrect decision-making in financial institutions is very likely to cause financial crises and distress. Bankruptcy prediction and credit scoring are two important problems facing financial decision support. As many related studies develop financial distress models by some machine learning techniques, more advanced machine learning techniques, such as classifier ensembles and hybrid classifiers, have not been fully assessed. The aim of this paper is to develop a novel hybrid financial distress model based on combining the clustering technique and classifier ensembles. In addition, single baseline classifiers, hybrid classifiers, and classifier ensembles are developed for comparisons. In particular, two clustering techniques, Self-Organizing Maps (SOMs) and k-means and three classification techniques, logistic regression, multilayer-perceptron (MLP) neural network, and decision trees, are used to develop these four different types of bankruptcy prediction models. As a result, 21 different models are compared in terms of average prediction accuracy and Type I & II errors. By using five related datasets, combining Self-Organizing Maps (SOMs) with MLP classifier ensembles performs the best, which provides higher predication accuracy and lower Type I & II errors.     

Prediction of California bearing ratio (CBR) of fine grained soils by AI methods

Advances in field of artificial intelligence (AI) offers opportunities of utilizing new algorithms and models that enable researchers to solve the most complex systems. As in other engineering fields, AI methods have widely been used in geotechnical engineering. Unlikely, there seems quite insufficient number of research related to the use of AI methods for the estimation of California bearing ratio (CBR). There were actually some attempts to develop prediction models for CBR, but most of these models were essentially statistical correlations. Nevertheless, many of these statistical correlation equations generally produce unsatisfactory CBR values. However, this paper is likely one of the very first research which aims to investigate the applicability of AI methods for prediction of CBR. In this context, artificial neural network (ANN) and gene expression programming (GEP) were applied for the prediction of CBR of fine grained soils from Southeast Anatolia Region/Turkey. Using CBR test data of fine grained soils, some proper models are successfully developed. The results have shown that the both ANN and GEP are found to be able to learn the relation between CBR and basic soil properties. Additionally, sensitivity analysis is performed and it is found that maximum dry unit weight (γ_d) is the most effective parameter on CBR among the others such as plasticity index (PI), optimum moisture content (w_opt), sand content (S), clay + silt content (C + S), liquid limit (LL) and gravel content (G) respectively.     

On the differential benchmarking of promotional efficiency with machine learning modelling (II): Practical applications

The assessment of promotional sales with models constructed by machine learning techniques is arousing interest due, among other reasons, to the current economic situation leading to a more complex environment of simultaneous and concurrent promotional activities. An operative model diagnosis procedure was previously proposed in the companion paper, which can be readily used both for agile decision making on the architecture and implementation details of the machine learning algorithms, and for differential benchmarking among models. In this paper, a detailed example of model analysis is presented for two representative databases with different promotional behaviour, namely, a non-seasonal category (milk) and a heavily seasonal category (beer). The performance of four well-known machine learning techniques with increasing complexity is analyzed in detail here. In particular, k-Nearest Neighbours, General Regression Neural Networks, Multilayer Perceptron (MLP), and Support Vector Machines (SVM), are differentially compared. Present paper evaluates these techniques along the experiments described for both categories when applying the methodological findings obtained in the companion paper. We conclude that some elements included in the architecture are not essential for a good performance of the machine learning promotional models, such as the semiparametric nature of the kernel in SVM models, whereas other can be strongly dependent of the database, such as the convenience of multiple output models in MLP regression schemes. Additionally, the specificity of the behaviour of certain categories and product ranges determines the need to establish suitable and specific procedures for a better prediction and feature extraction.     

A comparative study of artificial neural network and adaptive neurofuzzy inference system for prediction of compressional wave velocity

In this study, two solutions for prediction of compressional wave velocity (p wave) are presented and compared: artificial neural network (ANN) and adaptive neurofuzzy inference system (ANFIS). Series of analyses were performed to determine the optimum architecture of utilized methods using the trial and error process. Several ANNs and ANFISs are constructed, trained and validated to predict p wave in the investigated carbonate reservoir. A comparative study on prediction of p wave by ANN and ANFIS is addressed, and the quality of the target prediction was quantified in terms of the mean-squared errors (MSEs), correlation coefficient (R ²) and prediction efficiency error. ANFIS with MSE of 0.0552 and R ² of 0.9647, and ANN with MSE of 0.042 and R ² of 0.976, showed better performance in comparison with MLR methods. ANN and ANFIS systems have performed comparably well and accurate for prediction of p wave.     

Several non-linear models in estimating air-overpressure resulting from mine blasting

This research presents several non-linear models including empirical, artificial neural network (ANN), fuzzy system and adaptive neuro-fuzzy inference system (ANFIS) to estimate air-overpressure (AOp) resulting from mine blasting. For this purpose, Miduk copper mine, Iran was investigated and results of 77 blasting works were recorded to be utilized for AOp prediction. In the modeling procedure of this study, results of distance from the blast-face and maximum charge per delay were considered as predictors. After constructing the non-linear models, several performance prediction indices, i.e. root mean squared error (RMSE), variance account for (VAF), and coefficient of determination (R ²) and total ranking method are examined to choose the best predictive models and evaluation of the obtained results. It is obtained that the ANFIS model is superior to other utilized techniques in terms of R ², RMSE, VAF and ranking herein. As an example, RMSE values of 5.628, 3.937, 3.619 and 2.329 were obtained for testing datasets of empirical, ANN, fuzzy and ANFIS models, respectively, which indicate higher performance capacity of the ANFIS technique to estimate AOp compared to other implemented methods.     

Computing maximal Kleene closures that are embeddable in a given subword-closed language

Motivated by certain coding techniques for reliable DNA computing, we consider the problem of characterizing nontrivial languages D that are maximal with the property that D ^* is contained in the subword closure of a given set S of words of some fixed length k. This closure is simply the set of all words whose subwords of length k must be in S. We provide a deep structural characterization of these languages D, which leads to polynomial time algorithms for computing such languages.     

Identification of k-step-ahead prediction error model and MPC control

This work studies k-step-ahead prediction error model identification and its relationship to MPC control. The use of error criteria in parameter estimation will be discussed, where the identified model is used in model predictive control (MPC). Assume that the model error is dominated by the variance part, it can be shown that a k-step-ahead prediction error model is not optimal for k-step-ahead prediction. A normal one-step-ahead prediction error criterion will be optimal for k-step-ahead prediction. Then it is argued that even when some bias exists, the result could still hold true. Therefore, for MPC identification of linear processes, one-step-ahead prediction error models fever k-step-ahead prediction models. Simulations and industrial testing data will be used to illustrate the idea.     

Soft computing techniques in ensemble precipitation nowcast

This study presented various soft computing techniques for forecasting the hourly precipitations during tropical cyclones. The purpose of the current study is to present a concise and synthesized documentation of the current level of skill of various models at precipitation forecasts. The techniques involve artificial neural networks (ANN) comprising the multilayer perceptron (MLP) with five training methods (denoted as ANN-1, ANN-2, ANN-3, ANN-4, and ANN-5), and decision trees including classification and regression tree (CART), Chi-squared automatic interaction detector (CHAID), and exhaustive CHAID (E-CHAID). The developed models were applied to the Shihmen Reservoir Watershed in Taiwan. The traditional statistical models including multiple linear regressions (MLR), and climatology average model (CLIM) were selected as the benchmarks and compared with these machine learning. A total of 157 typhoons affecting the watershed were collected. The measures used include numerical statistics and categorical statistics. The RMSE criterion was employed to assess the suitable scenario, while the categorical scores, bias, POD, FAR, HK, and ETS were based on the rain contingency table. Consequently, this study found that ANN and decision trees provide better prediction compared to traditional statistical models according to the various average skill scores.     

Use of artificial neural networks for prediction of discharge coefficient of triangular labyrinth side weir in curved channels

Side weirs have been extensively used in hydraulic and environmental engineering applications. The discharge coefficient of the triangular labyrinth side weirs is 1.5-4.5 times higher than that of rectangular side weirs. This study aims to estimate the discharge coefficient (C_d) of triangular labyrinth side weir in curved channel by using artificial neural networks (ANN). In this study, 7963 laboratory test results are used for determining the C_d. The performance of the ANN model is compared with multiple nonlinear and linear regression models. Root mean square errors (RMSE), mean absolute errors (MAE) and correlation coefficient (R) statistics are used as comparing criteria for the evaluation of the models’ performances. Based on the comparisons, it was found that the neural computing technique could be employed successfully in modeling discharge coefficient from the available experimental data. There were good agreements between the measured values and the values obtained using the ANN model. It was found that the ANN model with RMSE of 0.1658 in validation stage is superior in estimation of discharge coefficient than the multiple nonlinear and linear regression models with RMSE of 0.2054 and 0.2926, respectively.     

Artificial neural networks and genetic algorithm for bearing fault detection

A study is presented to compare the performance of three types of artificial neural network (ANN), namely, multi layer perceptron (MLP), radial basis function (RBF) network and probabilistic neural network (PNN), for bearing fault detection. Features are extracted from time domain vibration signals, without and with preprocessing, of a rotating machine with normal and defective bearings. The extracted features are used as inputs to all three ANN classifiers: MLP, RBF and PNN for two- class (normal or fault) recognition. Genetic algorithms (GAs) have been used to select the characteristic parameters of the classifiers and the input features. For each trial, the ANNs are trained with a subset of the experimental data for known machine conditions. The ANNs are tested using the remaining set of data. The procedure is illustrated using the experimental vibration data of a rotating machine. The roles of different vibration signals and preprocessing techniques are investigated. The results show the effectiveness of the features and the classifiers in detection of machine condition.