一种改进的人工神经网络学习算法及其在超声检测中的应用

本文用多层感知器 (MLP)与误差反向传播算法 (errorback propagationalgorithm)构造训练人工神经网络 ,提出了新的误差反向传播改进算法。试验结果表明 ,改进的BP算法收敛速度较之常规BP算法明显加快 ,因而在工业现场的超声检测领域有广阔应用前景。     

Application of Hybrid Learning Neural Fuzzy Systems in Reliability Prediction

This study presents a hybrid learning neural fuzzy system for accurately predicting system reliability. Neural fuzzy system learning with and without supervision has been successfully applied in control systems and pattern recognition problems. This investigation modifies the hybrid learning fuzzy systems to accept time series data and therefore examines the feasibility of reliability prediction. Two neural network systems are developed for solving different reliability prediction problems. Additionally, a scaled conjugate gradient learning method is applied to accelerate the training in the supervised learning phase. Several existing approaches, including feed‐forward multilayer perceptron (MLP) networks, radial basis function (RBF) neural networks and Box–Jenkins autoregressive integrated moving average (ARIMA) models, are used to compare the performance of the reliability prediction. The numerical results demonstrate that the neural fuzzy systems have higher prediction accuracy than the other methods. Copyright © 2005 John Wiley & Sons, Ltd.     

Development and analyses of data-driven models for predicting the bed depth profile of solids flowing in a rotary kiln

Soft computing data-driven modeling (DDM) techniques have attracted the attention of many researchers across the globe as they do not require deep knowledge of the complex physical process. In the present research, data-driven based models have been developed using support vector regression (SVR), multilayer perceptron neural network (MLP), radial basis function neural network (RBFNN) and general regression neural networks (GRNN) techniques for predicting the bed depth profile of solids flowing in a rotary kiln. The performances of the developed models were compared and evaluated against the experimental results in terms of statistical measures such as coefficient of determination (R²), and average absolute relative error (AARE). The obtained results and findings from this research have revealed that data-driven models can predict the bed depth profile of solids flowing in a rotary kiln quite accurately. The SVR-based model exhibited the lowest AARE value of 1.72% and highest R² value of 0.9981 while GRNN, RBFNN, and MLP models gave corresponding values of AARE as 3.69%, 55.13%, 98.15% and those of R² as 0.9898, 0.0052 and 0.0081, respectively. Moreover, the developed DDM-based models i.e. GRNN, RBFNN, and MLP models overcame the limitations of the existing solutions which involved iterative numerical procedure entailing high degree of computational complexity.     

Predicting of mechanical properties of Fe–Mn–(Al, Si) TRIP/TWIP steels using neural network modeling

In this work, an artificial neural network (ANN) model was established in order to predict the mechanical properties of transformation induced plasticity/twinning induced plasticity (TRIP/TWIP) steels. The model developed in this study was consider the contents of Mn (15–30 wt%), Si (2–4 wt%) and Al (2–4 wt%) as inputs, while, the total elongation, yield strength and tensile strength are presented as outputs. The optimal ANN architecture and training algorithm were determined. Comparing the predicted values by ANN with the experimental data indicates that trained neural network model provides accurate results.     

基于高维输入小波神经网络的热连轧机产品质量模型

小波神经网络是一种以小波函数为激励函数的神经网络。现有的小波神经网络局限于低维,本文提出一种适合高维输入的小波神经网络建模方法,对几种小波函数与学习算法进行了比较实验,成功地解决了32维输入的大型多辊热连轧机钢板材质量建模问题。     

Prediction of thin film thickness of field emission using wavelet neural networks

Based on wavelet transforms extracting characteristic features from experimental data, the wavelet neural network (WNN) is used as an elementary model to study the characteristics of field emission from thin films. The WNN model is trained with learning samples of thin film thickness. The function mappings that the trained WNN model contains are the very ones that thin film thickness varies with characteristic parameters of field emission. A predicting model on thin film thickness of field emission is obtained. The data of thickness of diamond thin films is used to test this model. The results show that the absolute value of the relative error is within 2.98%, and the well-trained WNN model possesses good forecasting characteristics.     

Fault detection,classification, and location for active distribution network based on neural network and phase angle analysis

The improved radial basis function (RBF) method utilizes an orthogonal regression matrix to produce an artificial neural network structure based on regularized least square. The phase angle and amplitude signal of fault voltage and current are extracted based on frequency domain analysis. The proposed method adopts the fault signal for fault diagnosis synchronously. The IEEE 13-bus active distribution network (ADN) simulation model is set up in Matlab. Test results demonstrate that accuracy of the fault diagnosis can reach 98.07% and the response time of the fault classification method is less than 0.04s. The wavelet neural network (WNN) model is developed to extract the maximum decomposition level and time series behavior. The WNN method can resist noise effects and improve the fault classification accuracy by 4.3%. The effect of fault type and fault resistance on the fault location method is researched. The fault simulation result shows that the proposed method can locate a fault precisely and synchronously. The improved RBF method can diagnose the fault section, classify the fault type and locate a fault accurately in ADN. The research is significant to maintain system stability against realistic fault and network restore.     

E-mail Spam Classification Using Grasshopper Optimization Algorithm and Neural Networks

Spam has turned into a big predicament these days, due to the increase in the number of spam emails, as the recipient regularly receives piles of emails. Not only is spam wasting users’ time and bandwidth. In addition, it limits the storage space of the email box as well as the disk space. Thus, spam detection is a challenge for individuals and organizations alike. To advance spam email detection, this work proposes a new spam detection approach, using the grasshopper optimization algorithm (GOA) in training a multilayer perceptron (MLP) classifier for categorizing emails as ham and spam. Hence, MLP and GOA produce an artificial neural network (ANN) model, referred to (GOAMLP). Two corpora are applied Spam Base and UK-2011 Web spam for this approach. Finally, the finding represents evidence that the proposed spam detection approach has achieved a better level in spam detection than the status of the art.     

电液伺服系统的神经网络建模方法研究

针对电液伺服系统固有的流量-压力特性等非线性因素使得采用传递函数等传统方法难以获得电液伺服系统的精确模型的问题,详细研究了电液伺服系统的神经网络建模方法.研究了两种最常见的神经网络,即多层感知器神经网络和径向基函数神经网络,采用5种典型学习算法构造了3种多层感知器神经网络和2种径向基函数神经网络,并结合自动定深电液伺服系统的工程实例,详细分析了这5种神经网络在电液伺服系统中的建模性能.研究结果表明,采用正交最小二乘算法的径向基函数神经网络最适合电液伺服系统的建模.     

实现CDMA最佳多用户检测的神经网络方法

提出并讨论了两种实现码分多址系统中最佳多用户检测的神经网络方法。一种基于离散Ｈｏｐｆｉｅｌｄ神经网络，另一种基于采用反向传播算法的多层感知器神经网络。理论分析和计算机模拟都证实了这两种神经网络方法的可行性，优越性和实用性。前者适用“固定”用户情况；后者既可用于“固定”用户吼适用于移动用户的情况，因而在未来的ＣＤＭＡ个人通信网中有较好的应用前景。     

Modeling of Magnetic Properties of Nanocrystalline La-doped Barium Hexaferrite

In this paper an artificial neural network (ANN) has been developed to compute the magnetization of the pure and La-doped barium ferrite powders synthesized in ammonium nitrate melt. The input parameters were: the Fe/Ba ratio, La content, sintering temperature, HCl washing and applied magnetic field. A total of 8284 input data set from currently measured 35 different samples with different Fe/Ba ratios, La contents and washed or not washed in HCl were available. These data were used in the training set for the multilayer perceptron (MLP) neural network trained by Levenberg–Marquardt learning algorithm. The hyperbolic tangent and sigmoid transfer functions were used in the hidden layer and output layer, respectively. The correlation coefficients for the magnetization were found to be 0.9999 after the network was trained.     

Neural networks for large- and small-signal modeling of MESFET/HEMTtransistors

In this paper, we present a comparative study of three neural networks-based solutions for large- and small-signal modeling of MESFET and HEMT transistors. The first two neural architectures are specific for this modeling problem: the generalized radial basis function (GRBF) network, and the smoothed piecewise linear (SPWL) model. These models are compared with the well-known multilayer perceptron (MLP) network. Results are presented for both the large- and small-signal regimes separately. Finally, a global model is proposed that is able to accurately characterize the whole behavior of the transistors. This model is based on a simple combination of the best models obtained for the two kinds of regimes     

Automatic breast cancer detection based on optimized neural network using whale optimization algorithm

Breast cancer is the second deadliest type of cancer. Early detection of breast cancer can considerably improve the effectiveness of treatment. A significant early sign of breast cancer is the mass. However, separating the cancerous masses from the normal portions of the breast tissue is usually a challenge for radiologists. Recently, because of the availability of high‐accuracy computing, computer‐aided detection systems based on image processing have become capable of accurately diagnosing the various types of cancers. The main purpose of this study is to utilize a powerful image segmentation method for the diagnosis of cancerous regions through mammography, based on a new configuration of the multilayer perceptron (MLP) neural network. The most popular method for minimizing the errors in an MLP neural network is backpropagation. However, this method has certain drawbacks, such as a low convergence speed and becoming trapped at the local minimum. In this study, a new training algorithm based on the whale optimization algorithm is proposed for the MLP network. This algorithm is capable of solving various problems toward the current algorithms for the analyzed systems. The proposed method is validated on the Mammographic Image Analysis Society database, which contains 322 digitized mammography images, and the Digital Database for Screening Mammography, which contains approximately 2500 digitized mammography images. To assess the detection performance of the proposed system, the correct detection rate, percentage of identification with false acceptance, and percentage of identification with false rejection were evaluated and compared using various methods. The results indicate that the proposed method is highly efficient and yields significantly better accuracy compared with other methods.     

Neural-network classifiers for automatic real-world aerial image recognition

We describe the application of the multilayer perceptron (MLP) network and a version of the adaptive resonance theory version 2-A (ART 2-A) network to the problem of automatic aerial image recognition (AAIR). The classification of aerial images, independent of their positions and orientations, is required for automatic tracking and target recognition. Invariance is achieved by the use of different invariant feature spaces in combination with supervised and unsupervised neural networks. The performance of neural-network-based classifiers in conjunction with several types of invariant AAIR global features, such as the Fourier-transform space, Zernike moments, central moments, and polar transforms, are examined. The advantages of this approach are discussed. The performance of the MLP network is compared with that of a classical correlator. The MLP neural-network correlator outperformed the binary phase-only filter (BPOF) correlator. It was found that the ART 2-A distinguished itself with its speed and its low number of required training vectors. However, only the MLP classifier was able to deal with a combination of shift and rotation geometric distortions.     

Development of Al¬2O¬3/TiN Ceramic Cutting Tool Materials by Artificial Neural Networks

The artificial neural networks (ANN) which have broad application were proposed to develop multiphase ceramic cutting tool materials. Based on the back propagation algorithm of the forward multilayer perceptron, the models to predict volume content of composition in particle reinforced ceramics are established. The Al¬2O¬3/TiN ceramic cutting tool material was developed by ANN, whose mechanical properties fully satisfy the cutting requirements.     

Rule Extraction from Trained Artifical Neural Networks

The neural network rule extraction problem is aimed at obtaining rules from an arbitrarily trained artificial neural network. Recently there have been several approaches to rule extraction. Approaches to rule extraction implement a priori knowledge of data or rule requirements into neural networks before the rules are extracted. Although this may lead to a simplified final phase of acquitting the rules from particular type of neural networks, it limits the methodologies for general-purpose use. This article approaches the neural network rule extraction problem in its essential and general form. Preference is given to multilayer perceptron networks (MLP networks) due to their universal approximation capabilities. The article establishes general theoretical grounds for rule extraction from trained artificial neural networks and further focuses on the problem of crisp rule extraction. The problem of crisp rule extraction from trained MLP networks is first approached on theoretical level. Present ed theoretical results state conditions guaranteeing equivalence between classification by an MLP network and crisp logical formalism. Based on the theoretical results an algorithm for crisp rule extraction, independent of training strategy, is proposed. The rule extraction algorithm can be used even in cases where the theoretical conditions are not strictly satisfied; by offering an approximate classification. An introduced rule extraction algorithm is experimentally demonstrated.

     

Estimation of toxicity of ionic liquids in Leukemia Rat Cell Line and Acetylcholinesterase enzyme by principal component analysis, neural networks and multiple lineal regressions

Multiple linear regression (MLR), radial basis network (RB), and multilayer perceptron (MLP) neural network (NN) models have been explored for the estimation of toxicity of ammonium, imidazolium, morpholinium, phosphonium, piperidinium, pyridinium, pyrrolidinium and quinolinium ionic liquid salts in the Leukemia Rat Cell Line (IPC-81) and Acetylcholinesterase (AChE) using only their empirical formulas (elemental composition) and molecular weights. The toxicity values were estimated by means of decadic logarithms of the half maximal effective concentration (EC(50)) in microM (log(10)EC(50)). The model's performances were analyzed by statistical parameters, analysis of residuals and central tendency and statistical dispersion tests. The MLP model estimates the log(10)EC(50) in IPC-81 and AchE with a mean prediction error less than 2.2 and 3.8%, respectively.     

Development of Al_2O_3/TiN Ceramie Cutting Tool Materials by Artificial Neural Networks

The artificial neural networks (ANN) which have broad application were proposed to develop multiphase ceramie cutting tool materials. Based on the back propagation algorithm of the forward multilayer perceptron, the models to predict volume content of composition in particie reinforced ceramies are established. The Al2O3/TiN ceramie cutting tool material was developed by ANN, whose mechanicai properties fully satisfy the cutting requirements.     

Development of Al2O3/TiN Ceramic Cutting Tool Materials by Artificial Neural Networks

The artificial neural networks (ANN) which have broad application were proposed to develop multiphase ceramic cutting tool materials. Based on the back propagation algorithm of the forward multilayer perceptron, the models to predict volume content of composition in particle reinforced ceramics are established. The Al2O3/TiNl ceramic cutting tool material was developed by ANN, whose mechanical properties fully satisfy the cutting requirements.     

Adaptive split spectrum processing using a neural network

The polarity thresholding algorithm for split spectrum processing (SSP) is known to work well once properly tuned. However, there are several problems related to the finding of the right split parameters such as the number of filters and the information carrying spectral range. Here we show that the polarity thresholding method can be formulated as a multilayer perceptron (MLP) neural network with binary neurons and binary input signals operating in feedforward mode. Then the method is generalized to process nonbinary data using an adaptive MLP with graded neurons. Experiments with real ultrasonic NDE signals are presented using the conventional backpropagation optimization algorithm (BP) and a second order optimization method (BFGS) with exact line search. Finally, alternative adaptive algorithms based on a decomposition of the network into single neurons or linear discriminants are briefly discussed.