多层前向人工神经网络图像分类算法

传统人工神经网络的输入均为向量形式,而图像由矩阵形式表示,因此,在用人工神经网络进行图像处理时,图像将以向量形式输入至神经网络,这破坏了图像的结构信息,从而影响了图像处理的效果。为了提高网络对图像的处理能力,文中借鉴了深度学习的思想与方法,引进了具有矩阵输入的多层前向神经网络。同时,采用传统的反向传播训练算法(BP)训练该网络,给出了训练过程与训练算法,并在USPS手写数字数据集上进行了数值实验。实验结果表明,相对于单隐层矩阵输入前向神经网络(2D-BP),所提多层网络具有较好的分类效果。此外,对于彩色图片分类问题,利用所提出的2D-BP网络,给出了一个有效的可行方法。     

An iterative learning scheme for motion control of robots using neural networks: A case study

In this paper, an iterative learning controller using neural networks has been studied for the motion control of robotic manipulators. Simulations of a two-link robot have demonstrated that the proposed control scheme for robotic manipulators can greatly reduce tracking errors after a few trials. Our modification of the original back-propagation algorithm is employed in the neural network, resulting in a much faster learning rate. The results of simulation have also shown that the proposed iterative learning controller has a faster rate of convergence and better robustness.     

A kind of BP neural network algorithm based on grey interval

In order to improve the learning ability of a forward neural network, in this article, we incorporate the feedback back-propagation (FBBP) and grey system theory to consider the learning and training of a neural network new perspective. By reducing the input grey degree we optimise the input of the neural network to make it more rational for learning and training of neural networks. Simulation results verified the efficiency of the proposed algorithm by comparing its performance with that of FBBP and classic back-propagation (BP). The results showed that the proposed algorithm has the characteristics of fast training and strong ability of generalisation and it is an effective learning method.     

Development of a predictive system for car fuel consumption using an artificial neural network

A predictive system for car fuel consumption using a back-propagation neural network is proposed in this paper. The proposed system is constituted of three parts: information acquisition system, fuel consumption forecasting algorithm and performance evaluation. Although there are many factors which will effect the fuel consumption of a car in a practical drive procedure, however, in the present system the impact factors for fuel consumption are simply decided as make of car, engine style, weight of car, vehicle type and transmission system type which are used as input information for the neural network training and fuel consumption forecasting procedure. In the fuel consumption forecasting, to verify the effect of the proposed predictive system, an artificial neural network with back-propagation neural network has a learning capability for car fuel consumption prediction. The prediction results demonstrated that the proposed system using neural network is effective and the performance is satisfactory in fuel consumption prediction.     

复杂运动目标的学习与识别

针对复杂运动目标识别问题,提出了一个基于反馈型随机神经网络的运动认脸与物体的自动识别系统,该系统具有强大学习能力,运动目标检测与识别快速准确等特点,在对该的核心－反馈型二元网络进行深入分析的基础上,提出了一种适合于该神经网络模型的高效渐进式Boltzmann学习算法,实验结果表明,该识别系统性能优异,在几个方面超过了eTrue公司的TrueFace人脸识别系统。     

基于人工神经网络的数字字符识别

提出一种用神经网络来识别含有噪声的数字字符的方法。神经网络采用带有动量项和自适应学习率的反向传播算法(BP)进行训练。样本由理想信号和带有噪声的信号组成。通过比较测试结果得出对同一网络既使用理想信号又使用带有噪声的信号对网络进行训练可使系统具有更强的容错性。最后给出的实验结果证明了该方法的有效性。     

遗传BP神经网络及其在异常检测中的应用

为了克服BP神经网络速度慢、易陷入局部最小的缺点,利用GA的全局搜索能力优化BP神经网络权值,本文提出了遗传BP神经网络算法,并将其用于异常检测之中。在对Kddcup,99攻击数据进行分析和特征约简的基础上,设定了遗传BP神经网络算法的参数。实验结果表明,基于遗传BP神经网络异常检测模型的建立快于BP神经网络算法。     

3D object recognition based on a geometrical topology model and extreme learning machine

In this paper, one geometrical topology hypothesis is present based on the optimal cognition principle, and the single-hidden layer feedforward neural network with extreme learning machine (ELM) is used for 3D object recognition. It is shown that the proposed approach can identify the inherent distribution and the dependence structure for each 3D object along multiple view angles by evaluating the local topological segments with a dipole topology model and developing the relevant mathematical criterion with ELM algorithm. The ELM ensemble is then used to combine the individual single-hidden layer feedforward neural network of each 3D object for performance improvements. The simulation results have shown the excellent performance and the effectiveness of the developed scheme.     

基于神经网络的非线性学习控制研究

本文将多层前向传递神经网络应用于非线性系统控制,通过对神经网络的训练,实现非线性系统的状态反馈控制。本文还介绍了用神经网络控制一类非线性系统的学习控制算法,该算法对对象的数学模型依赖程度较低,为非线性系统的学习控制提供了一种有效的研究方法。另外还给出了该算法应用于几个不同非线性对象的学习控制仿真结果。     

Neural network controller with flexible structure based on feedback-error-learning approach

In practice, the back-propagation algorithm often runs very slowly, and the question naturally arises as to whether there are necessarily intrinsic computation and difficulties with training neural networks, or better training algorithms might exist. Two important issues will be investigated in this framework. One establishes a flexible structure, to construct very simple neural network for multi-input/output systems. The other issue is how to obtain the learning algorthm to achieve good performance in the training phase. In this paper, the feedforward neural network with flexible bipolar sigmoid functions (FBSFs) are investigated to learn the inverse model of the system. The FBSF has changeable shape by changing the values of its parameter according to the desired trajectory or the teaching signal. The proposed neural network is trained to learn the inverse dynamic model by using back-propagation learning algorithms. In these learning algorithms, not only the connection weights but also the sigmoid function parameters (SFPs) are adjustable. The feedback-error-learning is used as a learning method for the feedforward controller. In this case, the output of a feedback controller is fed to the neural network model. The suggested method is applied to a two-link robotic manipulator control system which is configured as a direct controller for the system to demonstrate the capability of our scheme. Also, the advantages of the proposed structure over other traditional neural network structures are discussed.     

Stochastic sensitivity analysis method for neural network learning

A new, efficient algorithm is developed for the sensitivity analysis of a class of continuous-time recurrent neural networks with additive noise signals. The algorithm is based on the stochastic sensitivity analysis method using the variational approach, and formal expressions are obtained for the functional derivative sensitivity coefficients. The present algorithm uses only the internal states and noise signals to compute the gradient information needed in the gradient descent method, where the evaluation of derivatives is not necessary. In particular, it does not require the solution of adjoint equations of the back-propagation type. Thus, the algorithm has the potential for efficiently learning the network weights with significantly fewer computations. The effectiveness of the algorithm in a statistical sense is shown, and the method is applied to the familiar layered network.     

Back-propagation learning in expert networks

Expert networks are event-driven, acyclic networks of neural objects derived from expert systems. The neural objects process information through a nonlinear combining function that is different from, and more complex than, typical neural network node processors. The authors develop back-propagation learning for acyclic, event-driven networks in general and derive a specific algorithm for learning in EMYCIN-derived expert networks. The algorithm combines back-propagation learning with other features of expert networks, including calculation of gradients of the nonlinear combining functions and the hypercube nature of the knowledge space. It offers automation of the knowledge acquisition task for certainty factors, often the most difficult part of knowledge extraction. Results of testing the learning algorithm with a medium-scale (97-node) expert network are presented.     

Combining neural networks and semantic feature space for email classification

Email is one of the most ubiquitous and pervasive applications used on a daily basis by millions of people worldwide, individuals and organizations more and more rely on the emails to communicate and share information and knowledge. However, the increase in email users has resulted in a dramatic increase in spam emails during the past few years. It is becoming a big challenge to process and manage the emails efficiently for and individuals and organizations. This paper proposes new email classification models using a linear neural network trained by perceptron learning algorithm and a nonlinear neural network trained by back-propagation learning algorithm. An efficient semantic feature space (SFS) method is introduced in these classification models. The traditional back-propagation neural network (BPNN) has slow learning speed and is prone to trap into a local minimum, so the modified back-propagation neural network (MBPNN) is presented to overcome these limitations. The vector space model based email classification system suffers from a large number of features and ambiguity in the meaning of terms, which will lead to sparse and noisy feature space. So we use the SFS to convert the original sparse and noisy feature space to a semantically richer feature space, which will helps to accelerate the learning speed. The experiments are conducted based on different training set size and extracted feature size. Experimental results show that the models using MBPNN outperform the traditional BPNN, and the use of SFS can greatly reduce the feature dimensionality and improve email classification performance.     

BP算法的改进及用模拟电路实现的神经网络分类器

基于用模拟电路实现神经网络分类器的目的，对多层静态前馈神经网络的ＢＰ算法做了改进，采用线性限幅函数代替Ｓｉｇｍｏｉｄ函数作为神经元的激活函数，给出了改进的ＢＰ算法。对该算法性能的实验研究表明：这种改进算法不但方便了用线性模拟集成运算放大电路实现神经网络，而且具有学习速度快，映射能力强等优点。根据本文算法设计的神经网络分类器，无论是计算机仿真，还是模拟电路实现，都得到了比较高的识别率。     

基于快速学习型神经网络的机器人运动学模型辨识及运动控制

该文提出一种快速学习型神经网络，它不仅符合生物神经网络的基本特征，而且算法简单，学习收敛速度快，有线性，非线性系统辨识精度高优异特点。因此，此类神经网络非常适合于机器人运动学模型辨识及运动控制，仿真结果表明，基于快速学习型神经网络进行机械手运动学模型辨识有运动控制是合适的。     

汉语人机接口中神经网络模型的研究

在简要地介绍了人工神经网络(ANN)基本特性的基础上,着重介绍了多层神经网络的一种学习算法——反向传播法在语音合成中的应用,提出了一种从文本到声音的转换即完成汉语语音合成的神经网络模型.初步的实验结果是令人满意的.     

基于粒子群优化的仓虫分类识别技术研究

在对仓虫分类识别过程中,为了改善因采用BP神经网络产生的由于训练时间长和易于陷入局部极小点,而导致效率和分类的准确性较低的情况,对粒子群优化算法进行了研究,并把这种算法运用到神经网络学习训练中。实验表明,将基于粒子群优化的神经网络算法应用到仓虫分类中,从训练时间、识别率上得到了较大的改善,而且算法易于实现,且能更快地收敛于全局最优解。     

Implementation of the RBF neural chip with the back-propagation algorithm for on-line learning

This article presents the hardware implementation of the floating-point processor (FPP) to develop the radial basis function (RBF) neural network for the general purpose of pattern recognition and nonlinear control. The floating-point processor is designed on a field programmable gate array (FPGA) chip to execute nonlinear functions required in the parallel calculation of the back-propagation algorithm. Internal weights of the RBF network are updated by the online learning back-propagation algorithm. The on-line learning process of the RBF chip is compared numerically with the results of the RBF neural network learning process written in the MATLAB program. The performance of the designed RBF neural chip is tested for the real-time pattern classification of the XOR logic. Performances are evaluated by comparing results from the MATLAB through extensive experimental studies.     

EMG-Based Motion Discrimination Using a Novel Recurrent Neural Network

This paper presents a pattern discrimination method for electromyogram (EMG) signals for application in the field of prosthetic control. The method uses a novel recurrent neural network based on the hidden Markov model. This network includes recurrent connections, which enable modeling time series, such as EMG signals. Weight coefficients in the network can be learned using a well-known back-propagation through time algorithm. Pattern discrimination experiments were conducted to demonstrate the feasibility and performance of the proposed method. We were able to successfully discriminate forearm motions using the EMG signals, and achieved considerably high discrimination performance compared with other discrimination methods.     

Fuzzy neural networks for learning fuzzy if-then rules

This study is dedicated to developing a fuzzy neural network with linguistic teaching signals. The proposed network, which can be applied either as a fuzzy expert system or a fuzzy controller, is able to process and learn the numerical information as well as the linguistic information. The network consists of two parts: (1) initial weights generation and (2) error back-propagation (EBP)-type learning algorithm. In the first part, a genetic algorithm (GA) generates the initial weights for a fuzzy neural network in order to prevent the network getting stuck to the local minimum. The second part employs the EBP-type learning algorithm for fine-tuning. In addition, the unimportant weights are eliminated during the training process. The simulated results do not only indicate that the proposed network can accurately learn the relations of fuzzy inputs and fuzzy outputs, but also show that the initial weights from the GA can coverage better and weight elimination really can reduce the training error. Moreover, real-world problem results show that the proposed network is able to learn the fuzzy IF-THEN rules captured from the retailing experts regarding the promotion effect on the sales.