Prediction of Hydroforming Characteristics using Random Neural Networks

In recent years, hydroforming has become the topic of a lot of active research. Researchers have been looking for better procedures and prediction tools to improve the quality of the product and reduce the prototyping cost. Similar to any other metal forming process, hydroforming leads to non-homogeneous plastic deformations of the workpiece. In this paper, a model is developed to predict the amount of deformation caused by hydroforming using random neural networks (RNNs). RNNs learn the behavior of a system from the provided input/output data in a manner similar to the way the human brain does. This is different from the usual connectionist neural network (NN) models which are based on simple functional analyses. Experimental data is collected and used in training as well as testing the RNNs. The RNN models have feedforward architectures and use a generalized learning algorithm in the training process. Multi-layer RNNs with as few as six neurons were used to capture the nonlinear correlations between the input and output data collected from an experimental setup. The RNN models were able to predict the center deflection, the thickness variation, as well as the deformed shape of circular plate specimens with good accuracy. Received: February 2004 / Accepted: September 2005     

基于递归神经网络的再入飞行器最优姿态控制

针对再入飞行器的姿态跟踪问题,基于递归神经网络提出最优跟踪控制.采用反步法和递归神经网络,设计自适应前馈控制,将再入飞行器的最优姿态跟踪问题转化为等价的姿态角误差/角速率误差最优调节问题.采用自适应动态规划技术,解决最优调节问题.引入神经网络估计最优控制中的代价函数,推导最优反馈控制律,同时保证Hamilton–Jac...     

循环神经网络研究综述

循环神经网络是神经网络序列模型的主要实现形式,近几年得到迅速发展,其是机器翻译、机器问题回答、序列视频分析的标准处理手段,也是对于手写体自动合成、语音处理和图像生成等问题的主流建模手段.鉴于此,循环神经网络的各分支按照网络结构进行详细分类,大致分为3大类:一是衍生循环神经网络,这类网络是基于基本RNNs模型的结构衍生变体,即对RNNs的内部结构进行修改;二是组合循环神经网络,这类网络将其他一些经典的网络模型或结构与第一类衍生循环神经网络进行组合,得到更好的模型效果,是一种非常有效的手段;三是混合循环神经网络,这类网络模型既有不同网络模型的组合,又在RNNs内部结构上进行修改,是同属于前两类网络分类的结构.为了更加深入地理解循环神经网络,进一步介绍与循环神经网络经常混为一谈的递归神经网络结构以及递归神经网络与循环神经网络的区别和联系.在详略描述上述模型的应用背景、网络结构以及模型变种后,对各个模型的特点进行总结和比较,并对循环神经网络模型进行展望和总结.     

Continuous attractors of a class of recurrent neural networks

Recurrent neural networks (RNNs) may possess continuous attractors, a property that many brain theories have implicated in learning and memory. There is good evidence for continuous stimuli, such as orientation, moving direction, and the spatial location of objects could be encoded as continuous attractors in neural networks. The dynamical behaviors of continuous attractors are interesting properties of RNNs. This paper proposes studying the continuous attractors for a class of RNNs. In this network, the inhibition among neurons is realized through a kind of subtractive mechanism. It shows that if the synaptic connections are in Gaussian shape and other parameters are appropriately selected, the network can exactly realize continuous attractor dynamics. Conditions are derived to guarantee the validity of the selected parameters. Simulations are employed for illustration.     

Stability analysis of discrete-time recurrent neural networks based on standard neural network models

In order to conveniently analyze the stability of various discrete-time recurrent neural networks (RNNs), including bidirectional associative memory, Hopfield, cellular neural network, Cohen-Grossberg neural network, and recurrent multiplayer perceptrons, etc., the novel neural network model, named standard neural network model (SNNM) is advanced to describe this class of discrete-time RNNs. The SNNM is the interconnection of a linear dynamic system and a bounded static nonlinear operator. By combining Lyapunov functional with S-Procedure, some useful criteria of global asymptotic stability for the discrete-time SNNMs are derived, whose conditions are formulated as linear matrix inequalities. Most delayed (or non-delayed) RNNs can be transformed into the SNNMs to be stability analyzed in a unified way. Some application examples of the SNNMs to the stability analysis of the discrete-time RNNs shows that the SNNMs make the stability conditions of the RNNs easily verified.     

Combining GRN modeling and demonstration-based programming for robot control

In recent years, gene regulatory networks (GRNs) have been proposed to work as reliable and robust control mechanisms for robots. Because recurrent neural networks (RNNs) have the unique characteristic of presenting system dynamics over time, we thus adopt such kind of network structure and the principles of gene regulation to develop a biologically and computationally plausible GRN model for robot control. To simulate the regulatory effects and to make our model inferable from time-series data, we also implement an enhanced network-learning algorithm to derive network parameters efficiently. In addition, we present a procedure of programming-by-demonstration to collect behavior sequence data of the robot as expression profiles, and then employ our network-modeling framework to infer controllers. To verify the proposed approach, experiments have been conducted, and the results show that our regulatory model can be inferred for robot control successfully.     

磁浮列车悬浮系统的神经网络建模研究

磁浮列车的悬浮系统是一个典型的非线性系统,其精确数学模型的建立非常困难。目前使用的系统模型大多是经过简化的近似线性化动力学模型,这样的模型在悬浮系统的研究中只起到方向上的指导作用,在工程实践中获取控制对象的精确模型具有重要的意义。神经网络不仅能够逼近复杂的非线性静态映射关系,同时也可以用于动态系统的特性学习,这里采用神经网络来建立悬浮系统的精确模型。文中简述了磁浮列车悬浮系统的基本结构和原理。讨论了非线性动态系统神经网络建模的一般方法。采用了输出反馈型的多层前向神经网络对悬浮系统进行了建模。并使用悬浮系统的输入输出数据对神经网络模型进行了训练和仿真,验证了该建模方法的可行性。     

Constrained motion control of flexible robot manipulators based on recurrent neural networks

In this paper, a neural network approach is presented for the motion control of constrained flexible manipulators, where both the contact force everted by the flexible manipulator and the position of the end-effector contacting with a surface are controlled. The dynamic equations for vibration of flexible link and constrained force are derived. The developed control, scheme can adaptively estimate the underlying dynamics of the manipulator using recurrent neural networks (RNNs). Based on the error dynamics of a feedback controller, a learning rule for updating the connection weights of the adaptive RNN model is obtained. Local stability properties of the control system are discussed. Simulation results are elaborated on for both position and force trajectory tracking tasks in the presence of varying parameters and unknown dynamics, which show that the designed controller performs remarkably well.     

A comparison of experimental designs in the development of a neural network simulation metamodel

In this case study, we investigate the effects of experimental design on the development of artificial neural networks as simulation metamodels. A simple, deterministic combat model developed within the paradigm of system dynamics provides the underlying simulation. The neural network metamodels are developed using six different experimental design approaches. These include a traditional full factorial design, a random sampling design, a central composite design, a modified Latin Hypercube design and designs supplemented with domain knowledge. The results from this case study show how much impact the experimental design chosen for the neural network training set can have on the predictive accuracy achieved by the metamodel. We compare the networks in terms of various performance measures. The neural network developed from the modified Latin Hypercube design supplemented with domain knowledge produces the best performance, outperforming networks developed from other designs of the same size.     

一种卷积神经网络和极限学习机相结合的人脸识别方法

卷积神经网络是一种很好的特征提取器,但却不是最佳的分类器,而极限学习机能够很好地进行分类,却不能学习复杂的特征,根据这两者的优点和缺点,将它们结合起来,提出一种新的人脸识别方法。卷积神经网络提取人脸特征,极限学习机根据这些特征进行识别。本文还提出固定卷积神经网络的部分卷积核以减少训练参 数,从而提高识别精度的方法。在人脸库ORL和XM2VTS上进行测试的结果表明,本文的结合方法能有效提高人脸识别的识别率,而且固定部分卷积核的方式在训练样本少时具有优势。     

Sliding mode neural network inference fuzzy logic control foractive suspension systems

In the automotive industry, suspension systems are designed to provide desirable vehicle ride and handling properties. This paper presents the development of a robust intelligent nonlinear controller for active suspension systems based on a comprehensive and realistic nonlinear model. The inherent complex nonlinear system model's structure, and the presence of parameter uncertainties, have increased the difficulties of applying conventional linear and nonlinear control techniques. Recently, the combination of sliding mode, fuzzy logic, and neural network methodologies has emerged as a promising technique for dealing with complex uncertain systems. In this paper, a sliding mode neural network inference fuzzy logic controller is designed for automotive suspension systems in order to enhance the ride and comfort. Extensive simulations are performed on a quarter-car model, and the results show that the proposed controller outperforms existing conventional controllers with regard to body acceleration, suspension deflection, and tire deflection     

Discrete-time delayed standard neural network model and its application

The research on the theory and application of artificial neural networks has achieved a great success over the past two decades. Recently, increasing attention has been paid to recurrent neural networks, which are rich in dynamics, highly parallelizable, and easily implementable with VLSI. Due to these attractive features, RNNs have widely been applied to system identification, control, optimization and associative memories[1]. Stability analysis, which is critical to any applications of R…     

时间压缩轨迹特征识别的火灾烟雾检测

目的 检测烟雾可以预警火灾。视频监控烟雾比传统的单点探测器监控范围更广、反应更灵敏,对环境和安装的要求也更低。但是目前的烟雾检测算法,无论是利用烟雾的色彩、纹理等静态特征和飘动、形状变化或者频域变化等动态特征的传统方法,还是采用卷积神经网络、循环神经网络等深度学习的方法,准确率和敏感性都不高。方法 本文着眼于烟雾的升腾特性,根据烟雾运动轨迹的右倾直线特性、连续流线型特性、低频特性、烟源固定特性和比例特性,采用切片的方式用卷积神经网络（CNN）抽取时间压缩轨迹的动态特征,用循环神经网络（RNN）抽取长程的时间关联关系,采用分块的方式提高空间分辨能力,能准确、迅速地识别烟雾轨迹并发出火灾预警。结果 对比CNN、C3D （3d convolutional networks）、traj+SVM （trajectory by support vector machine）、traj+RNNs （trajectory by recurrent neural network）和本文方法traj+CNN+RNNs （trajectory by convolutional neural networks and recurrent neural network）以验证效果。CNN和C3D先卷积抽取特征,后分类。traj+SVM采用SVM辨识视频时间压缩图像中的烟雾轨迹,traj+RNNs采用RNNs分辨烟雾轨迹,traj+CNN+RNNs结合CNN和RNNs识别轨迹。实验表明,与traj+SVM相比,traj+CNN+RNNs准确率提高了35.2%,真负率提高15.6%。但是深度学习的方法往往计算消耗很大,traj+CNN+RNNs占用内存2.31 GB,网络权重261 MB,前向分析时帧率49帧/s,而traj+SVM帧率为178帧/s。但与CNN、C3D相比,本文方法较轻较快。为了进一步验证方法的有效性,采用一般方法难以识别的数据进一步测试对比这5个方法。实验结果表明,基于轨迹的方法仍然取得较好的效果,traj+CNN+RNNs的准确率、真正率、真负率和帧率还能达到0.853、0.847、0.872和52帧/s,但是CNN、C3D的准确率下降到0.585、0.716。结论 从视频的时间压缩轨迹可以辨认出烟雾的轨迹,即便是早期的弱小烟雾也能准确识别,因此traj+CNN+RNNs辨识轨迹的方法有助于预警早期火灾。本文方法能够在较少的资源耗费下大幅度提高烟雾检测的准确性和敏感性。     

深度神经网络在多场景车辆属性识别中的研究

单一的车辆属性识别已无法满足现有的交通系统,为了提高在实际监控中车辆检测定位的可靠性,利用深度神经网络的思想建立了一种能够在近景监控场景和交通监控场景两种不同场景下识别车辆属性的模型,主要包括车辆类型和颜色两种属性类别。以YOLOv3神经网络为基础,对其进行改进,降低网络深度的同时保证准确率,将车辆类型和颜色属性进行分级训练,提高模型检测速度,此外,创建了AttributesCars车辆属性数据集完成数据准备工作。实验结果表明,所提方法在平均准确率为95.63%的前提下可以满足视频的实时性要求,并且在两种不同场景下均取得了不错的成绩,适用于多场景车辆属性识别。     

Evolving Recurrent Neural Network using Cartesian Genetic Programming to Predict The Trend in Foreign Currency Exchange Rates

Forecasting the foreign exchange rate is an uphill task. Numerous methods have been used over the years to develop an efficient and reliable network for forecasting the foreign exchange rate. This study utilizes recurrent neural networks (RNNs) for forecasting the foreign currency exchange rates. Cartesian genetic programming (CGP) is used for evolving the artificial neural network (ANN) to produce the prediction model. RNNs that are evolved through CGP have shown great promise in time series forecasting. The proposed approach utilizes the trends present in the historical data for its training purpose. Thirteen different currencies along with the trade-weighted index (TWI) and special drawing rights (SDR) is used for the performance analysis of recurrent Cartesian genetic programming-based artificial neural networks (RCGPANN) in comparison with various other prediction models proposed to date. The experimental results show that RCGPANN is not only capable of obtaining an accurate but also a computationally efficient prediction model for the foreign currency exchange rates. The results demonstrated a prediction accuracy of 98.872 percent (using 6 neurons only) for a single-day prediction in advance and, on average, 92% for predicting a 1000 days’ exchange rate in advance based on ten days of data history. The results prove RCGPANN to be the ultimate choice for any time series data prediction, and its capabilities can be explored in a range of other fields.     

Dynamic response of highway trucks due to road surface roughness

Vehicle characteristics, vehicle speed and road surface roughness are major factors influencing bridge dynamic response. In order to improve the previous vehicle model studies, vehicle models with seven or twelve degrees of freedom were developed for H20–44 and HS20–44 trucks, respectively. Vehicle models were validated by comparisons with the real truck dynamic systems.

The road surface roughness was generated from power spectral density (PSD) functions for very good, good, average, and poor roads. The impact factors of suspension and tire forces were obtained for vehicle models running on different classes of roads at various speeds. A comparison of computed and experimental impact results was also made.     

Critical dynamics study on recurrent neural networks: Globally exponential stability

Critical dynamics research of recurrent neural networks (RNNs) is very meaningful in both theoretical importance and practical significance. Due to the essential difficulty in analysis, there were only a few contributions concerning it. In this paper, we devote to study the critical dynamics behaviors for RNNs with general forms. By exploring some intrinsic features processed naturally by the nonlinear activation mappings of RNNs, and by using matrix measure theory, new criteria are found to ascertain the globally exponential stability of RNNs under the critical conditions. The results obtained here either yield new, or sharpen, extend or unify, to a large extent, most of the existing non-critical conclusions as well as the latest critical results.     

Multiobjective hybrid optimization and training of recurrent neural networks.

The application of neural networks to solve a problem involves tasks with a high computational cost until a suitable network is found, and these tasks mainly involve the selection of the network topology and the training step. We usually select the network structure by means of a trial-and-error procedure, and we then train the network. In the case of recurrent neural networks (RNNs), the lack of suitable training algorithms sometimes hampers these procedures due to vanishing gradient problems. This paper addresses the simultaneous training and topology optimization of RNNs using multiobjective hybrid procedures. The proposal is based on the SPEA2 and NSGA2 algorithms for making hybrid methods using the Baldwinian hybridization strategy. We also study the effects of the selection of the objectives, crossover, and mutation in the diversity during evolution. The proposals are tested in the experimental section to train and optimize the networks in the competition on artificial time-series (CATS) benchmark.     

Model dissection from earthquake time series: A comparative analysis using modern non-linear forecasting and artificial neural network approaches

This study utilizes two non-linear approaches to characterize model behavior of earthquake dynamics in the crucial tectonic regions of Northeast India (NEI). In particular, we have applied a (i) non-linear forecasting technique to assess the dimensionality of the earthquake-generating mechanism using the monthly frequency earthquake time series (magnitude ?4) obtained from NOAA and USGS catalogues for the period 1960–2003 and (ii) artificial neural network (ANN) methods—based on the back-propagation algorithm (BPA) to construct the neural network model of the same data set for comparing the two. We have constructed a multilayered feed forward ANN model with an optimum input set configuration specially designed to take advantage of more completely on the intrinsic relationships among the input and retrieved variables and arrive at the feasible model for earthquake prediction. The comparative analyses show that the results obtained by the two methods are stable and in good agreement and signify that the optimal embedding dimension obtained from the non-linear forecasting analysis compares well with the optimal number of inputs used for the neural networks.The constructed model suggests that the earthquake dynamics in the NEI region can be characterized by a high-dimensional chaotic plane. Evidence of high-dimensional chaos appears to be associated with “stochastic seasonal” bias in these regions and would provide some useful constraints for testing the model and criteria to assess earthquake hazards on a more rigorous and quantitative basis.