基于构造性形态学神经网络的一种提升算法

构造性形态学神经网络算法（CMNN）是一种数学形态学与传统的神经网络模型相结合的一种非线性神经网络,有较强的实用性。其训练算法根据形态学联想记忆而来,在测试过程中采用形态学算子将测试样本归类于训练得到的超盒之中。由于其测试过程无法正确地将落在超盒外的样本进行分类,后有人提出了一种基于模糊格的形态学神经网络（FL-CMNN）,该算法用样本与超盒的隶属度判断提高了原CMNN算法的分类效果,但增加了算法的复杂程度且分类效果不稳定。这里提出一种基于构造性形态学神经网络算法的提升算法（LCMNN）,该算法继承了原有的形态学算子运算速度快的优点且能够将落在超盒之外的样本进行准确地归类。数值实验表明,基于构造性形态学神经网络算法的提升算法（LCMNN）与其他几种算法相比,能够达到最好的分类效果,而且简单易行,计算时间少。     

Structural synthesis of fast two-layer neural networks

Methods of construction of structural models of fast two-layer neural networks are considered. The methods are based on the criteria of minimum computing operations and maximum degrees of freedom. Optimal structural models of two-layer neural networks are constructed. Illustrative examples are given. Translated from Kibernetika i Sistemnyi Analiz, No. 4, pp. 47–56, July–August, 2000.     

模块小波神经网络在工业产品质量控制中的应用

针对输入空间包含多种类型的数据时，以单一的神经网络为模型，其收敛很困难的问题，提出一种基于模块小波神经网络的建模方法。利用分而治之思想，模块神经网络通过一个门控网络进行分类和协调，可以将一个复杂任务分解成几个简单的子任务，每个子任务由一个局部专家网络学习，与传统的模块网络不同，这里的专家网络是小波网络而不是BP网络，将所提出的网络模型用于热连轧产品质量建模，并与单一的神经网络建模结果进行比较，建模结果表明，模块小波神经网络模型优于单一神经网络模型。     

基于多BP神经网络的内存组合特征分类方法

针对内存数据在攻击行为发生后会发生改变,而传统完整性度量系统使用的基准值度量存在检测率低、灵活性不足等问题的现象,提出一种基于多反向传播(BP)神经网络的内存组合特征分类方法.首先,将内存数据通过度量对象提取算法(MOEA)提取特征值;然后,分别使用不同的BP神经网络进行模型训练;最后,再通过一个BP神经网络对所得数据...     

神经网络结构动态优化设计的分析与展望

阐述了神经网络结构设计对神经网络性能的影响. 介绍了动态结构神经网络, 尤其是增长型和修剪型神经网络研究的发展过程, 分析了动态设计方法研究在计算能力、学习理论和网络的稳定性等方面取得的成果. 最后对神经网络动态设计的研究进行总结, 给出了神经网络结构动态设计研究的发展趋势.     

Neurobiology suggests the design of modular architectures for neural control

The existence of modular structures in the biological world strongly suggests that the training of this kind of structure is actually feasible. It is a key indication for the development of neural network applications, especially in the field of robotics. Indeed, a single network can only efficiently treat problems with few independent variables; the combination of several networks is necessary to address more complex tasks. We investigate learning techniques and show that using a particular form of architecture can ease the training of a modular structure: a bi-directional structure that allows combining several neural networks. The approach is illustrated with Kohonen's self-organizing maps for a robotic visual servoing task.     

利用离散Hopfield网络的码本设计方法

论文提出了一种利用Hopfield网络的码本设计方法,分析了LBG算法和离散Hopfield网络的特点,针对该特点构造聚类表格,并按离散Hopfield神经网络串行方式运行,从而得到最终码字集。通过实验表明,在码本大小相同的情况下,峰值信噪比提高了2.742～3.825 dB,生成的码本质量较传统的LBG算法更加有效。     

新型前向神经网络设计方法在软测量中的应用

软测量模型广泛应用于替代实物传感器预测与估计不可在线测量的变量.从利用前向神经网络建立复杂的软测量模型的问题出发,从空间理论的角度揭示了前向神经网络以及各层的数学模型,并提出了一种新型的网络设计方法.最后,通过上述算法建立了某型无人机飞行仿真系统中的角速度软测量模型.     

A comparison between functional networks and artificial neural networks for the prediction of fishing catches

In recent years, functional networks have emerged as an extension of artificial neural networks (ANNs). In this article, we apply both network techniques to predict the catches of the Prionace Glauca (a class of shark) and the Katsowonus Pelamis (a variety of tuna, more commonly known as the Skipjack). We have developed an application that will help reduce the search time for good fishing zones and thereby increase the fleets competitivity. Our results show that, thanks to their superior learning and generalisation capacities, functional networks are more efficient than ANNs. Our data proceeds from remote sensors. Their spectral signatures allow us to calculate products that are useful for ecological modelling. After an initial phase of digital image processing, we created a database that provides all the necessary patterns to train both network types.     

A modular neural network for super-resolution of human faces

This paper presents the original and versatile architecture of a modular neural network and its application to super-resolution. Each module is a small multilayer perceptron, trained with the Levenberg-Marquardt method, and is used as a generic building block. By connecting the modules together to establish a composition of their individual mappings, we elaborate a lattice of modules that implements full connectivity between the pixels of the low-resolution input image and those of the higher-resolution output image. After the network is trained with patterns made up of low and high-resolution images of objects or scenes of the same kind, it will be able to enhance dramatically the resolution of a similar object’s representation. The modular nature of the architecture allows the training phase to be readily parallelized on a network of PCs. Finally, it is shown that the network performs global-scale reconstruction of human faces from very low resolution input images.     

层次化双注意力神经网络模型的情感分析研究

在篇章级的情感分类中由于篇章级文本较长,特征提取较普通句子级分析相对较难,大多方法使用层次化的模型进行篇章文本的情感分析,但目前的层次化模型多以循环神经网络和注意力机制为主,单一的循环神经网络结构提取的特征不够明显。本文针对篇章级的情感分类任务,提出一种层次化双注意力神经网络模型。首先对卷积神经网络进行改进,构建词注意力卷积神经网络。然后模型从两个层次依次提取篇章特征,第一层次使注意力卷积神经网络发现每个句子中的重要词汇,提取句子的词特征,构建句子特征向量;第二层次以循环神经网络获取整个篇章的语义表示,全局注意力机制发现篇章中每个句子的重要性,分配以不同的权重,最后构建篇章的整体语义表示。在IMDB、YELP 2013、YELP 2014数据集上的实验表明,模型较当前最好的模型更具优越性。     

Polynomial neural networks architecture: analysis and design

In this study, we introduce and investigate a class of neural architectures of Polynomial Neural Networks (PNNs), discuss a comprehensive design methodology and carry out a series of numeric experiments. Two kinds of PNN architectures, namely a basic PNN and a modified PNN architecture are discussed. Each of them comes with two types such as the generic and the advanced type. The essence of the design procedure dwells on the Group Method of Data Handling. PNN is a flexible neural architecture whose structure is developed through learning. In particular, the number of layers of the PNN is not fixed in advance but becomes dynamically meaning that the network grows over the training period. In this sense, PNN is a self-organizing network. A comparative analysis shows that the proposed PNN are models with higher accuracy than other fuzzy models.     

分块二维保局投影方法及其在人脸识别中的应用

提出了一种基于图像分块的二维保局投影(分块2DLPP)的人脸识别方法.先对原始图像矩阵进行分块,然后对分块子图像施行2DLPP方法,再将各个分块按照一定的次序整合起来进行特征提取,从而实现图像降维.该方法能有效地提取图像的局部特征.实验表明:该方法在识别性能上优于2DLPP方法.     

Intelligent design of shear wall layout based on graph neural networks

Structural scheme design of shear wall structures is important because it is the first stage that guides the project along its entire structural design process and significantly impacts the subsequent design stages. Design methods for shear wall layouts based on deep generative algorithms have been proposed and achieved some success. However, current generative algorithms rely on pixel images to design shear wall layouts, which have many model parameters and require intensive calculations. Moreover, it is challenging to use pixel image-based methods to reflect the topological characteristics of structures and connect them with the subsequent design stages. The above defects can be effectively solved by representing a shear wall structure in graph data form and adopting graph neural networks (GNNs), which have a robust topological-characteristic-extraction capability. However, there is no existing research using GNN methods in the design of shear wall structures owing to the lack of graph representation methods and high-quality structural graph data for shear walls. Therefore, this study develops an intelligent design method for shear wall layouts based on GNNs. Two graph representation methods for a shear wall structure—graph edge representation and graph node representation—are examined. A data augmentation method for shear wall structures in graph data form is established to enhance the universality of the GNN performance. An evaluation method for both graph representation methods is developed. Case studies show that the shear wall layout designed using the established GNN method is highly similar to the design by experienced engineers.     

基于神经网络的电动执行器状态诊断

本文以神经网络为工具,以电动执行器为研究对象,提出基于自组织竞争型神经网络的电动执行器诊断方法,利用该网络的非线性动态系统辨识能力,通过比较系统预测值和实际参数测量值,达到状态诊断的目的。本系统以VB6.0为开发工具,以SQLServer2000为后台数据库,实现了对电动执行器的智能状态诊断。     

A feasible intrusion detector for recognizing IIS attacks based on neural networks

Most activities on the Internet can be recorded as log files of websites and website administrators can inspect log files to locate problems after any network intrusion occurs. However, since log files usually contain a huge quantity of data, without effective methods, it is generally not feasible for administrators to determine the concealed meanings within log files. One method for dealing with this issue is to use neural networks; this is an effective means to distinguish and classify abnormal data in log files, thus alleviating the administrator's burden. This paper presents the results of a study on intrusion detection on IIS (Internet information services) utilizing a hybrid intrusion detection system (IDS). The feasibility of the hybrid IDS is validated based on the Internet scanner system (ISS). In the intrusion detection system proposed, we used four different training data sets: 200, 800, 1400, and 2000. The system is trained either by Taguchi's experimental design or full factorial experimental design under different training data sets; the former can save much more time than the latter. Under Taguchi's experimental design, the best results are obtained when the training data set is of size 1400; overall accuracy in this case is 97.5%. On the contrary, for the full factorial experimental design, the best results are reached when the training data set is of size 2000; overall accuracy is 97.6%. Our study indicates that when to retrain the detector and how much time to allow for this training fully depend on the downgrade percentage of the detection rate, which determines the size of the retraining data set. To reduce the void time for updating the detector, the downgrade percentage should be restricted.     

融合迁移学习和神经网络的皮肤病诊断方法

针对医学特征对患者病情发展的时间顺序无法有效表达,医学特征构建工作耗费大量人工成本,以及皮肤病数据样本数量较少等问题,提出了融合迁移学习和神经网络的皮肤病辅助诊断方法。该方法将TextLSTM(long short term memory neural network for text)、TextCNN(convolutional neural network for text)以及RCNN(recurrent convolutional neural networks for text classification)等3种基于神经网络的文本分类模型应用于皮肤病辅助诊断,同时融入迁移学习技术,能够在一定程度上将皮肤病专业书籍中的理论知识迁移到诊断模型中。在皮肤病多分类实验中,本文方法的正确率优于对比方法;在皮肤病二分类实验中,本文方法的召回率优于对比方法。迁移学习对实验结果的积极影响率高于75%。     

Design of information granule-oriented RBF neural networks and its application to power supply for high-field magnet

To realize effective modeling and secure accurate prediction abilities of models for power supply for high-field magnet (PSHFM), we develop a comprehensive design methodology of information granule-oriented radial basis function (RBF) neural networks. The proposed network comes with a collection of radial basis functions, which are structurally as well as parametrically optimized with the aid of information granulation and genetic algorithm. The structure of the information granule-oriented RBF neural networks invokes two types of clustering methods such as K-Means and fuzzy C-Means (FCM). The taxonomy of the resulting information granules relates to the format of the activation functions of the receptive fields used in RBF neural networks. The optimization of the network deals with a number of essential parameters as well as the underlying learning mechanisms (e.g., the width of the Gaussian function, the numbers of nodes in the hidden layer, and a fuzzification coefficient used in the FCM method). During the identification process, we are guided by a weighted objective function (performance index) in which a weight factor is introduced to achieve a sound balance between approximation and generalization capabilities of the resulting model. The proposed model is applied to modeling power supply for high-field magnet where the model is developed in the presence of a limited dataset (where the small size of the data is implied by high costs of acquiring data) as well as strong nonlinear characteristics of the underlying phenomenon. The obtained experimental results show that the proposed network exhibits high accuracy and generalization capabilities.