自组织特征映射神经网络的改进及应用研究

为了提高自组织特征映射(SOM)神经网络学习速度及分类精度,对初始连接权值及竞争层神经元数的确定方法进行改进。提出用聚类方法确定初始权值的新方法,还提出了采用聚类数与邻域之和确定竞争层神经元数的方法,并给出了改进后的SOM分类算法。将改进的SOM网络用于储粮害虫分类,采用留一方法进行分类验证实验。仿真结果表明,改进后的SOM网络在学习速度和分类精度方面都有明显提高,证明了该方法的有效性。     

基于混合神经网络的入侵检测技术

本文将自组织映射神经网络与学习矢量量化的学习算法混合,用于基于程序行为的本机入侵异常检测中。考虑到目前很多方法存在成功率低以及训练时间长的缺点,本文利用自组织映射神经网络对数据聚类,然后通过学习矢量量化对已聚类的数据再进行分类。仿真实践证明,这种混合优化技术可使分类的边界得以收缩,可提高分类精度和准度,提高了入侵检验的成功率。     

一种基于改进神经网络的高效模糊聚类算法

针对利用自组织特征映射(SOFM)神经网络进行模糊聚类时出现的一些问题,提出改进结构的神经网络,采用自适应的聚类初值,能够实现高维数据和任意形状族的聚类,与具有同样聚类效果的其他算法相比,具有较低的时间复杂度。仿真实验结果表明,该聚类算法比单个的神经网络聚类算法和同类其他算法更有效。     

基于SOFM网络的聚类分析

基于自组织特征映射网络的聚类分析，是在神经网络基础上发展起来的一种新的非监督聚类方法，分析了基于自组织特征映射网络聚类的学习过程，分析了权系数自组织过程中邻域函数和学习步长的一般取值问题，给出了基于自组织特征映射网络聚类实现的具体算法，并通过实际示例测试，证实了算法的正确性。     

串联机器人轨迹跟踪控制模糊自适应PID算法的误差修正

提出了一种基于改进PID控制算法的串联机器人轨迹跟踪控制策略,首先采用减聚类的方法和改进的Logistic映射对RBF神经网络进行聚类中心的优化,然后将改进RBF神经网络中的自适应学习机制和自调整能力应用于传统PID控制算法中,对PID控制算法进行最优PID控制参数的选取。仿真实验表明,提出的串联机器人轨迹跟踪控制策略相比较传统PID控制算法,其误差更小,精度更高。     

自组织映射(SOM)聚类算法的研究

通过自组织映射神经网络实现的聚类算法能将任意维数的输入信号模式转变为一维或二维的离散映射,以拓扑有序的方式自适应实现这个变换.介绍自组织映射聚类算法的原理,通过实验进行仿真,结果表明自组织映射聚类算法是可行有效的.     

利用自组织特征映射神经网络进行可视化聚类

自组织特征映射作为一种神经网络方法，在数据挖掘、机器学习和模式分类中得到了广泛的应用。它将高维输人空间的数据映射到一个低维、规则的栅格上，从而可以利用可视化技术探测数据的固有特性。该文说明了自组织特征映射神经网络的工作原理和具体实现算法，同时利用一个算例展示了利用自组织特征映射进行聚类时的可视化特性，包括聚类过程的可视化和聚类结果的可视化，这也是自组织特征映射得到广泛应用的原因之一。     

基于核的双自组织特征映射网络在预测中的应用

提出了一种基于核的双自组织特征映射网络.该网络通过同时使用两个相关的映射网络扩展了原有的自组织神经网络,针对自组织特征映射网络容易受到高噪声的影响,将核学习的方法应用于自组织映射聚类中,以核函数代替了原始数据在特征空间中映射值的内积,传统的SOM算法使用的是欧氏距离,而KSOM通过使用不同的核函数为原始空间诱导出不同的欧式距离,这样就提高了算法的鲁棒性.将改进后的神经网络用于金融时间序列的预测,其实验结果表明,改进后的神经网络具有较强的鲁棒性.     

基于样本自组织聚类的BP神经网络预测模型

根据实际应用中神经网络训练样本通常具有内在特征和规律性,提出一种基于样本自组织聚类的BP神经网络预测模型。通过自组织竞争网络的聚类特征,改善样本训练对BP网络性能的影响。BP神经网络采用收敛速度较快和误差精度较高的动量—自适应学习速率调整算法。并通过基于这种模型的空气质量预测实验,表明基于样本自组织聚类的BP神经网络预测模型首先会提高收敛速度,其次会减少陷入局部最小的可能,提高预测精度。     

基于多维自组织特征映射的聚类算法研究

作为神经网络的一种方法,自组织特征映射在数据挖掘、模式分类和机器学习中得到了广泛应用.本文详细讨论了自组织特征映射的聚类算法的工作原理和具体实现算法.通过系统仿真实验分析,SOFMF算法很好地克服了许多聚类算法存在的问题,在时间复杂度上具有良好的性能.     

多获胜节点SOM及其在股票分析中的应用

为了增强自组织映射(self-organizing map,SOM)网络的动态竞争和聚类能力,提高解的精度,在无监督的SOM神经网络的基础上,通过拓广获胜节点的数量,改进网络中的邻域函数和连接权函数等方法,提出具有多获胜节点的SOM模型.为了避免多个输入样本映射到同一个输出节点,还提出了禁忌映射的方法.为了验证所提出的方法的有效性,以股票的聚类分析为实例,对该方法进行了检验.通过对每股收益、每股净资产、净资产收益率、每股经营性现金流量及净利润等5项反映上市公司综合盈利能力的财务指标进行了模拟实验,所得的数值结果表明,在标准SOM及所提出的几种多获胜节点SOM网络模型中,具有双获胜节点(SOM with 2 winners,SOM2W)的网络模型获得了最好的聚类效果.结合实验结果对网络模型的进一步分析也表明,SOM2W的聚类能力优于标准SOM及其他网络模型.该模型为股票的分析和选择提供了一种可行的途径,在金融领域具有潜在的应用价值.     

在数据挖掘中基于SOM网络的数据分析可视化设计

阐述了SOM（Self-Organizing Map)自组织神经网络和Davies-Bouldin聚类判定法，采用SOM网络构建了数据挖掘中数据模型，设计了SOM网络数据分析可视化软件，并进行了详细的可视化数据分析，同时，设计的软件已经初步应用到数据挖掘当中，取得了良好的效果。     

On robustness of radial basis function network with input perturbation

In this article, we have proposed a methodology for making a radial basis function network (RBFN) robust with respect to additive and multiplicative input noises. This is achieved by properly selecting the centers and widths for the radial basis function (RBF) units of the hidden layer. For this purpose, firstly, a set of self-organizing map (SOM) networks are trained for center selection. For training a SOM network, random Gaussian noise is injected in the samples of each class of the data set. The number of SOM networks is same as the number of classes present in the data set, and each of the SOM networks is trained separately by the samples belonging to a particular class. The weight vector associated with a unit in the output layer of a particular SOM network corresponding to a class is used as the center of a RBF unit for that class. To determine the widths of the RBF units, p-nearest neighbor algorithm is used class-wise. Proper selection of centers and widths makes the RBFN robust with respect to input perturbation and outliers present in the data set. The weights between the hidden and output layers of RBFN are obtained by pseudo inverse method. To test the robustness of the proposed method in additive and multiplicative noise scenarios, ten standard data sets have been used for classification. Proposed method has been compared with three existing methods, where the centers have been generated in three ways: randomly, using k-means algorithm, and based on SOM network. Simulation results show the superiority of the proposed method compared to those methods. Wilcoxon signed-rank test also shows that the proposed method is statistically better than those methods.

     

The effect of sample size on the extended self-organizing map network—A market segmentation application

Kohonen's self-organizing map (SOM) network maps input data to a lower dimensional output map. The extended SOM network further groups the nodes on the output map into a user specified number of clusters. Kiang, Hu and Fisher used the extended SOM network for market segmentation and showed that the extended SOM provides better results than the statistical approach that reduces the dimensionality of the problem via factor analysis and then forms segments with cluster analysis. In this study, we examined the effect of sample size on the extended SOM compared to that on the factor/cluster approach. Two sampling schemes, one with random sampling and the other one with proportionate sampling were used. Comparisons were made using the correct classification rates between the two approaches at various sample sizes. Unlike statistical models, neural networks are not dependent on statistical assumptions. Thus, the results for neural network models are stable across sample sizes but sensitive to initial weights and model specifications.     

Application of feature selection methods for automated clustering analysis: a review on synthetic datasets

The effective modelling of high-dimensional data with hundreds to thousands of features remains a challenging task in the field of machine learning. This process is a manually intensive task and requires skilled data scientists to apply exploratory data analysis techniques and statistical methods in pre-processing datasets for meaningful analysis with machine learning methods. However, the massive growth of data has brought about the need for fully automated data analysis methods. One of the key challenges is the accurate selection of a set of relevant features, which can be buried in high-dimensional data along with irrelevant noisy features, by choosing a subset of the complete set of input features that predicts the output with higher accuracy comparable to the performance of the complete input set. Kohonen’s self-organising neural network map has been utilised in various ways for this task, such as with the weighted self-organising map (WSOM) approach and this method is reviewed for its efficacy. The study demonstrates that the WSOM approach can result in different results on different runs on a given dataset due to the inappropriate use of the steepest descent optimisation method to minimise the weighted SOM’s cost function. An alternative feature weighting approach based on analysis of the SOM after training is presented; the proposed approach allows the SOM to converge before analysing the input relevance, unlike the WSOM that aims to apply weighting to the inputs during the training which distorts the SOM’s cost function, resulting in multiple local minimums meaning the SOM does not consistently converge to the same state. We demonstrate the superiority of the proposed method over the WSOM and a standard SOM in feature selection with improved clustering analysis.

     

SOM神经网络在独立学院招生决策中的应用

自组织映射(SOM)是一种竞争型无指导学习的神经网络方法。SOM神经网络已广泛地应用于模式聚类、模式识别、拓扑不变性映射等方面。本文利用SOM对中国31个省份进行聚类分析,建立独立学院招生决策模型。首先,选取各省份的报到率、第一志愿率和人均GDP等作为SOM神经网络的输入模式;然后,用SOM进行聚类;最后,对聚类结果进行分析得出各类的生源地特征和等级。实验结果表明,利用SOM对生源地进行聚类分析是可行的、有效的,可以避开人的主观因素,更迅速客观地得到聚类结果。它为独立学院编制招生计划和招生宣传方案提供了一种新的参考依据,在独立学院招生领域具有较好的应用前景。     

一种 SOM 和 K-Means 结合算法在 SMT 焊接质量中的应用研究

针对SOM 神经网络算法复杂度高精度低以及K-Means聚类算法需事先确定聚类（簇）数目和随机选取初始聚类中心的不足,论文提出了一种SOM神经网络与K-M eans相结合的S-K二次聚类算法,进行功能互补。该算法应用在SM T焊接质量上,能提高数据聚类信息的精确度,直观地看到数据的分布情况,改善系统的整体性能。     

ParaGro: a learning algorithm for growing parallel self-organizing maps with any input/output dimensions

Self-organizing maps (SOM) have become popular for tasks in data visualization, pattern classification or natural language processing and can be seen as one of the major contemporary concepts for artificial neural networks. The general idea is to approximate a high dimensional and previously unknown input distribution by a lower dimensional neural network structure so that the topology of the input space is mapped closely. Not only is the general topology retained but the relative densities of the input space are reflected in the final output. Kohonen maps also have the property of neighbor influence. That is, when a neuron decides to move, it pulls all of its neighbors in the same direction modified by an elasticity factor. We present a SOM that processes the whole input in parallel and organizes itself over time. The main reason for parallel input processing lies in the fact that knowledge can be used to recognize parts of patterns in the input space that have already been learned. Thus, networks can be developed that do not reorganize their structure from scratch every time a new set of input vectors is presented, but rather adjust their internal architecture in accordance with previous mappings. One basic application could be a modeling of the whole–part relationship through layered architectures.

The presented neural network model implements growing parallel SOM structure for any input and any output dimension. The advantage of the proposed algorithm is in its property of processing the whole input space in one step. All nodes of the network compute their step simultaneously, and are, therefore, able to detect known patterns without reorganizing. The simulation results support the theoretical framework presented in the following sections.     

A combined measure for quantifying and qualifying the topology preservation of growing self-organizing maps

The Self-Organizing Map (SOM) is a neural network model that performs an ordered projection of a high dimensional input space in a low-dimensional topological structure. The process in which such mapping is formed is defined by the SOM algorithm, which is a competitive, unsupervised and nonparametric method, since it does not make any assumption about the input data distribution. The feature maps provided by this algorithm have been successfully applied for vector quantization, clustering and high dimensional data visualization processes. However, the initialization of the network topology and the selection of the SOM training parameters are two difficult tasks caused by the unknown distribution of the input signals. A misconfiguration of these parameters can generate a feature map of low-quality, so it is necessary to have some measure of the degree of adaptation of the SOM network to the input data model. The topology preservation is the most common concept used to implement this measure. Several qualitative and quantitative methods have been proposed for measuring the degree of SOM topology preservation, particularly using Kohonen's model. In this work, two methods for measuring the topology preservation of the Growing Cell Structures (GCSs) model are proposed: the topographic function and the topology preserving map.     

改进SOM神经网络在电力调度故障诊断中的应用

为了解决电力调度自动化系统中故障、安全监测不到位,尤其是缺少精确定位和关联分析等问题,利用改进的SOM神经网络提出了一种故障诊断模型.首先,在分析调度系统历史数据基础上,提取故障的特征向量,建立学习样本.接着通过算法训练输入和输出间的内在联系,供后续测试验证使用.最后,在已具备数据内在映射关系的网络中,测试待检测数据,验证其故障诊断的效果.最后的结果表明,此模型对不同类型故障识别和诊断能力较强,是一种行之有效的人工智能诊断方法.