基于特征聚类的稀疏自编码快速算法

稀疏自编码网络在自然语言、图像处理等领域都取得了显著效果.已有的研究表明增加网络提取的特征个数可以优化稀疏自编码网络的处理效果，同时该操作将导致网络训练耗时过长.为尽可能减少网络的训练时间，本文提出了一种基于特征聚类的稀疏自编码快速算法.本算法首先根据K均值聚类最优数确定本质特征的个数，再由网络训练得到本质特征，并通过旋转扭曲增加特征的多样性，使网络处理效果得到提升的同时，减少网络训练耗间.实验在标准的手写体识别数据库MNIST和人脸数据库CMU-PIE上进行，结果表明本文所提算法能在保证网络正确率有所提升的同时，大幅度缩短网络训练耗时.

An Optimized Sparse Auto-encoder Network Based on Feature Clustering

The method of deep sparse auto-encoder networks has achieved state-of-art performance in the fields of image processing and natural language processing.It's been proved that higher accuracy of deep sparse auto-encoder networks is obtained by the increase of features' number,however,it also leads to a longer training time.In this paper,an optimized sparse auto-encoder networks which based on feature clustering is been presented for both classification accuracy enhancement and training time decreasing.The proposed method first get the number of substantive features by optimizing k-means clustering.Then initialize the network with that number and obtain the substantive features by training again the network.Finally the improvement of feature varieties is achieved by rotation and distortion of the substantive features.In the experiments,the improvement of classification accuracy and reduction of training time is verified by comparing the performance of optimized sparse auto-encoder with normal sparse auto-encoder in the basic dataset MNIST and CMU-PIE.