基于脉冲神经网络的迁移学习算法与软件框架

使用脉冲序列进行数据处理的脉冲神经网络具有优异的低功耗特性,但由于学习算法不成熟,多层网络训练存在收敛困难的问题。利用反向传播网络具有学习算法成熟和训练速度快的特点,设计一种迁移学习算法。基于反向传播网络完成训练过程,并通过脉冲编码规则和自适应的权值映射关系,将训练结果迁移至脉冲神经网络。实验结果表明,在多层脉冲神经网络中,迁移学习算法能够有效解决训练过程中收敛困难的问题,在MNIST数据集和CIFAR-10数据集上的识别准确率分别达到98.56%和56.00%,且具有微瓦级别的低功耗特性。

Transfer Learning Algorithm and Software Framework Based on Spiking Neuron Network

Spiking Neuron Network(SNN)uses spike sequence for data processing,so it has the excellent characteristic of low power consumption.However,due to the immaturity of learning algorithm,the multilayer network training has difficulty in convergence.Utilizing the mature learning algorithm and fast training speed of the back propagation network,this paper proposes a transfer learning algorithm.The algorithm completes the training process based on the back propagation network and transfers the training results to the spiking neuron networks through the spike coding rules and the adaptive weight mapping relationship.Experimental results show that the transfer learning algorithm can effectively solve the convergence problem in the training process of multilayer spiking neuron networks.The recognition accuracy on the MNIST dataset and CIFAR-10 dataset can be up to 98.56%and 56.00%respectively,with low power consumption at the microwatt level.