首页 | 本学科首页   官方微博 | 高级检索  
     

基于SNN神经元重分布的NEST仿真器性能优化
引用本文:刘家航,郁龚健,李佩琦,华夏,柴志雷,陈闻杰.基于SNN神经元重分布的NEST仿真器性能优化[J].计算机工程,2022,48(3):189-196.
作者姓名:刘家航  郁龚健  李佩琦  华夏  柴志雷  陈闻杰
作者单位:1. 江南大学 人工智能与计算机学院, 江苏无锡 214122;2. 江苏省模式识别与计算智能工程实验室, 江苏 无锡 214122;3. 华东师范大学 软硬件协同设计技术与应用教育部工程研究中心, 上海 200062
基金项目:国家自然科学基金“基于工作负载表征的类脑体系结构基准测试模型与自动映射方法研究”(61972180);
摘    要:为满足大规模脉冲神经网络(SNN)的计算需求,类脑计算系统通常需要采用大规模并行计算平台。然而随着节点数量的增多,通信在仿真中所占比例大幅增加,导致计算效率下降。类脑模拟器开源软件NEST采用缓冲区大小相等的策略,有效缩短了通信时间,但是由于缓冲区互相无交流,使得通信数据量持续增加,因此其在能耗方面表现较差。分析NEST集群的负载特性,针对其中的通信问题进行稀疏性优化,提出基于SNN子图跨节点优化的神经元重分布算法ReLOC。通过优化SNN子图的跨节点分布减少每一轮神经元到进程的数量,从而减少跨节点脉冲,使进程间通信更加稀疏,达到缩减每一轮通信进程的目的。在此基础上,以稀疏交换的思想对NEST本身的通信机制进行改进,使有脉冲交换的进程进行数据交换,从而在连接稀疏的情况下提升通信效率。以包含28个Xilinx PYNQ节点的计算集群作为实验平台,运行皮质微电路SNN模型和平衡随机网络模型,验证ReLOC算法的有效性。实验结果表明,相比循环分布算法,重分布算法能够使通信的平均稀疏性提高20%,同时配合稀疏交换最多可使通信能耗减少98.63%。

关 键 词:脉冲神经网络  神经元重分布  PYNQ集群  NEST仿真器  稀疏交换  
收稿时间:2021-02-25
修稿时间:2021-04-15

Performance Optimization of NEST Simulator Based on SNN Neuron Relocation
LIU Jiahang,YU Gongjian,LI Peiqi,HUA Xia,CHAI Zhilei,CHEN Wenjie.Performance Optimization of NEST Simulator Based on SNN Neuron Relocation[J].Computer Engineering,2022,48(3):189-196.
Authors:LIU Jiahang  YU Gongjian  LI Peiqi  HUA Xia  CHAI Zhilei  CHEN Wenjie
Affiliation:1. School of Artifical Intelligence and Computer Science, Jiangnan University, Wuxi, Jiangsu 214122, China;2. Jiangsu Provincial Engineering Laboratory of Pattern Recognition and Computational Intelligence, Wuxi, Jiangsu 214122, China;3. MoE Engineering Research Center for Software/Hardware Co-design Technology, East China Normal University, Shanghai 200062, China
Abstract:To meet the computational requirements of large-scale Spiking Neural Network(SNN),brain like computing systems generally require large-scale parallel computing platforms.However,the proportion of communication steps required to conduct a simulation increases greatly with increasing numbers of nodes,resulting in reduced computational efficiency.Open-source brain like simulation software NEST uses the strategy of equal buffer size,which considerably reduces the required communication time.However,due to the lack of communication between buffers,the amount of communication data continues to increase.Therefore,the performance of such methods is poor in terms of energy consumption.To solve this problem,this paper analyzes the load characteristics of a NEST cluster and carries out a sparsity optimization of the communication system.Furthermore,it proposes a neuron relocation algorithm called ReLOC based on SNN subgraph crossnode optimization.Optimizing the cross-node distribution of the SNN subgraph reduces the number of neurons to be processed in each round.This reduces the cross node pulse,increases the sparsity of the inter-process communication,and reduces the length of each round of the communication process.On this basis,the communication mechanism of NEST is improved based on the idea of sparse exchange,enabling the process to exchange data via a pulse exchange mechanism and improving communication efficiency under conditions of sparse connection.Using a computing cluster containing 28 Xilinx PYNQ nodes as an experimental platform,this paper implements a cortical microcircuit SNN model and a balanced random network model to verify the effectiveness of the proposed ReLOC algorithm.Experimental results show that ReLOC algorithm can improve the average communication sparsity by 20%,and reduce communication energy consumption by up to 98.63%.
Keywords:Spiking Neural Network(SNN)  neuron relocation  PYNQ cluster  NEST simulator  sparse exchange
本文献已被 维普 万方数据 等数据库收录!
点击此处可从《计算机工程》浏览原始摘要信息
点击此处可从《计算机工程》下载全文
设为首页 | 免责声明 | 关于勤云 | 加入收藏

Copyright©北京勤云科技发展有限公司  京ICP备09084417号