自动化学报2024,Vol.50Issue(9) :1724-1735.DOI:10.16383/j.aas.c230656

基于自适应时间步脉冲神经网络的高效图像分类

Adaptive Timestep Improved Spiking Neural Network for Efficient Image Classification

李千鹏 贾顺程 张铁林 陈亮
自动化学报2024,Vol.50Issue(9) :1724-1735.DOI:10.16383/j.aas.c230656

基于自适应时间步脉冲神经网络的高效图像分类

Adaptive Timestep Improved Spiking Neural Network for Efficient Image Classification

李千鹏 1贾顺程 1张铁林 2陈亮1
扫码查看

作者信息

  • 1. 中国科学院自动化研究所 北京 100190;中国科学院大学人工智能学院 北京 101408
  • 2. 中国科学院自动化研究所 北京 100190;中国科学院大学人工智能学院 北京 101408;中国科学院脑科学与智能技术卓越创新中心 上海 200031
  • 折叠

摘要

脉冲神经网络(Spiking neural network,SNN)由于具有相对人工神经网络(Artifcial neural network,ANN)更低的计算能耗而受到广泛关注.然而,现有SNN大多基于同步计算模式且往往采用多时间步的方式来模拟动态的信息整合过程,因此带来了推理延迟增大和计算能耗增高等问题,使其在边缘智能设备上的高效运行大打折扣.针对这个问题,本文提出一种自适应时间步脉冲神经网络(Adaptive timestep improved spiking neural network,ATSNN)算法,该算法可以根据不同样本特征自适应选择合适的推理时间步,并通过设计一个时间依赖的新型损失函数来约束不同计算时间步的重要性.与此同时,针对上述ATSNN特点设计一款低能耗脉冲神经网络加速器,支持ATSNN算法在VGG和ResNet等成熟框架上的应用部署.在CIFAR10、CIFAR100、CIFAR10-DVS等标准数据集上软硬件实验结果显示,与当前固定时间步的SNN算法相比,ATSNN算法的精度基本不下降,并且推理延迟减少36.7%~58.7%,计算复杂度减少33.0%~57.0%.在硬件模拟器上的运行结果显示,ATSNN的计算能耗仅为GPU RTX 3090Ti的4.43%~7.88%.显示出脑启发神经形态软硬件的巨大优势.

Abstract

Spiking neural network(SNN)has received broad attention for its relatively lower computational energy consumption compared to artificial neural network(ANN).However,most conventional SNNs use a synchronous computation paradigm,whereby multiple timesteps are commonly used to simulate the dynamic process of informa-tion integration,resulting in some problems such as extended inference delay and increased computational energy consumption,which lead to a serious efficiency discount during the realistic application of edge intelligent devices.In this paper,we propose an adaptive timestep improved spiking neural network(ATSNN)algorithm,which can automatically choose a proper inference timestep based on different features of input samples,and regulate the im-portance of different timesteps by designing an innovative time-dependent loss function.Besides,a low energy con-sumption SNN accelerator is designed based on the characteristics of ATSNN mentioned above to support applica-tions and deployments of ATSNN algorithm on some mature frameworks(such as VGG and ResNet).The results of software and hardware experiments on standard datasets such as CIFAR10,CIFAR100,and CIFAR10-DVS show that,compared to conventional SNN algorithms using static timesteps,the ATSNN algorithm can reach a compar-able accuracy but with a decreased inference delay(around 36.7%~58.7%)and reduced computational complexity(around 33.0%~57.0%).Furthermore,the running results on the hardware simulator indicate that the computa-tional energy consumption of ATSNN is only around 4.43%~7.88%of GPU RTX 3090Ti.It shows great advant-ages of brain-inspired neuromorphic hardware and software.

关键词

脉冲神经网络/低功耗推理/高效训练/低延迟

Key words

Spiking neural network(SNN)/low power consumption inference/efficient training/low latency

引用本文复制引用

基金项目

国家重点研发计划(2021ZD0200300)

出版年

2024
自动化学报
中国自动化学会 中国科学院自动化研究所

自动化学报

CSTPCD北大核心
影响因子:1.762
ISSN:0254-4156
段落导航相关论文