首页|深浅双路径卷积神经网络

深浅双路径卷积神经网络

扫码查看
受限于嵌入式设备和移动设备的内存和计算能力,深度卷积神经网络(CNN)的部署因较大的参数量和较慢的推理速度受到阻碍,因此轻量化网络研究越来越受到关注.基于ResNet-50构建一个带浅层和深层的双路径架构(SDDP),可以通过调整两个路径的通道维度比例实现模型的压缩.此外,还提出一个特征分离模块,基于通道注意力将特征图分为两组,一组进入深路径,另一组进入浅路径,精确的分组可以让特征提取更加高效.该网络架构在ImageNet数据集上超越了当前最好的剪枝方法和轻量化设计模型.
CONVOLUTIONAL NEURAL NETWORK WITH DEEP AND SHALLOW PATHS
Limited by the memory and computing power of the embedded devices and mobile devices,the deployment of deep convolutional neural networks(CNN)is hindered by the large amount of parameters and slow inference speed.Therefore,lightweight network research has attracted more and more attention.This paper constructs a dual-path architecture with shallow and deep layers based on ResNet-50.The compression of the model could be achieved by adjusting the channel dimension ratio of the two paths.In addition,a feature separation module was proposed,which divided the feature maps into two groups based on channel attention.One group entered the deep path,and the other group entered the shallow path.Precise grouping could make feature extraction more efficient.This architecture surpassed the current best pruning methods and lightweight design models on the ImageNet dataset.

Convolutional neural networkModel compressionChannel attention

沈超元、续晋华

展开 >

华东师范大学计算机科学与技术学院 上海 200062

卷积神经网络 模型压缩 通道注意力

2024

计算机应用与软件
上海市计算技术研究所 上海计算机软件技术开发中心

计算机应用与软件

CSTPCD北大核心
影响因子:0.615
ISSN:1000-386X
年,卷(期):2024.41(5)
  • 22