宇航总体技术2024,Vol.8Issue(5) :64-73.DOI:10.20210/j.issn.2096-4080.2024.05.008

应用感知的深度神经网络剪枝方法

A Pruning Method for Deep Neural Networks Using Perception

白学营 陈维常 徐菲 胡健伟
宇航总体技术2024,Vol.8Issue(5) :64-73.DOI:10.20210/j.issn.2096-4080.2024.05.008

应用感知的深度神经网络剪枝方法

A Pruning Method for Deep Neural Networks Using Perception

白学营 1陈维常 1徐菲 1胡健伟1
扫码查看

作者信息

  • 1. 中国人民解放军军事科学院系统工程研究院,北京 100010
  • 折叠

摘要

神经网络模型面临着参数过多、计算负载高和内存开销迅速增长等问题.为了满足各种应用场景和设备的多样性,有必要针对特定应用优化神经网络模型.鉴于此,提出了一种基于应用类别感知的深度神经网络剪枝方法,该方法分析了在卷积神经网络前向传播过程中,不同滤波器在提取类别特征方面的不同作用.获得了滤波器的重要性及与应用类别之间的关系,针对特定应用中的不同目标类别进行了定制化的剪枝优化,并通过PyTorch深度学习框架进行了设计和实现.实验结果表明,所提出的基于应用感知的神经网络优化方法能够有效地优化卷积神经网络.

Abstract

Neural network models face challenges such as an excessive number of parameters,high computational load,and rapidly increasing memory overhead.To accommodate the diversity of ap-plication scenarios and devices,it is essential to optimize neural network models for specific appli-cations.This work proposes a deep neural network pruning method that is aware of application categories.This method analyzes the distinct roles of various filters in extracting class features during the forward propagation process in convolutional neural networks.It identifies the relation-ship between the importance of filters and application categories,and carries out customized prun-ing optimization for different target categories in specific applications.The work is designed and implemented based on the PyTorch deep learning framework.Experimental results demonstrate that the application-aware neural network optimization method proposed in this paper can effec-tively optimize convolutional neural networks.

关键词

卷积神经网络/神经网络优化/应用感知/滤波器剪枝/知识蒸馏

Key words

Convolution neural network/Neural network optimization/Application awareness/Filter pruning/Knowledge distillation

引用本文复制引用

基金项目

国家部委基金资助项目()

出版年

2024
宇航总体技术

宇航总体技术

CSTPCD
ISSN:
参考文献量8
段落导航相关论文