首页|Efficient neural network using pointwise convolution kernels with linear phase constraint

Efficient neural network using pointwise convolution kernels with linear phase constraint

扫码查看
In current efficient convolutional neural networks, 1 × 1 convolution is widely used. However, theamount of computation and the number of parameters of 1 × 1 convolution layers account for a large partof these neural network models. In this paper, we propose to use linear-phase pointwise convolution kernels(LPPC kernels) to reduce the computational complexities and storage costs of these neural networks.We design four types of LPPC kernels based on the parity of the number of input channels and symmetryof the weights of the pointwise convolution kernel. Experimental results show that Type-Ⅰ LPPC kernelscan compress some popular networks better with a small reduction in accuracy than the other types ofLPPC kernels. The LPPC kernels can be used as new 1 × 1 convolution kernels to design efficient neuralnetwork architectures in the future. Moreover, the LPPC kernels are friendly to low-power hardwareaccelerator design to achieve lower memory access cost and smaller model size.

Convolutional Neural Network (CNN)Efficient neural networkPointwise convolutionLinear-phase filter

Feng Liang、Zhichao Tian、Ming Dong、Shuting Cheng、Li Sun、Hai Li、Yiran Chen、Guohe Zhang

展开 >

School of Microelectronics, Xi’an Jiaotong University, Xi’an, Shaanxi 710049, China

Department of Electrical and Computer Engineering, Duke University, Durham, NC 27708, USA

2021

Neurocomputing

Neurocomputing

EISCI
ISSN:0925-2312
年,卷(期):2021.423(Jan.29)
  • 2
  • 40