首页|Research on High-Precision Stochastic Computing VLSI Structures for Deep Neural Network Accelerators

Research on High-Precision Stochastic Computing VLSI Structures for Deep Neural Network Accelerators

扫码查看
Deep neural networks (DNN) are widely used in image recognition,image classification,and other fields. However,as the model size increases,the DNN hardware accelerators face the challenge of higher area overhead and energy consumption. In recent years,stochastic computing (SC) has been considered a way to realize deep neural networks and reduce hardware consumption. A probabilistic compensation algorithm is proposed to solve the accuracy problem of stochastic calculation,and a fully parallel neural network accelerator based on a deter-ministic method is designed. The software simulation results show that the accuracy of the probability compensation algorithm on the CIFAR-10 data set is 95.32%,which is 14.98% higher than that of the traditional SC algorithm. The accuracy of the deterministic algorithm on the CIFAR-10 dataset is 95.06%,which is 14.72% higher than that of the traditional SC algorithm. The results of Very Large Scale Integration Circuit (VLSI) hardware tests show that the normalized energy efficiency of the fully parallel neural network accelerator based on the deter-ministic method is improved by 31% compared with the circuit based on binary computing.

stochastic computinghardware acceleratordeep neural network

WU Jingguo、ZHU Jingwei、XIONG Xiankui、YAO Haidong、WANG Chengchen、CHEN Yun

展开 >

Fudan University,Shanghai 200433,China

State Key Laboratory of Mobile Network and Mobile Multimedia Technology,Shenzhen 518055,China

ZTE Corporation,Shenzhen 518057,China

2024

中兴通讯技术(英文版)
中兴通讯股份有限公司,安徽省科技情报研究所

中兴通讯技术(英文版)

影响因子:0.036
ISSN:1673-5188
年,卷(期):2024.22(4)