首页|Towards optimized tensor code generation for deep learning on sunway many-core processor

Towards optimized tensor code generation for deep learning on sunway many-core processor

扫码查看
原文链接
  • NETL
  • NSTL
  • 万方数据
The flourish of deep learning frameworks and hardware platforms has been demanding an efficient compiler that can shield the diversity in both software and hardware in order to provide application portability.Among the existing deep learning compilers,TVM is well known for its efficiency in code generation and optimization across diverse hardware devices.In the meanwhile,the Sunway many-core processor renders itself as a competitive candidate for its attractive computational power in both scientific computing and deep learning workloads.This paper combines the trends in these two directions.Specifically,we propose swTVM that extends the original TVM to support ahead-of-time compilation for architecture requiring cross-compilation such as Sunway.In addition,we leverage the architecture features during the compilation such as core group for massive parallelism,DMA for high bandwidth memory transfer and local device memory for data locality,in order to generate efficient codes for deep learning workloads on Sunway.The experiment results show that the codes generated by swTVM achieve 1.79x improvement of inference latency on average compared to the state-of-the-art deep learning framework on Sunway,across eight representative benchmarks.This work is the first attempt from the compiler perspective to bridge the gap of deep learning and Sunway processor particularly with productivity and efficiency in mind.We believe this work will encourage more people to embrace the power of deep learning and Sunway many-core processor.

sunway processordeep learning compilercode generationperformance optimization

Mingzhen LI、Changxi LIU、Jianjin LIAO、Xuegui ZHENG、Hailong YANG、Rujun SUN、Jun XU、Lin GAN、Guangwen YANG、Zhongzhi LUAN、Depei QIAN

展开 >

State Key Laboratory of Software Development Environment,Beijing 100191,China

School of Computer Science and Engineering,Beihang University,Beijing 100191,China

National University of Singapore,Singapore 119077,Singapore

State Key Laboratory of Mathematical Engineering and Advanced Computing,Wuxi 214000,China

Science and Technology on Special System Simulation Laboratory Beijing Simulation Center,Beijing 100854,China

Department of Computer Science and Technology,Tsinghua University,Beijing 100084,China

展开 >

国家重点研发计划国家自然科学基金国家自然科学基金State Key Laboratory of Software Development Environment中央高校基本科研业务费专项

2020YFB15067036207201861732002SKLSDE-2021ZX-06

2024

10.1007/s11704-022-2440-7

计算机科学前沿
高等教育出版社

计算机科学前沿

CSTPCDEI
影响因子：0.303
ISSN：2095-2228
年,卷(期)：2024.18(2)
  • 38