人工智能芯片在互联技术中的应用
Application of Artificial Intelligence Chips in Internet Technology
赵立东 1孟玉 1刘彦1
作者信息
- 1. 上海燧原科技股份有限公司,上海 201306
- 折叠
摘要
阐述互联技术与人工智能芯片在大模型中的特点.介绍大模型中常用的并行拆分方式,提出一种适合不同规模张量并行的物理拓扑,并针对不同规模的应用,分析对应的逻辑拓扑和数据处理方法,从而高效地满足大模型对互联的需求.
Abstract
This paper expounds the characteristics of interconnection technology and artificial intelligence chips in large models.It introduces the commonly used parallel splitting methods in large models,proposes a physical topology suitable for parallel tensors of different scales,and analyzes the corresponding logical topology and data processing methods for applications of different scales,thereby efficiently meeting the interconnection requirements of large models.
关键词
人工智能芯片/互联技术/分布式系统Key words
artificial intelligence chips/interconnection technology/distributed system引用本文复制引用
出版年
2024
NETL
NSTL
万方数据