计算机工程与科学2024,Vol.46Issue(9) :1529-1538.DOI:10.3969/j.issn.1007-130X.2024.09.002

面向结构矩阵的可扩展并行矩阵乘算法框架

A scalable parallel structured matrix multiplication algorithm framework

李胜国 廖霞 于恒彪 黄春 姜浩 逯喜燕 王华林 成礼智
计算机工程与科学2024,Vol.46Issue(9) :1529-1538.DOI:10.3969/j.issn.1007-130X.2024.09.002

面向结构矩阵的可扩展并行矩阵乘算法框架

A scalable parallel structured matrix multiplication algorithm framework

李胜国 1廖霞 2于恒彪 1黄春 1姜浩 1逯喜燕 1王华林 3成礼智3
扫码查看

作者信息

  • 1. 国防科技大学计算机学院,湖南长沙 410073
  • 2. 清华大学计算机科学与技术系,北京 100084
  • 3. 国防科技大学理学院,湖南长沙 410073
  • 折叠

摘要

结构矩阵在科学计算和工程应用中具有重要作用,例如Cauchy、Toeplitz、Vandermonde和Hankel矩阵等.虽然这些矩阵都是稠密的,但只需要O(n)个参数(生成元)就可以表示,其中n为矩阵的维数.提出了面向结构矩阵的可扩展并行矩阵乘算法框架,利用矩阵生成元显式地构造各进程的局部矩阵块,从而减少通信开销;同时利用矩阵块的数值低秩性,进一步降低计算开销.因此,该算法框架可同时降低计算量和通信量,适用于Cannon、Fox和PUMMA等矩阵乘算法.在天河2巨型机上进行了大量的数值测试,测试结果表明,该算法可获得相对ScaLAPACK中的PDGEMM函数的8.96倍加速.

Abstract

Structured matrices play an important role in scientific computing and engineering applica-tions,such as Cauchy,Toeplitz,Vandermonde,and Hankel matrices.Although these matrices are dense,they can be expressed with only O(n)parameters(generators),where n is the dimension of the matrix.The core idea of the algorithm in this paper is to use matrix generators to explicitly construct lo-cal matrix blocks of each process,thereby reducing communication overhead.Additionally,by levera-ging the numerical low-rank property of these matrix blocks.This paper further minimize computational overhead.Consequently,the proposed parallel structured matrix multiplication algorithm framework can simultaneously reduce both computational and communication costs,making it suitable for matrix multiplication algorithms like Cannon,Fox,and PUMMA.Extensive numerical tests were conducted on the Tianhe-2 supercomputer,and the results demonstrate that the proposed algorithm achieves an 8.96 × speedup compared to the PDGEMM function in ScaLAPACK.

关键词

结构矩阵/矩阵乘法/FFT/Cauchy矩阵/Toeplitz矩阵/分布式并行

Key words

structured matrix/matrix multiplication/FFT/Cauchy matrix/Toeplitz matrix/distribu-ted parallel

引用本文复制引用

出版年

2024
计算机工程与科学
国防科学技术大学计算机学院

计算机工程与科学

CSTPCD北大核心
影响因子:0.787
ISSN:1007-130X
段落导航相关论文