首页|Patent Issued for Method and system for weight memory mapping for streaming oper ation of giant generative artifical intelligence hardware (USPTO 12153898)
Patent Issued for Method and system for weight memory mapping for streaming oper ation of giant generative artifical intelligence hardware (USPTO 12153898)
扫码查看
点击上方二维码区域,可以放大扫码查看
原文链接
NETL
NSTL
News editors obtained the following quote from the background information suppli ed by the inventors:“1. Field of the Invention“Example embodiments relate to a method and system for weight memory mapping for a streamingoperation of a giant generative artificial intelligence hardware.“2. Description of the Related Art“In the case of generative artificial intelligence models, many of them adopt a transformer structure andexhibit high performance. However, in the case of a tr ansformer, latency is crucial due to small parallelismof operations. An efficie nt weight mapping method is required to reduce latency of hardware.
Artificial IntelligenceBusinessEmerg ing TechnologiesHyperAccel Co. Ltd.Machine Learning