Patent Application Titled 'Systems And Methods For Distributing Layers Of Special Mixture-Of-Experts Machine Learning Models' Published Online (USPTO 20230419166)
Patent Application Titled 'Systems And Methods For Distributing Layers Of Special Mixture-Of-Experts Machine Learning Models' Published Online (USPTO 20230419166)
扫码查看
点击上方二维码区域，可以放大扫码查看
Abstract
Reporters obtained the following quote from the background information supplied by the inventors:“Machine learning models using mixture-of-expert (MOE) techniques are typically made up of N numberof layers which are broadly classified as MOE layers and non-MOE layers. Various distribution strategiesare used to distribute large MOE machine learning models into computing system hardware.
NETL
NSTL