首页|基于轻量化Transformer模型的多变量风电功率预测

基于轻量化Transformer模型的多变量风电功率预测

扫码查看
风电功率预测对电力调度和新能源管理极为重要.为准确高效预测多变量风电功率,提出一种基于轻量化Transformer(Light Transformer)的风电功率预测方法.首先,采用滚动序列建模方法,确定输入数据,然后采用Transformer预测模型,改进和精简原始结构,在前馈网络模块中使用GeLU激活函数来代替传统的ReLU激活函数,提升模型的质量,轻量化网络结构,利用多头注意力机制,加快模型训练速度,提升预测模型精度.
Multivariate Wind Power Prediction with Lightweight Transformer Model
Wind power prediction is extremely important for power dispatching and new energy management.In order to accurately and efficiently predict the multivariate wind power,a wind power prediction method based on Light Transformer is proposed.Firstly,the rolling sequence modeling method is used to determine the input data,and then the Transformer prediction model is used to improve and streamline the original structure and use the GeLU Activation Function instead of the traditional GeLU Activation Function in the feed-forward network module to improve the quality of the model.It lightens the network structure,utilizes the multi-attention mechanism,accelerates the training speed of the model and improves the accuracy of the prediction model.

Lightweight Transformer modelwind powerActivation Function

宋倩、蓝俊欢

展开 >

河池学院 大数据与计算机学院,广西 河池 546300

广西电网有限责任公司河池供电局,广西 河池 546300

轻量化Transformer模型 风电功率 激活函数

2022年广西高校中青年教师科研基础能力提升项目2023年河池学院校级科研平台

2022KY06062023XJPT011

2024

现代信息科技
广东省电子学会

现代信息科技

ISSN:2096-4706
年,卷(期):2024.8(16)
  • 14