Multivariate Wind Power Prediction with Lightweight Transformer Model
Wind power prediction is extremely important for power dispatching and new energy management.In order to accurately and efficiently predict the multivariate wind power,a wind power prediction method based on Light Transformer is proposed.Firstly,the rolling sequence modeling method is used to determine the input data,and then the Transformer prediction model is used to improve and streamline the original structure and use the GeLU Activation Function instead of the traditional GeLU Activation Function in the feed-forward network module to improve the quality of the model.It lightens the network structure,utilizes the multi-attention mechanism,accelerates the training speed of the model and improves the accuracy of the prediction model.
Lightweight Transformer modelwind powerActivation Function