Energy-efficient optimization strategy based on elastic data migration in big data streaming platform
Focused on the problem that the stream computing platform was suffering from the high energy consumption and low efficiency due to the lack of consideration for energy efficiency in designing process,an energy-efficient optimi-zation strategy based on elastic data migration in big data streaming platform(EEDM-BDSP)was proposed.Firstly,models of the load prediction and the resource judgment were set up,and the load prediction algorithm was designed,which predicted the load tendency and determine node resource occupancy,so as to find nodes of resource overload and redundancy.Secondly,models of the resource constraint and the optimal data migration were set up,and the optimal data migration algorithm was proposed,which data migration for the purpose of improving node resource utilization.Finally,model of the energy consumption was set up to calculate the energy consumption saved by the cluster after data migration.The experimental results show that the EEDM-BDSP changes node resources in the cluster can responded on time,the resource utilization and the energy-efficient are improved.
万方数据
维普
