To solve the problem of low spectrum utilization of multi-node autonomous frequency decision-making in the dynamic electromagnetic countermeasure environment,the research on intelligent cooperative spectrum allocation technology for in complete electromagnetic information is carried out,which improves spectrum utilization through multi-node intelligent collaboration.Firstly,the spectrum allocation problem is modelled as an optimization problem to maximize the frequency-using equipment,and secondly,a resource decision-making algorithm based on the multi-node cooperative diversion experience repetition mechanism(Cooperation-Deep double Q-network,Co-DDQN)is proposed.This algorithm evaluates the historical experience data based on the cooperative diversion function and is trained by a hierarchical experience pool,so that each agent can form a lightweight cooperative decision-making ability under self-observation,and solve the problem of inconsistency between the optimization direction of multi-node decision-making and the overall optimization goal under low-visibility conditions.Besides,a hybrid reward function based on confidence allocation is designed,and each node considers itself when the decision is made,which can reduce the emergence of lazy nodes,explore a better overall action strategy,and further improve the system efficiency.Simulation results show that when the number of nodes is 20,the number of accessible devices of the proposed algorithm outperforms the global greedy algorithm and the genetic algorithm,and the difference with the centralized spectrum allocation algorithm with complete information sharing is within 5％,which is more suitable for cooperative spectrum allocation of low-visibility nodes.
维普
万方数据