火力与指挥控制2024,Vol.49Issue(5) :36-43,51.DOI:10.3969/j.issn.1002-0640.2024.05.005

基于脉冲神经网络的指挥智能体技术

Command Agent Technology Based on Spiking Neural Network

王栋 赵彦东 陈希飞
火力与指挥控制2024,Vol.49Issue(5) :36-43,51.DOI:10.3969/j.issn.1002-0640.2024.05.005

基于脉冲神经网络的指挥智能体技术

Command Agent Technology Based on Spiking Neural Network

王栋 1赵彦东 1陈希飞1
扫码查看

作者信息

  • 1. 北方自动控制技术研究所,太原 030006
  • 折叠

摘要

针对现有智能体技术应用于军事指挥控制领域中时存在计算资源需求高、奖励值稀疏、收敛速度慢、推理效果差的问题,提出了一种基于脉冲神经网络(spiking neural network,SNN)和分层强化学习的指挥智能体技术.基于分层强化学习思想对军事指挥智能体进行建模,利用SNN构建智能体决策模型;通过ANN-SNN转换的学习算法获得基于SNN的指挥智能体;基于"墨子"兵棋推演软件开展对比试验,与现有智能体技术相比,提出方法对计算资源的需求较低,且具有较高的博弈对抗胜率.

Abstract

As for such problems existing in the application of current agent technology in the field of military command and control as high demand for computational resources,sparse reward values,slow convergence speed,and poor reasoning effects,a command agent technology based on Spiking Neural Network(SNN)and hierarchical reinforcement learning is proposed.Firstly,the military comm-and agent is modeled based on the idea of hierarchical reinforcement learning,and the decision-making model of the agent is constructed with SNN.Then,the learning algorithm of ANN-SNN conversion is used to obtain the command agent based on SNN.Finally,a comparative experiment is carried out based on the"Mozi"wargaming software.Compared with the existing agent technology,the proposed method has lower demand for computational resources and higher win rate of game confrontation.

关键词

脉冲神经网络/分层强化学习/指挥智能体/ANN-SNN

Key words

spiking neural network/hierarchical reinforcement learning/command agent/ANN-SNN

引用本文复制引用

出版年

2024
火力与指挥控制
火力与指挥控制研究会,火力与指挥控制专业情报网

火力与指挥控制

CSTPCDCSCD北大核心
影响因子:0.312
ISSN:1002-0640
参考文献量16
段落导航相关论文