指挥与控制学报2024,Vol.10Issue(4) :509-515.DOI:10.3969/j.issn.2096-0204.2024.04.0509

知识驱动的智能博弈对抗行动序列规划方法

Knowledge Driven Course of Action Planning for Intelligent Game Confrontation

陈希亮 曹雷 康凯 李晨溪
指挥与控制学报2024,Vol.10Issue(4) :509-515.DOI:10.3969/j.issn.2096-0204.2024.04.0509

知识驱动的智能博弈对抗行动序列规划方法

Knowledge Driven Course of Action Planning for Intelligent Game Confrontation

陈希亮 1曹雷 1康凯 1李晨溪2
扫码查看

作者信息

  • 1. 陆军工程大学指挥控制工程学院,南京 210007
  • 2. 解放军31108部队,南京 210007
  • 折叠

摘要

针对基于深度强化学习方法解决实际博弈对抗序列规划问题中存在的探索-利用矛盾、奖赏信号稀疏、数据利用率低、难以稳定收敛等问题,分析了基于知识的学习型智能生成模式,提出基于知识驱动的方法,从用规则教、从数据中学、用问题引导等方面构建了智能博弈对抗行动序列规划模型,为提升探索-利用效率、精准奖励函数、加速算法收敛提供了理论支撑.对基于强化学习的智能博弈对抗问题求解的难点问题进行了讨论,指出下一步深度强化学习算法走向实用的发展方向.

Abstract

Aiming at the problems of conflict between exploration and utilization,sparse reward signals,low data utilization rate,and difficulty in stable convergence in solving the practical course of action planning for Intelligent Game Confrontation based on deep reinforcement learning.The knowledge-based type-learning intelligent generation mode is analyzed,and the knowledge driven method is proposed.The course of planning model of intelligent game confrontation from the aspects of rule-based teaching,data-based learning and problem-based guidance and other aspects is constructed,which provides theoretical support for improving the exploration utilization efficiency,accurate reward function and accelerating algorithm convergence.The difficult problems of solving the intelligent game confrontation problem based on reinforcement learning are discussed,and the more practical development direction of the next step deep enforcement learning algorithm is pointed out.

关键词

深度强化学习/博弈对抗/知识驱动/行动序列规划

Key words

deep reinforcement learning/intelligent game confrontation/knowledge driven/course of action planning

引用本文复制引用

基金项目

国家自然科学基金(62273356)

出版年

2024
指挥与控制学报

指挥与控制学报

CSTPCDCSCD北大核心
ISSN:
参考文献量17
段落导航相关论文