As the field of RL matures,ε-greedy method is widely used in RL,such as deep Q network.However,ε-greedy has a certain probability to choose other actions that are not optimal when choosing ac-tions,leading to constant exploration.In this context,a Dynamic ε-greedy algorithm(DEG)and Dueling Actor-Critic framework(ACDD)are proposed,which are able to balance exploration and exploitation prob-lems in RL.DEG inputs the state into the ACDD framework to get the advantage value to automatically ad-just the value of ε,thus maintaining a better balance between exploration and exploitation.This experiment tests the performance of DEG in a Multi-Armed Bandit task,using the average cumulative reward and the optimal action selection rate as evaluation criteria.Compared with some widely used algorithms,DEG can achieve higher average cumulative reward and optimal action selection rate,and improve performance.
关键词
深度强化学习/探索和利用/动态化ε/Dueling/Actor-Critic框架/多臂老虎机
Key words
deep reinforcement learning/exploration and exploitation/dynamic ε/Dueling Actor-Critic framework/Multi-Armed Bandit
维普
万方数据