首页|Production-logistics collaborative scheduling in dynamic flexible job shops using nested-hierarchical deep reinforcement learning

Production-logistics collaborative scheduling in dynamic flexible job shops using nested-hierarchical deep reinforcement learning

扫码查看
Effective manufacturing in flexible job shops often requires collaboratively organizing production and logistics activities. This necessitates a thorough exploration of corresponding collaborative scheduling problem. However, extant studies remain relatively preliminary, not only neglecting the inevitable disturbances in real-world but also failing to satisfy the essential need for collaboration, that is, to simultaneously optimize both activities' objectives. Therefore, this study proposes a novel production-logistics collaborative scheduling problem for dynamic flexible job shops, in which the common yet underappreciated disturbance of logistics equipment breakdowns is meticulously considered, and two typical objectives individually pursued by two activities are optimized simultaneously. To solve the proposed problem, a nested-hierarchical deep reinforcement learning method is developed. In this method, a new nested-hierarchical framework that rationally deploys multiple agents is designed to facilitate the required multi-objective optimization while ensuring the practicality of decision-making process. Based on this framework, appropriate state features, actions, and reward functions are devised for each agent, and a training mechanism based on multi-agent proximal policy optimization is proposed to train agents effectively. Experiments in an aviation component production shop are conducted to confirm the effectiveness of proposed method and problem.

Flexible job shopProduction-logistics collaborative schedulingDynamic schedulingDeep reinforcement learningNested-hierarchical framework

Jiaxuan Shi、Fei Qiao、Juan Liu、Yumin Ma、Dongyuan Wang、Chen Ding

展开 >

Shanghai Research Institute for Intelligent Autonomous Systems, Tongji University Shanghai, 201210, China

School of Electronics and Information Engineering, Tongji University Shanghai, 201804, China

2025

Advanced engineering informatics

Advanced engineering informatics

SCI
ISSN:1474-0346
年,卷(期):2025.65(Pt.2)
  • 65