中国化学工程学报(英文版)2024,Vol.69Issue(5) :63-71.DOI:10.1016/j.cjche.2023.12.005

Combining reinforcement learning with mathematical programming:An approach for optimal design of heat exchanger networks

Hui Tan Xiaodong Hong Zuwei Liao Jingyuan Sun Yao Yang Jingdai Wang Yongrong Yang
中国化学工程学报(英文版)2024,Vol.69Issue(5) :63-71.DOI:10.1016/j.cjche.2023.12.005

Combining reinforcement learning with mathematical programming:An approach for optimal design of heat exchanger networks

Hui Tan 1Xiaodong Hong 2Zuwei Liao 1Jingyuan Sun 1Yao Yang 1Jingdai Wang 1Yongrong Yang1
扫码查看

作者信息

  • 1. State Key Laboratory of Chemical Engineering,College of Chemical and Biological Engineering,Zhejiang University,Hangzhou 310027,China
  • 2. State Key Laboratory of Chemical Engineering,College of Chemical and Biological Engineering,Zhejiang University,Hangzhou 310027,China;ZJU-Hangzhou Global Scientific and Technological Innovation Center,Hangzhou 311215,China
  • 折叠

Abstract

Heat integration is important for energy-saving in the process industry.It is linked to the persistently challenging task of optimal design of heat exchanger networks(HEN).Due to the inherent highly non-convex nonlinear and combinatorial nature of the HEN problem,it is not easy to find solutions of high quality for large-scale problems.The reinforcement learning(RL)method,which learns strategies through ongoing exploration and exploitation,reveals advantages in such area.However,due to the complexity of the HEN design problem,the RL method for HEN should be dedicated and designed.A hybrid strategy combining RL with mathematical programming is proposed to take better advantage of both methods.An insightful state representation of the HEN structure as well as a customized reward function is introduced.A Q-learning algorithm is applied to update the HEN structure using the ε-greedy strategy.Better results are obtained from three literature cases of different scales.

Key words

Heat exchanger network/Reinforcement learning/Mathematical programming/Process design

引用本文复制引用

基金项目

Project of National Natural Science Foundation of China(U22A20415)

Project of National Natural Science Foundation of China(21978256)

Project of National Natural Science Foundation of China(22308314)

"Pioneer"and"Leading Goose"Research & Development Program of Zhejiang(2022C01SA442617)

artificial intelligence+High Performance Computing Center of ZJU-ICI()

出版年

2024
中国化学工程学报(英文版)
中国化工学会

中国化学工程学报(英文版)

CSTPCDEI
影响因子:0.818
ISSN:1004-9541
段落导航相关论文