首页|基于课程正则化的物理信息神经网络渐进式训练策略

基于课程正则化的物理信息神经网络渐进式训练策略

扫码查看
为降低物理信息神经网络(physics-informed neural networks,PINN)优化目标函数的复杂性和训练难度,提出一种基于课程正则化渐进式训练策略,在该策略中基于课程学习思想动态调整损失函数,使正则化项中偏微分方程所表征的物理信息从较平稳状态逐步过渡到变化剧烈状态,降低任务学习难度;加强损失函数中初始条件和边界条件部分的数据约束,平衡数据部分和物理信息部分损失;采用固定步长指数衰减学习率进行优化,尽可能避免目标函数陷入局部最小值.通过波动和热传导两类偏微分方程进行试验对比和分析,结果表明计算效率能够提升约 50%,预测精度能够提高 0.5~1 个数量级.所提出方法可以有效提高PINN的数值稳定性和预测精度,加快PINN在复杂物理场学习任务中收敛速率.
Progressive training strategy of physics-informed neural networks based on curriculum regularization
A progressive training strategy based on curriculum regularization was proposed to reduce the complexity and training dif-ficulty of the optimization objective function for physics-informed neural networks(PINN).In this strategy,the loss function was dynamically adjusted based on the idea of course learning.The physical information represented by the partial differential equation in the regularization term was gradually transitioned from a relatively stable state to a drastic state,which reduced the learning difficulty of task.The data constraints of initial conditions and boundary conditions in the loss function were strengthened to balance the losses between the data and physical information parts.A fixed step-size exponential decay learning rate was employed for optimization to avoid the objective function falling into the local minimum.Through experimental comparison and analysis of two types of partial dif-ferential equations,namely wave and heat conduction,the results showed that the computational efficiency could be improved by about 50%,and the prediction accuracy can be improved by an order of magnitude.The proposed method could improve the numerical stabil-ity and prediction accuracy of PINN,and accelerate the convergence rate of PINN in complex physical field learning tasks.

physics-informed neural networkcurriculum regularizationloss functionpartial differential equationnumerical stability

范黎林、刘士豪、李源、毛文涛、陈宗涛

展开 >

河南师范大学计算机与信息工程学院,河南新乡 453007

智慧商务与物联网技术河南省工程实验室,河南新乡 453007

物理信息神经网络 课程学习 损失函数 偏微分方程 数值稳定性

国家自然科学基金资助项目国家自然科学基金资助项目河南省科技攻关重点项目

11702087U1704158212102210103

2024

山东大学学报(工学版)
山东大学

山东大学学报(工学版)

CSTPCD北大核心
影响因子:0.634
ISSN:1672-3961
年,卷(期):2024.54(1)
  • 1