首页|瞬态场景下基于光流法的红外视频插帧算法研究

瞬态场景下基于光流法的红外视频插帧算法研究

扫码查看
针对现有红外图像插帧方法,在瞬态场景下均不能得到鲁棒性较好的插入帧红外图像,提出了一种基于注意力的多尺度、多分支光流网络,提取相邻2帧红外图像光流信息,每个分支分别学习一种光流信息,利用多尺度特征融合模块在每个尺度上聚焦局部重要信息.设计了 一个多光流特征重加权模块,根据通道注意力自适应地选择每个光流的特征.经实验结果证明,所提方法可以很好地完成插帧任务,其性能与最先进的方法相比较更具有优越性.
Research on Infrared Video Frame Interpolation Algorithm Based on Optical Flow Method in Transient Scene
According to the existing infrared image intercalation methods,the infrared image with good robustness can not be obtained in the transient scene.A multi-scale and multi-branch optical flow net-work based on attention is proposed.Optical flow information of two adjacent infrared images is extracted,and each branch learns one optical flow information respectively.Then,multi-scale feature fusion module is used to focus on locally important information at each scale.A multi-optical flow feature reweighting module is designed to select the features of each optical flow adaptively according to channel attention.The experimental results show that the proposed method can complete the frame interpolation task well,and its performance is more superior than that of the state of the art algorithms.

infrared video frame interpolationattention mechanismoptical flowfeature fusion

李文波、王玉、王明泉、商奥雪、丰晓钰

展开 >

中北大学信息与通信工程学院,山西太原 030051

红外视频插帧 注意力机制 光流 特征融合

山西省重点研发计划山西省高等学校科技创新项目

201803D1210692020L0624

2024

机械与电子
中国机械工业联合会科技工作部 机械与电子杂志社

机械与电子

CSTPCD
影响因子:0.243
ISSN:1001-2257
年,卷(期):2024.42(4)
  • 27