瞬态场景下基于光流法的红外视频插帧算法研究
Research on Infrared Video Frame Interpolation Algorithm Based on Optical Flow Method in Transient Scene
李文波 1王玉 1王明泉 1商奥雪 1丰晓钰1
作者信息
- 1. 中北大学信息与通信工程学院,山西太原 030051
- 折叠
摘要
针对现有红外图像插帧方法,在瞬态场景下均不能得到鲁棒性较好的插入帧红外图像,提出了一种基于注意力的多尺度、多分支光流网络,提取相邻2帧红外图像光流信息,每个分支分别学习一种光流信息,利用多尺度特征融合模块在每个尺度上聚焦局部重要信息.设计了 一个多光流特征重加权模块,根据通道注意力自适应地选择每个光流的特征.经实验结果证明,所提方法可以很好地完成插帧任务,其性能与最先进的方法相比较更具有优越性.
Abstract
According to the existing infrared image intercalation methods,the infrared image with good robustness can not be obtained in the transient scene.A multi-scale and multi-branch optical flow net-work based on attention is proposed.Optical flow information of two adjacent infrared images is extracted,and each branch learns one optical flow information respectively.Then,multi-scale feature fusion module is used to focus on locally important information at each scale.A multi-optical flow feature reweighting module is designed to select the features of each optical flow adaptively according to channel attention.The experimental results show that the proposed method can complete the frame interpolation task well,and its performance is more superior than that of the state of the art algorithms.
关键词
红外视频插帧/注意力机制/光流/特征融合Key words
infrared video frame interpolation/attention mechanism/optical flow/feature fusion引用本文复制引用
基金项目
山西省重点研发计划(201803D121069)
山西省高等学校科技创新项目(2020L0624)
出版年
2024
国家科技期刊平台
NSTL
万方数据