首页|基于局部分离与多尺度融合的图像超分辨率重建

基于局部分离与多尺度融合的图像超分辨率重建

扫码查看
目前基于深度学习的超分辨率重建网络存在卷积运算冗余、图像重建信息不完整、模型参数庞大等问题,限制了其在边缘设备上的适用性。针对上述问题,提出一种轻量级的局部分离与多尺度融合图像超分辨率重建网络,该网络利用局部卷积对图像进行特征提取,通过分离部分图像通道,在减少网络冗余计算的同时保持图像重建的质量。设计一种多尺度特征融合模块,在空间维度学习长依赖特征,并采用一个通道注意力增强组在空间维度捕获空间特征,减少图像重建信息的丢失,有效恢复图像的细节纹理。由于多尺度特征融合模块更多地是从全局角度进行特征提取融合,因此构建一种高效反残差模块补充网络的局部上下文信息提取能力。在Set 5、Set 14、B 100、Urban 100、Manga 109这5个基准数据集上的实验结果表明,当尺度因子为2、3、4倍时,该网络的参数量分别为373 000、382 000、394 000,FLOPs分别为84。0×109、38。1×109、22。1×109。与VDSR、IMDN、RFDN、RLFN等网络相比,该网络在较少网络参数的情况下,能够保证图像重建效果。
Image Super-Resolution Reconstruction Based on Partial Separation and Multiscale Fusion
Currently,deep-learning-based super-resolution reconstruction networks suffer from issues such as convolution operation redundancy,incomplete image reconstruction information,and large model parameters that limit their applicability to edge devices.To address these issues,this study proposes a lightweight image super-resolution reconstruction network based on partial separation and multiscale fusion.This network utilizes partial convolutions for feature extraction and separates partial image channels to reduce redundant computations while maintaining the quality of the image reconstruction.At the same time,a multiscale feature fusion module is designed to learn long-range dependency features and capture spatial features in the spatial dimension using a channel attention enhancement group.This reduces the loss of image reconstruction information and effectively restores the details and textures of the image.Finally,because the multiscale feature fusion block focuses on global feature extraction and fusion,an efficient inverted residual block is constructed to supplement the ability to extract local contextual information.The network is tested on five benchmark datasets:Set 5,Set 14,B 100,Urban 100,and Manga 109,with scale factors of 2,3,and 4 times.The parameters of the network are 373 000,382 0000,and 394 000,and the FLOPs are 84.0×109,38.1×109,and 22.1×109,respectively.Quantitative and qualitative experimental results show that compared with networks such as VDSR,IMDN,RFDN,and RLFN,the proposed network ensures image reconstruction quality with fewer network parameters.

super-resolution reconstructionlightweight networkpartial convolutionmultiscale fusionlong-range dependencies

杨郅树、梁佳楠、曹永军、钟震宇、何永伦

展开 >

五邑大学智能制造学部,广东 江门 529020

广东省科学院智能制造研究所广东省现代控制技术重点实验室,广东 广州 510070

华南理工大学机械与汽车工程学院,广东 广州 511442

超分辨率重建 轻量级网络 局部卷积 多尺度融合 长依赖关系

佛山市重点领域科技攻关项目广州市科技计划项目

2020001006827202206010052

2024

计算机工程
华东计算技术研究所 上海市计算机学会

计算机工程

CSTPCD北大核心
影响因子:0.581
ISSN:1000-3428
年,卷(期):2024.50(7)
  • 6