基于条件控制扩散模型的遥感图像超分辨率增强算法
A Super-Resolution Enhancement Algorithm for Remote Sensing Images Using Conditional Controlled Diffusion Models
付奕博 1谢东海 1王志博 1易畅 1郭柳艳 1吴俣2
作者信息
- 1. 首都师范大学资源环境与旅游学院,北京 100048;首都师范大学城市环境过程与数字模拟国家重点实验室孵化基地,北京 100048
- 2. 天津大学地球系统科学学院,天津 300072
- 折叠
摘要
图像超分辨率技术通过提升图像的空间分辨率,增强图像清晰度,增加图像细节信息,实现在硬件条件不变的情况下提高图像质量.鉴于遥感影像具有较大的像幅、复杂的特征表现和丰富的细节,结合遥感图像信息高效获取的需求,本文提出了一种基于条件控制扩散模型(Diffusion Model)的遥感图像超分辨率算法DSR(Diffusion Super-Resolution).该算法以同一区域的低分辨率遥感图像为扩散模型的控制条件,与添加噪声后的高分辨率遥感图像拼接作为输入,构建了一个以U-Net为主干,融合残差连接和自注意力机制的深度噪声训练网络,并改进了损失函数以获得更优的超分辨率效果.本文实验中采用了多时相、多时期的国产卫星高分系列、高景系列的高分辨率遥感图像以及公开数据集Alsat-2B作为测试数据,测试了从32像素尺寸扩大至128像素的超分辨率效果.在这一基础上,将本文提出的算法与Bicubic、SRGAN、Real-ESRGAN、SwinIR等超分辨率算法进行比较,在PSNR和SSIM指标上取得了更好的性能.实验结果表明:DSR算法适用于遥感图像的超分辨率重建,特别是在多光谱遥感图像的超分辨率处理中,能够提升超分辨率结果质量,克服了简单卷积网络只能提取图像浅层特征的局限,避免了对抗神经网络训练过程中难以收敛的问题,显著提升了遥感图像中丰富细节的还原能力.
Abstract
Image super-resolution technology enhances image clarity and enriches image detail by improving image spatial resolution,enabling quality enhancement without changing hardware conditions.Given the large size,complex target features,and abundant details of remote sensing images,along with the need for efficient information acquisition,we propose a Diffusion Super-Resolution (DSR) algorithm based on a conditional diffusion model.This approach uses low-resolution remote sensing images from the same region as conditioning inputs to the diffusion model,while high-resolution images with added noise are concatenated as inputs.A deep noise training network was constructed with U-Net as the backbone,incorporating residual connections and self-attention mechanisms.The loss function was also improved for better super-resolution results.The DSR method was tested using high-resolution remote sensing images from multiple periods of the domestic Gaofen and SuperView satellite series.The super-resolution results demonstrated pixel dimension expansion from 32 to 128.Comparative experiments with Bicubic,SRGAN,Real-ESRGAN,and SwinIR super-resolution algorithms showed that the DSR method outperforms these algorithms in both PSNR and SSIM metrics.Additionally,the DSR method significantly improves the quality of multispectral remote sensing images.By leveraging the conditional diffusion model,it successfully preserves rich detail and enhances spatial resolution without compromising image clarity.This method offers an efficient solution for super-resolution reconstruction,ensuring effective information acquisition in remote sensing applications and fulfilling the requirements of various domains such as land use classification,environmental monitoring,and urban planning.Moreover,the DSR method also opens new avenues for future research by demonstrating the potential of diffusion models in remote sensing image processing.It overcomes the limitations of simple convolutional networks,which extract only shallow features,and avoids the convergence issues commonly seen in adversarial neural networks during training,ultimately improving the restoration of rich details in remote sensing images.
关键词
扩散模型/超分辨率/遥感图像/残差网络/深度学习/高分辨率遥感/遥感图像重建Key words
Diffusion Model/super-resolution/remote sensing images/residual network/deep learning/high-resolution remote sensing/remote sensing image reconstruction引用本文复制引用
基金项目
国家自然科学基金项目(42071318)
国家重点研发计划项目(2022YFB3904104)
出版年
2024
NETL
NSTL
万方数据