首页|基于条件控制扩散模型的遥感图像超分辨率增强算法

基于条件控制扩散模型的遥感图像超分辨率增强算法

扫码查看
图像超分辨率技术通过提升图像的空间分辨率,增强图像清晰度,增加图像细节信息,实现在硬件条件不变的情况下提高图像质量.鉴于遥感影像具有较大的像幅、复杂的特征表现和丰富的细节,结合遥感图像信息高效获取的需求,本文提出了一种基于条件控制扩散模型(Diffusion Model)的遥感图像超分辨率算法DSR(Diffusion Super-Resolution).该算法以同一区域的低分辨率遥感图像为扩散模型的控制条件,与添加噪声后的高分辨率遥感图像拼接作为输入,构建了一个以U-Net为主干,融合残差连接和自注意力机制的深度噪声训练网络,并改进了损失函数以获得更优的超分辨率效果.本文实验中采用了多时相、多时期的国产卫星高分系列、高景系列的高分辨率遥感图像以及公开数据集Alsat-2B作为测试数据,测试了从32像素尺寸扩大至128像素的超分辨率效果.在这一基础上,将本文提出的算法与Bicubic、SRGAN、Real-ESRGAN、SwinIR等超分辨率算法进行比较,在PSNR和SSIM指标上取得了更好的性能.实验结果表明:DSR算法适用于遥感图像的超分辨率重建,特别是在多光谱遥感图像的超分辨率处理中,能够提升超分辨率结果质量,克服了简单卷积网络只能提取图像浅层特征的局限,避免了对抗神经网络训练过程中难以收敛的问题,显著提升了遥感图像中丰富细节的还原能力.
A Super-Resolution Enhancement Algorithm for Remote Sensing Images Using Conditional Controlled Diffusion Models
Image super-resolution technology enhances image clarity and enriches image detail by improving image spatial resolution,enabling quality enhancement without changing hardware conditions.Given the large size,complex target features,and abundant details of remote sensing images,along with the need for efficient information acquisition,we propose a Diffusion Super-Resolution (DSR) algorithm based on a conditional diffusion model.This approach uses low-resolution remote sensing images from the same region as conditioning inputs to the diffusion model,while high-resolution images with added noise are concatenated as inputs.A deep noise training network was constructed with U-Net as the backbone,incorporating residual connections and self-attention mechanisms.The loss function was also improved for better super-resolution results.The DSR method was tested using high-resolution remote sensing images from multiple periods of the domestic Gaofen and SuperView satellite series.The super-resolution results demonstrated pixel dimension expansion from 32 to 128.Comparative experiments with Bicubic,SRGAN,Real-ESRGAN,and SwinIR super-resolution algorithms showed that the DSR method outperforms these algorithms in both PSNR and SSIM metrics.Additionally,the DSR method significantly improves the quality of multispectral remote sensing images.By leveraging the conditional diffusion model,it successfully preserves rich detail and enhances spatial resolution without compromising image clarity.This method offers an efficient solution for super-resolution reconstruction,ensuring effective information acquisition in remote sensing applications and fulfilling the requirements of various domains such as land use classification,environmental monitoring,and urban planning.Moreover,the DSR method also opens new avenues for future research by demonstrating the potential of diffusion models in remote sensing image processing.It overcomes the limitations of simple convolutional networks,which extract only shallow features,and avoids the convergence issues commonly seen in adversarial neural networks during training,ultimately improving the restoration of rich details in remote sensing images.

Diffusion Modelsuper-resolutionremote sensing imagesresidual networkdeep learninghigh-resolution remote sensingremote sensing image reconstruction

付奕博、谢东海、王志博、易畅、郭柳艳、吴俣

展开 >

首都师范大学资源环境与旅游学院,北京 100048

首都师范大学城市环境过程与数字模拟国家重点实验室孵化基地,北京 100048

天津大学地球系统科学学院,天津 300072

扩散模型 超分辨率 遥感图像 残差网络 深度学习 高分辨率遥感 遥感图像重建

国家自然科学基金项目国家重点研发计划项目

420713182022YFB3904104

2024

地球信息科学学报
中国科学院地理科学与资源研究所

地球信息科学学报

CSTPCD北大核心
影响因子:1.004
ISSN:1560-8999
年,卷(期):2024.26(10)