A pansharpening algorithm for remote sensing images based on high-frequency domain and multi-depth dilated network
The pansharpening of remote sensing images is a process that extracts the spectral information of multispectral images and the structural information of panchromatic images and then fuse the information to form high-resolution multispectral remote sensing images,which,however,suffer a lack of spectral or structural information.To mitigate this problem,this study proposed a pansharpening algorithm for remote sensing images based on a multi-depth neural network.This algorithm includes a structural protection module and a spectral protection module.The structural protection module extracts the high-frequency information of panchromatic and multispectral images through filtering and then extracts the multi-scale information of the images using a multi-depth neural network.The purpose is to improve the spatial information extraction ability of the model and to reduce the risk of overfitting.The spectral protection module connects the upsampled multispectral images with the structural protection module through a skip connection.To validate the effectiveness of the new algorithm,this study,under consistent experimental conditions,compared the new algorithm with multiple pansharpening algorithms for remote sensing images and assessed these algorithms from the angles of subjective visual effects and objective evaluation.The results indicate that the algorithm proposed in this study can effectively protect the spectral information of multispectral images and the structural information of panchromatic images in solving the lack of structural information in current algorithms for image fusion.
remote sensing pansharpeningmulti-depth networkmulti-scale learningskip connectionspatial and spectral fusion