Parallel channel shuffling and Transformer-based denoising for hyperspectral images
Objective With the increasing availability and advancement of hyperspectral imaging technology,hyperspectral images have become an invaluable resource in various fields,including agriculture,environmental monitoring,and remote sensing.However,these images are often prone to noise contamination,which can significantly degrade their quality and hinder accurate analysis and interpretation.As a result,denoising hyperspectral images has become a crucial task in the field of remote sensing image processing,attracting significant attention from researchers worldwide.The challenges associ-ated with denoising hyperspectral images are multifaceted.First,the inherent characteristics of hyperspectral data,such as high dimensionality and complex spectral information,pose significant difficulties for traditional denoising approaches.The presence of noise in hyperspectral images can obscure valuable information embedded within the spectral bands,mak-ing it essential to develop advanced denoising techniques that can effectively restore the original signal while preserving the rich texture and spatial details.Furthermore,the development of deep learning techniques,particularly convolutional neu-ral networks(CNNs),has revolutionized the field of image processing,including denoising tasks.CNN-based approaches have shown promising results in denoising various types of images.However,when it comes to hyperspectral data,tradi-tional CNN architectures face limitations in capturing the global contextual information necessary for accurate denoising.The fixed-size receptive fields of CNNs restrict their ability to exploit the spatial and spectral correlations present in hyper-spectral images,thereby reducing their overall denoising performance.To overcome these limitations,recent research has explored the integration of Transformers,which were originally designed for natural language processing tasks,into the field of computer vision,including hyperspectral image denoising.Transformers are capable of capturing long-range depen-dencies and global contextual information,making them an attractive alternative to CNNs for denoising tasks.However,directly applying Transformer-based models to hyperspectral data requires careful consideration of the specific challenges posed by the unique characteristics of hyperspectral images.Method In this study,we propose a novel denoising model for hyperspectral images that combines the strengths of Transformers and parallel convolution operations.Our model comprises three key modules:channel shuffling module,block downsampling global enhancement module,and adaptive bidirectional feature fusion module.These modules work synergistically to address the challenges encountered in denoising hyperspec-tral images.The channel shuffling module exploits the inter-channel relationships within hyperspectral data by incorporat-ing channel-mixing operations.By fusing information across different spectral channels,the module enhances the represen-tation power of the network and enables more comprehensive feature extraction.This approach effectively addresses the limitation of traditional CNN-based methods in fully utilizing the global information available in hyperspectral images,ulti-mately improving the model's denoising performance.In the block downsampling global enhancement module,we leverage a block downsampling strategy to capture global contextual information.By reducing the spatial resolution of the input hyperspectral image,the module enlarges the receptive fields,allowing the model to incorporate larger-scale information during the denoising process.This mechanism enhances the model's understanding of the overall structure of the image,facilitating more effective noise suppression and accurate restoration of spatial details.The adaptive bidirectional feature fusion module is designed to strike a balance between local and global feature extraction,leveraging the complementary strengths of CNNs and Transformers.This module introduces a mechanism for adaptively fusing features from local and global contexts,enabling the model to effectively combine local details with global information.By considering the intricate relationship between spatial and spectral features,our proposed approach improves the denoising performance and pre-serves the rich texture information inherent in hyperspectral images.Result To evaluate the effectiveness of our proposed model,extensive experiments were conducted on publicly available hyperspectral image datasets,including ICVL and Pavia.Experimental results demonstrated the superior denoising performance of our approach compared with that of current state-of-the-art methods.Our model consistently outperformed existing techniques in various noise scenarios,effectively removing noise while preserving the fine spatial details and rich texture information of hyperspectral images.The experi-mental evaluation involved quantitative metrics such as peak signal-to-noise ratio(PSNR),structural similarity index(SSIM),and spectral angel mapping(SAM).Our proposed model achieved significantly higher PSNR values and SSIM scores compared with the baseline methods,indicating improved denoising accuracy and visual quality of the restored images.In addition,the SAM values obtained using our model were consistently lower,indicating higher spectral similar-ity.Moreover,we conducted a comprehensive analysis of the computational efficiency of our model.With the increasing volume and complexity of hyperspectral data,developing denoising methods that are computationally efficient without sacri-ficing performance is crucial.Our proposed model demonstrated competitive computational efficiency,making it practical for real-world applications that involve large-scale hyperspectral image processing.Conclusion The success of our denois-ing model can be attributed to the synergistic combination of the Transformer-based architecture and the channel-mixing parallel convolution operations.The Transformer module enables effective capture of global contextual information,facili-tating better understanding of the relationships between spectral bands and spatial features.By incorporating channel-mixing operations,our model exploits the inter-channel correlations and enhances the discriminative power of feature extraction,resulting in improved denoising performance.Furthermore,our model's ability to handle diverse noise sce-narios and maintain image quality can be attributed to the adaptive bidirectional feature fusion module.This module intelli-gently combines local and global features,enabling effective noise suppression while preserving the fine details and texture information specific to different regions of the hyperspectral images.The adaptability of the feature fusion mechanism ensures robust denoising performance across various noise levels and image characteristics.In conclusion,this study pres-ents a novel denoising model for hyperspectral images based on the integration of Transformers and channel-mixing parallel convolution.The proposed model effectively addresses the limitations of traditional approaches in utilizing global informa-tion and captures the complex spatial-spectral correlations inherent in hyperspectral data.Experimental results demonstrate its superior denoising performance compared with that of state-of-the-art methods,with improved accuracy and preservation of fine details and texture information.The model's computational efficiency further enhances its practicality for real-world applications.Future research directions may include exploring additional mechanisms for adaptive feature fusion and inves-tigating the model's performance on other hyperspectral image processing tasks such as classification and segmentation.
NETL
NSTL
万方数据
