Cross-dataset hyperspectral image classification based on fusion feature optimization
Objective Hyperspectral image is a 3D data cube of"space-spectrum integration".Its high-resolution spectral information can realize fine-grained land cover identification,and its wide-coverage spatial information can complete accu-rate land cover mapping.Therefore,hyperspectral images with spatial information and spectral information are widely used in tasks related to land cover classification.Thus,hyperspectral image classification is an important research topic in remote sensing field and a key supporting technology for many Earth observation tasks,such as smart cities,precision agri-culture,and modern national defense.In recent years,many classification methods for hyperspectral images have been proposed to mine spatial and spectral information based on different deep networks,and they have achieved unprecedented high-precision classification results.However,due to various factors such as the change in acquisition environment and the difference in imaging sensors,the feature distribution of different hyperspectral images is shifted,which leads to the diffi-culty of cross-dataset classification.For this reason,existing classification methods usually retrain the model to deal with new hyperspectral image dataset,which is label intensive and time consuming.In the era of remote sensing big data,devel-oping classification methods for cross-dataset hyperspectral images is important.Therefore,this study investigates classifi-cation methods for cross-dataset hyperspectral images to achieve large-scale Earth observation missions.Method This study proposes an unsupervised classification method for cross-dataset hyperspectral images based on feature optimization.The proposed method consists of three main modules.First,a feature balancing strategy is proposed to optimize the intra-dataset features independently.During the adversarial domain adaptation process,the transferability and discriminability of features are contradictory,and most existing methods sacrifice the feature discriminability of target dataset,which results in blurred class boundaries and affects classification performance.In the proposed method,a regularization term with singular value of the feature vectors from the source and target datasets is minimized to enhance the transferability and discriminability of the learned features.By extracting better features,this method achieves more accurate classification results on the target dataset.Second,a feature matching strategy is proposed to optimize the inter-dataset features collab-oratively.No labeled sample is available in the target dataset,and feature discrepancies are obvious between the source dataset and the target dataset.Thus,the model cannot accurately match the two datasets,which leads to inadequate gener-alization.In the proposed method,an implicit feature augmentation strategy is performed to guide the source features to the target space,which improves the generalization performance of the model.By utilizing the underlying relationships between different datasets,this method adapts better to the target dataset and improves the overall performance of the classi-fication model.Finally,an adversarial learning framework based on implicit discriminator is designed to optimize inter-dataset class-level features.Existing adversarial learning methods often construct an additional discriminator or use a binary classifier as a discriminator.The former focuses only on feature confusion between datasets and ignores class-level information,and the latter considers only class-level differences,which leads to ambiguous predictions.In the proposed method,by reusing the task classifier as an implicit discriminator,inter-dataset alignment and cross-dataset class recogni-tion are achieved.By further optimizing the adversarial learning method,this approach can further enhance the classifica-tion performance of the model on the target dataset.Result All experiments in this study are executed on a desktop com-puter with Intel Core i7 4.0 GHz CPU,GeForce GTX 1080Ti GPU,and 32 GB memory.PyTorch,which is a widely used deep learning framework,is used in the experiment.The experiments are conducted on Pavia and HyRANK datasets.The evaluation indexes include overall accuracy(OA),average accuracy(AA),and K coefficient.In addition,the classifica-tion results are intuitively represented by classification maps.The experimental results are compared with various recent classification methods for cross-dataset hyperspectral images trained with all labeled source samples and unlabeled target samples.The proposed method is optimized by a small-batch SGD optimizer with a momentum of 0.9.The learning rates for the Pavia and HyRANK datasets are set to 0.000 1 and 0.001,respectively.The maximum number of iterations is set to 2 000.In the Pavia datasets,OA,AA,and κ values increase by 1.75％,3.55％,and 2.17％,respectively,compared with the model with the second performance.In the HyRANK datasets,OA,AA,and K values increase by 6.58％,13.10％,and 7.96％,respectively,compared with the second-ranked model.Experimental results show that,compared with other methods,the classification maps produced by the proposed method are closer to the ground truth,and evaluation indexes of some categories are significantly improved.Moreover,the ablation experiment is conducted to study the effect of each module of the proposed method,which proves that each module is effective in improving the cross-dataset classifica-tion effect of hyperspectral images.Conclusion In this study,a feature-optimized classification method for cross-dataset hyperspectral images is proposed.The proposed method provides a novel solution for unsupervised classification of cross-dataset hyperspectral images.By combining feature equalization,feature matching,and adversarial learning techniques,the method improves the generalization capability and classification performance of the model.Thus,it is an effective approach for cross-dataset image classification tasks.The proposed method is verified on two hyperspectral datasets,and the experimental results show that the proposed method can significantly improve the accuracy of cross-dataset hyperspec-tral images under unsupervised conditions compared with related methods.
NETL
NSTL
万方数据
