A hierarchical geometry-to-semantic fusion GNN framework for earth surface anomalies detection
The increasing occurrence of Earth Surface Anomalies(ESAs)highlights the importance of the timely and accurate detection of such events.Therefore,researchers have utilized satellite imagery for large-scale detection and developed advanced deep learning methods.However,the performance of the methods is hindered by inadequate labeled data and the complexity of semantic information in satellite imagery.In this paper,we aim to address the aforementioned problems and improve the performance of Earth surface anomaly detection.This paper reviews and summarizes developments in Earth's surface anomaly detection and the problems that hinder the performance of existing methods.Then,we proposed a hierarchical geometry-to-semantic fusion Graph Neural Network(GNN)framework,which utilizes a single image for the detection of Earth's surface anomalies and reduces the demand for data and time required for preprocessing and inference.Specifically,our method employs two branches for the extraction of geoentities and construction of graphs at different levels.Then,a hierarchical graph attention network was utilized to update node features and extract graph embeddings for each level.An attention-based feature fusion module then combined them to yield the graph-level feature vector of the input image,which was finally processed through a multilayer perceptron for ESA detection.Given that existing ESA datasets mainly focus on single-class detection or post-hoc analysis,which is insufficient for our research needs,we proposed ESAD,which is a composite dataset,to bridge the gap between large-scale multiclass datasets.Specifically,ESAD is composed of three publicly datasets:xBD,Multi3Net and Sichuan Landslide,and Debrisflow.The proposed method was effective and accurate for detecting ESA,outperforming many baseline methods and balancing between accuracy and efficiency.Thus,it is suitable for ESA detection,saving valuable time and resources for downstream tasks.In conclusion,we proposed a hierarchical geometry-to-semantic fusion GNN framework for ESA detection.It leverages GNN to learn high-order semantic information from satellite imagery.To address insufficiency in benchmark datasets,we created the ESAD dataset based on existing related datasets.Our method achieved a good balance between accuracy and efficiency and is suitable for ESA detection with high timeliness requirements.In future work,we will further explore more models and extend our method to on-orbit real-time ESA detection task.
NETL
NSTL
万方数据
