武汉大学学报(信息科学版)2024,Vol.49Issue(9) :1566-1573.DOI:10.13203/j.whugis20230099

一种识别植被覆盖滑坡的多模态深度神经网络模型

A Multi-modal Deep Neural Network Model for Forested Landslide Detection

唐小川 涂子涵 任绪清 方成勇 王宇 刘鑫 范宣梅
武汉大学学报(信息科学版)2024,Vol.49Issue(9) :1566-1573.DOI:10.13203/j.whugis20230099

一种识别植被覆盖滑坡的多模态深度神经网络模型

A Multi-modal Deep Neural Network Model for Forested Landslide Detection

唐小川 1涂子涵 2任绪清 2方成勇 3王宇 2刘鑫 2范宣梅3
扫码查看

作者信息

  • 1. 成都理工大学计算机与网络安全学院,四川 成都,610059;成都理工大学地质灾害防治与地质环境保护国家重点实验室,四川 成都,610059;中国民用航空飞行学院民航飞行技术与飞行安全重点实验室,四川 德阳,618307;电子科技大学通信抗干扰技术国家级重点实验室,四川 成都,611731
  • 2. 成都理工大学计算机与网络安全学院,四川 成都,610059
  • 3. 成都理工大学地质灾害防治与地质环境保护国家重点实验室,四川 成都,610059
  • 折叠

摘要

中国西南山区植被茂盛,该区域光学遥感影像上的滑坡常被植被遮挡、难以辨识,基于光学遥感影像的植被覆盖滑坡识别错误率较高,难以满足实际需求.针对这一问题,利用机载激光雷达(light detection and ranging,LiDAR)生成的数字高程模型(digital elevation model,DEM)和山体阴影图去除滑坡表面的植被覆盖,构建了一个植被覆盖山区的滑坡数据集.在此基础上,提出一种基于多模态深度学习的智能滑坡识别模型,综合利用DEM和山体阴影图识别植被覆盖条件下的滑坡,模型主要包括3个神经网络模块:自动提取DEM数据特征的Transformer神经网络,自动提取山影图特征的Transformer神经网络,以及融合多模态遥感数据的卷积注意力神经网络.实验对比了 ResU-Net、LandsNet、HRNet、SeaFormer模型,结果表明,所提模型达到了最高的滑坡预测精度,交并比和F1值分别提高了 9.3%和6.8%.因此,Li-DAR能够有效地去除植被干扰,适用于识别西南山区植被覆盖条件下的滑坡;提出的LiDAR滑坡识别模型能够预测滑坡的位置,为滑坡监测设备选址提供了有力支撑.

Abstract

Objectives:Vegetation widely spread in the southwestern mountainous regions of China.In the remote sensing images of this area,the landslides are usually shaded by vegetation.The error rate of forested landslide detection in remote sensing images is high,which is hard to meet practical needs.Methods:To address this issue,this paper uses light detection and ranging(LiDAR)-derived digital elevation mode(DEM)and hillshade to remove the forest on the landslides.In addition,a new dataset for forested landslide detection is also constructed.On this basis,an intelligent landslide detection model base on multi-modal deep learning is proposed.The proposed model uses DEM and hillshade to identify forested landslides,which consists of three neural network models:A transformer network for automatically extracting DEM fea-tures,a transformer network for automatically extracting hillshade features,and a convolution neural net-work with attention mechanism for merging multi-modal remote sensing data.Results:The proposed model is compared with ResU-Net,LandsNet,HRNet and SeaFormer.Experimental results show that the pro-posed model achieves the highest prediction accuracy.Intersection over union and F1 are improved by 9.3% and 6.8% ,respectively.Conclusions:LiDAR is able to remove the impact of forest cover,which is suitable for identifying the forested landslides in the southwest mountain areas of China.The proposed LiDAR-based landslide detection model is able to predict the position of landslides,which is useful for deciding the position of landslide monitoring devices.

关键词

滑坡识别/植被覆盖/山体阴影图/DEM/多模态深度学习/神经网络模型

Key words

landslide detection/vegetation cover/hillshade/DEM/multi-modal deep learning/neural network model

引用本文复制引用

出版年

2024
武汉大学学报(信息科学版)
武汉大学

武汉大学学报(信息科学版)

CSTPCDCSCD北大核心
影响因子:1.072
ISSN:1671-8860
段落导航相关论文