中国水利水电科学研究院学报(中英文)2024，Vol.22Issue(2) ：219-228.DOI:10.13244/j.cnki.jiwhr.20230133

水利遥感数据规模化加工处理平台框架研究

Study on a large-scale processing platform framework for hydrological remote sensing data

江威 庞治国 吕娟 丁小辉 张朋杰 何国金 张伟
中国水利水电科学研究院学报(中英文)2024，Vol.22Issue(2) ：219-228.DOI:10.13244/j.cnki.jiwhr.20230133
✕
  • 维普
  • 万方数据

水利遥感数据规模化加工处理平台框架研究

Study on a large-scale processing platform framework for hydrological remote sensing data

江威 1庞治国 1吕娟 1丁小辉 2张朋杰 1何国金 3张伟4
扫码查看

作者信息

  • 1. 中国水利水电科学研究院,北京 100038;水利部防洪抗旱减灾工程技术研究中心(水旱灾害防御中心),北京 100038
  • 2. 江西财经大学软件与物联网工程学院,南昌 330013
  • 3. 中国科学院空天信息创新研究院,北京 100094
  • 4. 北京天目创新科技有限公司,北京 100096
  • 折叠

摘要

以卫星遥感为代表的地表信息空天获取手段是支撑新时期智慧水利建设的重要途径.当前,遥感数据获取能力与处理服务能力之间出现了失衡,大量的对地观测卫星遥感数据被获取,而能够支撑水利业务的遥感数据产品即时服务能力和动态更新频次仍然存在瓶颈,"卫星数据量大、处理流程复杂、产品服务不足"的现状长期存在,制约着水利行业遥感应用的质量和效率.本文通过调研当前国内外遥感大数据加工处理进展,分析了面向智慧水利建设的水利遥感数据处理平台需求,设计了一种水利遥感数据规模化加工处理平台的框架,用于海量卫星遥感数据产品全链路自动化处理,以提升水利遥感数据产品处理质量和服务效率.该平台可以实现超过30种多源高分遥感数据全流程处理,通过动态分配GPU和CPU计算缓存,实现卫星遥感数据正射校正、融合、镶嵌、质检以及水利遥感专题信息提取等流程规模化、并行化和自动化处理,生产满足数字孪生流域建设的卫星遥感专题产品,支撑新时期智慧水利建设的遥感深度应用.

Abstract

Satellite remote sensing,as a representative means of aerospace information acquisition,plays a crucial role in supporting the development of smart water resources management in the new era.Currently,there is a sig-nificant imbalance between the capability to acquire remote sensing data and the capability to provide data process-ing services.While a large volume of Earth observation satellite remote sensing data is being collected,there are still bottlenecks in the immediate service capability and dynamic update frequency of remote sensing data products that can support water resources management.The persistent challenges of"large satellite data volume,complex processing workflows,and inadequate product services"continue to hinder the quality and efficiency of remote sensing applications in the water resources field.This paper conducts research and analysis of the current progress in domestic and international remote sensing big data processing.It analyzes the requirements for a hydrological re-mote sensing data processing platform tailored for smart water resources management.A framework for a large-scale processing platform for water resources remote sensing data is designed,intended for the automated processing of massive satellite remote sensing data products along the entire chain.This platform aims to enhance the quality and efficiency of water resources remote sensing data product processing.It can achieve parallel processing for over 30 different sources of high-resolution remote sensing data,utilizing dynamic allocation of GPU and CPU computing resources to automate tasks such as satellite remote sensing data orthorectification,fusion,mosaicking,quality control,and extraction of hydrological remote sensing thematic information.The platform produces satellite remote sensing thematic products that meet the requirements for digital twin basin construction,thus supporting the deep application of remote sensing in smart water resources management in the new era.

关键词

水利遥感/规模化处理/遥感大数据/遥感专题产品/智慧水利

Key words

hydrological remote sensing/large-scale processing/remote sensing big data/remote sensing the-matic products/smart water resources

引用本文复制引用

基金项目

国家自然科学基金项目(42301450)

中国水利水电科学研究院基本科研业务费专项项目(JZ110145B0012023)

中国水科院减灾中心"技术研发型"科技创新人才项目(WH0166B012023)

出版年

2024
中国水利水电科学研究院学报(中英文)
中国水利水电科学研究院

中国水利水电科学研究院学报(中英文)

CSTPCD北大核心
影响因子：0.523
ISSN：2097-096X
参考文献量14
段落导航相关论文