Application of Distributed Storage and Computing Method in Water Conservancy Geospatial Big Data
This article presents a Hadoop&Spark-based distributed storage and computing framework for saving and managing water conservancy geospatial big data efficiently. By reasonably using Spark's memory and cache mechanism, the distributed storage and computing method is designed and achieved. It calculates and analyzes the reservoir capacity by using DEM data of a hydroelectric sta-tion reservoir and the results show that the proposed distributed computing method can improve computing efficiency of large geospatial data effectively. Meanwhile, this distributed computing method exhibits good adaptability.
HadoopSparkgeospatial big datadistributed computingreservoir capacity calculation
万方数据
维普
