Design and implementation of long sequential structured data processing application based on"cloud-edge"
In order to enhance the statistical and processing support capability of long sequential ground observation data,and to accelerate the cloud-based transformation of key business platforms in the"cloud-edge"mode,a timed task processing flow of processing pipeline is built by directly connecting to the library based on the resource data environment and the cloud integration standard of the provincial meteorological big data cloud platform("CMADaaS"),and the"SpringBoot+Mybatis framework"is adopted to develop a collaborative interface to provide real-time data query service,and the full-process business monitoring and alarm functions for data processing are incorporated into the"TianJing"management,achieving comprehensively integrating the original platform into the cloud environment.The results of cloud application indicate significant savings in hardware and storage resources,with real-time query efficiency improved by over 30%.The development model is simple,efficient,and highly extensible,providing technical guidance and reference for related massive structured data statistical scenarios.
国家科技期刊平台
NSTL
万方数据
