Astronomical satellite data processing is one of the essential aspects of scientific research in the field of space astronomy,which is currently a hot research topic.However,because large-scale data processing is required,traditional methods to process data do not satisfy the requirements of current applications under the background of big data.To address this issue,this paper proposes a data processing software system that realizes the automation and standardization of data processing for astronomical satellite.First,through analyzing the relationship among different satellite data products,data chunking technique is adopted to achieve the memory management.Second,by standardizing data processing algorithms and tools,the unified management of underlying code is realized.Finally,a workflow scheduling platform is developed to achieve the custom configuration and real-time monitoring of the data processing workflow.Experiments were conducted to verify the availability and practicality of the proposed system,and the results show that it is can overcome the deficiencies in traditional methods.The system also achieves the automation and standardization of data processing for astronomical satellite,which can provide guidance for the design of related software systems.
关键词
软件系统/卫星数据处理/工作流/天文卫星/算法标准化
Key words
software system/satellite data processing/workflow/astronomical satellite/algorithm standardization
维普
万方数据