A Universal Satellite Data Processing and Scheduling System Based on Scientific Workflow
After the massive observation data generated by astronomical satellites is transmitted to the ground,it needs to go through a series of processing processes to generate data products that can be used by scientific researchers.Traditional data processing methods require a lot of time and labor costs,and there are shortcomings such as lack of flexibility,difficult task management,and inefficient exe-cution.Based on the above problems,in order to realize the automation and standardization of satellite data product generation,we study and design a general satellite data processing and scheduling system based on scientific workflow technology.By encapsulating satellite data processing algorithms,combined with scientific workflow,visual editing and other related technologies,to realize the automation and configurability of satellite data processing,users do not need to modify the code when updating requirements,only need to reconfigure pa-rameters.The pluggable component design mechanism is used to achieve a universal type of system to meet the different data processing needs of the expanding number of satellites.Application tests are carried out according to the data processing requirements of existing sat-ellites,and the application examples show that the system can realize the automatic processing of satellite data,and can greatly improve the flexibility,maintainability and execution efficiency of the data processing process,which is conducive to scientific researchers to obtain satellite data products according to their own needs.
astronomical satellite data processingdata productsscientific workflowtask schedulingautomation
万方数据
维普
