Design and Implementation of EAST Integrated Data Access System Based on Spring Cloud
During the EAST experiment,a large amount of data exceeding 1 PiB will be generated.Based on the actual needs of the experiment and the characteristics of the data structure,multiple data systems have been established.With the continuous growth of data scale and system access,existing systems has gradually exposed its limitations in terms of functional maintenance and expansion,while lacking effective monitoring of data status and a unified access mechanism.Based on the microservice architecture design,an EAST integrated data access system was constructed.Based on the EAST experimental data type,establish multiple data microservices that support independent development and deployment,and implement microservice integrated management through the Spring Cloud framework components.Using Kafka as the message middleware,a data engine is built to complete asynchronous collection and processing of experimental data status information.Using VUE technology,a portal system is built and unified access to data services is achieved.The system has successfully overcome many limitations of the single architecture,not only achieving the status monitoring function of EAST experimental data,but also providing users with a comprehensive EAST data service access platform,further ensuring the high availability of the EAST data system.
Tokamakdata accessmicroservice architecturedata status monitoring
NETL
NSTL
万方数据
