High availability transaction load balancing scheduling optimization based on data set of Zookeeper framework
High availability of datasets is one of the important research topics in the big data environment.At present,the low availability of datasets on big data service platforms is an important factor affecting system operational efficiency,mainly due to low transaction scheduling efficiency,poor transaction consistency,and slow transaction response speed of datasets.The article optimizes the resource manager response mechanism through the Zookeeper framework for data transaction scheduling,solving issues such as load balancing and transaction response timeout.Through microservice architecture,transaction resources are managed,data structures are optimized,and standardized interfaces are formed to enable interrupt mechanisms to send correct information,meeting the resource scheduling requirements of big data platforms in different environments,and improving the digitalization,security,and high availability levels of big data platforms.