An analysis to Batch Warehousing Tool for Data Synchronization between Databases
Propose a batch storage tool for data synchronization between databases to address the issues that arise during data synchronization between databases.For multi-threaded algorithms,create at least two sub threads for reading transaction logs and parallel read different content blocks of the source database transaction logs;Each sub thread reads content blocks and generates SQL execution statements in parallel,creates SQL files in parallel,and writes the file name of the SQL file into the sequence of executable files.For single threaded algorithms,under the technical background of synchronizing by parsing the transaction logs of the source database,batch execution of SQL commands can improve data synchronization efficiency.The tool signif-icantly improves the efficiency of data synchronization by doubling the parsing efficiency.
NETL
NSTL
万方数据
