In order to better build a unified management data warehouse and provide unified data services for all relevant application software within the scope of transaction log analysis,this article applies big data technology to complete the design and implementation of a transaction log analysis system,and uses real log data from 25 transaction platforms over the past year for data simulation on the SimulWorks platform to study the accuracy of transaction log analysis data.The results show that the new solution under the data transaction log analysis system can save over 85%of data warehouse hardware facilities and improve the accuracy of log analysis data by about 82.7%.Therefore,data-driven transaction log analysis systems and the response time for log analysis data reading and writing has also been significantly improved.
big datadata warehousedata simulationtrading log analysishardware facilities
NETL
NSTL
万方数据
