Evaluation of the Performance of CarbonData in the Network Security Log Analysis Scenario
This article focuses on the analysis scenario of enterprise network security logs,using actual network security log data,designing table building and testing methods,and using big data engines Spark SQL and Presto to evaluate the performance of the indexed columnar data format CarbonData.Through test-ing,it has been found that the data query and statistical efficiency based on Spark SQL+CarbonData scheme is high,which can meet various data processing and analysis requirements and is suitable for network securi-ty log analysis applications.This article provides a reference for the technical selection and design of enter-prise network security log analysis solutions.
万方数据
维普
