基于Hadoop的离线电商数据分析系统的设计与实现
Design and implementation of offline e-commerce data analysis system based on Hadoop
潘杰恒 1蔡群英1
作者信息
- 1. 韩山师范学院计算机与信息工程学院,潮州 521041
- 折叠
摘要
随着互联网的普及和人们不断增长的消费需求,电子商务平台已成为人们生活不可或缺的一部分,由此产生大量数据.基于Hadoop,设计并实现一个离线电商数据分析系统,从系统架构、数据采集、传输、存储、分析处理和可视化等方面作了介绍,系统具有一定的数据分析能力,能将原本无用的数据进行整理利用,发挥数据本身的价值.
Abstract
With the popularization of the Internet and the growing consumer demand of the people,e-commerce platforms have become an indispensable part of people,generating a large amount of data.Based on Hadoop,design and implement an offline e-commerce data analysis system.This article introduces the system architecture,data collection,transmission,storage,analysis and processing,and visualization.The system has certain data analysis capabilities and can organize and utilize previously useless data,leveraging the value of the data itself.
关键词
电商/离线/分析系统/大数据/Hadoop/Hive/Flume/KafkaKey words
e-commerce/offline/analysis system/big data/Hadoop/Hive/Flume/Kafka引用本文复制引用
出版年
2024
NETL
NSTL
万方数据