首页|基于大数据技术的工业大数据高可用集群搭建设计与实现

基于大数据技术的工业大数据高可用集群搭建设计与实现

扫码查看
随着互联网技术在工业生产中广泛应用,工业互联网的发展突飞猛进.在工业生产中,企业为了对工业大数据进行更好的采集、分析和预处理,利用大数据技术搭建大数据集群来完成各个生产环节.基于Hadoop的高可用分布式框架已经成为很多企业在集群搭建中的首选.文章在基于高可用Hadoop组件基础上,搭建了Hive、HBase、Spark、Flink、Kafka等大数据生态系统中一些重要组件,用于对数据的存储、采集、抽取、清洗、预处理和分析等操作,帮助企业在生产过程中完善生产环节,提高生产效率.
Design and implementation of industrial big data high availability cluster construction based on big data technology
With the wide application of the Internet in industrial production,the development of industrial Internet is advancing rapidly.In industrial production,in order to assist enterprises in better collecting,analyzing,and preprocessing the industrial big data,it is necessary to build a big data cluster to complete various production processes using big data technology.Hadoop based highly available distributed frameworks have become the preferred choice for many enterprises in cluster construction.In the article,based on highly available Hadoop components,some important components in the big data ecosystem such as Hive,HBase,Spark,Flink,Kafka,etc.are built to store,collect,extract,clean,preprocess,and analyze data,helping enterprises improve production processes and increase production efficiency.

industrial big dataHadoop cluster constructiondata processing

张艳敏、马晓涛、杨冰倩、吴卫宏、赵滨

展开 >

河北软件职业技术学院,河北 保定 071000

工业大数据 Hadoop集群搭建 数据处理

2024

无线互联科技
江苏省科学技术情报研究所

无线互联科技

影响因子:0.263
ISSN:1672-6944
年,卷(期):2024.21(22)