首页|基于Hadoop技术的气象数据实时传输监控系统设计

基于Hadoop技术的气象数据实时传输监控系统设计

扫码查看
气象数据在传输过程中,可能会出现数据丢失、重复、错误等问题,为准确分析气象问题表现情况,实现对气象问题的实时监控,设计了基于Hadoop技术的气象数据实时传输监控系统;联合JTAG调试电路与数据采集器,调节风速风向、雨雪、雷电、温湿度4个基础监控模块,完成气象数据实时传输监控系统的硬件设计;根据Hadoop架构体系连接形式,搭建Ha-doop 架构体系,预处理气象数据;在此基础上,匹配数据库机制与业务信息表单,实现应用系统的实时传输监控功能,再联合相关系统硬件,完成基于Hadoop技术的气象数据实时传输监控系统的设计;实验结果表明,在文章设计系统作用下,A、B、C三个场景的风力、降雨、降雪、雷电等级监控结果均与气象数据取样结果保持一致,能够有效实现对风、雨、雪、雷4种气象问题的实时监测,可以准确分析气象问题表现情况,且平均响应时间仅为61。3 ms,具有较好的实时性。
Design of Real-time Meteorological Data Transmission and Monitoring System Based on Hadoop Technology
During the transmission of meteorological data,there may be issues such as data loss,duplication,and errors.In order to accurately analyze the meteorological problems and achieve the real-time monitoring of meteorological problems,a real-time trans-mission and monitoring system for the meteorological data based on Hadoop technology is designed.JTAG is combined to debug the circuit and data collector,adjust the four basic monitoring modules of wind speed and direction,rain and snow,lightning,and temper-ature and humidity,and complete the hardware design of the real-time transmission and monitoring system for the meteorological da-ta.According to the Hadoop architecture system,the Hadoop architecture system and preprocess meteorological data are built to process the meteorological data.On this basis,the database mechanism with business information forms is matched to achieve the re-al-time transmission and monitoring function of the application system.Then,in conjunction with the relevant system hardware,the meteorological data real-time transmission and monitoring system based on Hadoop technology is designed.The experimental results show that the designed system has the monitoring results of wind,rainfall,snowfall,and lightning levels in scenarios of A,B,and C,which is consistent with the meteorological data sampling results,the system can effectively achieve the real-time monitoring of four meteorological problems of wind,rain,snow,and thunder,accurately analyze the performance of the meteorological problems,and the average response time is only 61.3 ms,which has a good real-time performance.

Hadoop technologymeteorological datatransmission monitoring systemJTAG circuitdata collectordatabasebusiness information tablemeteorological issues

陶淘、彭颖、张晨亮

展开 >

新疆维吾尔自治区气象信息中心,乌鲁木齐 830002

西南民族大学计算机科学与工程学院,成都 610041

新疆维吾尔自治区气象技术装备保障中心,乌鲁木齐 830002

Hadoop技术 气象数据 传输监控系统 JTAG电路 数据采集器 数据库 业务信息表 气象问题

自治区创新环境(人才、基地)建设专项

2022287713

2024

计算机测量与控制
中国计算机自动测量与控制技术协会

计算机测量与控制

CSTPCD
影响因子:0.546
ISSN:1671-4598
年,卷(期):2024.32(1)
  • 23