舰船通信数据异常智能检测方法设计
Design of intelligent detection method for abnormal ship communication data
仇丹丹1
作者信息
- 1. 河南大学濮阳工学院,河南濮阳 457000;濮阳职业技术学院数学与信息工程学院,河南濮阳 457000
- 折叠
摘要
舰船通信网络受到外界环境干扰会导致通信数据产生异常,影响通信质量.针对该问题,设计基于云计算平台的舰船通信数据异常智能检测方法.在基于Hadoop的云计算平台内,利用HDFS分布式文件系统存储舰船通信数据,MapReduce计算框架针对存储的通信数据,在Map任务环节中利用Master节点搜索非工作状态下的Worker节点执行检测任务;Reduce任务环节中利用主成分分析方法提取通信数据特征,并将其作为聚类中心,利用欧几里得距离确定待检测舰船通信数据与聚类中心间的距离值,距离越小说明两者相似度越高;设定距离阈值,当距离值小于距离阈值时,即可将其定义为正常数据,相反为异常数据,由此实现异常数据检测.实验结果显示该方法可有效获取异常数据检测结果,且检测结果的AUC值达到0.91,能够有效提升舰船通信服务质量.
Abstract
External environmental interference on ship communication networks can cause abnormal communication data and affect communication quality.To address this issue,a cloud computing platform based intelligent detection method for ship communication data anomalies is designed.In the Hadoop based cloud computing platform,the HDFS distributed file system is used to store ship communication data.The MapReduce computing framework targets the stored communica-tion data and uses the Master node to search for non working Worker nodes in the Map task stage to perform detection tasks;In the Reduce task,principal component analysis is used to extract communication data features and use them as clustering centers.The Euclidean distance is used to determine the distance value between the communication data of the ship to be de-tected and the clustering center.The shorter the distance,the higher the similarity between the two;Set a distance threshold.When the distance value is less than the distance threshold,it can be defined as normal data and vice versa,thus achieving abnormal data detection.The experimental results show that this method can effectively obtain abnormal data detection res-ults,and the AUC value of the detection results reaches 0.91,which can effectively improve the quality of ship communica-tion services.
关键词
云计算平台/舰船通信数据/异常检测/主成分分析/特征提取/偏离度阈值Key words
cloud computing platform/ship communication data/anomaly detection/principal component analys-is/feature extraction/deviation threshold引用本文复制引用
基金项目
河南省重点研发与推广专项科技攻关计划(2020)(212102210081)
出版年
2024
NETL
NSTL
万方数据