首页|基于改进YOLOv8与语义知识融合的金具缺陷检测方法研究

基于改进YOLOv8与语义知识融合的金具缺陷检测方法研究

扫码查看
针对输电线路螺栓金具缺陷检测任务中存在的缺陷样本类间分布不均、缺陷微小特征提取困难等问题,提出基于改进 YOLOv8 和语义知识融合的输电线路螺栓缺陷检测方法.首先,通过深入分析数据样本中螺栓金具缺陷种类与该螺栓承载金具种类之间的关系,完成语义关联构建工作;之后,在 YOLOv8 模型Neck部分引入BiFusion和RepBlock模块,增强模型的特征提取能力;其次,使用改进的融合语义知识校正权重的Loss函数,进一步提高训练模型的准确性,减少误检的发生;最后,分别完成基线选取实验、消融实验、超参数调整实验以及对比实验.实验结果表明,相较于Baseline模型,改进YOLOv8 方法在平均精确率(mAP)上提升了 4.0%,在关键少样本类精确率上提升了 24.6%,可有效提高输电线路螺栓金具缺陷检测的效果,该语义关联构建及语义知识融合方法具有一定的泛用性,为输电线路无人机智能巡检领域提供了新的方法支持.
Research on defect detection of transmission line fittings based on improved YOLOv8 and semantic knowledge fusion
To address issues such as the uneven distribution of defect samples among classes and the difficulty in extracting tiny features of defects in the task of detecting defects of transmission line bolts and fixtures,a defect detection method for transmission line bolts and fixtures was proposed based on the improvement of YOLOv8 and semantic knowledge fusion.First,the semantic correlation was established by analyzing the relationship between the defective types of bolt fittings in the data samples and the types of fittings carried by that bolt.Then,the BiFusion and RepBlock modules were introduced into the Neck part of the YOLOv8 model to enhance its feature extraction capability.Second,the Loss function of the weights was corrected using an improved fusion of semantic knowledge,further improving the accuracy of the training model and reducing the occurrence of misdetection.Finally,baseline selection experiments,ablation experiments,hyper-parameter experiments,and comparative experiments were conducted,respectively.The experimental results showed that compared with the Baseline model,the improved YOLOv8 method increased the mean average precision(mAP)by 4.0%and improved the accuracy of the key less sample classes by 24.6%,effectively enhancing the defect detection performance for transmission line bolted fittings.The proposed semantic correlation establishment and semantic knowledge fusion method also demonstrated a certain degree of generalizability,providing new methodological support for UAV-based intelligent inspection of transmission lines.

UAV inspectiontransmission line fittingsbolt defect detectionsemantic information fusionYOLOv8

李刚、蔡泽浩、孙华勋、赵振兵

展开 >

华北电力大学计算机系,河北 保定 071003

复杂能源系统智能计算教育部工程研究中心,河北 保定 071003

中国华电集团有限公司,北京 100031

无人机巡检 输电线路金具 螺栓缺陷检测 语义信息融合 YOLOv8

国家自然科学基金项目国家自然科学基金项目

61871182U21A20486

2024

图学学报
中国图学学会

图学学报

CSTPCD北大核心
影响因子:0.73
ISSN:2095-302X
年,卷(期):2024.45(5)