首页|基于语义增广与YOLOv8的钢轨表面缺陷检测方法

基于语义增广与YOLOv8的钢轨表面缺陷检测方法

扫码查看
针对钢轨表面缺陷检测中存在的表面反光导致缺陷不明显、样本数量少、检测实时性要求高、检测精度偏低等问题,提出一种融合语义增广与YOLO模型的钢轨表面缺陷检测方法.以RSDDs数据集为例,截取钢轨表面缺陷区域,采用傅里叶变换提取缺陷语义特征,并结合原始图像进行语义增广,构建了表面缺陷增广数据集;基于YOLOv8检测模型,增加了融合低层特征的检测头,构建了面向钢轨表面缺陷实例分割的检测模型;通过模型训练与测试,对比图像语义增广、YOLOv8模型改进在钢轨表面缺陷检测、语义分割精度上的效果.研究结果表明:傅里叶域提取语义特征能够抑制表面反光影响,图像的语义增广和YOLOv8模型改进的策略均能够有效提升钢轨表面缺陷检测的准确率和召回率,语义增广在检测精度和实例分割精度的mAP50指标分别提高2.1和3.0个百分点,YOLOv8模型改进策略在检测精度和实例分割精度的mAP50指标分别提高1.0和1.4百分点;结合语义增广与模型改进,将钢轨表面缺陷的检测精度和分割精度的mAP50指标分别提升至0.937和0.934,在mAP50~95指标上分别达到11.4和11.9个百分点的提升,显著提升了钢轨表面缺陷检测的准确性,同时保持了较好的实时性.研究结果为进一步提升钢轨表面缺陷检测的准确性和效率提供解决思路,为铁路基础设施的数字化、智能化运维管理提供参考.
Rail surface defect detection based on semantic augmentation and YOLOv8
To unclear defects caused by surface reflection,small sample,high real-time detection requirements,and low accuracy in surface defects,a surface defect instance segmentation detection method combining semantic augmentation and YOLO was proposed.Firstly,using RSDDs dataset to cut out the defect areas and Fourier transform to extract semantic features,combined with the original image to construct surface defect augmentation dataset.Secondly,a detection head that integrates low-level features had been added to the YOLOv8 model,and a detection model for instance segmentation of surface defects was been constructed.Finally,the model was trained and tested,and the performance of semantic augmentation and model improvements were verified through comparative experiments.The experimental results demonstrate that semantic features in the Fourier domain can suppress the influence of surface reflection.Both the semantic augmentation and model improvements can effectively improve the accuracy and recall.The accuracy of detection and instance segmentation are improved by 2.1 and 3.0 on mAP50 by using semantic augmentation.The model improvements on YOLOv8 will bring 1.0 and 1.4 increase on detection and instance segmentation,respectively.By combining semantic augmentation and model improvements,the mAP50 for detection and instance segmentation are achieved to 0.937 and 0.934,respectively,and the mAP50~95 will be improved 11.4 and 11.9 percentage.Besides,proposed method can maintain good real-time performance during significantly improving the accuracy.The research can provide solutions for surface defect detection,and intelligent maintenance management on railway infrastructure.

Fourier transformsemantic augmentationrail surface defectsinstance segmentationYOLOv8

吴永军、崔灿、何永福

展开 >

重庆交通大学 交通运输学院,重庆 400074

郑州大学 黄河实验室,河南 郑州 450001

傅里叶变换 语义增广 钢轨表面缺陷 实例分割 YOLOv8

重庆市教委科学技术研究项目重庆市自然科学基金面上项目

KJQN202100708CSTB2022NSCQ-MSX0908

2024

铁道科学与工程学报
中南大学 中国铁道学会

铁道科学与工程学报

CSTPCD北大核心EI
影响因子:0.837
ISSN:1672-7029
年,卷(期):2024.21(9)
  • 8