首页|基于改进BiSeNet V2的手机盖板缺陷检测方法

基于改进BiSeNet V2的手机盖板缺陷检测方法

扫码查看
为实现手机盖板表面缺陷自动化检测,提出一种基于改进BiSeNetV2语义分割缺陷检测方法.首先,融合加权图像差分方法进行缺陷特征增强以便于网络模型提取缺陷特征;然后,用分组膨胀卷积层来提取细节分支网络不同尺度的缺陷特征以减少浅层细节信息的损失,引入通道注意力机制,自适应学习并校准缺陷特征通道之间的相关性,增强网络模型提取缺陷特征的能力;最后,解码网络采用多尺度特征融合方法,恢复特征提取过程中损失的局部细节信息,提高缺陷检测的分割精度和准确率.由实验结果可知,所提方法的缺陷检测准确率为91.27%,误分类率为5.02%,缺陷检出率为96.29%,缺陷漏检率为3.71%,正常样本误检率为1.00%,因此所提改进的网络模型对手机盖板表面各类缺陷具有较好的检测效果.
Surface Defect Detection of Mobile Phone Covers Based on Improved BiSeNet V2
Objective Mobile phone glass covers are crucial components of display screens,influencing optical display performance and user experience.Mass production necessitates rigorous defect detection due to inevitable defects like scratches and dirt.Current methods like manual inspection and traditional machine vision fall short of meeting high-volume,high accuracy demands.Addressing these challenges,we propose an improved BiSeNet V2-based semantic segmentation method for accurate and efficient surface defect detection of mobile phone covers with diverse defect types,complex shapes,and challenging background distinctions.Methods We introduce an improved BiSeNet V2 semantic segmentation method tailored for detecting defects on mobile phone covers.Initially,we enhance defect features using a fusion weighted image difference method to aid network model extraction,addressing unclear detect imaging and low background discrimination issues.Building upon BiSeNet V2,enhancements include a detailed branch network using grouped dilated convolution and residual structures to enhance multi-scale defect feature extraction and preserve shallow feature details.A channel attention mechanism adaptively calibrates feature channel importance,bolstering defect recognition.A multi-scale feature fusion method in the decoding network restores lost local detail,enhancing defect segmentation accuracy and precision.Results and Discussions In response to various surface defects in mobile phone cover plates,such as multiple types of defects,small affected areas,a wide range of size variations,unclear defect features,and challenges in distinguishing them from the background.We adopt a lightweight semantic segmentation network based on BiSeNet V2 for defect detection.The network model is enhanced and optimized from four key aspects:improving defect feature representation,incorporating group dilation convolution,integrating attention mechanisms,and fusing multi-scale features.These enhancements effectively boost the accuracy of segmenting small and slender defect targets,enabling the classification and detection of multiple defect types.The refined model strikes a good balance between detection accuracy and detection speed.Eight samples of defect images from mobile phone cover plates are selected for detailed analysis and comparison(Fig.14).Results demonstrate that the improved network model excels in extracting defect features and recovering shallow details,achieving notably comprehensive segmentation results for slender scratch defects,surface dust,and foreign objects.Significant improvements are observed in detecting small point-shaped targets and in distinguishing similar defects,enabling overall detection efficacy across different defect types on mobile phone cover surfaces.In practical production processes,defect detection on mobile phone cover plates prioritizes metrics such as defect sample detection,missed detections,and false detections of normal samples.We quantitatively analyze the defect detection performance on mobile phone cover plates.Utilizing the improved BiSeNet V2 network model,354 defect samples and 100 normal samples are examined,and the detection outcomes for various defect types in image samples are statistically analyzed.Experimental results(Table 5)indicate that the proposed method achieves a defect detection accuracy of 91.27%,a misclassification rate of 5.02%,a defect detection rate of 96.29%,a leakage detection rate is 3.71%,and a normal sample misdetection rate of 1.00%.Thus,the improved network model significantly enhances defect detection capabilities across diverse surface defects of mobile phone covers.Conclusions We propose an improved BiSeNet V2 semantic segmentation network for detecting surface defects on mobile phone cover plates.Initially,defect image features are enhanced through weighted image difference processing,enhancing contrast between defects and background to facilitate comprehensive defect feature extraction.Subsequently,employing group dilation convolution and squeeze-and-excitation(SE)attention mechanism enhances bilateral feature extraction,accommodating defect features at diverse scales while minimizing loss of feature detail and channel-wise feature map calibration for adaptive response.Lastly,a multi-scale feature fusion method in the upsampling decoding network restores lost detail information,enhancing segmentation accuracy across various defect types and reducing missed detection rates.Experimental results demonstrate superior detection performance of the improved BiSeNet V2 network model compared to alternative semantic segmentation networks for diverse defect types on mobile phone cover plates.

machine visionmobile phone coverdefect detectionsemantic segmentationBiSeNet V2

刘波、王婷婷、刘杰

展开 >

河海大学机电工程学院,江苏常州 213200

机器视觉 手机盖板 缺陷检测 语义分割 BiSeNet V2

2024

光学学报
中国光学学会 中国科学院上海光学精密机械研究所

光学学报

CSTPCD北大核心
影响因子:1.931
ISSN:0253-2239
年,卷(期):2024.44(16)