首页|基于卷积神经网络UNet++的散斑图像变形测量方法

基于卷积神经网络UNet++的散斑图像变形测量方法

扫码查看
为了进一步提高深度学习在散斑图像变形测量领域的测量精度和泛化能力,提出了一种散斑图像的变形场测量方法,该方法基于图像分割网络UNet++,并融入残差块和坐标注意力机制分别测量散斑图像的位移场和应变场.为了提高网络的泛化性能,在Hermite数据集的基础上增添了真实试验中的散斑图案以及亮度变化,构建了适应于该网络的全新数据集.对该方法与现有深度学习方法在自建数据集和公开数据集上分别进行测试,结果表明:所提方法在所有测试中均取得了最高的平均精度和最优的鲁棒性;其他网络在具有亮度变化的数据集中几乎失效,而所提网络依然能准确测量出变形场;在DIC挑战数据集中Star5图像集和Star6图像集上,所提网络获得了最低的性能度量指标,分别为1.372和0.003 7.
Speckle Image Deformation Measurement Method Based on Convolutional Neural Network UNet++
Traditional Digital Image Correlation(DIC)methods face challenges in terms of computational speed,especially for large datasets,and in handling complex scenarios involving high-frequency deformation or discontinuities such as cracks.With the advent of deep learning,the potential for leveraging Convolutional Neural Networks(CNNs)for DIC has become increasingly apparent.Deep learning has revolutionized computer vision,achieving state-of-the-art results in tasks such as image classification,object detection,and segmentation.The success of CNNs in these domains suggests that they could also be applied to the task of DIC,potentially offering improvements in both accuracy and computational efficiency.In this context,the publication presents a novel approach to DIC using an advanced CNN architecture known as UNet++.The proposed method,termed DIC-Net++,is designed to address the limitations of traditional DIC algorithms and enhance the performance of deep learning in the context of speckle image deformation measurement.The article has developed two specialized networks within the DIC-Net++framework:DIC-Net++-d for displacement field measurement and DIC-Net++-s for strain field measurement.These networks are built upon the UNet++architecture,which is known for its effective feature extraction and fusion capabilities,and have been augmented with residual blocks and coordinate attention mechanisms to improve their performance.To facilitate the training of these networks and enhance their generalization capabilities,a new dataset is constructed that extends the Hermite dataset with additional real experimental speckle patterns and variations in brightness.This comprehensive dataset includes 47 800 image pairs,with 35 800 pairs derived from the Hermite dataset,10 000 from real experiments,and 2 000 involving high-frequency deformation.The dataset is meticulously divided into training,validation,and testing subsets to ensure a robust evaluation of the proposed networks.The text describes the design and training process of the DIC-Net++networks,emphasizing the innovative features of the architecture and the training procedures.A loss function based on the Average Endpoint Error(AEE)is utilized,which quantifies the vector difference between the predicted and actual displacement or strain field values.The networks are trained using the AdamW optimization method with a weight decay rate of 5×10-4,and a constant learning rate of 5×10-4 to prevent overfitting.The batch size is set to 32 to balance the trade-off between GPU memory usage and training speed.The results of the experiments conducted using the proposed DIC-Net++method are comprehensively presented and analyzed.The article has compared the performance of DIC-Net++-d with other competing networks,such as StrainNet-f and DIC-Net-d,on both self-built and public datasets.The experiments include tests on datasets with artificially introduced brightness variations to assess the robustness of the networks to such changes.The findings indicate that DIC-Net++-d outperforms other networks in terms of both accuracy and robustness,with minimal degradation in performance even when the datasets include significant brightness variations.Furthermore,the article has evaluated the performance of DIC-Net++on the DIC Challenge datasets,which are standardized datasets designed to provide a fair comparison of different DIC algorithms.The results on the Star5 and Star6 image sets demonstrate that DIC-Net++-d achieves the lowest Metrological Efficiency(MEI)among the tested networks,indicating superior accuracy and resolution.The MEI values for DIC-Net++-d on the Star5 and Star6 datasets are 1.372 and 0.003 7,respectively,which are significantly lower than those of other networks.This paper accelerates the application of deep learning technology in the field of DIC through the DIC-Net++method.The integration of residual blocks and coordinate attention mechanisms into the network design has proven to be highly effective in enhancing the network's ability to extract and fuse features,leading to improved measurement accuracy and robustness.The extensive experiments and comparisons with existing methods demonstrate the superior performance of DIC-Net++,both on self-built datasets and public benchmarks.

Optical measurementsDeformation measurementConvolutional neural networkDigital image correlationDeep learning

陈强、梁浚哲、梁晋

展开 >

西安交通大学 机械工程学院 精密制造技术全国重点实验室,西安 710049

光学测量 形变测量 卷积神经网络 数字图像相关法 深度学习

2024

光子学报
中国光学学会 中国科学院西安光学精密机械研究所

光子学报

CSTPCD北大核心
影响因子:0.948
ISSN:1004-4213
年,卷(期):2024.53(11)