武汉科技大学学报(自然科学版)2025,Vol.48Issue(1) :59-69.DOI:10.3969/j.issn.1674-3644.2025.01.008

基于循环一致对抗学习的段码液晶仪表读数识别方法

A reading recognition method for seven-segment LCD meters based on cycle-consistent adversarial learning

惠毅 徐望明 叶胜
武汉科技大学学报(自然科学版)2025,Vol.48Issue(1) :59-69.DOI:10.3969/j.issn.1674-3644.2025.01.008

基于循环一致对抗学习的段码液晶仪表读数识别方法

A reading recognition method for seven-segment LCD meters based on cycle-consistent adversarial learning

惠毅 1徐望明 2叶胜1
扫码查看

作者信息

  • 1. 武汉科技大学信息科学与工程学院,湖北 武汉,430081
  • 2. 武汉科技大学信息科学与工程学院,湖北 武汉,430081;武汉科技大学冶金自动化与检测技术教育部工程研究中心,湖北 武汉,430081
  • 折叠

摘要

为解决自然场景中仪表图像受复杂光照、背景及其他随机干扰所造成的读数识别难题,提出一种基于循环一致对抗学习的段码液晶仪表读数识别方法.该方法使用M-CRAFT作为字符检测网络,获取段码读数区域和段码字符位置,通过后处理算法分割得到段码字符子图像,然后以循环一致对抗域自适应网络CYCADA为基础,增加感知损失和重构损失并设计分类器,构建了一种改进的字符背景分离与识别网络I-CYCADA,用于将具有复杂背景的段码字符图像转换为清晰直观的二值图像,从而使读数识别变得更为简单和准确.为了验证该方法的有效性,构建了由多种复杂场景下的液晶段码仪表图像组成的数据集.实验结果表明,I-CYCADA可与不同CNN分类网络结合使用,均能提升转换后的段码字符图像的识别准确率,本文方法在自建数据集上的字符级识别准确率达95.39%,完整读数识别准确率达86.65%,有效改善了对困难样本的识别效果,且轻量级设计可满足实时性要求.

Abstract

To solve the difficult problem of reading recognition caused by complex illumination,background and other ran-dom interference to meter images in natural scenes,a novel method for seven-segment LCD meter readings based on cy-cle-consistent adversarial learning was presented.M-CRAFT was used as the character detecting network to obtain the read-ing region and the positions of the segmental code characters,and the sub-images of the characters were segmented via post-processing.Then,based on cycle-consistent adversarial domain adaption(CYCADA)network,an improved network for background separation and character recognition,named I-CYCADA,was constructed by considering the perceptual loss and the reconstruction loss as well as designing a classifier.I-CYCADA converted the segmental code character image with com-plex background into a clear and intuitive binary image,which made reading recognition simpler and more accurate.To verify the validity of the proposed method,a dataset composed of images of seven-segment LCD meters in a variety of complex sce-narios was built.Experimental results show that I-CYCADA network can be used in combination with different CNN classifi-cation networks to improve the recognition accuracy of the converted images of segmental code characters.The proposed method achieves a character-level recognition accuracy of 95.39%and a whole reading recognition accuracy of 86.65%on the self-constructed dataset.The recognition effect of difficult samples is effectively improved,and the lightweight design can meet the real-time requirements.

关键词

液晶仪表/读数识别/对抗学习/域自适应/感知损失/重构损失

Key words

LCD meter/reading recognition/adversarial learning/domain adaptation/perceptual loss/reconstruction loss

引用本文复制引用

出版年

2025
武汉科技大学学报(自然科学版)
武汉科技大学

武汉科技大学学报(自然科学版)

北大核心
影响因子:0.38
ISSN:1674-3644
段落导航相关论文