首页|面向多种天气场景下目标检测的多域动态平均教师模型

面向多种天气场景下目标检测的多域动态平均教师模型

扫码查看
现有的基于深度学习的目标检测模型中,由于复杂天气使得现有方法的精度大幅降低。因此为了有效地消除不同天气场景带来的域差异问题,提出一种多域动态平均教师模型。首先引入多域平均教师模块,为多个不同天气场景下目标域数据生成伪标签;然后引入基于学生网络的风格迁移模块,解决多域任务中学生网络对不同目标域泛化能力差的问题,可有效地减小源域与不同目标域之间的差异,提升学生网络对不同目标域的泛化能力;最后提出基于教师网络的动态过滤伪标签模块,根据教师网络对不同目标域的学习效果动态地调整过滤伪标签的阈值,提升每个目标域伪标签质量。在FoggyCityscapes & RainCityscapes和Dusk-rain & Night-rain数据集上的实验结果表明,所提模型分别获得了 40。3%和31。4%的精度,在雨天、雾天和夜晚等多种复杂天气场景下都优于对比方法。
Multi-Domain Dynamic Mean Teacher for Object Detection in Complex Weather
The performance of existing deep learning-based object detection models significantly degrades due to the influence of complex weather.To effectively eliminate the problem of domain differences caused by dif-ferent weather scenes,propose a multi-domain dynamic mean teacher model.First,introduce a multi-domain mean teacher module to generate pseudo-labels for target domain data in multiple different weather scenes.Then,introduce a student network-based style transfer module to solve the problem of weak generalization ability of student network to different target domains in multi-domain tasks.It can effectively reduce the dif-ference between source domain and different target domains and improve the generalization ability of the stu-dent network to different target domains.Finally,a teacher network-based dynamic filtering pseudo-label module is used to dynamically adjust the threshold values of filtering pseudo labels according to the learning effect of the teacher network on different target domains and improve the quality of pseudo labels for each tar-get domain.Experiments on FoggyCityscapes & RainCityscapes and Dusk-rain & Night-rain datasets show that the proposed model achieves 40.3%and 31.4%accuracy respectively,and outperforms other comparison methods in complex weather scenes such as rain,fog and night.

domain adaptationobject detectionmulti-target domainsstyle transferpseudo-labeling

刘袁缘、王超凡、王文斌、张浩宇、罗忠文

展开 >

中国地质大学(武汉)计算机学院 武汉 430074

中国地质大学(武汉)国家地理信息系统工程技术研究中心 武汉 430074

领域自适应 目标检测 多目标域 风格迁移 伪标签

国家自然科学基金面上项目武汉市科技局基础前沿项目

620762272020010601012166

2024

计算机辅助设计与图形学学报
中国计算机学会

计算机辅助设计与图形学学报

CSTPCD北大核心
影响因子:0.892
ISSN:1003-9775
年,卷(期):2024.36(3)
  • 33