首页|基于颜色校正和深度信息去雾的水下感知系统

基于颜色校正和深度信息去雾的水下感知系统

扫码查看
针对水下距离感知任务真实训练数据缺乏,水下目标感知任务目标模糊、密集、多尺度的问题,提出一种基于颜色校正和深度信息去雾的水下视觉感知系统。设计了一种改进的融合增强方法,并建立了一个水下单目图像数据集,以解决距离感知任务数据不足的难点。设计了一种基于深度信息的去雾方法,结合水下成像模型对图像进行去雾处理,提升图像质量。设计了一种基于中心点检测的通道重排网络,将卷积神经网络中浅层的详细特征完全集成到深层中,且无需锚框,增强对小目标、密集目标的特征提取能力。实验表明,该系统可从水下图像中恢复真实陆地色彩,准确感知水下场景相对距离,并实现域内和跨域高精度目标感知,在URPC数据集上取得了78。2%的域内目标检测精度,比基准CenterNet高出4。6%,在UTTS数据集上取得81。5%跨域目标检测精度,证明了该系统的有效性。
An Underwater Sensing System Based on Color Correction and Depth Information Dehazing
The core of an Autonomous Underwater Vehicle(AUV)lies in its ability to accurately perceive objects and the surrounding environment.With advancements in underwater optical vision sensor technology,optical imaging for environment perception is now feasible.Despite progress in object detection,underwater images'inherent degradation poses challenges.High underwater pressure complicates distance information acquisition,leading to limited training datasets.Moreover,the degradation and blurriness of underwater images often obscure object features.To enhance AUVs'capabilities in distance perception and scene reconstruction,research is increasingly focusing on precise localization and depth scene construction in underwater scenarios.To this end,this paper introduces an underwater visual perception system which incorporates color correction and depth information dehazing to overcome these challenges.Specifically,we propose an improved color correction method that combines white balance and adaptive histogram equalization for effective white balance and histogram adjustments to original images.This approach effectively mitigates the common issue of red artifacts in underwater images,thus rendering the images more realistic.Additionally,our method leverages white balance adjustments to enhance overall image contrast,thereby improving feature clarity.Moreover,to address the challenge of data insufficiency in underwater distance perception tasks,we have developed an improved fusion enhancement method.Through this approach,we establish an underwater monocular image dataset.Specifically,we collected a large number of underwater images from the Internet and enhanced them using the aforementioned image enhancement method.Building upon this,we integrated a monocular depth estimation network into our framework,where the depth estimation network is trained on the collected underwater images in an unsupervised manner.This approach provides depth map information,which is essential for subsequent image dehazing within the framework.Furthermore,to address the mis-detection issue in object detection caused by image degradation,we developed a novel underwater dehazing method.Note that the depth information generated by the monocular depth estimation network provides a more accurate modeling than prior knowledge,thus further enhance the dehazing performance.This method not only enhances image quality but also effectively clarifies degraded and blurry images,when it is incorporated into the proposed underwater imaging perception framework.To achieve more precise object localization,we propose a novel channel reordering network based on center point detection.This method effectively incorporates fine-grained features from the shallower layers of the convolutional neural network into the deeper layers.It should be noted that this anchor-free method effectively enhances feature extraction for small and dense objects.The efficacy of this method was demonstrated through extensive experiments on multiple datasets,including recovery experiments on underwater images.Extensive experiments were conducted to validate the method's ability to restore true terrestrial colors and to accurately perceive relative distances in underwater scenes.Additional experiments validated the method's high-precision object perception capabilities both within and across domains,achieving high performance levels on the URPC-Color and the URPC-Dehaze datasets.Furthermore,a comparison was made with various advanced one-stage models on the URPC dataset.Our method achieves an in-domain object detection accuracy of 78.2%,representing a 4.6%improvement over the baseline CenterNet.Moreover,category-wise accuracy performance shows that our method surpasses all other methods by a large margin,further indicating its effectiveness in underwater scenarios.In cross-domain detection experiments,our method achieves competitive results with an 81.5%object detection accuracy on the UTTS dataset.This further indicates the cross-domain capabilities of our method in underwater scenarios.The color correction and dehazing experiments highlighted the method's ability to enhance image quality and more effectively perceive scene depth and object information.

Object detectionDehazingDepth estimationColor correctionUnderwater image

毛昭勇、刘楠、陈刚琦、侯冬冬、沈钧戈

展开 >

西北工业大学 无人系统技术研究院,西安 710072

中国航天科技创新研究院,北京 100088

西北工业大学 航海学院,西安 710072

中国船舶重工集团公司第七一三研究所,河南省水下智能装备重点实验室,郑州 450015

展开 >

目标检测 去雾 深度估计 颜色校正 水下图像

中央基本科研业务费陕西省自然科学基金陕西省秦创原"科学家+工程师"西安市科技计划-人工智能示范项目

50002201922022JM-2062022KXJ-00621RGZN0008

2024

光子学报
中国光学学会 中国科学院西安光学精密机械研究所

光子学报

CSTPCD北大核心
影响因子:0.948
ISSN:1004-4213
年,卷(期):2024.53(6)