哈尔滨工程大学学报2024,Vol.45Issue(8) :1427-1433.DOI:10.11990/jheu.202310016

针对鱼眼图像的FastSAM多点标注算法

FastSAM multipoint annotation algorithm for fisheye images

乔人杰 蔡成涛
哈尔滨工程大学学报2024,Vol.45Issue(8) :1427-1433.DOI:10.11990/jheu.202310016

针对鱼眼图像的FastSAM多点标注算法

FastSAM multipoint annotation algorithm for fisheye images

乔人杰 1蔡成涛1
扫码查看

作者信息

  • 1. 哈尔滨工程大学 智能科学与工程学院,黑龙江 哈尔滨 150001;黑龙江省环境智能感知重点实验室,黑龙江 哈尔滨 150001;哈尔滨工程大学 "船海装备智能化技术与应用"教育部重点实验室,黑龙江 哈尔滨 150001
  • 折叠

摘要

为了解决多点表示方法在鱼眼图像人体检测过程中标注成本高的问题,本文提出了基于FastSAM的多点标注算法,将鱼眼图像数据集本身的矩形框标注作为提示引导框,与原图一起作为输入,通过FastSAM获取较为准确的目标分割标注,根据分割标注与矩形框的IoU评估分割信息的准确性,对于不准确的个体进一步补全纠错.针对多点表示无法处理中心点不在目标内的问题,提出了基于凸包的多点表示回归策略,直接通过分割信息获取多点表示标注信息,同时设计了相对应的标签分配机制和损失函数.本文的方法可以节省大量的人工成本,同时通过实验验证该算法具有可行性.

Abstract

The multipoint representation method has significant advantages in the field of people detection in fisheye images.However,its annotation process is time-consuming and labor-intensive.Therefore,this paper proposes a multipoint annotation algorithm based on FastSAM.First,the rectangular bounding boxes annotated on the fisheye image datasets are used as prompt boxes,which are input into FastSAM along with the original image to obtain more accurate object segmentation annotations.The accuracy of the segmentation information is evaluated according to the IoU between the segmentation annotation and the prompt box.For inaccurate annotations,further manual screening and correction are performed.To address the issue of the multipoint representation's inability to handle cases in which the center point is not inside the target,we propose a convex hull-based multipoint representation re-gression strategy.This strategy can directly obtain multipoint representation annotations through segmentation infor-mation,and a corresponding label assignment mechanism and loss function are designed.The method in this paper can save a lot of labor costs,and the feasibility of the algorithm is verified through experiments.

关键词

多点标注/鱼眼图像/人体检测/FastSAM/凸包/提示矩形框/标签分配/损失函数

Key words

multipoint annotation/fisheye image/people detection/FastSAM/convex hull/prompt rectangular box/label assignment/loss function

引用本文复制引用

基金项目

黑龙江省自然科学基金重点项目(ZD2022F001)

出版年

2024
哈尔滨工程大学学报
哈尔滨工程大学

哈尔滨工程大学学报

CSTPCD北大核心
影响因子:0.655
ISSN:1006-7043
段落导航相关论文