首页|基于语义引导的人像自动抠图模型

基于语义引导的人像自动抠图模型

扫码查看
原文链接
  • NETL
  • NSTL
  • 万方数据
为解决现有人像抠图方法中存在的语义判别错误和抠图细节模糊问题,提出一种基于语义引导的人像自动抠图模型.首先引入CNN-Transformer混合架构EMO进行特征编码.接着,在语义分割解码分支利用多尺度混合注意力模块处理最高层编码特征,以增强多尺度表征和像素级判别能力.然后,使用特征增强模块融合高层次特征,促使高层语义信息在浅层网络的流动.同时,细节抠取解码分支中的聚合以引导来自模块不同分支的特征聚合,利用聚合特征更好地引导网络提取浅层特征,提高了边缘细节抠取精度.在 3 个数据集上的实验表明,该方法与所比较方法相比性能达到了最优,并显著降低了参数量和计算复杂度,具有较高的竞争力.
Automatic portrait matting model based on semantic guidance
To address the issues of semantic discrimination errors and unclear details in existing portrait matting methods,an automatic matting model based on semantic guidance was proposed.Firstly,a hybrid CNN-Transformer architecture EMO was introduced for feature encoding.Then,the semantic segmentation decoding branch utilized a multi-scale hybrid attention module to process the top-level encoded features,enhancing multi-scale representation and pixel-level discrimination capabilities.Next,a feature enhancement module was employed to merge high-level features,facilitating the flow of high-level semantic information through the shallow network.Simultaneously,the aggregation guidance module in the detail extraction decoding branch aggregated features from different branches,utilizing the aggregated features to better guide the network in extracting shallow features,thereby improving the accuracy of edge and detail extraction.Experiments on three datasets demonstrated that our approach outperformed the compared methods,achieving optimal performance while significantly reducing parameter count and computational complexity,validating the competitiveness of our proposed method.

portrait mattingsemantic guidancemulti-scalefeature enhancementaggregation guidance

程艳、严志航、赖建明、王桂喜、钟林辉

展开 >

江西师范大学软件学院,江西南昌 330022

江西省智能信息处理与情感计算省重点实验室,江西 南昌 330022

江西师范大学数字产业学院,江西 上饶 334000

江西师范大学计算机信息与工程学院,江西 南昌 330022

展开 >

人像抠图 语义引导 多尺度 特征增强 聚合引导

国家自然科学基金项目国家自然科学基金项目江西省科技创新基地计划省重点实验室项目江西省自然科学基金项目江西省03专项及5G项目江西省主要学科学术和技术带头人培养计划领军人才项目

62167006619670112024SSY0313120212BAB20201720212ABC03A2220213BCJL22047

2024

10.11996/JG.j.2095-302X.2024040683

图学学报
中国图学学会

图学学报

CSTPCD北大核心
影响因子：0.73
ISSN：2095-302X
年,卷(期)：2024.45(4)