首页|Landmark Detection and 3D Face Reconstruction for Caricature using a Nonlinear Parametric Model

Landmark Detection and 3D Face Reconstruction for Caricature using a Nonlinear Parametric Model

扫码查看
Caricature is an artistic abstraction of the human face by distorting or exaggerating certain facial features, while still retains a likeness with the given face. Due to the large diversity of geometric and texture variations, automatic landmark detection and 3D face reconstruction for caricature is a challenging problem and has rarely been studied before. In this paper, we propose the first automatic method for this task by a novel 3D approach. To this end, we first build a dataset with various styles of 2D caricatures and their corresponding 3D shapes, and then build a parametric model on vertex based deformation space for 3D caricature face. Based on the constructed dataset and the nonlinear parametric model, we propose a neural network based method to regress the 3D face shape and orientation from the input 2D caricature image. Ablation studies and comparison with state-of-the-art methods demonstrate the effectiveness of our algorithm design. Extensive experimental results demonstrate that our method works well for various caricatures.

Hongrui Cai、Yudong Guo、Zhuang Peng、Juyong Zhang

展开 >

University of Science and Technology of China, China

2021

Graphical models

Graphical models

EISCI
ISSN:1524-0703
年,卷(期):2021.118(1)
  • 9
  • 63