Back close

Automatic 3D Facial Landmark-Based Deformation Transfer on Facial Variants for Blendshape Generation

Project Incharge:Dr. Divya Udayan J.
Automatic 3D Facial Landmark-Based Deformation Transfer on Facial Variants for Blendshape Generation

Blendshape models are used in various computer vision applications, such as expression transfer, 3D reconstruction, expression analysis and so on. Blendshape models have received lot of attention in last decades, and extensive research is carried out in the 3D face modeling. Computer-based animations use blendshape models for the transfer of target facial expression to animated character. The major challenge in such animation is developing blendshape models that can represent various facial expressions. To create such large data set of expression, one requires a dedicated expert team and it is a time-consuming process. In this paper, we propose a framework for automatic facial landmark detection and blendshape generation through expression transfer. The proposed work is in two main folds: Initially, facial landmarks are extracted based on geometric information of the given facial mesh. Further, the extracted landmark points and the estimated correspondence between source and target facial models are used to perform deformation transfer. Experiment results show that our method is able to transfer expression by using automatic landmarks and also the smoothness of deformation around facial landmark areas proves that our proposed landmark-based deformation method is as good as the state-of-the-art methods. Our proposed method for automatic facial landmark detection based on geometric information of 3D face model has the ability to detect reliable correspondences, and it is faster and simpler compared with the state-of-the-art automatic deformation transfer method on the facial models.

Collaboration

  • VIT University, Vellore, Konkuk University , S. Korea 

Outcome

  • Anupama K Ingale, Anny Leema A, HyungSeok Kim, Divya Udayan J, Automatic 3D Facial Landmark-Based Deformation Transfer on Facial Variants for Blendshape Generation, Arabian Journal for Science and Engineering(SCOPUS, SCI IF:2.38) URL: https://doi.org/10.1007/s13369-022-07403-2 

Related Projects

Modulation of MicroRNA and Transcriptional Regulation of MMP-2 by Natural Products in Human Breast Cancer Cells
Modulation of MicroRNA and Transcriptional Regulation of MMP-2 by Natural Products in Human Breast Cancer Cells
E-bike
E-bike
Screening for reading Difficulty 
Screening for reading Difficulty 
Detection and Prevention of Advanced Persistent Threat (APT) Activitiesin Heterogeneous Networks using SIEM and Deep Learning
Detection and Prevention of Advanced Persistent Threat (APT) Activitiesin Heterogeneous Networks using SIEM and Deep Learning
Study of Energy Harvesting SWIPT Enabled Wireless Networks
Study of Energy Harvesting SWIPT Enabled Wireless Networks
Admissions Apply Now