Back close

Automatic 3D Facial Landmark-Based Deformation Transfer on Facial Variants for Blendshape Generation

Project Incharge:Dr. Divya Udayan J.
Automatic 3D Facial Landmark-Based Deformation Transfer on Facial Variants for Blendshape Generation

Blendshape models are used in various computer vision applications, such as expression transfer, 3D reconstruction, expression analysis and so on. Blendshape models have received lot of attention in last decades, and extensive research is carried out in the 3D face modeling. Computer-based animations use blendshape models for the transfer of target facial expression to animated character. The major challenge in such animation is developing blendshape models that can represent various facial expressions. To create such large data set of expression, one requires a dedicated expert team and it is a time-consuming process. In this paper, we propose a framework for automatic facial landmark detection and blendshape generation through expression transfer. The proposed work is in two main folds: Initially, facial landmarks are extracted based on geometric information of the given facial mesh. Further, the extracted landmark points and the estimated correspondence between source and target facial models are used to perform deformation transfer. Experiment results show that our method is able to transfer expression by using automatic landmarks and also the smoothness of deformation around facial landmark areas proves that our proposed landmark-based deformation method is as good as the state-of-the-art methods. Our proposed method for automatic facial landmark detection based on geometric information of 3D face model has the ability to detect reliable correspondences, and it is faster and simpler compared with the state-of-the-art automatic deformation transfer method on the facial models.

Collaboration

  • VIT University, Vellore, Konkuk University , S. Korea 

Outcome

  • Anupama K Ingale, Anny Leema A, HyungSeok Kim, Divya Udayan J, Automatic 3D Facial Landmark-Based Deformation Transfer on Facial Variants for Blendshape Generation, Arabian Journal for Science and Engineering(SCOPUS, SCI IF:2.38) URL: https://doi.org/10.1007/s13369-022-07403-2 

Related Projects

Development of Real-Time Personalized Intervention System for Elderly People in Ambient Assisted Living
Development of Real-Time Personalized Intervention System for Elderly People in Ambient Assisted Living
Kochi Intervention for Tobacco Smoke-Free Homes [KIFT]
Kochi Intervention for Tobacco Smoke-Free Homes [KIFT]
Registration of ultrasound images of patients suffering hypertrophic cardiomyopathy with Gadolinium-enhanced MRI images
Registration of ultrasound images of patients suffering hypertrophic cardiomyopathy with Gadolinium-enhanced MRI images
Investigation on Effect of Space Radiations on Space Durable Polymeric Nano Composite for Future Generation Space Missions
Investigation on Effect of Space Radiations on Space Durable Polymeric Nano Composite for Future Generation Space Missions
Development and Prototyping of ICT enabled Smart Charging Network Components
Development and Prototyping of ICT enabled Smart Charging Network Components
Admissions Apply Now