Back close

Automatic 3D Facial Landmark-Based Deformation Transfer on Facial Variants for Blendshape Generation

Project Incharge:Dr. Divya Udayan J.
Automatic 3D Facial Landmark-Based Deformation Transfer on Facial Variants for Blendshape Generation

Blendshape models are used in various computer vision applications, such as expression transfer, 3D reconstruction, expression analysis and so on. Blendshape models have received lot of attention in last decades, and extensive research is carried out in the 3D face modeling. Computer-based animations use blendshape models for the transfer of target facial expression to animated character. The major challenge in such animation is developing blendshape models that can represent various facial expressions. To create such large data set of expression, one requires a dedicated expert team and it is a time-consuming process. In this paper, we propose a framework for automatic facial landmark detection and blendshape generation through expression transfer. The proposed work is in two main folds: Initially, facial landmarks are extracted based on geometric information of the given facial mesh. Further, the extracted landmark points and the estimated correspondence between source and target facial models are used to perform deformation transfer. Experiment results show that our method is able to transfer expression by using automatic landmarks and also the smoothness of deformation around facial landmark areas proves that our proposed landmark-based deformation method is as good as the state-of-the-art methods. Our proposed method for automatic facial landmark detection based on geometric information of 3D face model has the ability to detect reliable correspondences, and it is faster and simpler compared with the state-of-the-art automatic deformation transfer method on the facial models.

Collaboration

  • VIT University, Vellore, Konkuk University , S. Korea 

Outcome

  • Anupama K Ingale, Anny Leema A, HyungSeok Kim, Divya Udayan J, Automatic 3D Facial Landmark-Based Deformation Transfer on Facial Variants for Blendshape Generation, Arabian Journal for Science and Engineering(SCOPUS, SCI IF:2.38) URL: https://doi.org/10.1007/s13369-022-07403-2 

Related Projects

Technoeconomic Environmental Assessment of Greener Technologies for Road Transport and Power Generation to reduce Atmospheric Pollution and its Impact on Human Health In Delhi
Technoeconomic Environmental Assessment of Greener Technologies for Road Transport and Power Generation to reduce Atmospheric Pollution and its Impact on Human Health In Delhi
Identification of Human in High Speed Vehicles During Accidents
Identification of Human in High Speed Vehicles During Accidents
An Intelligent Controller for Power Flow Management in a Smart Microgrid System with Power Quality Enhancement
An Intelligent Controller for Power Flow Management in a Smart Microgrid System with Power Quality Enhancement
C. elegans as a Model to Develop Anti-helmintic Strategies in Solid Waste Management
C. elegans as a Model to Develop Anti-helmintic Strategies in Solid Waste Management
GURU an MPEG-4 Based Distance Learning Environment for Users with Disabilities
GURU an MPEG-4 Based Distance Learning Environment for Users with Disabilities
Admissions Apply Now