Back close

Automatic 3D Facial Landmark-Based Deformation Transfer on Facial Variants for Blendshape Generation

Project Incharge:Dr. Divya Udayan J.
Automatic 3D Facial Landmark-Based Deformation Transfer on Facial Variants for Blendshape Generation

Blendshape models are used in various computer vision applications, such as expression transfer, 3D reconstruction, expression analysis and so on. Blendshape models have received lot of attention in last decades, and extensive research is carried out in the 3D face modeling. Computer-based animations use blendshape models for the transfer of target facial expression to animated character. The major challenge in such animation is developing blendshape models that can represent various facial expressions. To create such large data set of expression, one requires a dedicated expert team and it is a time-consuming process. In this paper, we propose a framework for automatic facial landmark detection and blendshape generation through expression transfer. The proposed work is in two main folds: Initially, facial landmarks are extracted based on geometric information of the given facial mesh. Further, the extracted landmark points and the estimated correspondence between source and target facial models are used to perform deformation transfer. Experiment results show that our method is able to transfer expression by using automatic landmarks and also the smoothness of deformation around facial landmark areas proves that our proposed landmark-based deformation method is as good as the state-of-the-art methods. Our proposed method for automatic facial landmark detection based on geometric information of 3D face model has the ability to detect reliable correspondences, and it is faster and simpler compared with the state-of-the-art automatic deformation transfer method on the facial models.

Collaboration

  • VIT University, Vellore, Konkuk University , S. Korea 

Outcome

  • Anupama K Ingale, Anny Leema A, HyungSeok Kim, Divya Udayan J, Automatic 3D Facial Landmark-Based Deformation Transfer on Facial Variants for Blendshape Generation, Arabian Journal for Science and Engineering(SCOPUS, SCI IF:2.38) URL: https://doi.org/10.1007/s13369-022-07403-2 

Related Projects

Synthesis of Nanostructured Transition Metal Oxide Thin Film Coatings on Steel Substrates by Dip Coating for Corrosion and Wear Resistance Applications
Synthesis of Nanostructured Transition Metal Oxide Thin Film Coatings on Steel Substrates by Dip Coating for Corrosion and Wear Resistance Applications
Development of Bronze Alloys and Comparison of Their Mechanical and Wear Properties
Development of Bronze Alloys and Comparison of Their Mechanical and Wear Properties
Hybrid Composite for Aviation, Space and Defence Applications
Hybrid Composite for Aviation, Space and Defence Applications
Development of Laser Surface Texturing technology for automotive application
Development of Laser Surface Texturing technology for automotive application
Blockchain-based Peer to Peer Energy Trading
Blockchain-based Peer to Peer Energy Trading
Admissions Apply Now