Back close

Implementation of Single Camera Markerless Facial Motion Capture using Blendshapes

Publication Type : Conference Proceedings

Publisher : CSITSS

Source : 2021 IEEE International Conference on Computation System and Information Technology for Sustainable Solutions (CSITSS), 2021

Url : https://ieeexplore.ieee.org/document/9683460

Campus : Bengaluru

School : Department of Computer Science and Engineering

Department : Computer Science and Engineering

Year : 2021

Abstract : Facial motion capture is the process of digitizing the facial motion of an actor by locating several facial landmarks of the actor’s face and using the relative coordinates of these landmarks to drive the facial structure of a 3D character in software like Blender. Recent advances have enabled markerless technology to track the desired facial features from frame to frame. In this work, the input from a single front-facing camera is used and the face is located using face detection algorithms. Its output is then used to find the relative coordinates of facial landmarks like lip corners, upper eyelids, and eyebrows etc., using a facial landmark detector. To achieve comparable levels of accuracy without the depth or 3D information that would be captured from a multi-camera setup, morph targets have been used to add constraints to the animation to avoid unnatural positions of the virtual character. The distance between a referential landmark that has minimal movement and the driving landmark determines the influence of the corresponding morph target. To establish an orientation invariant landmark detection, geometric normalization and face size normalization have been deployed.

Cite this Research Publication : M. R. Somepalli, M. D. S. Charan, S. Shruthi and S. Palaniswamy, "Implementation of Single Camera Markerless Facial Motion Capture using Blendshapes," 2021 IEEE International Conference on Computation System and Information Technology for Sustainable Solutions (CSITSS), 2021

Admissions Apply Now