Back close

A 3D stroke based representation of sign language signs using key maximum curvature points and 3D chain codes

Publication Type : Journal Article

Publisher : Multimedia Tools and Applications, Springer New York LLC

Source : Multimedia Tools and Applications, Springer New York LLC, p.1-34 (2017)

Url : https://www.scopus.com/inward/record.uri?eid=2-s2.0-85017422092&doi=10.1007%2fs11042-017-4624-y&partnerID=40&md5=9c9c579b2ab43a13aa1336a8cbddefb8

Keywords : Codes (symbols), Curvature points, EquiVolumetric Partition (EVP), Indian sign languages, Local motions, Stroke sequences, Trajectories, Visual languages

Campus : Amritapuri

School : Department of Computer Science and Engineering, School of Engineering

Center : AI and Disability Studies

Department : Computer Science

Year : 2017

Abstract : Sign Language is a visual spatial language used by deaf and dumb community to convey their thoughts and ideas with the help of hand gestures and facial expressions. This paper proposes a novel 3D stroke based representation of dynamic gestures of Sign Language Signs incorporating local as well as global motion information. The dynamic gesture trajectories are segmented into strokes or sub-units based on Key Maximum Curvature Points (KMCPs) of the trajectory. This new representation has helped us in uniquely representing the signs with fewer number of key frames. We extract 3D global features from global trajectories using a scheme of representing strokes as 3D codes, which involves dividing strokes into smaller units (stroke subsegment vectors or SSVs), and representing them as belonging to one of the 22 partitions. These partitions are obtained using a discretisation procedure which we call an equivolumetric partition (EVP) of sphere. The codes representing the strokes are referred to as an EVP code. In addition to global hand motion and local hand motion, facial expressions are also considered for non-manual signs to interpret the meaning of words completely. In contrast to existing methods, our method of stroke based representation has less expensive training phase since it only requires the training of key stroke features and stroke sequences of each word. © 2017 Springer Science+Business Media New York

Cite this Research Publication :
M. Geetha and Dr. Kaimal, M. R., “A 3D stroke based representation of sign language signs using key maximum curvature points and 3D chain codes”, Multimedia Tools and Applications, pp. 1-34, 2017

Admissions Apply Now