Publication Type : Journal Article
Publisher : Multimedia Tools and Applications, Springer New York LLC
Source : Multimedia Tools and Applications, Springer New York LLC, p.1-34 (2017)
Url : https://www.scopus.com/inward/record.uri?eid=2-s2.0-85017422092&doi=10.1007%2fs11042-017-4624-y&partnerID=40&md5=9c9c579b2ab43a13aa1336a8cbddefb8
Keywords : Codes (symbols), Curvature points, EquiVolumetric Partition (EVP), Indian sign languages, Local motions, Stroke sequences, Trajectories, Visual languages
Campus : Amritapuri
School : Department of Computer Science and Engineering, School of Engineering
Center : AI and Disability Studies
Department : Computer Science
Year : 2017
Abstract : Sign Language is a visual spatial language used by deaf and dumb community to convey their thoughts and ideas with the help of hand gestures and facial expressions. This paper proposes a novel 3D stroke based representation of dynamic gestures of Sign Language Signs incorporating local as well as global motion information. The dynamic gesture trajectories are segmented into strokes or sub-units based on Key Maximum Curvature Points (KMCPs) of the trajectory. This new representation has helped us in uniquely representing the signs with fewer number of key frames. We extract 3D global features from global trajectories using a scheme of representing strokes as 3D codes, which involves dividing strokes into smaller units (stroke subsegment vectors or SSVs), and representing them as belonging to one of the 22 partitions. These partitions are obtained using a discretisation procedure which we call an equivolumetric partition (EVP) of sphere. The codes representing the strokes are referred to as an EVP code. In addition to global hand motion and local hand motion, facial expressions are also considered for non-manual signs to interpret the meaning of words completely. In contrast to existing methods, our method of stroke based representation has less expensive training phase since it only requires the training of key stroke features and stroke sequences of each word. © 2017 Springer Science+Business Media New York
Cite this Research Publication :
M. Geetha and Dr. Kaimal, M. R., “A 3D stroke based representation of sign language signs using key maximum curvature points and 3D chain codes”, Multimedia Tools and Applications, pp. 1-34, 2017