Publication Type : Journal Article
Thematic Areas : Wireless Network and Application
Publisher : Journal of Intelligent and Fuzzy Systems
Source : Journal of Intelligent and Fuzzy Systems, IOS Press, Volume 32, Number 4, p.2963-2969 (2017)
Url : https://www.scopus.com/inward/record.uri?eid=2-s2.0-85016826128&doi=10.3233%2fJIFS-169239&partnerID=40&md5=a4b3833016a94e467b04e2e09739da3c
Keywords : Classroom tests, E-learning, Education, Eye contact, Gesture recognition, Intelligent e-learning systems, Intelligent systems, Joint information, Memory architecture, Microsoft Kinect sensors, Perspective corrections, Soft computing, Student interactions, Students, System architectures, Teaching, Video streaming
Campus : Amritapuri
School : Department of Computer Science and Engineering
Center : Amrita Center for Wireless Networks and Applications (AmritaWNA)
Department : Computer Science
Year : 2017
Abstract : Current eLearning systems enable streaming of live lectures to distant students facilitating a live instructor-student interaction. However, studies have shown that there exists a marked divide in local students' (student present in the teacher's location) experience as compared to distant students'. One of the major factors attributing to this rift is lack of gaze aligned interaction. In this paper, we present a system architecture that receives gesture triggers as input, and dynamically calculates the perspective angle to be captured of the speaking participant, for the listener, facilitating eye contact. The gesture triggers are calculated using Microsoft Kinect sensor which extracts skeleton joint information of the instructor, and performs gesture recognition with the acquired joint information real-time. This serves as interaction-initiation triggers for dynamic perspective correction for gaze alignment during a conversation. For evaluation, we constructed a five classroom test-bed with dynamic perspective correction and user study results indicate a marked 42 enhancement in experience with the gaze correction in place. © 2017-IOS Press and the authors. All rights reserved.
Cite this Research Publication : N. Ramkumar, P. Rangan, V., Uma Gopalakrishnan, and Balaji Hariharan, “Gesture triggered, dynamic gaze alignment architecture for intelligent eLearning systems”, Journal of Intelligent and Fuzzy Systems, vol. 32, pp. 2963-2969, 2017.