Qualification: 
MSc, M.Tech
umag@am.amrita.edu

Uma Gopalakrishnan currently serves as a Research Associate at the Amrita Center for Wireless Networks & Applications (Amrita WNA), Amritapuri Campus. 

Publications

Publication Type: Journal Article

Year of Publication Publication Type Title

2017

Journal Article

N. Ramkumar, P. Rangan, V., Uma Gopalakrishnan, and Balaji Hariharan, “Gesture triggered, dynamic gaze alignment architecture for intelligent eLearning systems”, Journal of Intelligent and Fuzzy Systems, vol. 32, pp. 2963-2969, 2017.[Abstract]


Current eLearning systems enable streaming of live lectures to distant students facilitating a live instructor-student interaction. However, studies have shown that there exists a marked divide in local students' (student present in the teacher's location) experience as compared to distant students'. One of the major factors attributing to this rift is lack of gaze aligned interaction. In this paper, we present a system architecture that receives gesture triggers as input, and dynamically calculates the perspective angle to be captured of the speaking participant, for the listener, facilitating eye contact. The gesture triggers are calculated using Microsoft Kinect sensor which extracts skeleton joint information of the instructor, and performs gesture recognition with the acquired joint information real-time. This serves as interaction-initiation triggers for dynamic perspective correction for gaze alignment during a conversation. For evaluation, we constructed a five classroom test-bed with dynamic perspective correction and user study results indicate a marked 42 enhancement in experience with the gaze correction in place. © 2017-IOS Press and the authors. All rights reserved. More »»

2016

Journal Article

Uma Gopalakrishnan, Ramkumar, N., P. Rangan, V., and Balaji Hariharan, “Multilayered presentation architecture in intelligent eLearning systems”, Advances in Intelligent Systems and Computing, vol. 530, pp. 533-541, 2016.[Abstract]


eLearning systems have become essential in enabling lectures from experts accessible to masses spread across distant geographic location. The digital representation of different components in the instructor’s environment, such as the presentation screen and the instructor’s video, in a remote location is often spatially disconnected. This results in missing out spatially related gestural cues such as pointing at the screen by the instructor. This paper discusses a method of creating a spatially connected, close to natural view of the instructor’s environment by overlaying the instructor’s video defined by his contour over the presentation screen content. This technique involves a calibration step required to match the camera perspectives of the different video components. We present a real-time and robust calibration technique allowing for automatic recalibration in a dynamic classroom scenario which involves changes in camera position and pan, tilt and zoom parameters. © Springer International Publishing AG 2016. More »»

Publication Type: Patent

Year of Publication Publication Type Title

2017

Patent

V. P. Rangan, Balaji Hariharan, Narayanankutty, R., and Uma Gopalakrishnan, “System and Method for Synthesizing, Preserving Consistent Relative Neighborhood positions in Multiperspective Multipoint Tele-Immersive Environment (2D) ”, U.S. Patent 15/180,4142017.[Abstract]


An e-learning system has a local classroom with an instructor station and a microphone and a local student station with a microphone, a plurality of remote classrooms with an instructor display and a student station with a microphone, and planar displays and video cameras in each of the classrooms, the remote and local classrooms connected over a network, with a server monitoring feeds and enforcing exclusive states, with sets of video displays, each set dedicated to a remote classroom, arrayed along a line orthogonal to a line between the instructor station and the local student station, with one display in each set facing toward the instructor station, and one display in each set facing toward the local student station.

More »»
PDF iconus-9826196b2.pdf

2017

Patent

V. P. Rangan, Balaji Hariharan, Narayanankutty, R., and Uma Gopalakrishnan, “System and Method for Synthesizing, Preserving Consistent Relative Neighborhood positions in Multiperspective Multipoint Tele-Immersive Environment (3D) ”, U.S. Patent 15/180,6042017.[Abstract]


An e-learning system has a local classroom with an instructor station and a microphone and a local student station with a microphone, a plurality of remote classrooms with an instructor display and a student station with a microphone, and planar displays and video cameras in each of the classrooms, the remote and local classrooms connected over a network, with a server monitoring feeds and enforcing exclusive states, with sets of video displays, each set dedicated to a remote classroom, arrayed along a line orthogonal to a line between the instructor station and the local student station, with one display in each set facing toward the instructor station, and one display in each set facing toward the local student station.

More »»
PDF iconus-9852647b2.pdf

2016

Patent

P. V. Rangan, Balaji Hariharan, Rahul K Pathinarupothi, Narayanankutty, R., Gopakumar, S. A., and Uma Gopalakrishnan, “System and Method for Synthesizing, Preserving Consistent Relative Neighborhood positions in Multiperspective Multipoint Tele-Immersive Environment (2D)”, U.S. Patent US 15/180,4142016.[Abstract]


An e-learning system has a local classroom with an instructor station and a microphone and a local student station with a microphone, a plurality of remote classrooms with an instructor display and a student station with a microphone, and planar displays and video cameras in each of the classrooms, the remote and local classrooms connected over a network, with a server monitoring feeds and enforcing exclusive states, with sets of video displays, each set dedicated to a remote classroom, arrayed along a line orthogonal to a line between the instructor station and the local student station, with one display in each set facing toward the instructor station, and one display in each set facing toward the local student station.

More »»

2016

Patent

P. V. Rangan, Balaji Hariharan, Rahul K Pathinarupothi, Narayanankutty, R., Gopakumar, S. A., and Uma Gopalakrishnan, “System and Method for Synthesizing, Preserving Consistent Relative Neighborhood positions in Multiperspective Multipoint Tele-Immersive Environment (3D)”, U.S. Patent US 15/180,6042016.[Abstract]


An e-learning system has a local classroom comprising a local student station and an instructor station, such that local students at the local student station and an instructor at the instructor station face each other directly along a first viewing line, a plurality of remote classrooms each having a student station, video cameras in each of the remote classrooms positioned and oriented to capture video images of subjects, video displays in the local classroom arranged along a line orthogonal to the first viewing line and all facing the local student station, in sets of at least two displays, arranged vertically one above another, each first set of at least two displays dedicated to one of the remote classrooms, a second plurality of video displays like the first, but facing the instructor, connection apparatus between classrooms, a server coordinating video feeds with displays.

More »»

2015

Patent

P. V. Rangan, Balaji Hariharan, Rahul K Pathinarupothi, Narayanankutty, R., Gopakumar, S. A., and Uma Gopalakrishnan, “System and Method for Synthesizing and Preserving Consistent Relative Neighborhood Position in Multi-Perspective Multi-Point Tele-Immersive Environments”, U.S. Patent US20150062284A12015.[Abstract]


An e-learning system has a local classroom with an instructor station and a microphone and a local student station with a microphone, a remote classroom with an instructor display and a student station with a microphone, and planar displays and video cameras in each of the classrooms, the remote and local classrooms connected over a network, with a server monitoring feeds and enforcing exclusive states, such that audio and video feeds are managed in a manner that video and audio of the instructor, the local students and the first remote students, as seen and heard either directly or via speakers and displays by each of the instructor, the local students and the remote students presents to each as though all are interacting in the same room. (India Provisional Patent Application No. 3888/CHE/2013)

More »»

Publication Type: Conference Paper

Year of Publication Publication Type Title

2017

Conference Paper

Ramkumar Narayanan, Uma Gopalakrishnan, and Ekanath Srihari Rangan, “Gaze Alignment Techniques for Multipoint Mobile Telemedicine for Ophthalmological Consultations”, in 7th EAI International Conference on Wireless Mobile Communication and Health care (MobiHealth 2017), Vienna, Austria, 2017.[Abstract]


Telemedical consultation systems are emerging as a viable medium for patient-doctor interaction in a number of medical specialties. Such systems are already prevalent in fields like cardio diagnosis and it is still very nascent in the field of ophthalmology. But with the emergence of affordable and high quality remote-control cameras, a host of new possibilities have opened up. In this paper, we have developed innovative gaze alignment techniques for ensuring Mutual Gaze, Gaze Awareness and Gaze following. The system is shown to work effectively even for interactions that are as complex as involving multiparty consultations involving remotely located patients through the use of a mobile telemedicine network and general physician/physician-assistant and specialist ophthalmologist.

Gaze Alignment Techniques for Multipoint... (PDF Download Available). Available from: https://www.researchgate.net/publication/320979757_Gaze_Alignment_Techni... [accessed Apr 23 2018].

More »»

2013

Conference Paper

Balaji Hariharan, Hari, S., and Uma Gopalakrishnan, “Multi speaker detection and tracking using audio and video sensors with gesture analysis”, in IFIP International Conference on Wireless and Optical Communications Networks, WOCN, Bhopal, Madhya Pradesh, 2013.[Abstract]


Video conferencing plays an important role in many corporate and educational fields. E-learning uses the concept of video conferencing for interaction between students' and tutors' in different locations. The tutor's actual presence is in a real classroom and the students can view their tutor through a video in a virtual classroom. Wireless microphones and video sensors are used, to facilitate an interaction between the students and tutors but sometimes it may not be as efficient when we use multiple speakers. In that case, it would be helpful if we can identify the student who asks a question first, either in the virtual or real classroom by using audio and video sensors. To make an E-learning classroom as similar to a real classroom, we propose a system that will utilize the professor's gestures; this will decide who can ask questions. This is particularly useful when we use several speakers in an E-learning classroom. The student who is asking a question, for the first time, will be located using audio and video sensors in either virtual or real classroom. The raised hand along with student's voice is used for localization. This method helps both the professor and the student get the experience of being in a real classroom. © 2013 IEEE.

More »»
Faculty Research Interest: 
207
PROGRAMS
OFFERED
5
AMRITA
CAMPUSES
15
CONSTITUENT
SCHOOLS
A
GRADE BY
NAAC, MHRD
8th
RANK(INDIA):
NIRF 2018
150+
INTERNATIONAL
PARTNERS