Publication Type:

Conference Paper


International Conference on Advances in Computing, Communications and Informatics (ICACCI-2016), IEEE (2016)


In our existing education system, teachers
primarily engage students verbally in what we call ‘chalk and
talk’ approach. Occasionally, certain learning models are also
made use of for the purpose of teaching specific concepts. Smart
classroom systems employ PowerPoint presentations, videos and
the like. However, lack of sufficient self-interactive models and/or
inadequate interaction with them, cause students lose focus.
Young children, particularly with disabilities such as those with
hearing impairment and vocal dysfunction are prone to it. Our
studies showed that students experienced enhanced attentiveness
in an environment conducive to self-interactive learning. The
word interaction here does not refer to just teacher-student
communication rather; it places greater emphasis on interactive
self-learning. The student is utmost comfortable when he/she
feels to be the center of attention or the teaching is exclusive to
him/her. We propose a novel learning system in order to kindle
the innate curiosity of students. This article presents an
application of the ongoing research on interactive learning. Our
system employs both Virtual Reality (VR) and Augmented
Reality (AR) to bring about a deeper immersive and effective
interactive learning experience to the students. This Interactive
VR-AR Learning System (IVRARLS) provides a learning
environment with each student being able to independently
interact to learn with his or her own virtual learning models in
real time. In our scheme, Microsoft Kinect is used for the
extraction of interactive gestures of the participant(s). This
approach is better suited particularly for the hearing impaired
and/or vocally challenged children nevertheless it does not
exclusively target them.

Cite this Research Publication

H. N and Jyothisha J. Nair, “Interactive Learning System for the Hearing Impaired and the Vocally Challenged”, in International Conference on Advances in Computing, Communications and Informatics (ICACCI-2016), 2016.