Publication Type : Conference Paper
Publisher : Springer, Singapore
Source : Springer, Singapore, 2021
Url : https://link.springer.com/chapter/10.1007/978-981-15-9647-6_38
Keywords : Object recognition, Speech recognition, ROS, Integration
Campus : Amritapuri
Center : Humanitarian Technology (HuT) Labs
Year : 2021
Abstract : Perception is a boon which is one of its kinds for every human being around the world. In this modern world, where technology has been tremendously developing, there has also been an escalation in the number of people being born with vision impairment. This paper provides a solution with a system that serves as an ability to hear and see for the assistive technologies such as service robots and rescue robots which could help for the old and crippled. This research deals with the integration of an object recognition technique with speech recognition using the robot operating system (ROS) to come up with a speech-based visual perceiving system that can aid the visually impaired people. The proposed object recognition uses Kinect v2 camera and YOLO algorithm for efficient object recognition. Here, mutual communication between the visually challenged and robot is established. This paper also discusses the system architecture implemented and tested in real and noisy environments.
Cite this Research Publication : Megalingam, R.K., Manaswini, M., Yannam, J., Akhil, T., Masetti, A., Rohith Raj, R.V. (2021). Integration of Speech and Vision for Perception in Assistive Robots Using Robot Operating System. In: Smys, S., Palanisamy, R., Rocha, Á., Beligiannis, G.N. (eds) Computer Networks and Inventive Communication Technologies. Lecture Notes on Data Engineering and Communications Technologies, vol 58. Springer, Singapore. https://doi.org/10.1007/978-981-15-9647-6_38