Back close

A Few-Shot Approach to Dysarthric Speech Intelligibility Level Classification Using Transformers

Publication Type : Conference Paper

Publisher : Cornell University

Source : International Conference on Computing Communication and Networking Technologies (ICCCNT)

Url : https://arxiv.org/abs/2309.09329#:~:text=This%20work%20also%20aims%20to,0.85%2C%20and%20specificity%20of%200.91.

Campus : Coimbatore

School : School of Artificial Intelligence - Coimbatore

Center : Computational Engineering and Networking

Year : 2023

Abstract : Dysarthria is a speech disorder that hinders communication due to difficulties in articulating words. Detection of dysarthria is important for several reasons as it can be used to develop a treatment plan and help improve a person's quality of life and ability to communicate effectively. Much of the literature focused on improving ASR systems for dysarthric speech. The objective of the current work is to develop models that can accurately classify the presence of dysarthria and also give information about the intelligibility level using limited data by employing a few-shot approach using a transformer model. This work also aims to tackle the data leakage that is present in previous studies. Our whisper-large-v2 transformer model trained on a subset of the UASpeech dataset containing medium intelligibility level patients achieved an accuracy of 85%, precision of 0.92, recall of 0.8 F1-score of 0.85, and specificity of 0.91. Experimental results also demonstrate that the model trained using the 'words' dataset performed better compared to the model trained on the 'letters' and 'digits' dataset. Moreover, the multiclass model achieved an accuracy of 67%.

Cite this Research Publication : P. N. Chowdary, M. S. Akshay, V. S. Aravind, M. S. Aashish, G. V. N. S. L. V. Vardhan and G. Jyothish Lal., "A Few-Shot Approach to Dysarthric Speech Intelligibility Level Classification Using Transformers," 2023 14th International Conference on Computing Communication and Networking Technologies (ICCCNT), Delhi, India, 2023, pp. 1-6, doi: 10.1109/ICCCNT56998.2023.10308067.

Admissions Apply Now