Back close

Towards improving speech recognition model with post-processing spell correction using BERT

Publication Type : Journal Article

Publisher : IoS Press

Source : 1 Jan. 2022 : 4873 – 4882, IoS Press

Url : https://dl.acm.org/doi/abs/10.3233/JIFS-213332

Campus : Coimbatore

School : School of Computing

Year : 2022

Abstract : Speech recognition has now become ubiquitous and plays an inevitable role in almost all sectors. Numerous works have been proposed on speech recognition; however, more accurate transcriptions are not possible. Exploration of various studies related to spell correction implies that several kinds of research have been carried out in this field but still it is a very challenging problem. This led to the need for a new spell corrector framework capable of leveraging the performance of the automatic speech recognition (ASR) system. The proposed work unveils state-of-the-art Bidirectional Encoder Representations from Transformers (BERT) based spell correction module developed on top of the deep recurrent neural network (RNN) based ASR system. The impact of BERT-based spell correction on the ASR system is evaluated on three different accent datasets in the perspective of word error rate (WER), character error rate (CER), and Bilingual evaluation understudy (BLEU) score. The experimental results inferred that the enhanced spell correction module is efficacious in detecting and correcting spell errors, by achieving the WER of 5.025% on librispeech corpus, 6.35% on voxforge, and 7.05% on NPTEL corpus.

Cite this Research Publication : Shunmuga Priya, M.C., Karthika Renuka, D., and Ashok Kumar, L. ‘Towards Improving Speech Recognition Model with Post-processing Spell Correction Using BERT’. 1 Jan. 2022 : 4873 – 4882, IoS Press

Admissions Apply Now