Publication

Abstract : This research investigates the efficacy of XLM-RoBERTa, a potent deep learning architecture rooted in transformer networks, for Part-of-Speech (POS) tagging—a foundational task in Natural Language Processing (NLP). The study narrows its focus to address the formidable UCD Telugu dataset, renowned for its intricate morphological characteristics that pose challenges to accurate tagging. Through meticulous fine-tuning of the pre-trained XLM-RoBERTa model. This study adeptly discerns and exploit intricate syntactic and semantic patterns underpinning the interplay between lexical elements and their respective POS tags. The rigorous evaluation regimen, complemented by a comprehensive statistical comparison with the Multilingual BERT model, conclusively establishes XLM-RoBERTa’s superiority. This advanced model attains a remarkable accuracy score of 91%, decisively surpassing the Multilingual BERT model, which achieves an accuracy of 88%. These findings not only underscore XLM-RoBERTa’s prowess in precise POS tagging, especially in the context of morphologically rich languages like Telugu, but also carry significant implications for the broader NLP community. This research unlocks valuable insights and positions XLM-RoBERTa as an exemplar of reliability and robustness in POS tagging. Furthermore, it extends an invitation for further exploration and innovation in deep learning architectures within the NLP domain.