Back close

Fine-Tuned BERT Based Multilingual Model for Named Entity Recognition in Native Indian Languages

Publication Type : Conference Paper

Publisher : IEEE

Source : 2023 International Conference on Evolutionary Algorithms and Soft Computing Techniques (EASCT)

Url : https://doi.org/10.1109/easct59475.2023.10392937

Campus : Chennai

School : School of Computing

Department : Computer Science and Engineering

Year : 2023

Abstract : Topic modeling is the statistical model for discovering hidden topics or keywords in a collection of documents. Topic modeling is also considered a probabilistic model for learning, analyzing, and discovering topics from the document collection. The most popular techniques for topic modeling are latent semantic analysis (LSA), probabilistic latent semantic analysis (pLSA), latent Dirichlet allocation (LDA), and the recent deep learning-based lda2vec. LDA is most commonly used in extractive multi-document summarization to determine whether the extracted sentence reflects the concept of the input document. In this paper, we will try to explore various multi-document summarization techniques that use LDA as a topic modeling method for improving final summary coverage and to reduce redundancy. Finally, we compared LDA and LSA using the Genism toolkit, and our experiment results show that LDA outperforms LSA if we increase the number of features considered for sentence selection.

Cite this Research Publication : G Bharathi Mohan, R Prasanna Kumar, Elakkiya R, Mukhtesh Venkata Sri Sai Pendem, Fine-Tuned BERT Based Multilingual Model for Named Entity Recognition in Native Indian Languages, 2023 International Conference on Evolutionary Algorithms and Soft Computing Techniques (EASCT), IEEE, 2023, https://doi.org/10.1109/easct59475.2023.10392937

Admissions Apply Now