Back close

A Novel Approach to Enhance the Topic Modeling Using Graph with BERT Embeddings

Publication Type : Conference Paper

Publisher : IEEE

Source : Scopus

Url : https://doi.org/10.1109/CSITSS64042.2024.10816914

Keywords : Semantics; BERT; Document collection; Document relationships; Document semantics; Embeddings; Graph-based; Graph-based representations; Modelling framework; Semantics understanding; Topic Modeling; Graph embeddings

Campus : Bengaluru

School : School of Computing

Department : Computer Science and Engineering

Year : 2024

Abstract : This paper introduces a novel topic modeling framework that integrates graph-based representations with BERT embeddings to enhance semantic understanding and structural analysis of document collections. Traditional methods often struggle to capture the interplay between document relationships and semantic context. We address this by constructing a document graph based on co-citation, co-reference, or semantic similarity, and augment it with BERT embeddings. Through fusion techniques, we combine these representations, resulting in improved topic coherence and interpretability. Extensive tests across various datasets show our method effectively identifies hidden topics and improves tasks like summarizing text and finding information. Our approach uses BERT and a graph-based topic model

Cite this Research Publication : Renuka Rajendra B, S Santanalakshmi, A Novel Approach to Enhance the Topic Modeling Using Graph with BERT Embeddings, Scopus, IEEE, 2024, https://doi.org/10.1109/CSITSS64042.2024.10816914

Admissions Apply Now