Back close

A High Performance Hybrid Algorithm for Text Classification

Publication Type : Conference Paper

Thematic Areas : Learning-Technologies, Wireless Network and Application

Publisher : Applications of Digital Information and Web Technologies (ICADIWT), 2014 Fifth International Conference.

Source : Applications of Digital Information and Web Technologies (ICADIWT), 2014 Fifth International Conference on the (2014)

Keywords : Accuracy, Algorithm design and analysis, Classification algorithms, Computational complexity, Dimensionality reduction, high performance hybrid algorithm, Hybrid classifier, k-nearest-neighbor algorithm, kNN, kNN algorithm, Pattern classification, PCA, preprocessing phase, Principal component analysis, Support vector machine classification, term weighting, text analysis, Text categorization, Text classification, Training, Vectors.

Campus : Amritapuri

School : Department of Computer Science and Engineering, School of Engineering

Center : Technologies & Education (AmritaCREATE), Amrita Center For Research in Analytics, Amrita Center for Wireless Networks and Applications (AmritaWNA)

Department : Computer Science

Year : 2014

Abstract : The high computational complexity of text classification is a significant problem with the growing surge in text data. An effective but computationally expensive classification is the k-nearest-neighbor (kNN) algorithm. Principal Component Analysis (PCA) has commonly been used as a preprocessing phase to reduce the dimensionality followed by kNN. However, though the dimensionality is reduced, the algorithm requires all the vectors in the projected space to perform the kNN. We propose a new hybrid algorithm that uses PCA amp; kNN but performs kNN with a small set of neighbors instead of the complete data vectors in the projected space, thus reducing the computational complexity. An added advantage in our method is that we are able to get effective classification using a relatively smaller number of principal components. New text for classification is projected into the lower dimensional space and kNN is performed only with the neighbors in each axis based on the principal that vectors that are closer in the original space are closer in the projected space and also along the projected components. Our findings with the standard benchmark dataset Reuters show that the proposed model significantly outperforms kNN and the standard PCA-kNN hybrid algorithms while maintaining similar classification accuracy.

Cite this Research Publication : Prof. Prema Nedungadi, Harikumar, H., and Dr. Maneesha V. Ramesh, “A high performance hybrid algorithm for text classification”, in Applications of Digital Information and Web Technologies (ICADIWT), 2014 Fifth International Conference on the, 2014

Admissions Apply Now