Publication Type:

Conference Paper


Applications of Digital Information and Web Technologies (ICADIWT), 2014 Fifth International Conference on the (2014)


accuracy, Algorithm design and analysis, Classification algorithms, Computational complexity, Dimensionality reduction, high performance hybrid algorithm, Hybrid classifier, k-nearest-neighbor algorithm, kNN, kNN algorithm, Pattern classification, PCA, preprocessing phase, Principal component analysis, Support vector machine classification, term weighting, text analysis, Text categorization, Text classification, Training, Vectors


The high computational complexity of text classification is a significant problem with the growing surge in text data. An effective but computationally expensive classification is the k-nearest-neighbor (kNN) algorithm. Principal Component Analysis (PCA) has commonly been used as a preprocessing phase to reduce the dimensionality followed by kNN. However, though the dimensionality is reduced, the algorithm requires all the vectors in the projected space to perform the kNN. We propose a new hybrid algorithm that uses PCA & kNN but performs kNN with a small set of neighbors instead of the complete data vectors in the projected space, thus reducing the computational complexity. An added advantage in our method is that we are able to get effective classification using a relatively smaller number of principal components. New text for classification is projected into the lower dimensional space and kNN is performed only with the neighbors in each axis based on the principal that vectors that are closer in the original space are closer in the projected space and also along the projected components. Our findings with the standard benchmark dataset Reuters show that the proposed model significantly outperforms kNN and the standard PCA-kNN hybrid algorithms while maintaining similar classification accuracy.

Cite this Research Publication

Prof. Prema Nedungadi, Harikumar, H., and Dr. Maneesha V. Ramesh, “A high performance hybrid algorithm for text classification”, in Applications of Digital Information and Web Technologies (ICADIWT), 2014 Fifth International Conference on the, 2014.

It appears your Web browser is not configured to display PDF files. Download adobe Acrobat or click here to download the PDF file.