Statistical semantics for enhancing document clustering
View Dr. Ahmed K. Farahat's Other CodesMATLAB code for semantic representation of documents using term-term correlation
Authors | Ahmed K. Farahat and Mohamed S. Kamel |
Journal/Conference Name | Knowledge and Information Systems (KAIS) |
Paper Category | Computer Science, Document Clustering |
Paper Abstract | Document clustering algorithms usually use vector space model (VSM) as their underlying model for document representation. VSM assumes that terms are independent and accordingly ignores any semantic relations between them. This results in mapping documents to a space where the proximity between document vectors does not reflect their true semantic similarity. This paper proposes new models for document representation that capture semantic similarity between documents based on measures of correlations between their terms. The paper uses the proposed models to enhance the effectiveness of different algorithms for document clustering. The proposed representation models define a corpus-specific semantic similarity by estimating measures of term–term correlations from the documents to be clustered. The corpus of documents accordingly defines a context in which semantic similarity is calculated. Experiments have been conducted on thirteen benchmark data sets to empirically evaluate the effectiveness of the proposed models and compare them to VSM and other well-known models for capturing semantic similarity. |
Date of publication | 2011 |
Code Programming Language | MATLAB |
Comment | If you use the code, please cite the paper. |