Statistical semantics for enhancing document clustering

View Dr. Ahmed K. Farahat's Other Codes

MATLAB code for semantic representation of documents using term-term correlation

Authors Ahmed K. Farahat and Mohamed S. Kamel
Journal/Conference Name Knowledge and Information Systems (KAIS)
Paper Category ,
Paper Abstract Document clustering algorithms usually use vector space model (VSM) as their underlying model for document representation. VSM assumes that terms are independent and accordingly ignores any semantic relations between them. This results in mapping documents to a space where the proximity between document vectors does not reflect their true semantic similarity. This paper proposes new models for document representation that capture semantic similarity between documents based on measures of correlations between their terms. The paper uses the proposed models to enhance the effectiveness of different algorithms for document clustering. The proposed representation models define a corpus-specific semantic similarity by estimating measures of term–term correlations from the documents to be clustered. The corpus of documents accordingly defines a context in which semantic similarity is calculated. Experiments have been conducted on thirteen benchmark data sets to empirically evaluate the effectiveness of the proposed models and compare them to VSM and other well-known models for capturing semantic similarity.
Date of publication 2011
Code Programming Language MATLAB
Comment If you use the code, please cite the paper.

Copyright Dr. Ahmed K. Farahat 2021