WSD algorithm based on a new method of vector-word contexts proximity calculation via epsilon-filtration

View Researcher's Other Codes

Disclaimer: The provided code links for this paper are external links. Science Nest has no responsibility for the accuracy, legality or content of these links. Also, by downloading this code(s), you agree to comply with the terms of use as set out by the author(s) of the code(s).

Please contact us in case of a broken link from here

Authors Alexander Kirillov, Andrew Krizhanovsky, Natalia Krizhanovsky
Journal/Conference Name Proceedings of the Karelian Research Centre of the Russian Academy of Sciences
Paper Category
Paper Abstract The problem of word sense disambiguation (WSD) is considered in the article. Given a set of synonyms (synsets) and sentences with these synonyms. It is necessary to select the meaning of the word in the sentence automatically. 1285 sentences were tagged by experts, namely, one of the dictionary meanings was selected by experts for target words. To solve the WSD-problem, an algorithm based on a new method of vector-word contexts proximity calculation is proposed. In order to achieve higher accuracy, a preliminary epsilon-filtering of words is performed, both in the sentence and in the set of synonyms. An extensive program of experiments was carried out. Four algorithms are implemented, including a new algorithm. Experiments have shown that in a number of cases the new algorithm shows better results. The developed software and the tagged corpus have an open license and are available online. Wiktionary and Wikisource are used. A brief description of this work can be viewed in slides (https//goo.gl/9ak6Gt). Video lecture in Russian on this research is available online (https//youtu.be/-DLmRkepf58).
Date of publication 2018
Code Programming Language PHP
Comment

Copyright Researcher 2022