NATURAL TEXT: MATHEMATICAL METHODS OF ATTRIBUTION

NATURAL TEXT: MATHEMATICAL METHODS OF ATTRIBUTION

The article proposes two algorithms for substandard texts filtering. The first of these is based on the fact that the frequency of n-grams occurrence in a quality text obeys the Zipf law, and when the words of the text are rearranged, the law ceases to act. Comparison of the frequency characterist...

Full description

Bibliographic Details
Main Authors: Vladimir V. Popov, Tatyana V. Shtelmakh
Format: Article
Language:English
Published: Volgograd State University 2019-08-01
Series:Vestnik Volgogradskogo Gosudarstvennogo Universiteta. Seriâ 2. Âzykoznanie
Subjects:
natural text
pseudo-text
text filtering
zipf’s law
n-grams
the rate of appearance of new words
“bag of words” model of the text
graph model of the text
Online Access:https://l.jvolsu.com/index.php/en/archive-en/562-science-journal-of-volsu-linguistics-2019-vol-18-no-2/materials-and-reports/1869-popov-v-v-shtelmakh-t-v-natural-text-mathematical-methods-of-attribution

Internet

https://l.jvolsu.com/index.php/en/archive-en/562-science-journal-of-volsu-linguistics-2019-vol-18-no-2/materials-and-reports/1869-popov-v-v-shtelmakh-t-v-natural-text-mathematical-methods-of-attribution

Similar Items