Word-Length Correlations and Memory in Large Texts: A Visibility Network Analysis

We study the correlation properties of word lengths in large texts from 30 ebooks in the English language from the Gutenberg Project (www.gutenberg.org) using the natural visibility graph method (NVG). NVG converts a time series into a graph and then analyzes its graph properties. First, the origina...

Full description

Bibliographic Details
Main Authors: Lev Guzmán-Vargas, Bibiana Obregón-Quintana, Daniel Aguilar-Velázquez, Ricardo Hernández-Pérez, Larry S. Liebovitch
Format: Article
Language:English
Published: MDPI AG 2015-11-01
Series:Entropy
Subjects:
Online Access:http://www.mdpi.com/1099-4300/17/11/7798
Description
Summary:We study the correlation properties of word lengths in large texts from 30 ebooks in the English language from the Gutenberg Project (www.gutenberg.org) using the natural visibility graph method (NVG). NVG converts a time series into a graph and then analyzes its graph properties. First, the original sequence of words is transformed into a sequence of values containing the length of each word, and then, it is integrated. Next, we apply the NVG to the integrated word-length series and construct the network. We show that the degree distribution of that network follows a power law, P ( k ) ∼ k - γ , with two regimes, which are characterized by the exponents γ s ≈ 1 . 7 (at short degree scales) and γ l ≈ 1 . 3 (at large degree scales). This suggests that word lengths are much more strongly correlated at large distances between words than at short distances between words. That finding is also supported by the detrended fluctuation analysis (DFA) and recurrence time distribution. These results provide new information about the universal characteristics of the structure of written texts beyond that given by word frequencies.
ISSN:1099-4300