Two halves of a meaningful text are statistically different

DOI10.1088/1742-5468/abe947zbMath1504.62187arXiv2004.06474OpenAlexW3139600714MaRDI QIDQ4992319

Rongrong Xie, Shengfeng Deng, Weibing Deng, Armen E. Allahverdyan

Publication date: 8 June 2021

Published in: Journal of Statistical Mechanics: Theory and Experiment (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/2004.06474

zbMATH Keywords

data miningscaling in socio-economic systemsinference in socio-economic system

Mathematics Subject Classification ID

Natural language processing (68T50) Linguistics (91F20) One- and multidimensional scaling in the social and behavioral sciences (91C15) Statistical aspects of big data and data science (62R07)

Uses Software

• GitHub

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• On the non-randomness of maximum Lempel Ziv complexity sequences of finite size
• ON A CLASS OF SKEW DISTRIBUTION FUNCTIONS
• Statistical criticality arises in most informative representations
• TOWARDS THE QUANTIFICATION OF THE SEMANTIC INFORMATION ENCODED IN WRITTEN LANGUAGE
• Numerical Analysis of Word Frequencies in Artificial and Natural Language Texts
• The Rank-Frequency Form of Zipf's Law
• LONG RANGE CORRELATION IN HUMAN WRITINGS
• Zipf's law unzipped
• Excess entropy in natural language: Present state and perspectives
• Word frequency distributions
• MAXIMAL NON-SYMMETRIC ENTROPY LEADS NATURALLY TO ZIPF'S LAW