Zipf's law emerges asymptotically during phase transitions in communicative systems

03/10/2016
by   Bohdan B. Khomtchouk, et al.
0

Zipf's law predicts a power-law relationship between word rank and frequency in language communication systems, and is widely reported in texts yet remains enigmatic as to its origins. Computer simulations have shown that language communication systems emerge at an abrupt phase transition in the fidelity of mappings between symbols and objects. Since the phase transition approximates the Heaviside or step function, we show that Zipfian scaling emerges asymptotically at high rank based on the Laplace transform. We thereby demonstrate that Zipf's law gradually emerges from the moment of phase transition in communicative systems. We show that this power-law scaling behavior explains the emergence of natural languages at phase transitions. We find that the emergence of Zipf's law during language communication suggests that the use of rare words in a lexicon is critical for the construction of an effective communicative system at the phase transition.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/30/2018

Modeling natural language emergence with integral transform theory and reinforcement learning

Zipf's law predicts a power-law relationship between word rank and frequ...
research
10/26/2017

Phase Transitions in Image Denoising via Sparsely Coding Convolutional Neural Networks

Neural networks are analogous in many ways to spin glasses, systems whic...
research
09/04/2018

Random Language Model: a path to principled complexity

Many complex generative systems use languages to create structured objec...
research
03/23/2023

The Quantization Model of Neural Scaling

We propose the Quantization Model of neural scaling laws, explaining bot...
research
05/16/2017

Agent-based model for the origins of scaling in human language

Background/Introduction: The Zipf's law establishes that if the words of...
research
03/04/2020

Phase transitions in a decentralized graph-based approach to human language

Zipf's law establishes a scaling behavior for word-frequencies in large ...
research
06/13/2012

Critical behavior in a cross-situational lexicon learning scenario

The associationist account for early word-learning is based on the co-oc...

Please sign up or login with your details

Forgot password? Click here to reset