Emergence of Zipf's law in the evolution of communication

Phys Rev E Stat Nonlin Soft Matter Phys. 2011 Mar;83(3 Pt 2):036115. doi: 10.1103/PhysRevE.83.036115. Epub 2011 Mar 28.

Abstract

Zipf's law seems to be ubiquitous in human languages and appears to be a universal property of complex communicating systems. Following the early proposal made by Zipf concerning the presence of a tension between the efforts of speaker and hearer in a communication system, we introduce evolution by means of a variational approach to the problem based on Kullback's Minimum Discrimination of Information Principle. Therefore, using a formalism fully embedded in the framework of information theory, we demonstrate that Zipf's law is the only expected outcome of an evolving communicative system under a rigorous definition of the communicative tension described by Zipf.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Information Theory*
  • Language*
  • Time Factors