Next Article in Journal
Bayesian Inference of Ecological Interactions from Spatial Data
Next Article in Special Issue
Pointwise Partial Information Decomposition Using the Specificity and Ambiguity Lattices
Previous Article in Journal
Two-Party Zero-Error Function Computation with Asymmetric Priors
Previous Article in Special Issue
Secret Sharing and Shared Information

Analyzing Information Distribution in Complex Systems

Institute of Computer Science, University of Tartu, Ulikooli 17, 50090 Tartu, Estonia
Author to whom correspondence should be addressed.
Received: 21 July 2017 / Revised: 27 September 2017 / Accepted: 1 November 2017 / Published: 24 November 2017
Information theory is often utilized to capture both linear as well as nonlinear relationships between any two parts of a dynamical complex system. Recently, an extension to classical information theory called partial information decomposition has been developed, which allows one to partition the information that two subsystems have about a third one into unique, redundant and synergistic contributions. Here, we apply a recent estimator of partial information decomposition to characterize the dynamics of two different complex systems. First, we analyze the distribution of information in triplets of spins in the 2D Ising model as a function of temperature. We find that while redundant information obtains a maximum at the critical point, synergistic information peaks in the disorder phase. Secondly, we characterize 1D elementary cellular automata rules based on the information distribution between neighboring cells. We describe several clusters of rules with similar partial information decomposition. These examples illustrate how the partial information decomposition provides a characterization of the emergent dynamics of complex systems in terms of the information distributed across their interacting units. View Full-Text
Keywords: information theory; partial information decomposition; Ising model; cellular automata information theory; partial information decomposition; Ising model; cellular automata
Show Figures

Figure 1

MDPI and ACS Style

Sootla, S.; Theis, D.O.; Vicente, R. Analyzing Information Distribution in Complex Systems. Entropy 2017, 19, 636.

AMA Style

Sootla S, Theis DO, Vicente R. Analyzing Information Distribution in Complex Systems. Entropy. 2017; 19(12):636.

Chicago/Turabian Style

Sootla, Sten, Dirk O. Theis, and Raul Vicente. 2017. "Analyzing Information Distribution in Complex Systems" Entropy 19, no. 12: 636.

Find Other Styles
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Article Access Map by Country/Region

Back to TopTop