February 07, 2013
Collins Conference Room
Eckehard Olbrich (Max Planck Institute for Mathematics in the Sciences)
Abstract. How can the information that a set of random variables contains about another random variable be decomposed? To what extent do different subgroups provide the same, i.e. shared or redundant, information, carry unique information or interact for the emergence of synergistic information?
Recently Williams and Beer proposed such a decomposition based on natural properties for shared information. While these properties fix the structure of the decomposition, they do not uniquely specify the values of the different terms. Therefore, we investigate additional properties such as strong symmetry and left monotonicity. We find that strong symmetry is incompatible with the properties proposed by Williams and Beer. Although left monotonicity is a very natural property for an information measure it is not fulfilled by any of the proposed measures.
We also study a geometric framework for information decompositions and ask whether it is possible to represent shared information by a family of posterior distributions.
Finally, we draw connections to the notions of shared knowledge and common knowledge in game theory. While many people believe that independent variables cannot share information, we show that in game theory independent agents can have shared knowledge, but not common knowledge.
We conclude that intuition and heuristic arguments do not suffice when arguing about information. We expect that further progress requires a more precise, operational idea of what shared information should be.
Nils Bertschinger, Johannes Rauh, Eckehard Olbrich, and Jürgen Jost. "Shared Information — New Insights and Problems in Decomposing Information in Complex Systems." arXiv:1210.5902 (2012)
Williams, P., and R. Beer. "Nonnegative decomposition of multivariate information." arXiv:1004.2515v1 (2010)
Purpose: Research Collaboration
SFI Host: David Wolpert
SFI's 2013 Community Lecture series continued May 9 in Santa Fe, with psychologist, philosopher, author, and mother Alison Gopnik on “The Minds of Children.” Watch the video of her ...
On September 4-6 in Austin, Texas, the Santa Fe Institute offers its popular short course on complexity, with a special focus on networks.
Ever wonder what SFI scientists like to think about? How many countries SFI External Professors represent? Who SFI's 300-plus donors are? SFI's 2012 Annual Report contains this and ...
The popular Science On Screen series continued Wednesday, May 8, with SFI's Simon DeDeo and the 1992 cult hacker film Sneakers. If you missed the event, you can read ...
SFI's 2013 Community Lecture series debuted March 14 with UC-Boulder's Leysia Palen describing how victims, observers, and “citizen-responders” are using modern technology to participate in disaster response. Watch ...