On the Differential and the Integral Value of Information

Research output: Contribution to journalArticlepeer-review

Abstract

A quantitative expression for the value of information within the framework of information theory and of the maximal entropy formulation is discussed. We examine both a local, differential measure and an integral, global measure for the value of the change in information when additional input is provided. The differential measure is a potential and as such carries a physical dimension. The integral value has the dimension of information. The differential measure can be used, for example, to discuss how the value of information changes with time or with other parameters of the problem.

Original languageEnglish
Article number43
JournalEntropy
Volume27
Issue number1
DOIs
StatePublished - Jan 2025

Bibliographical note

Publisher Copyright:
© 2025 by the author.

Keywords

  • constraints on a probability distribution
  • cross correlation of constraints
  • Lagrange multiplier
  • mutual information

Fingerprint

Dive into the research topics of 'On the Differential and the Integral Value of Information'. Together they form a unique fingerprint.

Cite this