Definition: | mean value of the transinformation content T(xi,xj) of two events xi and yj, each in one of two finite sets of mutually exclusive and jointly exhaustive events where X = {x1, …, xn} is the set of events xi (i = 1, …, n), Y = {y1, …, ym} is the set of events yj (j = 1, …, m) and p(xi,yj) the joint probability that both events occur Note 1 to entry: The mean transinformation content is symmetric in X and Y. It is also equal to the difference between the entropy of one of the two sets of events and the conditional entropy of this set relative to the other: . Note 2 to entry: The mean transinformation content is a quantitative measure of information transmitted through a channel, when X is a specific set of messages at the message source and Y is a specific set of messages at the message sink. It is equal to the difference between the entropy at the message source and the equivocation, or the difference between the entropy at the message sink and the irrelevance.
|