Specific-information

From HandWiki
Short description: State-dependent measures that converge to the mutual information


In information theory, specific-information is the generic name given to the family of state-dependent measures that in expectation converge to the mutual information. There are currently three known varieties of specific information usually denoted [math]\displaystyle{ I_V }[/math], [math]\displaystyle{ I_S }[/math], and [math]\displaystyle{ I_{ssi} }[/math]. The specific-information between a random variable [math]\displaystyle{ X }[/math] and a state [math]\displaystyle{ Y=y }[/math] is written as :[math]\displaystyle{ I( X ; Y = y) }[/math].

References