Holevo's theorem

Short description: Upper bound on the knowable information of a quantum state

Holevo's theorem is an important limitative theorem in quantum computing, an interdisciplinary field of physics and computer science. It is sometimes called Holevo's bound, since it establishes an upper bound to the amount of information that can be known about a quantum state (accessible information). It was published by Alexander Holevo in 1973.

Accessible information

As for several concepts in quantum information theory, accessible information is best understood in terms of a 2-party communication. So we introduce two parties: Alice and Bob. Alice has a classical random variable X, which can take the values {1, 2, ..., n} with corresponding probabilities {p₁, p₂, ..., p_n}. Alice then prepares a quantum state, represented by the density matrix ρ_X chosen from a set {ρ₁, ρ₂, ..., ρ_n}, and gives this state to Bob. Bob's goal is to find the value of X, and in order to do that, he performs a measurement on the state ρ_X, obtaining a classical outcome, which we denote with Y. In this context, the amount of accessible information, that is, the amount of information that Bob can get about the variable X, is the maximum value of the mutual information I(X : Y) between the random variables X and Y over all the possible measurements that Bob can do.

There is currently no known formula to compute the accessible information. There are, however, several upper bounds, the best-known of which is the Holevo bound, which is specified in the following theorem.

Statement of the theorem

Let {ρ₁, ρ₂, ..., ρ_n} be a set of mixed states and let ρ_X be one of these states drawn according to the probability distribution P = {p₁, p₂, ..., p_n}.

Then, for any measurement described by POVM elements {E_Y} and performed on [math]\displaystyle{ \rho = \sum_X p_X \rho_X }[/math], the amount of accessible information about the variable X knowing the outcome Y of the measurement is bounded from above as follows:

[math]\displaystyle{ I(X : Y) \leq S(\rho) - \sum_i p_i S(\rho_i), }[/math]

where [math]\displaystyle{ \rho = \sum_i p_i \rho_i }[/math], and [math]\displaystyle{ S }[/math] is the von Neumann entropy.

The quantity on the right-hand side of this inequality is called the Holevo information or Holevo χ quantity:

[math]\displaystyle{ \chi := S(\rho) - \sum_i p_i S(\rho_i). }[/math]

Proof

Consider the composite system that describes the entire communication process, which involves Alice's classical input [math]\displaystyle{ X }[/math], the quantum system [math]\displaystyle{ Q }[/math], and Bob's classical output [math]\displaystyle{ Y }[/math]. The classical input [math]\displaystyle{ X }[/math] can be written as a classical register [math]\displaystyle{ \rho^X := \sum\nolimits_{x=1}^n p_x |x\rangle \langle x| }[/math] with respect to some orthonormal basis [math]\displaystyle{ \{|x\rangle\}_{x=1}^n }[/math]. By writing [math]\displaystyle{ X }[/math] in this manner, the von Neumann entropy [math]\displaystyle{ S(X) }[/math] of the state [math]\displaystyle{ \rho^X }[/math] corresponds to the Shannon entropy [math]\displaystyle{ H(X) }[/math] of the probability distribution [math]\displaystyle{ \{p_x\}_{x=1}^n }[/math]:

[math]\displaystyle{ S(X) = -\operatorname{tr}\left(\rho^X \log \rho^X \right) = -\operatorname{tr}\left(\sum_{x=1}^n p_x \log p_x |x\rangle\langle x|\right) = -\sum_{x=1}^n p_x \log p_x = H(X). }[/math]

The initial state of the system, where Alice prepares the state [math]\displaystyle{ \rho_x }[/math] with probability [math]\displaystyle{ p_x }[/math], is described by

[math]\displaystyle{ \rho^{XQ} := \sum_{x=1}^n p_x |x\rangle \langle x|\otimes\rho_x. }[/math]

Afterwards, Alice sends the quantum state to Bob. As Bob only has access to the quantum system [math]\displaystyle{ Q }[/math] but not the input [math]\displaystyle{ X }[/math], he receives a mixed state of the form [math]\displaystyle{ \rho := \operatorname{tr}_X\left(\rho^{XQ}\right) = \sum\nolimits_{x=1}^n p_x \rho_x }[/math]. Bob measures this state with respect to the POVM elements [math]\displaystyle{ \{E_y\}_{y=1}^m }[/math], and the probabilities [math]\displaystyle{ \{q_y\}_{y=1}^m }[/math] of measuring the outcomes [math]\displaystyle{ y=1,2,\dots,m }[/math] form the classical output [math]\displaystyle{ Y }[/math]. This measurement process can be described as a quantum instrument

[math]\displaystyle{ \mathcal{E}^{Q}(\rho_x) = \sum_{y=1}^m q_{y|x} \rho_{y|x} \otimes |y\rangle \langle y|, }[/math]

where [math]\displaystyle{ q_{y|x} = \operatorname{tr}\left(E_y\rho_x\right) }[/math] is the probability of outcome [math]\displaystyle{ y }[/math] given the state [math]\displaystyle{ \rho_x }[/math], while [math]\displaystyle{ \rho_{y|x} = W\sqrt{E_y}\rho_x\sqrt{E_y}W^\dagger/q_{y|x} }[/math] for some unitary [math]\displaystyle{ W }[/math] is the normalised post-measurement state. Then, the state of the entire system after the measurement process is

[math]\displaystyle{ \rho^{XQ'Y} := \left[\mathcal{I}^{X}\otimes\mathcal{E}^{Q}\right]\!\left(\rho^{XQ}\right) = \sum_{x=1}^n\sum_{y=1}^m p_x q_{y|x} |x\rangle \langle x|\otimes\rho_{y|x}\otimes |y\rangle \langle y|. }[/math]

Here [math]\displaystyle{ \mathcal{I}^X }[/math] is the identity channel on the system [math]\displaystyle{ X }[/math]. Since [math]\displaystyle{ \mathcal{E}^Q }[/math] is a quantum channel, and the quantum mutual information is monotonic under completely positive trace-preserving maps, [math]\displaystyle{ S(X:Q'Y) \leq S(X:Q) }[/math]. Additionally, as the partial trace over [math]\displaystyle{ Q' }[/math] is also completely positive and trace-preserving, [math]\displaystyle{ S(X:Y) \leq S(X:Q'Y) }[/math]. These two inequalities give

[math]\displaystyle{ S(X:Y) \leq S(X:Q). }[/math]

On the left-hand side, the quantities of interest depend only on

[math]\displaystyle{ \rho^{XY} := \operatorname{tr}_{Q'}\left(\rho^{XQ'Y}\right) = \sum_{x=1}^n\sum_{y=1}^m p_x q_{y|x} |x\rangle \langle x|\otimes |y\rangle \langle y| = \sum_{x=1}^n\sum_{y=1}^m p_{x,y} |x,y\rangle \langle x,y|, }[/math]

with joint probabilities [math]\displaystyle{ p_{x,y}=p_x q_{y|x} }[/math]. Clearly, [math]\displaystyle{ \rho^{XY} }[/math] and [math]\displaystyle{ \rho^Y := \operatorname{tr}_X(\rho^{XY}) }[/math], which are in the same form as [math]\displaystyle{ \rho^X }[/math], describe classical registers. Hence,

[math]\displaystyle{ S(X:Y) = S(X)+S(Y)-S(XY) = H(X)+H(Y)-H(XY) = I(X:Y). }[/math]

Meanwhile, [math]\displaystyle{ S(X:Q) }[/math] depends on the term

[math]\displaystyle{ \log \rho^{XQ} = \log\left(\sum_{x=1}^n p_x |x\rangle \langle x|\otimes\rho_x\right) = \sum_{x=1}^n |x\rangle \langle x| \otimes \log\left(p_x\rho_x\right) = \sum_{x=1}^n \log p_x |x\rangle \langle x| \otimes I^Q + \sum_{x=1}^n |x\rangle \langle x| \otimes \log\rho_x, }[/math]

where [math]\displaystyle{ I^Q }[/math] is the identity operator on the quantum system [math]\displaystyle{ Q }[/math]. Then, the right-hand side is

[math]\displaystyle{ \begin{aligned} S(X:Q) &= S(X)+S(Q)-S(XQ) \\ &= S(X) + S(\rho) + \operatorname{tr}\left(\rho^{XQ}\log\rho^{XQ}\right) \\ &= S(X) + S(\rho) + \operatorname{tr}\left(\sum_{x=1}^n p_x\log p_x |x\rangle \langle x| \otimes \rho_x\right) + \operatorname{tr}\left(\sum_{x=1}^n p_x|x\rangle \langle x| \otimes \rho_x\log\rho_x\right)\\ &= S(X) + S(\rho) + \underbrace{\operatorname{tr}\left(\sum_{x=1}^n p_x\log p_x |x\rangle \langle x|\right)}_{-S(X)} + \operatorname{tr}\left(\sum_{x=1}^n p_x \rho_x\log\rho_x\right)\\ &= S(\rho) + \sum_{x=1}^n p_x \underbrace{\operatorname{tr}\left(\rho_x\log\rho_x\right)}_{-S(\rho_x)} \\ &= S(\rho) - \sum_{x=1}^n p_x S(\rho_x), \end{aligned} }[/math]

which completes the proof.

Comments and remarks

In essence, the Holevo bound proves that given n qubits, although they can "carry" a larger amount of (classical) information (thanks to quantum superposition), the amount of classical information that can be retrieved, i.e. accessed, can be only up to n classical (non-quantum encoded) bits. It was also established, both theoretically and experimentally, that there are computations where quantum bits carry more information through the process of the computation than is possible classically.

See also

• Superdense coding

Further reading

• Holevo, Alexander S. (1973). "Bounds for the quantity of information transmitted by a quantum communication channel". Problems of Information Transmission 9: 177–183. 
• Nielsen, Michael A.; Chuang, Isaac L. (2000). Quantum Computation and Quantum Information. Cambridge, UK: Cambridge University Press. ISBN 978-0-521-63235-5. OCLC 43641333.  (see page 531, subsection 12.1.1 - equation (12.6) )
• Wilde, Mark M. (2011). "From Classical to Quantum Shannon Theory". arXiv:1106.1445v2 [quant-ph].. See in particular Section 11.6 and following. Holevo's theorem is presented as exercise 11.9.1 on page 288.