Quantum stochastic calculus

Quantum stochastic calculus is a generalization of stochastic calculus to noncommuting variables. The tools provided by quantum stochastic calculus are of great use for modeling the random evolution of systems undergoing measurement, as in quantum trajectories. Just as the Lindblad master equation provides a quantum generalization to the Fokker–Planck equation, quantum stochastic calculus allows for the derivation of quantum stochastic differential equations (QSDE) that are analogous to classical Langevin equations.

For the remainder of this article stochastic calculus will be referred to as classical stochastic calculus, in order to clearly distinguish it from quantum stochastic calculus.

Heat baths

An important physical scenario in which a quantum stochastic calculus is needed is the case of a system interacting with a heat bath. It is appropriate in many circumstances to model the heat bath as an assembly of harmonic oscillators. One type of interaction between the system and the bath can be modeled (after making a canonical transformation) by the following Hamiltonian:

[math]\displaystyle{ H=H_\mathrm{sys}(\mathbf{Z})+\frac{1}{2}\sum_n\left((p_n-\kappa_nX)^2+\omega_n^2q_n^2\right)\,, }[/math]

where [math]\displaystyle{ H_\mathrm{sys} }[/math] is the system Hamiltonian, [math]\displaystyle{ \mathbf{Z} }[/math] is a vector containing the system variables corresponding to a finite number of degrees of freedom, [math]\displaystyle{ n }[/math] is an index for the different bath modes, [math]\displaystyle{ \omega_n }[/math] is the frequency of a particular mode, [math]\displaystyle{ p_n }[/math] and [math]\displaystyle{ q_n }[/math] are bath operators for a particular mode, [math]\displaystyle{ X }[/math] is a system operator, and [math]\displaystyle{ \kappa_n }[/math] quantifies the coupling between the system and a particular bath mode.

In this scenario the equation of motion for an arbitrary system operator [math]\displaystyle{ Y }[/math] is called the quantum Langevin equation and may be written as:

[math]\displaystyle{ \dot{Y}(t)=\frac{i}{\hbar}[H_\mathrm{sys},Y(t)]-\frac{i}{2\hbar}\left[X,\left\{Y(t),\xi(t)-\int_{t_0}^tf(t-t_0)\dot{X}(t^\prime)\mathrm{d}t^\prime-f(t-t_0)X(t_0)\right\}\right]\,, }[/math]

where [math]\displaystyle{ [\cdot,\cdot] }[/math] and [math]\displaystyle{ \{\cdot,\cdot\} }[/math] denote the commutator and anticommutator (respectively), the memory function [math]\displaystyle{ f }[/math] is defined as:

[math]\displaystyle{ f(t)\equiv\sum_n\kappa_n^2\cos(\omega_nt)\,, }[/math]

and the time dependent noise operator [math]\displaystyle{ \xi }[/math] is defined as:

[math]\displaystyle{ \xi(t)\equiv i\sum_n\kappa_n\sqrt{\frac{\hbar\omega_n}{2}}\left(-a_n(t_0)e^{-i\omega_n(t-t_0)}+a^\dagger_n(t_0)e^{i\omega_n(t-t_0)}\right)\,, }[/math]

where the bath annihilation operator [math]\displaystyle{ a_n }[/math] is defined as:

[math]\displaystyle{ a_n\equiv\frac{\omega_nq_n+ip_n}{\sqrt{2\hbar\omega_n}}\,. }[/math]

Oftentimes this equation is more general than is needed, and further approximations are made to simplify the equation.

White noise formalism

For many purposes it is convenient to make approximations about the nature of the heat bath in order to achieve a white noise formalism. In such a case the interaction may be modeled by the Hamiltonian [math]\displaystyle{ H=H_\mathrm{sys}+H_B+H_\mathrm{int} }[/math] where:

[math]\displaystyle{ H_B=\hbar\int_{-\infty}^\infty\mathrm{d}\omega\,\omega b^\dagger(\omega)b(\omega)\,, }[/math]

and

[math]\displaystyle{ H_\mathrm{int}=i\hbar\int_{-\infty}^\infty\mathrm{d}\omega\,\kappa(\omega)\left(b^\dagger(\omega)c-c^\dagger b(\omega)\right)\,, }[/math]

where [math]\displaystyle{ b(\omega) }[/math] are annihilation operators for the bath with the commutation relation [math]\displaystyle{ [b(\omega),b^\dagger(\omega^\prime)]=\delta(\omega-\omega^\prime) }[/math], [math]\displaystyle{ c }[/math] is an operator on the system, [math]\displaystyle{ \kappa(\omega) }[/math] quantifies the strength of the coupling of the bath modes to the system, and [math]\displaystyle{ H_\mathrm{sys} }[/math] describes the free system evolution. This model uses the rotating wave approximation and extends the lower limit of [math]\displaystyle{ \omega }[/math] to [math]\displaystyle{ -\infty }[/math] in order to admit a mathematically simple white noise formalism. The coupling strengths are also usually simplified to a constant in what is sometimes called the first Markov approximation:

[math]\displaystyle{ \kappa(\omega)=\sqrt{\frac{\gamma}{2\pi}}\,. }[/math]

Systems coupled to a bath of harmonic oscillators can be thought of as being driven by a noise input and radiating a noise output. The input noise operator at time [math]\displaystyle{ t }[/math] is defined by:

[math]\displaystyle{ b_\mathrm{in}(t)=\frac{1}{\sqrt{2\pi}}\int_{-\infty}^\infty\mathrm{d}\omega\,e^{-i\omega(t-t_0)}b_0(\omega)\,, }[/math]

where [math]\displaystyle{ b_0(\omega)=\left.b(\omega)\right\vert_{t=t_0} }[/math], since this operator is expressed in the Heisenberg picture. Satisfaction of the commutation relation [math]\displaystyle{ [b_\mathrm{in}(t),b_\mathrm{in}^\dagger(t^\prime)]=\delta(t-t^\prime) }[/math] allows the model to have a strict correspondence with a Markovian master equation.

In the white noise setting described so far, the quantum Langevin equation for an arbitrary system operator [math]\displaystyle{ a }[/math] takes a simpler form:

[math]\displaystyle{ \dot{a}=-\frac{i}{\hbar}[a,H_\mathrm{sys}]-[a,c^\dagger]\left(\frac{\gamma}{2}c+\sqrt{\gamma}b_\mathrm{in}(t)\right)+\left(\frac{\gamma}{2}c^\dagger+\sqrt{\gamma}b^\dagger_\mathrm{in}(t)\right)[a,c]\,. }[/math]   (WN1)

For the case most closely corresponding to classical white noise, the input to the system is described by a density operator giving the following expectation value:

[math]\displaystyle{ \langle b^\dagger_\mathrm{in}(t)b_\mathrm{in}(t^\prime)\rangle_{\rho_\mathrm{in}}=N\delta(t-t^\prime)\,. }[/math]

(WN2)

Quantum Wiener process

In order to define quantum stochastic integration, it is important to define a quantum Wiener process:

[math]\displaystyle{ B(t,t_0)=\int_{t_0}^tb_\mathrm{in}(t^\prime)\mathrm{d}t^\prime\,. }[/math]

This definition gives the quantum Wiener process the commutation relation [math]\displaystyle{ [B(t,t_0),B^\dagger(t,t_0)]=t-t_0 }[/math]. The property of the bath annihilation operators in (WN2) implies that the quantum Wiener process has an expectation value of:

[math]\displaystyle{ \langle B^\dagger(t,t_0)B(t,t_0)\rangle_{\rho(t,t_0)}=N(t-t_0)\,. }[/math]

The quantum Wiener processes are also specified such that their quasiprobability distributions are Gaussian by defining the density operator:

[math]\displaystyle{ \rho(t,t_0)=(1-e^{-\kappa})\exp\left[-\frac{\kappa B^\dagger(t,t_0)B(t,t_0)}{t-t_0}\right]\,, }[/math]

where [math]\displaystyle{ N=1/(e^\kappa-1) }[/math].

Quantum stochastic integration

The stochastic evolution of system operators can also be defined in terms of the stochastic integration of given equations.

Quantum Itô integral

The quantum Itô integral of a system operator [math]\displaystyle{ g(t) }[/math] is given by:

[math]\displaystyle{ (\mathbf{I})\int_{t_0}^tg(t^\prime)\mathrm{d}B(t^\prime)=\lim_{n\to\infty}\sum_{i=1}^ng(t_i)\left(B(t_{i+1},t_0)-B(t_i,t_0)\right)\,, }[/math]

where the bold (I) preceding the integral stands for Itô. One of the characteristics of defining the integral in this way is that the increments [math]\displaystyle{ \mathrm{d}B }[/math] and [math]\displaystyle{ \mathrm{d}B^\dagger }[/math] commute with the system operator.

Itô quantum stochastic differential equation

In order to define the Itô QSDE, it is necessary to know something about the bath statistics. In the context of the white noise formalism described earlier, the Itô QSDE can be defined as:

[math]\displaystyle{ (\mathbf{I})\,\mathrm{d}a=-\frac{i}{\hbar}[a,H_\mathrm{sys}]\mathrm{d}t+\gamma\left((N+1)\mathcal{D}[c^\dagger]a+N\mathcal{D}[c]a\right)\mathrm{d}t-\sqrt{\gamma}\left([a,c^\dagger]\mathrm{d}B(t)-\mathrm{d}B^\dagger(t)[a,c]\right)\,, }[/math]

where the equation has been simplified using the Lindblad superoperator:

[math]\displaystyle{ \mathcal{D}[A]a\equiv AaA^\dagger-\frac{1}{2}\left(A^\dagger Aa+aA^\dagger A\right)\,. }[/math]

This differential equation is interpreted as defining the system operator [math]\displaystyle{ a }[/math] as the quantum Itô integral of the right hand side, and is equivalent to the Langevin equation (WN1).

Quantum Stratonovich integral

The quantum Stratonovich integral of a system operator [math]\displaystyle{ g(t) }[/math] is given by:

[math]\displaystyle{ (\mathbf{S})\int_{t_0}^tg(t^\prime)\mathrm{d}B(t^\prime)=\lim_{n\to\infty}\sum_{i=1}^n\frac{g(t_i)+g(t_{i+1})}{2}\left(B(t_{i+1},t_0)-B(t_i,t_0)\right)\,, }[/math]

where the bold (S) preceding the integral stands for Stratonovich. Unlike the Itô formulation, the increments in the Stratonovich integral do not commute with the system operator, and it can be shown that:

[math]\displaystyle{ (\mathbf{S})\int_{t_0}^tg(t^\prime)\mathrm{d}B(t^\prime)-(\mathbf{S})\int_{t_0}^t\mathrm{d}B(t^\prime)g(t^\prime)=\frac{\sqrt{\gamma}}{2}\int_{t_0}^t\mathrm{d}t^\prime\,[g(t^\prime),c(t^\prime)]\,. }[/math]

Stratonovich quantum stochastic differential equation

The Stratonovich QSDE can be defined as:

[math]\displaystyle{ (\mathbf{S})\,\mathrm{d}a=-\frac{i}{\hbar}[a,H_\mathrm{sys}]\mathrm{d}t-\frac{\gamma}{2}\left([a,c^\dagger]c-c^\dagger[a,c]\right)\mathrm{d}t-\sqrt{\gamma}\left([a,c^\dagger]\mathrm{d}B(t)-\mathrm{d}B^\dagger(t)[a,c]\right)\,. }[/math]

This differential equation is interpreted as defining the system operator [math]\displaystyle{ a }[/math] as the quantum Stratonovich integral of the right hand side, and is in the same form as the Langevin equation (WN1).

Relation between Itô and Stratonovich integrals

The two definitions of quantum stochastic integrals relate to one another in the following way, assuming a bath with [math]\displaystyle{ N }[/math] defined as before:

[math]\displaystyle{ (\mathbf{S})\int_{t_0}^tg(t^\prime)\mathrm{d}B(t^\prime)=(\mathbf{I})\int_{t_0}^tg(t^\prime)\mathrm{d}B(t^\prime)+\frac{1}{2}\sqrt{\gamma}N\int_{t_0}^t\mathrm{d}t^\prime\,[g(t^\prime),c(t^\prime)]\,. }[/math]

Calculus rules

Just as with classical stochastic calculus, the appropriate product rule can be derived for Itô and Stratonovich integration, respectively:

[math]\displaystyle{ (\mathbf{I})\,\mathrm{d}(ab)=a\,\mathrm{d}b+b\,\mathrm{d}a+\mathrm{d}a\,\mathrm{d}b\,, }[/math]

[math]\displaystyle{ (\mathbf{S})\,\mathrm{d}(ab)=a\,\mathrm{d}b+\mathrm{d}a\,b\,. }[/math]

As is the case in classical stochastic calculus, the Stratonovich form is the one which preserves the ordinary calculus (which in this case is noncommuting). A peculiarity in the quantum generalization is the necessity to define both Itô and Stratonovitch integration in order to prove that the Stratonovitch form preserves the rules of noncommuting calculus.

Quantum trajectories

Quantum trajectories can generally be thought of as the path through Hilbert space that the state of a quantum system traverses over time. In a stochastic setting, these trajectories are often conditioned upon measurement results. The unconditioned Markovian evolution of a quantum system (averaged over all possible measurement outcomes) is given by a Lindblad equation. In order to describe the conditioned evolution in these cases, it is necessary to unravel the Lindblad equation by choosing a consistent QSDE. In the case where the conditioned system state is always pure, the unraveling could be in the form of a stochastic Schrödinger equation (SSE). If the state may become mixed, then it is necessary to use a stochastic master equation (SME).

Example unravelings

Plot of the evolution of the z-component of the Bloch vector of a two-level atom coupled to the electromagnetic field undergoing damped Rabi oscillations. The top plot shows the quantum trajectory for the atom for photon-counting measurements performed on the electromagnetic field, the middle plot shows the same for homodyne detection, and the bottom plot compares the previous two measurement choices (each averaged over 32 trajectories) with the unconditioned evolution given by the master equation.

Consider the following Lindblad master equation for a system interacting with a vacuum bath:

[math]\displaystyle{ \dot{\rho}=\mathcal{D}[c]\rho-i[H_\mathrm{sys},\rho]\,. }[/math]

This describes the evolution of the system state averaged over the outcomes of any particular measurement that might be made on the bath. The following SME describes the evolution of the system conditioned on the results of a continuous photon-counting measurement performed on the bath:

[math]\displaystyle{ \mathrm{d}\rho_I(t)=\left(\mathrm{d}N(t)\mathcal{G}[c]-\mathrm{d}t\mathcal{H}[iH_\mathrm{sys}+\frac{1}{2}c^\dagger c]\right)\rho_I(t)\,, }[/math]

where

[math]\displaystyle{ \begin{array}{rcl} \mathcal{G}[r]\rho & \equiv & \frac{r\rho r^\dagger}{\operatorname{Tr}[r\rho r^\dagger]}-\rho \\ \mathcal{H}[r]\rho & \equiv & r\rho+\rho r^\dagger-\operatorname{Tr}[r\rho+\rho r^\dagger]\rho \end{array} }[/math]

are nonlinear superoperators and [math]\displaystyle{ N(t) }[/math] is the photocount, indicating how many photons have been detected at time [math]\displaystyle{ t }[/math] and giving the following jump probability:

[math]\displaystyle{ \operatorname{E}[\mathrm{d}N(t)]=\mathrm{d}t\operatorname{Tr}[c^\dagger c\rho_I(t)]\,, }[/math]

where [math]\displaystyle{ \operatorname{E}[\cdot] }[/math] denotes the expected value. Another type of measurement that could be made on the bath is homodyne detection, which results in quantum trajectories given by the following SME:

[math]\displaystyle{ \mathrm{d}\rho_J(t)=-i[H_\mathrm{sys},\rho_J(t)]\mathrm{d}t+\mathrm{d}t\mathcal{D}[c]\rho_J(t)+\mathrm{d}W(t)\mathcal{H}[c]\rho_J(t)\,, }[/math]

where [math]\displaystyle{ \mathrm{d}W(t) }[/math] is a Wiener increment satisfying:

[math]\displaystyle{ \begin{array}{rcl} \mathrm{d}W(t)^2 & = & \mathrm{d}t \\ \operatorname{E}[\mathrm{d}W(t)] & = & 0\,. \end{array} }[/math]

Although these two SMEs look wildly different, calculating their expected evolution shows that they are both indeed unravelings of the same Lindlad master equation:

[math]\displaystyle{ \operatorname{E}[\mathrm{d}\rho_I(t)]=\operatorname{E}[\mathrm{d}\rho_J(t)]=\dot{\rho}\mathrm{d}t\,. }[/math]

Computational considerations

One important application of quantum trajectories is reducing the computational resources required to simulate a master equation. For a Hilbert space of dimension d, the amount of real numbers required to store the density matrix is of order d², and the time required to compute the master equation evolution is of order d⁴. Storing the state vector for a SSE, on the other hand, only requires an amount of real numbers of order d, and the time to compute trajectory evolution is only of order d². The master equation evolution can then be approximated by averaging over many individual trajectories simulated using the SSE, a technique sometimes referred to as the Monte Carlo wave-function approach. Although the number of calculated trajectories n must be very large in order to accurately approximate the master equation, good results can be obtained for trajectory counts much less than d². Not only does this technique yield faster computation time, but it also allows for the simulation of master equations on machines that do not have enough memory to store the entire density matrix.