Zakai equation

From HandWiki

In filtering theory the Zakai equation is a linear stochastic partial differential equation for the un-normalized density of a hidden state. In contrast, the Kushner equation gives a non-linear stochastic partial differential equation for the normalized density of the hidden state. In principle either approach allows one to estimate a quantity function (the state of a dynamical system) from noisy measurements, even when the system is non-linear (thus generalizing the earlier results of Wiener and Kalman for linear systems and solving a central problem in estimation theory). The application of this approach to a specific engineering situation may be problematic however, as these equations are quite complex.[1][2] The Zakai equation is a bilinear stochastic partial differential equation. It was named after Moshe Zakai.[3]

Overview

Assume the state of the system evolves according to

[math]\displaystyle{ dx = f(x,t) dt + dw }[/math]

and a noisy measurement of the system state is available:

[math]\displaystyle{ dz = h(x,t) dt + dv }[/math]

where [math]\displaystyle{ w, v }[/math] are independent Wiener processes. Then the unnormalized conditional probability density [math]\displaystyle{ p(x,t) }[/math] of the state at time t is given by the Zakai equation:

[math]\displaystyle{ dp = L[p] dt + p h^T dz }[/math]

where

[math]\displaystyle{ L[p] = -\sum \frac{\partial (f_i p)}{\partial x_i} + \frac12 \sum \frac{\partial^2 p}{\partial x_i \partial x_j} }[/math]

is a Kolmogorov forward operator.

As previously mentioned, [math]\displaystyle{ p }[/math] is an unnormalized density and thus does not necessarily integrate to 1. After solving for [math]\displaystyle{ p }[/math], integration and normalization can be done if desired (an extra step not required in the Kushner approach).

Note that if the last term on the right hand side is omitted (by choosing h identically zero), the result is a nonstochastic PDE: the familiar Fokker–Planck equation, which describes the evolution of the state when no measurement information is available.

See also

References

  1. Sritharan, S. S. (1994). "Nonlinear filtering of stochastic Navier–Stokes equations". in Funaki, T.; Woyczynski, W. A.. Nonlinear Stochastic PDEs: Burgers Turbulence and Hydrodynamic Limit. Springer-Verlag. pp. 247–260. ISBN 0-387-94624-1. http://www.nps.edu/Academics/Schools/GSEAS/SRI/BookCH9.pdf. 
  2. Hobbs, S. L.; Sritharan, S. S. (1996). "Nonlinear filtering theory for stochastic reaction–diffusion equations". in Gretsky, N.; Goldstein, J.; Uhl, J. J.. Probability and Modern Analysis. Marcel Dekker. pp. 219–234. http://www.nps.edu/Academics/Schools/GSEAS/SRI/BookCH10.pdf. 
  3. Zakai, M. (1969). "On the optimal filtering of diffusion processes". Zeitschrift für Wahrscheinlichkeitstheorie und Verwandte Gebiete 11 (3): 230–243. doi:10.1007/BF00536382. 

Further reading

  • Grigelionis, B.; Mikulevičius, R. (1983). "Stochastic evolution equations and densities of the conditional distributions". Theory and Application of Random Fields. Berlin: Springer. pp. 49–88. doi:10.1007/BFb0044682. 
  • Schuss, Zeev (2012). "Nonlinear Filtering and Smoothing of Diffusions". Nonlinear Filtering and Optimal Phase Tracking. Boston: Springer. pp. 85–106. doi:10.1007/978-1-4614-0487-3_3. ISBN 978-1-4614-0486-6.