Contiguity (probability theory)

From HandWiki

In probability theory, two sequences of probability measures are said to be contiguous if asymptotically they share the same support. Thus the notion of contiguity extends the concept of absolute continuity to the sequences of measures. The concept was originally introduced by (Le Cam 1960) as part of his foundational contribution to the development of asymptotic theory in mathematical statistics. He is best known for the general concepts of local asymptotic normality and contiguity.[1]

Definition

Let [math]\displaystyle{ (\Omega_n,\mathcal{F}_n) }[/math] be a sequence of measurable spaces, each equipped with two measures Pn and Qn.

  • We say that Qn is contiguous with respect to Pn (denoted QnPn) if for every sequence An of measurable sets, Pn(An) → 0 implies Qn(An) → 0.
  • The sequences Pn and Qn are said to be mutually contiguous or bi-contiguous (denoted Qn ◁▷ Pn) if both Qn is contiguous with respect to Pn and Pn is contiguous with respect to Qn.[2]

The notion of contiguity is closely related to that of absolute continuity. We say that a measure Q is absolutely continuous with respect to P (denoted QP) if for any measurable set A, P(A) = 0 implies Q(A) = 0. That is, Q is absolutely continuous with respect to P if the support of Q is a subset of the support of P, except in cases where this is false, including, e.g., a measure that concentrates on an open set, because its support is a closed set and it assigns measure zero to the boundary, and so another measure may concentrate on the boundary and thus have support contained within the support of the first measure, but they will be mutually singular. In summary, this previous sentence's statement of absolute continuity is false. The contiguity property replaces this requirement with an asymptotic one: Qn is contiguous with respect to Pn if the "limiting support" of Qn is a subset of the limiting support of Pn. By the aforementioned logic, this statement is also false.

It is possible however that each of the measures Qn be absolutely continuous with respect to Pn, while the sequence Qn not being contiguous with respect to Pn.

The fundamental Radon–Nikodym theorem for absolutely continuous measures states that if Q is absolutely continuous with respect to P, then Q has density with respect to P, denoted as ƒ = ​dQdP, such that for any measurable set A

[math]\displaystyle{ Q(A) = \int_A f\,\mathrm{d}P, \, }[/math]

which is interpreted as being able to "reconstruct" the measure Q from knowing the measure P and the derivative ƒ. A similar result exists for contiguous sequences of measures, and is given by the Le Cam's third lemma.

Properties

  • For the case [math]\displaystyle{ (P_n,Q_n)= (P,Q) }[/math] for all n it applies [math]\displaystyle{ Q_n\triangleleft P_n\Leftrightarrow Q\ll P }[/math].
  • It is possible that [math]\displaystyle{ P_n\ll Q_n }[/math] is true for all n without [math]\displaystyle{ P_n\triangleleft Q_n }[/math].[3]

Le Cam's first lemma

For two sequences of measures [math]\displaystyle{ (P_n)\text{ and }(Q_n) }[/math] on measurable spaces [math]\displaystyle{ (\Omega_n,\mathcal{F}_n) }[/math] the following statements are equivalent:[4]

  • [math]\displaystyle{ P_n\triangleleft Q_n }[/math]
  • [math]\displaystyle{ \frac{\mathrm dQ_n}{\mathrm dP_n}\overset{P_n}{\,\longrightarrow\,}U\text{ along a subsequence }\Rightarrow P(U\gt 0)=1 }[/math]
  • [math]\displaystyle{ \frac{\mathrm dP_n}{\mathrm dQ_n}\overset{Q_n}{\,\longrightarrow\,}V\text{ along a subsequence }\Rightarrow E(V)=1 }[/math]
  • [math]\displaystyle{ T_n\overset{P_n}{\,\longrightarrow\,}0\,\Rightarrow\, T_n\overset{Q_n}{\,\longrightarrow\,}0 }[/math] for any statistics [math]\displaystyle{ T_n:\Omega_n\rightarrow\mathbb{R} }[/math].

where [math]\displaystyle{ U }[/math] and [math]\displaystyle{ V }[/math] are random variables on [math]\displaystyle{ (\Omega,\mathcal{F},P)\text{ and }(\Omega',\mathcal{F}',Q) }[/math].

Interpretation

Prohorov's theorem tells us that given a sequence of probability measures, every subsequence has a further subsequence which converges weakly. Le Cam's first lemma shows that the properties of the associated limit points determine whether contiguity applies or not. This can be understood in analogy with the non-asymptotic notion of absolute continuity of measures.[5]

Applications

See also

Notes

  1. Wolfowitz J.(1974) Review of the book: "Contiguity of Probability Measures: Some Applications in Statistics. by George G. Roussas", Journal of the American Statistical Association, 69, 278–279 jstor
  2. (van der Vaart 1998)
  3. "Contiguity: Examples". https://www.stat.berkeley.edu/~bartlett/courses/2013spring-stat210b/notes/21notes.pdf#page=12. 
  4. (van der Vaart 1998)
  5. Vaart AW van der. Asymptotic Statistics. Cambridge University Press; 1998.
  6. Werker, Bas (June 2005). "Advanced topics in Financial Econometrics". http://www.samsi.info/200506/fmse/course-info/werker-updated-nov14.pdf. 

References

Additional literature

  • Roussas, George G. (1972), Contiguity of Probability Measures: Some Applications in Statistics, CUP, ISBN:978-0-521-09095-7.
  • Scott, D.J. (1982) Contiguity of Probability Measures, Australian & New Zealand Journal of Statistics, 24 (1), 80–88.

External links