Biology:Bayesian model of computational anatomy

Computational anatomy (CA) is a discipline within medical imaging focusing on the study of anatomical shape and form at the visible or gross anatomical scale of morphology. The field is broadly defined and includes foundations in anatomy, applied mathematics and pure mathematics, including medical imaging, neuroscience, physics, probability, and statistics. It focuses on the anatomical structures being imaged, rather than the medical imaging devices. The central focus of the sub-field of computational anatomy within medical imaging is mapping information across anatomical coordinate systems most often dense information measured within a magnetic resonance image (MRI). The introduction of flows into CA, which are akin to the equations of motion used in fluid dynamics, exploit the notion that dense coordinates in image analysis follow the Lagrangian and Eulerian equations of motion. In models based on Lagrangian and Eulerian flows of diffeomorphisms, the constraint is associated to topological properties, such as open sets being preserved, coordinates not crossing implying uniqueness and existence of the inverse mapping, and connected sets remaining connected. The use of diffeomorphic methods grew quickly to dominate the field of mapping methods post Christensen's original paper, with fast and symmetric methods becoming available.

The main statistical model

Source-channel model showing the source of images the deformable template [math]\displaystyle{ I \doteq \varphi \cdot I_\mathrm{temp} \in \mathcal{I} }[/math] and channel output associated with MRI sensor [math]\displaystyle{ I^D \in \mathcal{I}^{\mathcal{D}} }[/math]

The central statistical model of Computational Anatomy in the context of medical imaging has been the source-channel model of Shannon theory; the source is the deformable template of images [math]\displaystyle{ I \in \mathcal {I} }[/math], the channel outputs are the imaging sensors with observables [math]\displaystyle{ I^D \in {\mathcal I}^{\mathcal D} }[/math] (see Figure). The importance of the source-channel model is that the variation in the anatomical configuration are modelled separated from the sensor variations of the Medical imagery. The Bayes theory dictates that the model is characterized by the prior on the source, [math]\displaystyle{ \pi_{\mathcal{I}} (\cdot) }[/math] on [math]\displaystyle{ I \in \mathcal{I} }[/math], and the conditional density on the observable

[math]\displaystyle{ p(\cdot \mid I) \text{ on } I^D \in {\mathcal I}^{\mathcal D} }[/math]

conditioned on [math]\displaystyle{ I \in \mathcal{I} }[/math].

In deformable template theory, the images are linked to the templates, with the deformations a group which acts on the template; see group action in computational anatomy For image action [math]\displaystyle{ I(g) \doteq g \cdot I_\mathrm{temp}, g \in \mathcal{G} }[/math], then the prior on the group [math]\displaystyle{ \pi_{\mathcal{G}} (\cdot) }[/math] induces the prior on images [math]\displaystyle{ \pi_{\mathcal{I}} (\cdot) }[/math], written as densities the log-posterior takes the form

[math]\displaystyle{ \log p(I(g)\mid I^D) \simeq \log p(I^D \mid I(g))+ \log \pi_{\mathcal{G}}(g). }[/math]

The random orbit model which follows specifies how to generate the group elements and therefore the random spray of objects which form the prior distribution.

The random orbit model of computational anatomy

Orbits of brains associated to diffeomorphic group action on templates depicted via smooth flow associated to geodesic flows with random spray associated to random generation of initial tangent space vector field [math]\displaystyle{ v_0 \in V }[/math]; published in.

The random orbit model of Computational Anatomy first appeared in modelling the change in coordinates associated to the randomness of the group acting on the templates, which induces the randomness on the source of images in the anatomical orbit of shapes and forms and resulting observations through the medical imaging devices. Such a random orbit model in which randomness on the group induces randomness on the images was examined for the Special Euclidean Group for object recognition in which the group element [math]\displaystyle{ g \in \mathcal{G} }[/math] was the special Euclidean group in.

For the study of deformable shape in CA, the high-dimensional diffeomorphism groups used in computational anatomy are generated via smooth flows [math]\displaystyle{ \varphi_t, t \in [0,1] }[/math] which satisfy the Lagrangian and Eulerian specification of the flow fields satisfying the ordinary differential equation:

Showing the Lagrangian flow of coordinates [math]\displaystyle{ x \in X }[/math] with associated vector fields [math]\displaystyle{ v_t, t \in [0,1] }[/math] satisfying ordinary differential equation [math]\displaystyle{ \dot \varphi_t = v_t(\varphi_t), \varphi_0=id }[/math].

[math]\displaystyle{ \frac{d}{dt} \varphi_t = v_t \circ \varphi_t , \ \varphi_0 = \operatorname{id} \ ; }[/math]

(Lagrangian flow)

with [math]\displaystyle{ v \doteq (v_1,v_2,v_3) }[/math] the vector fields on [math]\displaystyle{ {\mathbb R}^3 }[/math] termed the Eulerian velocity of the particles at position [math]\displaystyle{ \varphi }[/math] of the flow. The vector fields are functions in a function space, modelled as a smooth Hilbert space with the vector fields having 1-continuous derivative . For [math]\displaystyle{ v_t = \dot \varphi_t \circ \varphi_t^{-1}, t \in [0,1] }[/math], the inverse of the flow is given by

[math]\displaystyle{ \frac{d}{dt} \varphi_t^{-1} = -(D \varphi_t^{-1}) v_t, \ \varphi_0^{-1} = \operatorname{id}, }[/math]

(Eulerianflow)

and the [math]\displaystyle{ 3 \times 3 }[/math] Jacobian matrix for flows in [math]\displaystyle{ \mathbb{R}^3 }[/math] given as [math]\displaystyle{ \ D\varphi \doteq \left(\frac{\partial \varphi_i}{\partial x_j}\right). }[/math]

To ensure smooth flows of diffeomorphisms with inverse, the vector fields [math]\displaystyle{ {\mathbb R}^3 }[/math] must be at least 1-time continuously differentiable in space which are modelled as elements of the Hilbert space [math]\displaystyle{ (V, \| \cdot \|_V ) }[/math] using the Sobolev embedding theorems so that each element [math]\displaystyle{ v_i \in H_0^3, i=1,2,3, }[/math] has 3-square-integrable derivatives. Thus [math]\displaystyle{ (V, \| \cdot \|_V ) }[/math] embed smoothly in 1-time continuously differentiable functions. The diffeomorphism group are flows with vector fields absolutely integrable in Sobolev norm:

[math]\displaystyle{ \operatorname{Diff}_V \doteq \left\{\varphi=\varphi_1: \dot \varphi_t = v_t \circ \varphi_t , \varphi_0 = \operatorname{id}, \int_0^1 \|v_t \|_V \, dt \lt \infty \right\} , }[/math]

(Diffeomorphism group)

where [math]\displaystyle{ \| v_t \|_V^2 \doteq \int_X Av_t \cdot v_t dx }[/math] with [math]\displaystyle{ A }[/math] a linear operator [math]\displaystyle{ A:V \mapsto V^* }[/math] defining the norm of the RKHS. The integral is calculated by integration by parts when [math]\displaystyle{ Av }[/math] is a generalized function in the dual space [math]\displaystyle{ V^* }[/math].

Riemannian exponential

In the random orbit model of computational anatomy, the entire flow is reduced to the initial condition which forms the coordinates encoding the diffeomorphism. From the initial condition [math]\displaystyle{ v_0 }[/math] then geodesic positioning with respect to the Riemannian metric of Computational anatomy solves for the flow of the Euler-Lagrange equation. Solving the geodesic from the initial condition [math]\displaystyle{ v_0 }[/math] is termed the Riemannian-exponential, a mapping [math]\displaystyle{ \operatorname{Exp}_\mathrm{id}(\cdot): V \to \operatorname{Diff}_V }[/math] at identity to the group.

The Riemannian exponential satisfies [math]\displaystyle{ \operatorname{Exp}_\mathrm{id} (v_0)= \varphi_1 }[/math] for initial condition [math]\displaystyle{ \dot \varphi_0 = v_0 }[/math], vector field dynamics [math]\displaystyle{ \dot \varphi_t = v_t \circ \varphi_t, t \in [0,1] }[/math],

• for classical equation diffeomorphic shape momentum [math]\displaystyle{ \int_X Av_t \cdot w \, dx }[/math], [math]\displaystyle{ Av \in V }[/math], then

[math]\displaystyle{ \frac{d}{dt} Av_t + (Dv_t)^T Av_t +(DAv_t)v_t + ( \nabla \cdot v) Av_t =0 \ ; }[/math]

• for generalized equation, then [math]\displaystyle{ Av \in V^* }[/math], [math]\displaystyle{ w \in V }[/math]

[math]\displaystyle{ \int_X \frac{d}{dt} Av_t \cdot w \,dx + \int_X Av_t \cdot ((Dv_t)w-(Dw)v_t)\,dx =0 . }[/math]

It is extended to the entire group, [math]\displaystyle{ \varphi= \operatorname{Exp}_\varphi(v_0\circ \varphi) \doteq \operatorname{Exp}_\mathrm{id} (v_0) \circ \varphi. }[/math] Depicted in the accompanying figure is a depiction of the random orbits around each exemplar, [math]\displaystyle{ m_0 \in \mathcal{M} }[/math], generated by randomizing the flow by generating the initial tangent space vector field at the identity [math]\displaystyle{ v_0 \in V }[/math], and then generating random object [math]\displaystyle{ n \doteq \operatorname{Exp}_\mathrm{id}(v_0) \cdot m_0 \in \mathcal{M} }[/math].

Figure showing the random spray of synthesized subcortical structures laid out in the two-dimensional grid representing the variance of the eigenfunction used for the momentum for synthesis.

Shown in the Figure on the right the cartoon orbit, are a random spray of the subcortical manifolds generated by randomizing the vector fields [math]\displaystyle{ v_0 }[/math] supported over the submanifolds. The random orbit model induces the prior on shapes and images [math]\displaystyle{ I \in \mathcal{I} }[/math] conditioned on a particular atlas [math]\displaystyle{ I_a \in \mathcal{I} }[/math]. For this the generative model generates the mean field [math]\displaystyle{ I }[/math] as a random change in coordinates of the template according to [math]\displaystyle{ I \doteq \varphi \cdot I_a }[/math], where the diffeomorphic change in coordinates is generated randomly via the geodesic flows.

MAP estimation in the multiple-atlas orbit model

The random orbit model induces the prior on shapes and images [math]\displaystyle{ I \in \mathcal{I} }[/math] conditioned on a particular atlas [math]\displaystyle{ I_a \in \mathcal{I} }[/math]. For this the generative model generates the mean field [math]\displaystyle{ I }[/math] as a random change in coordinates of the template according to [math]\displaystyle{ I \doteq \varphi \cdot I_a }[/math], where the diffeomorphic change in coordinates is generated randomly via the geodesic flows. The prior on random transformations [math]\displaystyle{ \pi_\mathrm{Diff} (d\varphi) }[/math] on [math]\displaystyle{ \operatorname{Diff}_V }[/math] is induced by the flow [math]\displaystyle{ \operatorname{Exp}_\mathrm{id}(v) }[/math], with [math]\displaystyle{ v \in V }[/math] constructed as a Gaussian random field prior [math]\displaystyle{ \pi_V(dv) }[/math]. The density on the random observables at the output of the sensor [math]\displaystyle{ I^D \in \mathcal{I}^D }[/math] are given by

[math]\displaystyle{ p(I^D\mid I_a) = \int_V p(I^D \mid \operatorname{Exp}_\mathrm{id}(v) \cdot I_a ) \pi_V (dv) \ . }[/math]

Maximum a posteriori estimation (MAP) estimation is central to modern statistical theory. Parameters of interest [math]\displaystyle{ \theta \in \Theta }[/math] take many forms including (i) disease type such as neurodegenerative or neurodevelopmental diseases, (ii) structure type such as cortical or subcortical structures in problems associated to segmentation of images, and (iii) template reconstruction from populations. Given the observed image [math]\displaystyle{ I^D }[/math], MAP estimation maximizes the posterior:

[math]\displaystyle{ \hat \theta \doteq \arg \max_{\theta \in \Theta} \log p(\theta \mid I^D). }[/math]

This requires computation of the conditional probabilities [math]\displaystyle{ p(\theta\mid I^D) = \frac{p(I^D,\theta)}{p(I^D)} }[/math]. The multiple atlas orbit model randomizes over the denumerable set of atlases [math]\displaystyle{ \{ I_a, a \in \mathcal{A} \} }[/math]. The model on images in the orbit take the form of a multi-modal mixture distribution

[math]\displaystyle{ p(I^D, \theta) = \sum_{a \in \mathcal{A}} p(I^D,\theta\mid I_a) \pi_{\mathcal A}(a) \ . }[/math]

The conditional Gaussian model has been examined heavily for inexact matching in dense images and for landmark matching.

Dense emage matching

Model [math]\displaystyle{ I^D(x), x \in X }[/math] as a conditionally Gaussian random field conditioned, mean field, [math]\displaystyle{ \varphi_1 \cdot I \doteq I(\varphi_1^{-1}), \varphi_1 \in Diff_V }[/math]. For uniform variance the endpoint error terms plays the role of the log-conditional (only a function of the mean field) giving the endpoint term:

[math]\displaystyle{ -\log p(I^D \mid I(g)) \simeq E(\varphi_1) \doteq \frac{1}{2 \sigma^2} \| I^D - I \circ \varphi_1^{-1} \|^2. }[/math]

(Conditional-Gaussian)

Landmark matching

Model [math]\displaystyle{ Y = \{ y_1,y_2,\dots \} }[/math] as conditionally Gaussian with mean field [math]\displaystyle{ \varphi_1 (x_i), i=1,2,\dots, \varphi_1 \in \operatorname{Diff}_V }[/math], constant noise variance independent of landmarks. The log-conditional (only a function of the mean field) can be viewed as the endpoint term:

[math]\displaystyle{ -\log p(I^D \mid I(g))\simeq \operatorname{E}(\varphi_1) \doteq \frac{1}{2 \sigma^2}\sum_i \| y_i -\varphi_1(x_i) \|^2. }[/math]

MAP segmentation based on multiple atlases

The random orbit model for multiple atlases models the orbit of shapes as the union over multiple anatomical orbits generated from the group action of diffeomorphisms, [math]\displaystyle{ \mathcal{I} = \textstyle \bigcup_{a \in \mathcal{A}}\displaystyle \operatorname{Diff}_V \cdot I_a }[/math], with each atlas having a template and predefined segmentation field [math]\displaystyle{ (I_a,W_a),a = a_1,a_2,\ldots }[/math]. incorporating the parcellation into anatomical structures of the coordinate of the MRI.. The pairs are indexed over the voxel lattice [math]\displaystyle{ I_a(x_i),W_a(x_i), x_i \in X \subset {\mathbb R}^3 }[/math] with an MRI image and a dense labelling of every voxel coordinate. The anatomical labelling of parcellated structures are manual delineations by neuroanatomists.

The Bayes segmentation problem is given measurement [math]\displaystyle{ I^D }[/math] with mean field and parcellation [math]\displaystyle{ (I,W) }[/math], the anatomical labelling [math]\displaystyle{ \theta \doteq W }[/math]. mustg be estimated for the measured MRI image. The mean-field of the observable [math]\displaystyle{ I^D }[/math] image is modelled as a random deformation from one of the templates [math]\displaystyle{ I \doteq \varphi \cdot I_a }[/math], which is also randomly selected, [math]\displaystyle{ A = a }[/math],. The optimal diffeomorphism [math]\displaystyle{ \varphi \in \mathcal{G} }[/math] is hidden and acts on the background space of coordinates of the randomly selected template image [math]\displaystyle{ I_a }[/math]. Given a single atlas [math]\displaystyle{ a }[/math], the likelihood model for inference is determined by the joint probability [math]\displaystyle{ p(I^D,W\mid A = a) }[/math]; with multiple atlases, the fusion of the likelihood functions yields the multi-modal mixture model with the prior averaging over models.

The MAP estimator of segmentation [math]\displaystyle{ W_a }[/math] is the maximizer [math]\displaystyle{ \max_{W} \log p(W \mid I^D) }[/math] given [math]\displaystyle{ I^D }[/math], which involves the mixture over all atlases.

[math]\displaystyle{ \hat W \doteq \arg \textstyle \max_W \displaystyle \log p(I^D,W) \text{ with } p(I^D,W) =\textstyle \sum_{a \in \mathcal{A}} \displaystyle p(I^D,W\mid A = a)\pi _A(a). }[/math]

The quantity [math]\displaystyle{ p(I^D,W) }[/math] is computed via a fusion of likelihoods from multiple deformable atlases, with [math]\displaystyle{ \pi _A(a) }[/math] being the prior probability that the observed image evolves from the specific template image [math]\displaystyle{ I_a }[/math].

The MAP segmentation can be iteratively solved via the expectation-maximization algorithm

[math]\displaystyle{ W^\text{new} \doteq \arg \max_W \int \log p(W,I^D,A, \varphi ) \, dp(A,\varphi \mid W^\text{old},I^D). }[/math]

MAP estimation of volume templates from populations and the EM algorithm

Generating templates empirically from populations is a fundamental operation ubiquitous to the discipline. Several methods based on Bayesian statistics have emerged for submanifolds and dense image volumes. For the dense image volume case, given the observable [math]\displaystyle{ I^{D_1}, I^{D_2}, \dots }[/math] the problem is to estimate the template in the orbit of dense images [math]\displaystyle{ I \in \mathcal{I} }[/math]. Ma's procedure takes an initial hypertemplate [math]\displaystyle{ I_0 \in \mathcal{I} }[/math] as the starting point, and models the template in the orbit under the unknown to be estimated diffeomorphism [math]\displaystyle{ I \doteq \varphi_0 \cdot I_0 }[/math], with the parameters to be estimated the log-coordinates [math]\displaystyle{ \theta \doteq v_0 }[/math] determining the geodesic mapping of the hyper-template [math]\displaystyle{ \operatorname{Exp}_\mathrm{id}(v_0) \cdot I_0 = I \in \mathcal{I} }[/math].

In the Bayesian random orbit model of computational anatomy the observed MRI images [math]\displaystyle{ I^{D_i} }[/math] are modelled as a conditionally Gaussian random field with mean field [math]\displaystyle{ \varphi_i \cdot I }[/math], with [math]\displaystyle{ \varphi_i }[/math] a random unknown transformation of the template. The MAP estimation problem is to estimate the unknown template [math]\displaystyle{ I \in \mathcal{I} }[/math] given the observed MRI images.

Ma's procedure for dense imagery takes an initial hypertemplate [math]\displaystyle{ I_0 \in \mathcal{I} }[/math] as the starting point, and models the template in the orbit under the unknown to be estimated diffeomorphism [math]\displaystyle{ I \doteq \varphi_0 \cdot I_0 }[/math]. The observables are modelled as conditional random fields, [math]\displaystyle{ I^{D_i} }[/math] a conditional-Gaussian random field with mean field [math]\displaystyle{ \varphi_i \cdot I \doteq \varphi_i \cdot \varphi_0 \cdot I_0 }[/math]. The unknown variable to be estimated explicitly by MAP is the mapping of the hyper-template [math]\displaystyle{ \varphi_0 }[/math], with the other mappings considered as nuisance or hidden variables which are integrated out via the Bayes procedure. This is accomplished using the expectation-maximization algorithm.

The orbit-model is exploited by associating the unknown to be estimated flows to their log-coordinates [math]\displaystyle{ v_i,i=1,\dots }[/math] via the Riemannian geodesic log and exponential for computational anatomy the initial vector field in the tangent space at the identity so that [math]\displaystyle{ \operatorname{Exp}_\mathrm{id}(v_{i}) \doteq \varphi_i }[/math], with [math]\displaystyle{ \operatorname{Exp}_\mathrm{id}(v_{0}) }[/math] the mapping of the hyper-template. The MAP estimation problem becomes

[math]\displaystyle{ \max_{v_0} p(I^D, \theta = v_0) = \int p(I^D, \theta= v_0\mid v_1,v_2, \dots ) \pi(v_1,v_2, \dots ) \, dv }[/math]

The EM algorithm takes as complete data the vector-field coordinates parameterizing the mapping, [math]\displaystyle{ v_i,i=1,\dots }[/math] and compute iteratively the conditional-expectation

[math]\displaystyle{ \begin{cases} Q(\theta=v_0; \theta^\text{old}=v_0^\text{old}) & = - \operatorname{E} ( \log p(I^D, \theta=v_0 \mid v_1,v_2,\dots)\mid I^D, \theta^\text{old}) \\ & = - \| ( \bar I^\text{old} - I_0 \circ \operatorname{Exp}_\mathrm{id}(v_0)^{-1} ) \sqrt{\beta^\text{old}} \|^2 - \|v_0\|_V^2 \end{cases} }[/math]

• Compute new template maximizing Q-function, setting

[math]\displaystyle{ \theta^\text{new}\doteq v_0^\text{new} = \arg \max_{\theta = v_0} Q(\theta ; \theta^\text{old}=v_0^\text{old}) = - \left\| ( \bar I^\text{old} - I_0 \circ \operatorname{Exp}_\mathrm{id}(v_0)^{-1} ) \sqrt{\beta^\text{old}} \right\|^2 - \| v_0\|_V^2 }[/math]

• Compute the mode-approximation for the expectation updating the expected-values for the mode values:

[math]\displaystyle{ v_i^\text{new} = \arg \max_{v: \dot \varphi = v \circ \varphi } - \int_0^1 \| v_t \|_V^2 \, dt - \| I^{D_i} - I_0 \circ \operatorname{Exp}_\mathrm{id}(v_0^\text{old})^{-1} \circ \operatorname{Exp}_\mathrm{id}(v)^{-1} \|^2. i=1,2,\dots }[/math]

[math]\displaystyle{ \beta^\text{new} (x) = \sum_{i=1}^n | D \operatorname{Exp}_\mathrm{id}(v_i^\text{new})(x) |, \text{ with } \bar I^\text{new} (x) = \frac{ \sum_{i=1}^n I^{D_i} \circ \operatorname{Exp}_\mathrm{id}(v_i^\text{new}) | D \operatorname{Exp}_\mathrm{id}(v_i^\text{new})(x) | }{ \beta^\text{old}(x)} }[/math]