Carleman matrix

From HandWiki

In mathematics, a Carleman matrix is a matrix used to convert function composition into matrix multiplication. It is often used in iteration theory to find the continuous iteration of functions which cannot be iterated by pattern recognition alone. Other uses of Carleman matrices occur in the theory of probability generating functions, and Markov chains.

Definition

The Carleman matrix of an infinitely differentiable function [math]\displaystyle{ f(x) }[/math] is defined as:

[math]\displaystyle{ M[f]_{jk} = \frac{1}{k!}\left[\frac{d^k}{dx^k} (f(x))^j \right]_{x=0} ~, }[/math]

so as to satisfy the (Taylor series) equation:

[math]\displaystyle{ (f(x))^j = \sum_{k=0}^{\infty} M[f]_{jk} x^k. }[/math]

For instance, the computation of [math]\displaystyle{ f(x) }[/math] by

[math]\displaystyle{ f(x) = \sum_{k=0}^{\infty} M[f]_{1,k} x^k. ~ }[/math]

simply amounts to the dot-product of row 1 of [math]\displaystyle{ M[f] }[/math] with a column vector [math]\displaystyle{ \left[1,x,x^2,x^3,...\right]^\tau }[/math].

The entries of [math]\displaystyle{ M[f] }[/math] in the next row give the 2nd power of [math]\displaystyle{ f(x) }[/math]:

[math]\displaystyle{ f(x)^2 = \sum_{k=0}^{\infty} M[f]_{2,k} x^k ~, }[/math]

and also, in order to have the zeroth power of [math]\displaystyle{ f(x) }[/math] in [math]\displaystyle{ M[f] }[/math], we adopt the row 0 containing zeros everywhere except the first position, such that

[math]\displaystyle{ f(x)^0 = 1 = \sum_{k=0}^{\infty} M[f]_{0,k} x^k = 1+ \sum_{k=1}^{\infty} 0* x^k ~. }[/math]

Thus, the dot product of [math]\displaystyle{ M[f] }[/math] with the column vector [math]\displaystyle{ \left[1,x,x^2,...\right]^\tau }[/math] yields the column vector [math]\displaystyle{ \left[1,f(x),f(x)^2,...\right]^\tau }[/math]

[math]\displaystyle{ M[f] * \left[ 1,x,x^2,x^3,...\right]^\tau = \left[ 1,f(x),(f(x))^2,(f(x))^3,...\right]^\tau. }[/math]

Generalization

A generalization of the Carleman matrix of a function can be defined around any point, such as:

[math]\displaystyle{ M[f]_{x_0} = M_x[x - x_0]M[f]M_x[x + x_0] }[/math]

or [math]\displaystyle{ M[f]_{x_0} = M[g] }[/math] where [math]\displaystyle{ g(x) = f(x + x_0) - x_0 }[/math]. This allows the matrix power to be related as:

[math]\displaystyle{ (M[f]_{x_0})^n = M_x[x - x_0]M[f]^nM_x[x + x_0] }[/math]

General Series

Another way to generalize it even further is think about a general series in the following way:
Let [math]\displaystyle{ f(x) = \sum_n c_n (f) \cdot \psi_n(x) }[/math] be a series approximation of [math]\displaystyle{ f(x) }[/math], where [math]\displaystyle{ \{\psi_n(x)\}_n }[/math] is a basis of the space containing [math]\displaystyle{ f(x) }[/math]
We can define [math]\displaystyle{ G[f]_{mn} = c_n(\psi_m \circ f) }[/math], therefore we have [math]\displaystyle{ \psi_m \circ f = \sum_n c_n (\psi_m \circ f) \cdot \psi_n = \sum_n G[f]_{mn} \cdot \psi_n }[/math], now we can prove that [math]\displaystyle{ G[g \circ f] = G[g] \cdot G[f] }[/math], if we assume that [math]\displaystyle{ \{\psi_n(x)\}_n }[/math] is also a basis for [math]\displaystyle{ g(x) }[/math] and [math]\displaystyle{ g(f(x)) }[/math].
Let [math]\displaystyle{ g(x) }[/math] be such that [math]\displaystyle{ \psi_l \circ g = \sum_m G[g]_{lm} \cdot \psi_m }[/math] where [math]\displaystyle{ G[g]_{lm} = c_m (\psi_l \circ g) }[/math].
Now [math]\displaystyle{ \sum_n G[g \circ f]_{mn} \psi_n = \psi_l \circ (g \circ f) = (\psi_l \circ g) \circ f = \sum_m G[g]_{lm} (\psi_m \circ f) = \sum_m G[g]_{lm} \sum_n G[f]_{mn} \psi_n = \sum_{n,m} G[g]_{lm} G[f]_{mn} \psi_n = \sum_{n} (\sum_m G[g]_{lm} G[f]_{mn}) \psi_n }[/math]
Comparing the first and the last term, and from [math]\displaystyle{ \{\psi_n(x)\}_n }[/math] being a base for [math]\displaystyle{ f(x) }[/math], [math]\displaystyle{ g(x) }[/math] and [math]\displaystyle{ g(f(x)) }[/math] it follows that [math]\displaystyle{ G[g \circ f] =\sum_m G[g]_{lm} G[f]_{mn}= G[g] \cdot G[f] }[/math]

Examples

If we set [math]\displaystyle{ \psi_n(x) = x^n }[/math] we have the Carleman matrix

If [math]\displaystyle{ \{e_n(x)\}_n }[/math] is an orthonormal basis for a Hilbert Space with a defined inner product [math]\displaystyle{ \langle f,g \rangle }[/math], we can set [math]\displaystyle{ \psi_n = e_n }[/math] and [math]\displaystyle{ c_n (f) }[/math] will be [math]\displaystyle{ {\displaystyle \langle f, e_n \rangle } }[/math]. If [math]\displaystyle{ e_n(x) = e^{\sqrt{-1} n x} }[/math] we have the analogous for Fourier Series, namely [math]\displaystyle{ c_n (f) = \cfrac{1}{2\pi} \int_{-\pi}^{\pi} \displaystyle f(x) \cdot e^{-\sqrt{-1}nx}dx }[/math]

Properties

Carleman matrices satisfy the fundamental relationship

  • [math]\displaystyle{ M[f \circ g] = M[f]M[g] ~, }[/math]

which makes the Carleman matrix M a (direct) representation of [math]\displaystyle{ f(x) }[/math]. Here the term [math]\displaystyle{ f \circ g }[/math] denotes the composition of functions [math]\displaystyle{ f(g(x)) }[/math].

Other properties include:

  • [math]\displaystyle{ \,M[f^n] = M[f]^n }[/math], where [math]\displaystyle{ \,f^n }[/math] is an iterated function and
  • [math]\displaystyle{ \,M[f^{-1}] = M[f]^{-1} }[/math], where [math]\displaystyle{ \,f^{-1} }[/math] is the inverse function (if the Carleman matrix is invertible).

Examples

The Carleman matrix of a constant is:

[math]\displaystyle{ M[a] = \left(\begin{array}{cccc} 1&0&0& \cdots \\ a&0&0& \cdots \\ a^2&0&0& \cdots \\ \vdots&\vdots&\vdots&\ddots \end{array}\right) }[/math]

The Carleman matrix of the identity function is:

[math]\displaystyle{ M_x[x] = \left(\begin{array}{cccc} 1&0&0& \cdots \\ 0&1&0& \cdots \\ 0&0&1& \cdots \\ \vdots&\vdots&\vdots&\ddots \end{array}\right) }[/math]

The Carleman matrix of a constant addition is:

[math]\displaystyle{ M_x[a + x] = \left(\begin{array}{cccc} 1&0&0& \cdots \\ a&1&0& \cdots \\ a^2&2a&1& \cdots \\ \vdots&\vdots&\vdots&\ddots \end{array}\right) }[/math]

The Carleman matrix of the successor function is equivalent to the Binomial coefficient:

[math]\displaystyle{ M_x[1 + x] = \left(\begin{array}{ccccc} 1&0&0&0& \cdots \\ 1&1&0&0& \cdots \\ 1&2&1&0& \cdots \\ 1&3&3&1& \cdots \\ \vdots&\vdots&\vdots&\vdots&\ddots \end{array}\right) }[/math]
[math]\displaystyle{ M_x[1 + x]_{jk} = \binom{j}{k} }[/math]

The Carleman matrix of the logarithm is related to the (signed) Stirling numbers of the first kind scaled by factorials:

[math]\displaystyle{ M_x[\log(1 + x)] = \left(\begin{array}{cccccc} 1&0&0&0&0& \cdots \\ 0&1&-\frac{1}{2}&\frac{1}{3}&-\frac{1}{4}& \cdots \\ 0&0&1&-1&\frac{11}{12}& \cdots \\ 0&0&0&1&-\frac{3}{2}& \cdots \\ 0&0&0&0&1& \cdots \\ \vdots&\vdots&\vdots&\vdots&\vdots&\ddots \end{array}\right) }[/math]
[math]\displaystyle{ M_x[\log(1 + x)]_{jk} = s(k, j) \frac{j!}{k!} }[/math]

The Carleman matrix of the logarithm is related to the (unsigned) Stirling numbers of the first kind scaled by factorials:

[math]\displaystyle{ M_x[-\log(1 - x)] = \left(\begin{array}{cccccc} 1&0&0&0&0& \cdots \\ 0&1&\frac{1}{2}&\frac{1}{3}&\frac{1}{4}& \cdots \\ 0&0&1&1&\frac{11}{12}& \cdots \\ 0&0&0&1&\frac{3}{2}& \cdots \\ 0&0&0&0&1& \cdots \\ \vdots&\vdots&\vdots&\vdots&\vdots&\ddots \end{array}\right) }[/math]
[math]\displaystyle{ M_x[-\log(1 - x)]_{jk} = |s(k, j)| \frac{j!}{k!} }[/math]

The Carleman matrix of the exponential function is related to the Stirling numbers of the second kind scaled by factorials:

[math]\displaystyle{ M_x[\exp(x) - 1] = \left(\begin{array}{cccccc} 1&0&0&0&0& \cdots \\ 0&1&\frac{1}{2}&\frac{1}{6}&\frac{1}{24}& \cdots \\ 0&0&1&1&\frac{7}{12}& \cdots \\ 0&0&0&1&\frac{3}{2}& \cdots \\ 0&0&0&0&1& \cdots \\ \vdots&\vdots&\vdots&\vdots&\vdots&\ddots \end{array}\right) }[/math]
[math]\displaystyle{ M_x[\exp(x) - 1]_{jk} = S(k, j) \frac{j!}{k!} }[/math]

The Carleman matrix of exponential functions is:

[math]\displaystyle{ M_x[\exp(a x)] = \left(\begin{array}{ccccc} 1&0&0&0& \cdots \\ 1&a&\frac{a^2}{2}&\frac{a^3}{6}& \cdots \\ 1&2a&2a^2&\frac{4a^3}{3}& \cdots \\ 1&3a&\frac{9a^2}{2}&\frac{9a^3}{2}& \cdots \\ \vdots&\vdots&\vdots&\vdots&\ddots \end{array}\right) }[/math]
[math]\displaystyle{ M_x[\exp(a x)]_{jk} = \frac{(j a)^k}{k!} }[/math]

The Carleman matrix of a constant multiple is:

[math]\displaystyle{ M_x[cx] = \left(\begin{array}{cccc} 1&0&0& \cdots \\ 0&c&0& \cdots \\ 0&0&c^2& \cdots \\ \vdots&\vdots&\vdots&\ddots \end{array}\right) }[/math]

The Carleman matrix of a linear function is:

[math]\displaystyle{ M_x[a + cx] = \left(\begin{array}{cccc} 1&0&0& \cdots \\ a&c&0& \cdots \\ a^2&2ac&c^2& \cdots \\ \vdots&\vdots&\vdots&\ddots \end{array}\right) }[/math]

The Carleman matrix of a function [math]\displaystyle{ f(x) = \sum_{k=1}^{\infty}f_k x^k }[/math] is:

[math]\displaystyle{ M[f] = \left(\begin{array}{cccc} 1&0&0& \cdots \\ 0&f_1&f_2& \cdots \\ 0&0&f_1^2& \cdots \\ \vdots&\vdots&\vdots&\ddots \end{array}\right) }[/math]

The Carleman matrix of a function [math]\displaystyle{ f(x) = \sum_{k=0}^{\infty}f_k x^k }[/math] is:

[math]\displaystyle{ M[f] = \left(\begin{array}{cccc} 1&0&0& \cdots \\ f_0&f_1&f_2& \cdots \\ f_0^2&2f_0f_1&f_1^2+2f_0f_2& \cdots \\ \vdots&\vdots&\vdots&\ddots \end{array}\right) }[/math]

Related matrices

The Bell matrix or the Jabotinsky matrix of a function [math]\displaystyle{ f(x) }[/math] is defined as[1][2][3]

[math]\displaystyle{ B[f]_{jk} = \frac{1}{j!}\left[\frac{d^j}{dx^j} (f(x))^k \right]_{x=0} ~, }[/math]

so as to satisfy the equation

[math]\displaystyle{ (f(x))^k = \sum_{j=0}^{\infty} B[f]_{jk} x^j ~, }[/math]

These matrices were developed in 1947 by Eri Jabotinsky to represent convolutions of polynomials.[4] It is the transpose of the Carleman matrix and satisfy

[math]\displaystyle{ B[f \circ g] = B[g]B[f] ~, }[/math] which makes the Bell matrix B an anti-representation of [math]\displaystyle{ f(x) }[/math].

See also

Notes

  1. ↑ Knuth, D. (1992). "Convolution Polynomials". The Mathematica Journal 2 (4): 67–78. Bibcode: 1992math......7221K. 
  2. ↑ Jabotinsky, Eri (1953). "Representation of functions by matrices. Application to Faber polynomials" (in en). Proceedings of the American Mathematical Society 4 (4): 546–553. doi:10.1090/S0002-9939-1953-0059359-0. ISSN 0002-9939. https://www.ams.org/proc/1953-004-04/S0002-9939-1953-0059359-0/. 
  3. ↑ Lang, W. (2000). "On generalizations of the stirling number triangles". Journal of Integer Sequences 3 (2.4): 1–19. Bibcode: 2000JIntS...3...24L. 
  4. ↑ Jabotinsky, Eri (1947). "Sur la représentation de la composition de fonctions par un produit de matrices. Applicaton à l'itération de e^x et de e^x-1.". Comptes rendus de l'Académie des Sciences 224: 323–324. 

References



Retrieved from "https://handwiki.org/wiki/index.php?title=Carleman_matrix&oldid=3378073"