Padé approximant

Short description: 'Best' approximation of a function by a rational function of given order

Henri Padé

In mathematics, a Padé approximant is the "best" approximation of a function near a specific point by a rational function of given order. Under this technique, the approximant's power series agrees with the power series of the function it is approximating. The technique was developed around 1890 by Henri Padé, but goes back to Georg Frobenius, who introduced the idea and investigated the features of rational approximations of power series.

The Padé approximant often gives better approximation of the function than truncating its Taylor series, and it may still work where the Taylor series does not converge. For these reasons Padé approximants are used extensively in computer calculations. They have also been used as auxiliary functions in Diophantine approximation and transcendental number theory, though for sharp results ad hoc methods—in some sense inspired by the Padé theory—typically replace them. Since a Padé approximant is a rational function, an artificial singular point may occur as an approximation, but this can be avoided by Borel–Padé analysis.

The reason the Padé approximant tends to be a better approximation than a truncating Taylor series is clear from the viewpoint of the multi-point summation method. Since there are many cases in which the asymptotic expansion at infinity becomes 0 or a constant, it can be interpreted as the "incomplete two-point Padé approximation", in which the ordinary Padé approximation improves the method truncating a Taylor series.

Definition

Given a function f and two integers m ≥ 0 and n ≥ 1, the Padé approximant of order [m/n] is the rational function

[math]\displaystyle{ R(x) = \frac{\sum_{j=0}^m a_j x^j}{1 + \sum_{k=1}^n b_k x^k} = \frac{a_0 + a_1 x + a_2 x^2 + \dots + a_m x^m}{1 + b_1 x + b_2 x^2 + \dots + b_n x^n}, }[/math] which agrees with f(x) to the highest possible order, which amounts to [math]\displaystyle{ \begin{align} f(0) &= R(0), \\ f'(0) &= R'(0), \\ f''(0) &= R''(0), \\ &\mathrel{\;\vdots} \\ f^{(m+n)}(0) &= R^{(m+n)}(0). \end{align} }[/math]

Equivalently, if [math]\displaystyle{ R(x) }[/math] is expanded in a Maclaurin series (Taylor series at 0), its first [math]\displaystyle{ m + n }[/math] terms would equal the first [math]\displaystyle{ m + n }[/math] terms of [math]\displaystyle{ f(x) }[/math], and thus [math]\displaystyle{ f(x) - R(x) = c_{m+n+1} x^{m+n+1} + c_{m+n+2} x^{m+n+2} + \cdots }[/math]

When it exists, the Padé approximant is unique as a formal power series for the given m and n.

The Padé approximant defined above is also denoted as [math]\displaystyle{ [m/n]_f(x). }[/math]

Computation

For given x, Padé approximants can be computed by Wynn's epsilon algorithm and also other sequence transformations from the partial sums [math]\displaystyle{ T_N(x) = c_0 + c_1 x + c_2 x^2 + \cdots + c_N x^N }[/math] of the Taylor series of f, i.e., we have [math]\displaystyle{ c_k = \frac{f^{(k)}(0)}{k!}. }[/math] f can also be a formal power series, and, hence, Padé approximants can also be applied to the summation of divergent series.

One way to compute a Padé approximant is via the extended Euclidean algorithm for the polynomial greatest common divisor. The relation [math]\displaystyle{ R(x) = P(x)/Q(x) = T_{m+n}(x) \bmod x^{m+n+1} }[/math] is equivalent to the existence of some factor [math]\displaystyle{ K(x) }[/math] such that [math]\displaystyle{ P(x) = Q(x)T_{m+n}(x) + K(x)x^{m+n+1}, }[/math] which can be interpreted as the Bézout identity of one step in the computation of the extended greatest common divisor of the polynomials [math]\displaystyle{ T_{m+n}(x) }[/math] and [math]\displaystyle{ x^{m+n+1} }[/math].

Recall that, to compute the greatest common divisor of two polynomials p and q, one computes via long division the remainder sequence [math]\displaystyle{ r_0=p,\;r_1=q,\quad r_{k-1}= q_k r_k +r_{k+1}, }[/math] k = 1, 2, 3, ... with [math]\displaystyle{ \deg r_{k+1} \lt \deg r_k\, }[/math], until [math]\displaystyle{ r_{k+1} = 0 }[/math]. For the Bézout identities of the extended greatest common divisor one computes simultaneously the two polynomial sequences [math]\displaystyle{ u_0=1,\;v_0=0,\quad u_1=0,\;v_1=1,\quad u_{k+1}=u_{k-1}-q_k u_k,\;v_{k+1}=v_{k-1}-q_kv_k }[/math] to obtain in each step the Bézout identity [math]\displaystyle{ r_k(x) = u_k(x) p(x) + v_k(x) q(x). }[/math]

For the [m/n] approximant, one thus carries out the extended Euclidean algorithm for [math]\displaystyle{ r_0=x^{m+n+1},\;r_1=T_{m+n}(x) }[/math] and stops it at the last instant that [math]\displaystyle{ v_k }[/math] has degree n or smaller.

Then the polynomials [math]\displaystyle{ P=r_k,\;Q=v_k }[/math] give the [m/n] Padé approximant. If one were to compute all steps of the extended greatest common divisor computation, one would obtain an anti-diagonal of the Padé table.

Riemann–Padé zeta function

To study the resummation of a divergent series, say [math]\displaystyle{ \sum_{z=1}^\infty f(z), }[/math] it can be useful to introduce the Padé or simply rational zeta function as [math]\displaystyle{ \zeta_R(s) = \sum_{z=1}^\infty \frac{R(z)}{z^s}, }[/math] where [math]\displaystyle{ R(x) = [m/n]_f(x) }[/math] is the Padé approximation of order (m, n) of the function f(x). The zeta regularization value at s = 0 is taken to be the sum of the divergent series.

The functional equation for this Padé zeta function is [math]\displaystyle{ \sum_{j=0}^n a_j \zeta_R(s-j) = \sum_{j=0}^m b_j \zeta_0(s-j), }[/math] where a_j and b_j are the coefficients in the Padé approximation. The subscript '0' means that the Padé is of order [0/0] and hence, we have the Riemann zeta function.

DLog Padé method

Padé approximants can be used to extract critical points and exponents of functions. In thermodynamics, if a function f(x) behaves in a non-analytic way near a point x = r like [math]\displaystyle{ f(x) \sim |x - r|^p }[/math], one calls x = r a critical point and p the associated critical exponent of f. If sufficient terms of the series expansion of f are known, one can approximately extract the critical points and the critical exponents from respectively the poles and residues of the Padé approximants [math]\displaystyle{ [n/n+1]_g(x) }[/math], where [math]\displaystyle{ g = f'/f }[/math].

Generalizations

A Padé approximant approximates a function in one variable. An approximant in two variables is called a Chisholm approximant (after J. S. R. Chisholm), in multiple variables a Canterbury approximant (after Graves-Morris at the University of Kent).

Two-points Padé approximant

The conventional Padé approximation is determined to reproduce the Maclaurin expansion up to a given order. Therefore, the approximation at the value apart from the expansion point may be poor. This is avoided by the 2-point Padé approximation, which is a type of multipoint summation method. At [math]\displaystyle{ x = 0 }[/math], consider a case that a function [math]\displaystyle{ f(x) }[/math] which is expressed by asymptotic behavior [math]\displaystyle{ f_0(x) }[/math]: [math]\displaystyle{ f \sim f_0(x) + o\big(f_0(x)\big), \quad x \to 0, }[/math] and at [math]\displaystyle{ x \to \infty }[/math], additional asymptotic behavior [math]\displaystyle{ f_\infty(x) }[/math]: [math]\displaystyle{ f(x) \sim f_\infty(x) + o\big(f_\infty(x)\big), \quad x \to \infty. }[/math]

By selecting the major behavior of [math]\displaystyle{ f_0(x), f_\infty(x) }[/math], approximate functions [math]\displaystyle{ F(x) }[/math] such that simultaneously reproduce asymptotic behavior by developing the Padé approximation can be found in various cases. As a result, at the point [math]\displaystyle{ x \to \infty }[/math], where the accuracy of the approximation may be the worst in the ordinary Padé approximation, good accuracy of the 2-point Padé approximant is guaranteed. Therefore, the 2-point Padé approximant can be a method that gives a good approximation globally for [math]\displaystyle{ x = 0 \sim \infty }[/math].

In cases where [math]\displaystyle{ f_0(x), f_\infty(x) }[/math] are expressed by polynomials or series of negative powers, exponential function, logarithmic function or [math]\displaystyle{ x \ln x }[/math], we can apply 2-point Padé approximant to [math]\displaystyle{ f(x) }[/math]. There is a method of using this to give an approximate solution of a differential equation with high accuracy. Also, for the nontrivial zeros of the Riemann zeta function, the first nontrivial zero can be estimated with some accuracy from the asymptotic behavior on the real axis.

Multi-point Padé approximant

A further extension of the 2-point Padé approximant is the multi-point Padé approximant. This method treats singularity points [math]\displaystyle{ x = x_j(j = 1, 2, 3, \dots, N) }[/math] of a function [math]\displaystyle{ f(x) }[/math] which is to be approximated. Consider the cases when singularities of a function are expressed with index [math]\displaystyle{ n_j }[/math] by [math]\displaystyle{ f(x) \sim \frac{A_j}{(x - x_j)^{n_j}}, \quad x \to x_j. }[/math]

Besides the 2-point Padé approximant, which includes information at [math]\displaystyle{ x = 0, x \to \infty }[/math], this method approximates to reduce the property of diverging at [math]\displaystyle{ x \sim x_j }[/math]. As a result, since the information of the peculiarity of the function is captured, the approximation of a function [math]\displaystyle{ f(x) }[/math] can be performed with higher accuracy.

Examples

sin(x)

[math]\displaystyle{ \sin(x) \approx \frac{ \frac{12671}{4363920} x^5 - \frac{2363}{18183} x^3 + x }{ 1+ \frac{445}{12122} x^2 + \frac{601}{872784} x^4 + \frac{121}{16662240} x^6} }[/math]

exp(x)

[math]\displaystyle{ \exp(x) \approx \frac{1 + \frac{1}{2} x + \frac{1}{9} x^2 + \frac{1}{72} x^3 + \frac{1}{1008} x^4 + \frac{1}{30240} x^5}{1 - \frac{1}{2} x + \frac{1}{9} x^2 - \frac{1}{72} x^3 + \frac{1}{1008} x^4 - \frac{1}{30240} x^5 } }[/math]

log(1+x)

[math]\displaystyle{ \log(1+x) \approx \frac{x + \frac 1 2 x^2}{1 + x + \frac 1 6 x^2} }[/math]

Jacobi sn(z|3)

[math]\displaystyle{ \mathrm{sn}(z|3) \approx \frac{ - \frac{9851629}{283609260} z^5 - \frac{572744}{4726821} z^3 + z }{ 1 + \frac{859490}{1575607} z^2 - \frac{5922035}{56721852} z^4 + \frac{62531591}{2977897230} z^6 } }[/math]

Bessel J₅(x)

[math]\displaystyle{ J_5(x) \approx \frac{- \frac{107}{28416000} x^7 + \frac{1}{3840} x^5 }{ 1 + \frac{151}{5550} x^2 + \frac{1453}{3729600} x^4 + \frac{1339}{358041600} x^6 + \frac{2767}{120301977600} x^8 } }[/math]

erf(x)

[math]\displaystyle{ \operatorname{erf}(x) \approx \frac{2}{15\sqrt\pi} \cdot \frac{ 49140 x + 3570 x^3 + 739 x^5 }{ 165 x^4 + 1330 x^2 + 3276 } }[/math]

Fresnel C(x)

[math]\displaystyle{ C(x) \approx \frac{1}{135} \cdot \frac{ 990791\pi^4 x^9 - 147189744\pi^2 x^5 + 8714684160 x }{ 1749\pi^4 x^8 + 523536\pi^2 x^4 + 64553216 } }[/math]

See also

• Padé table
• Bhaskara I's sine approximation formula

Literature

• Baker, G. A., Jr.; and Graves-Morris, P. Padé Approximants. Cambridge University Press , 1996.
• Baker, G. A., Jr. Padé approximant, Scholarpedia, 7(6):9756.
• Brezinski, C.; Redivo Zaglia, M. Extrapolation Methods. Theory and Practice. North-Holland, 1991. ISBN:978-0444888143
• Press, W. H.; Teukolsky, S. A.; Vetterling, W. T.; Flannery, B. P. (2007), "Section 5.12 Padé Approximants", Numerical Recipes: The Art of Scientific Computing (3rd ed.), New York: Cambridge University Press, ISBN 978-0-521-88068-8, http://apps.nrbook.com/empanel/index.html?pg=245 .
• Frobenius, G.; Ueber Relationen zwischen den Näherungsbrüchen von Potenzreihen, [Journal für die reine und angewandte Mathematik (Crelle's Journal)]. Volume 1881, Issue 90, Pages 1–17.
• Gragg, W. B.; The Pade Table and Its Relation to Certain Algorithms of Numerical Analysis [SIAM Review], Vol. 14, No. 1, 1972, pp. 1–62.
• Padé, H.; Sur la répresentation approchée d'une fonction par des fractions rationelles, Thesis, [Ann. École Nor. (3), 9, 1892, pp. 1–93 supplement.
• Wynn, P. (1966), "Upon systems of recursions which obtain among the quotients of the Padé table", Numerische Mathematik 8 (3): 264–269, doi:10.1007/BF02162562 .

External links

• Weisstein, Eric W.. "Padé Approximant". http://mathworld.wolfram.com/PadeApproximant.html. 
• Padé Approximants, Oleksandr Pavlyk, The Wolfram Demonstrations Project.
• Data Analysis BriefBook: Pade Approximation, Rudolf K. Bock European Laboratory for Particle Physics, CERN.
• Sinewave, Scott Dattalo, last accessed 2010-11-11.
• MATLAB function for Padé approximation of models with time delays.