Galerkin method

From HandWiki
Short description: Method for solving continuous operator problems (such as differential equations)

In mathematics, in the area of numerical analysis, Galerkin methods are named after the Soviet mathematician Boris Galerkin. They convert a continuous operator problem, such as a differential equation, commonly in a weak formulation, to a discrete problem by applying linear constraints determined by finite sets of basis functions.

Often when referring to a Galerkin method, one also gives the name along with typical assumptions and approximation methods used:

Examples of Galerkin methods are:

Example: Matrix linear system

We first introduce and illustrate the Galerkin method as being applied to a system of linear equations [math]\displaystyle{ A\mathbf x = \mathbf b }[/math] with the following symmetric and positive definite matrix

[math]\displaystyle{ A = \begin{bmatrix} 2 & 0 & 0\\ 0 & 2 & 1\\ 0 & 1 & 2 \end{bmatrix} }[/math]

and the solution and right-hand-side vectors

[math]\displaystyle{ \mathbf x = \begin{bmatrix} 1 \\ 0 \\ 0 \end{bmatrix}, \quad \mathbf b = \begin{bmatrix} 2 \\ 0 \\ 0 \end{bmatrix}. }[/math]

Let us take

[math]\displaystyle{ V = \begin{bmatrix} 0 & 0\\ 1 & 0\\ 0 & 1 \end{bmatrix}, }[/math]

then the matrix of the Galerkin equation[clarification needed] is

[math]\displaystyle{ V^* A V = \begin{bmatrix} 2 & 1\\ 1 & 2 \end{bmatrix}, }[/math]

the right-hand-side vector of the Galerkin equation is

[math]\displaystyle{ V^* \mathbf b = \begin{bmatrix} 0 \\ 0 \end{bmatrix}, }[/math]

so that we obtain the solution vector

[math]\displaystyle{ \mathbf y = \begin{bmatrix} 0 \\ 0 \end{bmatrix} }[/math]

to the Galerkin equation [math]\displaystyle{ \left(V^* A V\right) \mathbf y = V^* \mathbf b }[/math], which we finally uplift[clarification needed] to determine the approximate solution to the original equation as

[math]\displaystyle{ V \mathbf y = \begin{bmatrix} 0 \\ 0 \\ 0 \end{bmatrix}. }[/math]

In this example, our original Hilbert space is actually the 3-dimensional Euclidean space [math]\displaystyle{ \mathbb{R}^3 }[/math] equipped with the standard scalar product [math]\displaystyle{ (\mathbf u, \mathbf v) = \mathbf u^T \mathbf v }[/math], our 3-by-3 matrix [math]\displaystyle{ A }[/math] defines the bilinear form [math]\displaystyle{ a(\mathbf u, \mathbf v) = \mathbf u^T A \mathbf v }[/math], and the right-hand-side vector [math]\displaystyle{ \mathbf b }[/math] defines the bounded linear functional [math]\displaystyle{ f(\mathbf v) = \mathbf b^T \mathbf v }[/math]. The columns

[math]\displaystyle{ \mathbf e_1 = \begin{bmatrix} 0\\ 1\\ 0 \end{bmatrix} \quad \mathbf e_2 = \begin{bmatrix} 0\\ 0\\ 1 \end{bmatrix}, }[/math]

of the matrix [math]\displaystyle{ V }[/math] form an orthonormal basis of the 2-dimensional subspace of the Galerkin projection. The entries of the 2-by-2 Galerkin matrix [math]\displaystyle{ V^* A V }[/math] are [math]\displaystyle{ a(e_j, e_i),\, i, j = 1, 2 }[/math], while the components of the right-hand-side vector [math]\displaystyle{ V^* \mathbf b }[/math] of the Galerkin equation are [math]\displaystyle{ f(e_i),\, i = 1, 2 }[/math]. Finally, the approximate solution [math]\displaystyle{ V \mathbf y }[/math] is obtained from the components of the solution vector [math]\displaystyle{ \mathbf y }[/math] of the Galerkin equation and the basis as [math]\displaystyle{ \sum_{j=1}^2 y_j \mathbf e_j }[/math].

Linear equation in a Hilbert space

Weak formulation of a linear equation

Let us introduce Galerkin's method with an abstract problem posed as a weak formulation on a Hilbert space [math]\displaystyle{ V }[/math], namely,

find [math]\displaystyle{ u\in V }[/math] such that for all [math]\displaystyle{ v\in V, a(u,v) = f(v) }[/math].

Here, [math]\displaystyle{ a(\cdot,\cdot) }[/math] is a bilinear form (the exact requirements on [math]\displaystyle{ a(\cdot,\cdot) }[/math] will be specified later) and [math]\displaystyle{ f }[/math] is a bounded linear functional on [math]\displaystyle{ V }[/math].

Galerkin dimension reduction

Choose a subspace [math]\displaystyle{ V_n \subset V }[/math] of dimension n and solve the projected problem:

Find [math]\displaystyle{ u_n\in V_n }[/math] such that for all [math]\displaystyle{ v_n\in V_n, a(u_n,v_n) = f(v_n) }[/math].

We call this the Galerkin equation. Notice that the equation has remained unchanged and only the spaces have changed. Reducing the problem to a finite-dimensional vector subspace allows us to numerically compute [math]\displaystyle{ u_n }[/math] as a finite linear combination of the basis vectors in [math]\displaystyle{ V_n }[/math].

Galerkin orthogonality

The key property of the Galerkin approach is that the error is orthogonal to the chosen subspaces. Since [math]\displaystyle{ V_n \subset V }[/math], we can use [math]\displaystyle{ v_n }[/math] as a test vector in the original equation. Subtracting the two, we get the Galerkin orthogonality relation for the error, [math]\displaystyle{ \epsilon_n = u-u_n }[/math] which is the error between the solution of the original problem, [math]\displaystyle{ u }[/math], and the solution of the Galerkin equation, [math]\displaystyle{ u_n }[/math]

[math]\displaystyle{ a(\epsilon_n, v_n) = a(u,v_n) - a(u_n, v_n) = f(v_n) - f(v_n) = 0. }[/math]

Matrix form of Galerkin's equation

Since the aim of Galerkin's method is the production of a linear system of equations, we build its matrix form, which can be used to compute the solution algorithmically.

Let [math]\displaystyle{ e_1, e_2,\ldots,e_n }[/math] be a basis for [math]\displaystyle{ V_n }[/math]. Then, it is sufficient to use these in turn for testing the Galerkin equation, i.e.: find [math]\displaystyle{ u_n \in V_n }[/math] such that

[math]\displaystyle{ a(u_n, e_i) = f(e_i) \quad i=1,\ldots,n. }[/math]

We expand [math]\displaystyle{ u_n }[/math] with respect to this basis, [math]\displaystyle{ u_n = \sum_{j=1}^n u_je_j }[/math] and insert it into the equation above, to obtain

[math]\displaystyle{ a\left(\sum_{j=1}^n u_je_j, e_i\right) = \sum_{j=1}^n u_j a(e_j, e_i) = f(e_i) \quad i=1,\ldots,n. }[/math]

This previous equation is actually a linear system of equations [math]\displaystyle{ Au=f }[/math], where

[math]\displaystyle{ A_{ij} = a(e_j, e_i), \quad f_i = f(e_i). }[/math]

Symmetry of the matrix

Due to the definition of the matrix entries, the matrix of the Galerkin equation is symmetric if and only if the bilinear form [math]\displaystyle{ a(\cdot,\cdot) }[/math] is symmetric.

Analysis of Galerkin methods

Here, we will restrict ourselves to symmetric bilinear forms, that is

[math]\displaystyle{ a(u,v) = a(v,u). }[/math]

While this is not really a restriction of Galerkin methods, the application of the standard theory becomes much simpler. Furthermore, a Petrov–Galerkin method may be required in the nonsymmetric case.

The analysis of these methods proceeds in two steps. First, we will show that the Galerkin equation is a well-posed problem in the sense of Hadamard and therefore admits a unique solution. In the second step, we study the quality of approximation of the Galerkin solution [math]\displaystyle{ u_n }[/math].

The analysis will mostly rest on two properties of the bilinear form, namely

  • Boundedness: for all [math]\displaystyle{ u,v\in V }[/math] holds
    [math]\displaystyle{ a(u,v) \le C \|u\|\, \|v\| }[/math] for some constant [math]\displaystyle{ C\gt 0 }[/math]
  • Ellipticity: for all [math]\displaystyle{ u\in V }[/math] holds
    [math]\displaystyle{ a(u,u) \ge c \|u\|^2 }[/math] for some constant [math]\displaystyle{ c\gt 0. }[/math]

By the Lax-Milgram theorem (see weak formulation), these two conditions imply well-posedness of the original problem in weak formulation. All norms in the following sections will be norms for which the above inequalities hold (these norms are often called an energy norm).

Well-posedness of the Galerkin equation

Since [math]\displaystyle{ V_n \subset V }[/math], boundedness and ellipticity of the bilinear form apply to [math]\displaystyle{ V_n }[/math]. Therefore, the well-posedness of the Galerkin problem is actually inherited from the well-posedness of the original problem.

Quasi-best approximation (Céa's lemma)

Main page: Céa's lemma

The error [math]\displaystyle{ u-u_n }[/math] between the original and the Galerkin solution admits the estimate

[math]\displaystyle{ \|u-u_n\| \le \frac{C}{c} \inf_{v_n\in V_n} \|u-v_n\|. }[/math]

This means, that up to the constant [math]\displaystyle{ C/c }[/math], the Galerkin solution [math]\displaystyle{ u_n }[/math] is as close to the original solution [math]\displaystyle{ u }[/math] as any other vector in [math]\displaystyle{ V_n }[/math]. In particular, it will be sufficient to study approximation by spaces [math]\displaystyle{ V_n }[/math], completely forgetting about the equation being solved.

Proof

Since the proof is very simple and the basic principle behind all Galerkin methods, we include it here: by ellipticity and boundedness of the bilinear form (inequalities) and Galerkin orthogonality (equals sign in the middle), we have for arbitrary [math]\displaystyle{ v_n\in V_n }[/math]:

[math]\displaystyle{ c\|u-u_n\|^2 \le a(u-u_n, u-u_n) = a(u-u_n, u-v_n) \le C \|u-u_n\| \, \|u-v_n\|. }[/math]

Dividing by [math]\displaystyle{ c \|u-u_n\| }[/math] and taking the infimum over all possible [math]\displaystyle{ v_n }[/math] yields the lemma.

Galerkin's best approximation property in the energy norm

For simplicity of presentation in the section above we have assumed that the bilinear form [math]\displaystyle{ a(u, v) }[/math] is symmetric and positive definite, which implies that it is a scalar product and the expression [math]\displaystyle{ \|u\|_a=\sqrt{a(u, u)} }[/math] is actually a valid vector norm, called the energy norm. Under these assumptions one can easily prove in addition Galerkin's best approximation property in the energy norm.

Using Galerkin a-orthogonality and the Cauchy–Schwarz inequality for the energy norm, we obtain

[math]\displaystyle{ \|u-u_n\|_a^2 = a(u-u_n, u-u_n) = a(u-u_n, u-v_n) \le \|u-u_n\|_a \, \|u-v_n\|_a. }[/math]

Dividing by [math]\displaystyle{ \|u-u_n\|_a }[/math] and taking the infimum over all possible [math]\displaystyle{ v_n\in V_n }[/math] proves that the Galerkin approximation [math]\displaystyle{ u_n\in V_n }[/math] is the best approximation in the energy norm within the subspace [math]\displaystyle{ V_n \subset V }[/math], i.e. [math]\displaystyle{ u_n\in V_n }[/math] is nothing but the orthogonal, with respect to the scalar product [math]\displaystyle{ a(u, v) }[/math], projection of the solution [math]\displaystyle{ u }[/math] to the subspace [math]\displaystyle{ V_n }[/math].

Galerkin method for stepped Structures

I. Elishakof, M. Amato, A. Marzani, P.A. Arvan, and J.N. Reddy [6] [7] [8] [9] studied the application of the Galerkin method to stepped structures. They showed that the generalized function, namely unit-step function, Dirac’s delta function, and the doublet function are needed for obtaining accurate results.

History

The approach is usually credited to Boris Galerkin.[10][11] The method was explained to the Western reader by Hencky[12] and Duncan[13][14] among others. Its convergence was studied by Mikhlin[15] and Leipholz[16][17][18][19] Its coincidence with Fourier method was illustrated by Elishakoff et al.[20][21][22] Its equivalence to Ritz's method for conservative problems was shown by Singer.[23] Gander and Wanner[24] showed how Ritz and Galerkin methods led to the modern finite element method. One hundred years of method's development was discussed by Repin.[25] Elishakoff, Kaplunov and Kaplunov[26] show that the Galerkin’s method was not developed by Ritz, contrary to the Timoshenko’s statements.

See also

References

  1. A. Ern, J.L. Guermond, Theory and practice of finite elements, Springer, 2004, ISBN:0-387-20574-8
  2. "Georgii Ivanovich Petrov (on his 100th birthday)", Fluid Dynamics, May 2012, Volume 47, Issue 3, pp 289-291, DOI 10.1134/S0015462812030015
  3. S. Brenner, R. L. Scott, The Mathematical Theory of Finite Element Methods, 2nd edition, Springer, 2005, ISBN:0-387-95451-1
  4. P. G. Ciarlet, The Finite Element Method for Elliptic Problems, North-Holland, 1978, ISBN:0-444-85028-7
  5. Y. Saad, Iterative Methods for Sparse Linear Systems, 2nd edition, SIAM, 2003, ISBN:0-89871-534-2
  6. Elishakoff, I., Amato, M., Ankitha, A. P., & Marzani, A. (2021). Rigorous implementation of the Galerkin method for stepped structures needs generalized functions. Journal of Sound and Vibration, 490, 115708.
  7. Elishakoff, I., Amato, M., & Marzani, A. (2021). Galerkin’s method revisited and corrected in the problem of Jaworsky and Dowell. Mechanical Systems and Signal Processing, 155, 107604.
  8. Elishakoff, I., & Amato, M. (2021). Flutter of a beam in supersonic flow: truncated version of Timoshenko–Ehrenfest equation is sufficient. International Journal of Mechanics and Materials in Design, 1-17.
  9. Amato, M., Elishakoff, I., & Reddy, J. N. (2021). Flutter of a Multicomponent Beam in a Supersonic Flow. AIAA Journal, 59(11), 4342-4353.
  10. Galerkin, B.G.,1915, Rods and Plates, Series Occurring in Various Questions Concerning the Elastic Equilibrium of Rods and Plates, Vestnik Inzhenerov i Tekhnikov, (Engineers and Technologists Bulletin), Vol. 19, 897-908 (in Russian),(English Translation: 63-18925, Clearinghouse Fed. Sci. Tech. Info.1963).
  11. "Le destin douloureux de Walther Ritz (1878-1909)", (Jean-Claude Pont, editor), Cahiers de Vallesia, 24, (2012), ISBN:978-2-9700636-5-0
  12. Hencky H.,1927, Eine wichtige Vereinfachung der Methode von Ritz zur angennäherten Behandlung von Variationproblemen, ZAMM: Zeitschrift für angewandte Mathematik und Mechanik, Vol. 7, 80-81 (in German).
  13. Duncan, W.J.,1937, Galerkin’s Method in Mechanics and Differential Equations, Aeronautical Research Committee Reports and Memoranda, No. 1798.
  14. Duncan, W.J.,1938, The Principles of the Galerkin Method, Aeronautical Research Report and Memoranda, No. 1894.
  15. S. G. Mikhlin, "Variational methods in Mathematical Physics", Pergamon Press, 1964
  16. Leipholz H.H.E.,1976, Use of Galerkin’s Method for Vibration Problems, Shock and Vibration Digest, Vol. 8, 3-18
  17. Leipholz H.H.E.,1967, Über die Wahl der Ansatzfunktionen bei der Durchführung des Verfahrens von Galerkin, Acta Mech., Vol. 3, 295-317 (in German).
  18. Leipholz H.H.E., 1967, Über die Befreiung der Anzatzfunktionen des Ritzschen und Galerkinschen Verfahrens von den Randbedingungen, Ing. Arch., Vol. 36, 251-261 (in German).
  19. Leipholz, H.H.E.,1976, Use of Galerkin’s Method for Vibration Problems, The Shock and Vibration Digest Vol. 8, 3-18, 1976.
  20. Elishakoff, I., Lee,L.H.N.,1986, On Equivalence of the Galerkin and Fourier Series Methods for One Class of Problems, Journal of Sound and Vibration, Vol. 109, 174-177.
  21. Elishakoff, I., Zingales, M.,2003, Coincidence of Bubnov-Galerkin and Exact Solution in an Applied Mechanics Problem, Journal of Applied Mechanics, Vol. 70, 777-779.
  22. Elishakoff, I., Zingales M.,2004, Convergence of Bubnov-Galerkin Method Exemplified, AIAA Journal, Vol. 42(9), 1931-1933.
  23. Singer J.,1962, On Equivalence of the Galerkin and Rayleigh-Ritz Methods, Journal of the Royal Aeronautical Society, Vol. 66, No. 621, p.592.
  24. Gander, M.J, Wanner, G.,2012, From Euler, Ritz, and Galerkin to Modern Computing, SIAM Review, Vol. 54(4), 627-666.
  25. ] Repin, S.,2017, One Hundred Years of the Galerkin Method, Computational Methods and Applied Mathematics, Vol.17(3), 351-357.
  26. .Elishakoff, I., Julius Kaplunov, Elizabeth Kaplunov, 2020, “Galerkin’s method was not developed by Ritz, contrary to the Timoshenko’s statement”, in Nonlinear Dynamics of Discrete and Continuous Systems (A. Abramyan, I. Andrianov and V. Gaiko, eds.), pp. 63-82, Springer, Berlin.

External links