Bruun's FFT algorithm

From HandWiki
Short description: Fast Fourier transform algorithm

Bruun's algorithm is a fast Fourier transform (FFT) algorithm based on an unusual recursive polynomial-factorization approach, proposed for powers of two by G. Bruun in 1978 and generalized to arbitrary even composite sizes by H. Murakami in 1996. Because its operations involve only real coefficients until the last computation stage, it was initially proposed as a way to efficiently compute the discrete Fourier transform (DFT) of real data. Bruun's algorithm has not seen widespread use, however, as approaches based on the ordinary Cooley–Tukey FFT algorithm have been successfully adapted to real data with at least as much efficiency. Furthermore, there is evidence that Bruun's algorithm may be intrinsically less accurate than Cooley–Tukey in the face of finite numerical precision (Storn 1993).

Nevertheless, Bruun's algorithm illustrates an alternative algorithmic framework that can express both itself and the Cooley–Tukey algorithm, and thus provides an interesting perspective on FFTs that permits mixtures of the two algorithms and other generalizations.

A polynomial approach to the DFT

Recall that the DFT is defined by the formula: [math]\displaystyle{ X_k = \sum_{n=0}^{N-1} x_n e^{-\frac{2\pi i}{N} nk } \qquad k = 0,\dots,N-1. }[/math]

For convenience, let us denote the N roots of unity by ωNn (n = 0, ..., N − 1): [math]\displaystyle{ \omega_N^n = e^{-\frac{2\pi i}{N} n } }[/math] and define the polynomial x(z) whose coefficients are xn: [math]\displaystyle{ x(z) = \sum_{n=0}^{N-1} x_n z^n. }[/math]

The DFT can then be understood as a reduction of this polynomial; that is, Xk is given by: [math]\displaystyle{ X_k = x(\omega_N^k) = x(z) \mod (z - \omega_N^k) }[/math] where mod denotes the polynomial remainder operation. The key to fast algorithms like Bruun's or Cooley–Tukey comes from the fact that one can perform this set of N remainder operations in recursive stages.

Recursive factorizations and FFTs

In order to compute the DFT, we need to evaluate the remainder of [math]\displaystyle{ x(z) }[/math] modulo N degree-1 polynomials as described above. Evaluating these remainders one by one is equivalent to the evaluating the usual DFT formula directly, and requires O(N2) operations. However, one can combine these remainders recursively to reduce the cost, using the following trick: if we want to evaluate [math]\displaystyle{ x(z) }[/math] modulo two polynomials [math]\displaystyle{ U(z) }[/math] and [math]\displaystyle{ V(z) }[/math], we can first take the remainder modulo their product [math]\displaystyle{ U(z) }[/math] [math]\displaystyle{ V(z) }[/math], which reduces the degree of the polynomial [math]\displaystyle{ x(z) }[/math] and makes subsequent modulo operations less computationally expensive.

The product of all of the monomials [math]\displaystyle{ (z - \omega_N^k) }[/math] for k=0..N-1 is simply [math]\displaystyle{ z^N-1 }[/math] (whose roots are clearly the N roots of unity). One then wishes to find a recursive factorization of [math]\displaystyle{ z^N-1 }[/math] into polynomials of few terms and smaller and smaller degree. To compute the DFT, one takes [math]\displaystyle{ x(z) }[/math] modulo each level of this factorization in turn, recursively, until one arrives at the monomials and the final result. If each level of the factorization splits every polynomial into an O(1) (constant-bounded) number of smaller polynomials, each with an O(1) number of nonzero coefficients, then the modulo operations for that level take O(N) time; since there will be a logarithmic number of levels, the overall complexity is O (N log N).

More explicitly, suppose for example that [math]\displaystyle{ z^N-1 = F_1(z) F_2(z) F_3(z) }[/math], and that [math]\displaystyle{ F_k(z) = F_{k,1}(z) F_{k,2}(z) }[/math], and so on. The corresponding FFT algorithm would consist of first computing xk(z) = x(z) mod Fk(z), then computing xk,j(z) = xk(z) mod Fk,j(z), and so on, recursively creating more and more remainder polynomials of smaller and smaller degree until one arrives at the final degree-0 results.

Moreover, as long as the polynomial factors at each stage are relatively prime (which for polynomials means that they have no common roots), one can construct a dual algorithm by reversing the process with the Chinese remainder theorem.

Cooley–Tukey as polynomial factorization

The standard decimation-in-frequency (DIF) radix-r Cooley–Tukey algorithm corresponds closely to a recursive factorization. For example, radix-2 DIF Cooley–Tukey factors [math]\displaystyle{ z^N-1 }[/math] into [math]\displaystyle{ F_1 = (z^{N/2}-1) }[/math] and [math]\displaystyle{ F_2 = (z^{N/2}+1) }[/math]. These modulo operations reduce the degree of [math]\displaystyle{ x(z) }[/math] by 2, which corresponds to dividing the problem size by 2. Instead of recursively factorizing [math]\displaystyle{ F_2 }[/math] directly, though, Cooley–Tukey instead first computes x2(z ωN), shifting all the roots (by a twiddle factor) so that it can apply the recursive factorization of [math]\displaystyle{ F_1 }[/math] to both subproblems. That is, Cooley–Tukey ensures that all subproblems are also DFTs, whereas this is not generally true for an arbitrary recursive factorization (such as Bruun's, below).

The Bruun factorization

The basic Bruun algorithm for powers of two N=2n factorizes z2n-1 recursively via the rules:

[math]\displaystyle{ z^{2M}-1 = (z^M - 1) (z^M + 1) \, }[/math] [math]\displaystyle{ z^{4M} + az^{2M} + 1 = (z^{2M} + \sqrt{2-a}z^M+1) (z^{2M} - \sqrt{2-a}z^M + 1) }[/math]

where a is a real constant with |a| ≤ 2. If [math]\displaystyle{ a=2\cos(\phi) }[/math], [math]\displaystyle{ \phi\in(0,\pi) }[/math], then [math]\displaystyle{ \sqrt{2+a}=2\cos\tfrac\phi2 }[/math] and [math]\displaystyle{ \sqrt{2-a}=2\cos(\tfrac\pi 2-\tfrac\phi 2) }[/math].

At stage s, s=0,1,2,n-1, the intermediate state consists of 2s polynomials [math]\displaystyle{ p_{s,0},\dots,p_{s,2^s-1} }[/math] of degree 2n-s - 1 or less , where [math]\displaystyle{ \begin{align} p_{s,0}(z)&= p(z) \mod \left(z^{2^{n-s}}-1\right)&\quad&\text{and}\\ p_{s,m}(z) &= p(z)\mod \left(z^{2^{n-s}}-2\cos\left(\tfrac{m}{2^s}\pi\right)z^{2^{n-1-s}}+1\right)&m&=1,2,\dots,2^s-1 \end{align} }[/math]

By the construction of the factorization of z2n-1, the polynomials ps,m(z) each encode 2n-s values [math]\displaystyle{ X_k=p(e^{2\pi i\tfrac{k}{2^n}}) }[/math] of the Fourier transform, for m=0, the covered indices are k=0, 2k, 2∙2s, 3∙2s,…, (2n-s-1)∙2s, for m>0 the covered indices are k=m, 2s+1-m, 2s+1+m, 2∙2s+1-m, 2∙2s+1+m, …, 2n-m.

During the transition to the next stage, the polynomial [math]\displaystyle{ p_{s,\ell}(z) }[/math] is reduced to the polynomials [math]\displaystyle{ p_{s+1,\ell}(z) }[/math] and [math]\displaystyle{ p_{s+1,2^s-\ell}(z) }[/math] via polynomial division. If one wants to keep the polynomials in increasing index order, this pattern requires an implementation with two arrays. An implementation in place produces a predictable, but highly unordered sequence of indices, for example for N=16 the final order of the 8 linear remainders is (0, 4, 2, 6, 1, 7, 3, 5).

At the end of the recursion, for s = n-1, there remain 2n-1 linear polynomials encoding two Fourier coefficients X0 and X2n-1 for the first and for the any other kth polynomial the coefficients Xk and X2n-k.

At each recursive stage, all of the polynomials of the common degree 4M-1 are reduced to two parts of half the degree 2M-1. The divisor of this polynomial remainder computation is a quadratic polynomial zm, so that all reductions can be reduced to polynomial divisions of cubic by quadratic polynomials. There are N/2 = 2n−1 of these small divisions at each stage, leading to an O(N log N) algorithm for the FFT.

Moreover, since all of these polynomials have purely real coefficients (until the very last stage), they automatically exploit the special case where the inputs xn are purely real to save roughly a factor of two in computation and storage. One can also take straightforward advantage of the case of real-symmetric data for computing the discrete cosine transform (Chen Sorensen).

Generalization to arbitrary radices

The Bruun factorization, and thus the Bruun FFT algorithm, was generalized to handle arbitrary even composite lengths, i.e. dividing the polynomial degree by an arbitrary radix (factor), as follows. First, we define a set of polynomials φN,α(z) for positive integers N and for α in [0, 1) by: [math]\displaystyle{ \phi_{N, \alpha}(z) = \begin{cases} z^{2N} - 2 \cos (2 \pi \alpha) z^N + 1 & \text{if } 0 \lt \alpha \lt 1 \\ \\ z^{2N} - 1 & \text{if } \alpha = 0 \end{cases} }[/math]

Note that all of the polynomials that appear in the Bruun factorization above can be written in this form. The zeroes of these polynomials are [math]\displaystyle{ e^{2\pi i ( \pm\alpha + k ) / N} }[/math] for [math]\displaystyle{ k = 0, 1, \dots, N-1 }[/math] in the [math]\displaystyle{ \alpha \neq 0 }[/math] case, and [math]\displaystyle{ e^{2\pi i k / 2N} }[/math] for [math]\displaystyle{ k = 0, 1, \dots, 2N-1 }[/math] in the [math]\displaystyle{ \alpha = 0 }[/math] case. Hence these polynomials can be recursively factorized for a factor (radix) r via:

[math]\displaystyle{ \phi_{rM, \alpha}(z) = \begin{cases} \prod_{\ell=0}^{r-1} \phi_{M,(\alpha+\ell)/r} & \text{if } 0 \lt \alpha \leq 0.5 \\ \\ \prod_{\ell=0}^{r-1} \phi_{M,(1-\alpha+\ell)/r} & \text{if } 0.5 \lt \alpha \lt 1 \\ \\ \prod_{\ell=0}^{r-1} \phi_{M,\ell/(2r)} & \text{if } \alpha = 0 \end{cases} }[/math]

References

  • Bruun, Georg (1978). "z-Transform DFT filters and FFTs". IEEE Trans. on Acoustics, Speech and Signal Processing (ASSP) 26 (1): 56-63. 
  • Nussbaumer, H. J. (1990). Fast Fourier Transform and Convolution Algorithms. Berlin: Springer-Verlag. 
  • Wu, Yuhang (1990). "New FFT structures based on the Bruun algorithm". IEEE Trans. ASSP 38 (1): 188-191. 
  • Chen, Jianping; Sorensen, Henrik (1992). "An efficient FFT algorithm for real-symmetric data". Proc. ICASSP 5: 17-20. 
  • Storn, Rainer (1993). "Some results in fixed point error analysis of the Bruun-FTT [sic] algorithm". IEEE Trans. Signal Process. 41 (7): 2371-2375. 
  • Murakami, Hideo (1994). "Real-valued decimation-in-time and decimation-in-frequency algorithms". IEEE Trans. Circuits Syst. II: Analog and Digital Sig. Proc. 41 (12): 808-816. 
  • Murakami, Hideo (1996). "Real-valued fast discrete Fourier transform and cyclic convolution algorithms of highly composite even length". Proc. ICASSP 3: 1311-1314. 
  • Shashank Mittal, Md. Zafar Ali Khan, M. B. Srinivas, "A Comparative Study of Different FFT Architectures for Software Defined Radio", Lecture Notes in Computer Science 4599 (Embedded Computer Systems: Architectures, Modeling, and Simulation), 375-384 (2007). Proc. 7th Intl. Workshop, SAMOS 2007 (Samos, Greece, July 16–19, 2007).