The foundation of Fourier seriesFootnote 1 is based on the principle of orthogonality of functions. Now, the coefficients for the Fourier Series can easily be derived by using the orthogonality condition. If we try to apply a similar analogy to Taylor Series coefficients, then the function which obtains all the Taylor coefficients turns out to be not quite a function, but a distribution called the Dirac delta function. This will explicitly be used later to derive one from the other later.

The Fourier series can be succinctly represented in the form of the Dirichlet kernel as:

$$ f(x)= \lim _{r\rightarrow \infty } \frac{1}{2\pi } \int _{-\pi }^{\pi } f(t)\Sigma _{n=-r}^{r} e^{in(x-t)}dt $$
(1)
$$= \lim _{r\rightarrow \infty } \frac{1}{2\pi } \int _{-\pi }^{\pi } f(t) \frac{\sin (2r+1)\frac{x-t}{2}}{2\sin \frac{x-t}{2}} $$
(2)

Using a certain representation of the Dirac delta function that suits us:

$$\begin{aligned} \delta _n(x) &= \frac{1}{2\pi }\int _{-n}^{n} e^{-ixt} dt \nonumber \\ &= \frac{\sin nx}{\pi x} \end{aligned}$$
(3)

Therefore, as a slight modification, the Dirac delta can be represented (in the limit of large n) as:

$$\begin{aligned} \delta _n(x)=\frac{1}{2\pi } \frac{\sin (n+1/2)x}{\sin 1/2x} \end{aligned}$$
(4)

Introducing a change of variables with \(s=x-t\), we solve the above integral by repeatedly using by parts. Performing the first 2 iterations gives us:

$$\begin{aligned} f(x)= & {} \lim _{r\rightarrow \infty }\frac{1}{2\pi }\left[ f(x+s)\int _{-\pi -x}^{\pi -x} \frac{\sin (r+1/2)s}{\sin s/2}ds \right. \nonumber \\&\left. -\int _{-\pi -x}^{\pi -x} f^{'}(x+s)\left( \int \frac{\sin (r+1/2)s}{\sin s/2}ds\right) ds\right] \end{aligned}$$
(5)

The integration of the Dirac delta function gives the Heaviside step function where it is defined as:Footnote 2

$$\begin{aligned} \theta (x) \equiv \int _{-\infty }^{x} \delta (s) ds \end{aligned}$$
(6)

A notation is thus introduced here so that we can sufficiently represent the successive integrals of the Heaviside function as we expand similarly the other terms, continually invoking by parts. \(\theta _0 (x)\) is the Heaviside function while \(\theta _1 (x)\), \(\theta _2 (x), \ldots , \theta _n (x)\) represent the first, second, \(\ldots \) and nth integrals of the Heaviside function respectively.

Because of the nature of the Heaviside function, we note immediately that the function with successive integrations performed will only resemble the function in the interval \(-\pi \) to \(\pi \). Thus after a few iterations, we obtain:

$$\begin{aligned} f(x) & = f(x+s)-f^{'}(x+s)\int _{-\pi -x}^{\pi -x}\theta _0 (s)ds \nonumber \\&+f^{''}(x+s)\int _{-\pi -x}^{\pi -x}\theta _1 (s)ds \nonumber \\&-f^{'''}(x+s)\int _{-\pi -x}^{\pi -x}\theta _2 (s)ds+\cdots \end{aligned}$$
(7)

Now, the integrations of these class of \(\theta \) functions can be performed trivially to obtain as follows:

$$\begin{aligned} \theta _1 (x) &= x\theta _0 (x) \nonumber \\ \theta _2 (x) &= \frac{x^2}{2}\theta _0 (x)\nonumber \\&\ldots \end{aligned}$$
(8)

Further, the above integrals are limited between \( -\pi -x\) to \(\pi -x\). This thus means we only need to consider the \(-(-\pi -x)\) term. In the portion to the left of limits placed, the \(\theta \) functions remain uniformly zero while to the right of the limit, we obtain functions which are a difference of the 2\(\theta \) functions at limit values, giving us a function one order lesser than required.

Thus on expanding, it looks very similar to the Taylor series, but not quite of the same form. However, on closer inspection, we get the same form between \( - \pi \) to \(\pi \).

Thus going on expanding the last term by parts over and over, we get:

$$\begin{aligned} f(x) &= f(x+s)-f^{'}(x+s)(-\pi -x) +\frac{f^{''}(x+s)(-\pi -x)^2}{2!} \nonumber \\&-\frac{f^{'''}(x+s)(-\pi -x)^3}{3!}+\frac{f^{''''}(x+s)(-\pi -x)^4}{4!}-\cdots \end{aligned}$$
(9)

Transforming:

$$\begin{aligned} s:=(-\pi -x)=-h \end{aligned}$$

We thus obtain:

$$\begin{aligned} f(x)=f(x-h)+\frac{hf^{'}(x-h)}{1!}+\frac{h^2f^{''}(x-h)}{2!}+\cdots \end{aligned}$$
(10)

Specifically:

$$f(\pi+h)= f(\pi)+\frac{hf'(\pi)}{1!}+\frac{h^2 f''(\pi)}{2!}+\cdots$$
(11)

This shows us that the value of the function and its derivatives at \(\pi \) is extremely important. This can then be further generalised to a Fourier series with any suitably well-defined period. Thus the Taylor series is shown to be exactly derivable from its Fourier series. However there are a few important caveats which are listed below.

It must be noted that the above formulation of equality holds only for the specific transformation relation. Generalizing, this shows that the global properties of Fourier series can be matched by the local properties of expanding a function using a certain expansion coefficient. This above formulation could be replaced for a general Fourier series with the period replacing the limits \(-\pi \) to \(\pi \).

Thus, a neat relation has been shown to exist between a function’s Fourier and Taylor series in a certain domain.