This blog originates from a question in the final exam of Applied Stochastic Process this semester. The question focused on the Karhunen-Loève expansion of Brownian Bridge. Soon I was surprised to find that it provides a derivation for the Basel problem :
∑ n = 1 ∞ 1 n 2 = π 2 6 \begin{align}
\sum_{n=1}^\infty\dfrac{1}{n^2}=\dfrac{\pi^2}{6}
\end{align} n = 1 ∑ ∞ n 2 1 = 6 π 2
Brownian Bridge and KL Expansion
A standard bridge is defined as
B t = W t − t W 1 , t ∈ [ 0 , 1 ] \begin{align}
B_t=W_t-tW_1,\quad t\in [0,1]
\end{align} B t = W t − t W 1 , t ∈ [ 0 , 1 ]
where W t W_t W t is a standard Wiener Process. Autocorrelation function of B t B_t B t is
R ( s , t ) = min { s , t } − s t \begin{align}
R(s,t)=\min\{s,t\}-st
\end{align} R ( s , t ) = min { s , t } − s t
The KL expansion is given by the Mercer's decomposition of R ( s , t ) R(s,t) R ( s , t )
R ( s , t ) = ∑ i λ i ϕ i ( s ) ϕ i ( t ) \begin{align}
R(s,t)=\sum_{i}\lambda _i\phi _i(s)\phi _i(t)
\end{align} R ( s , t ) = i ∑ λ i ϕ i ( s ) ϕ i ( t )
in which eigen functions ϕ i \phi _i ϕ i s are given by
∫ 0 1 R ( s , t ) ϕ i ( s ) d s = λ i ϕ i ( t ) \begin{align}
\int _0^1 R(s,t)\phi _i(s) \,\mathrm{d}s = \lambda _i\phi _i(t)
\end{align} ∫ 0 1 R ( s , t ) ϕ i ( s ) d s = λ i ϕ i ( t )
My Solution in the Exam
Here I post my solution in the exam: substitute in the expression of R ( s , t ) R(s,t) R ( s , t )
λ i ϕ i ( t ) = ∫ 0 1 ( min { s , t } − s t ) ϕ i ( s ) d s = ∫ 0 t s ϕ i ( s ) d s + t ∫ t 1 ϕ i ( s ) d s − t ∫ 0 1 s ϕ i ( s ) d s \begin{align}
\lambda _i\phi _i(t)=&\int _0^1 (\min\{s,t\}-st)\phi _i(s) \,\mathrm{d}s\\
=&\int _0^t s\phi _i(s) \,\mathrm{d}s + t\int _t^1 \phi _i(s) \,\mathrm{d}s - t\int _0^1 s\phi _i(s) \,\mathrm{d}s
\end{align} λ i ϕ i ( t ) = = ∫ 0 1 ( min { s , t } − s t ) ϕ i ( s ) d s ∫ 0 t s ϕ i ( s ) d s + t ∫ t 1 ϕ i ( s ) d s − t ∫ 0 1 s ϕ i ( s ) d s
take differentiation d d t \dfrac{\mathrm{d}^{} }{\mathrm{d}t^{}} d t d to get
λ i d d t ϕ i ( t ) = t ϕ i ( t ) + ( ∫ t 1 ϕ i ( s ) d s + t ϕ i ( t ) ) − ∫ 0 1 s ϕ i ( s ) d s = ∫ t 1 ϕ i ( s ) d s − ∫ 0 1 s ϕ i ( s ) d s \begin{align}
\lambda _i\dfrac{\mathrm{d}^{} }{\mathrm{d}t^{}}\phi_i(t)=& t\phi _i(t) + \left( \int _t^1\phi _i(s) \,\mathrm{d}s + t\phi _i(t) \right) - \int _0^1 s\phi _i(s) \,\mathrm{d}s\\
=&\int _t^1\phi _i(s) \,\mathrm{d}s - \int _0^1 s\phi _i(s) \,\mathrm{d}s
\end{align} λ i d t d ϕ i ( t ) = = t ϕ i ( t ) + ( ∫ t 1 ϕ i ( s ) d s + t ϕ i ( t ) ) − ∫ 0 1 s ϕ i ( s ) d s ∫ t 1 ϕ i ( s ) d s − ∫ 0 1 s ϕ i ( s ) d s
one more differentiation d d t \dfrac{\mathrm{d}^{} }{\mathrm{d}t^{}} d t d
λ i d 2 d t 2 ϕ i ( t ) = − ϕ i ( t ) \begin{align}
\lambda _i\dfrac{\mathrm{d}^{2} }{\mathrm{d}t^{2}}\phi _i(t) = -\phi _i(t)
\end{align} λ i d t 2 d 2 ϕ i ( t ) = − ϕ i ( t )
with boundary condition ϕ i ( 0 ) = ϕ i ( 1 ) = 0 \phi _i(0)=\phi _i(1)=0 ϕ i ( 0 ) = ϕ i ( 1 ) = 0 , which has solution
ϕ n ( t ) = 2 sin ( n π t ) , λ n = ( 1 n π ) 2 \begin{align}
\phi _n(t)=\sqrt{2}\sin(n\pi t),\quad \lambda _n=\left(\dfrac{1}{n\pi}\right)^2
\end{align} ϕ n ( t ) = 2 sin ( nπ t ) , λ n = ( nπ 1 ) 2
i.e. the Mercer expansion is
R ( s , t ) = min { s , t } − s t = ∑ n = 1 ∞ 2 n 2 π 2 sin ( n π s ) sin ( n π t ) \begin{align}
R(s,t) = \min\{s,t\}-st = \sum_{n=1}^\infty \dfrac{2}{n^2\pi^2}\sin(n\pi s)\sin(n\pi t)
\end{align} R ( s , t ) = min { s , t } − s t = n = 1 ∑ ∞ n 2 π 2 2 sin ( nπ s ) sin ( nπ t )
Basel Problem
What makes it interesting is that we can consider the function value R ( 1 / 2 , 1 / 2 ) R(1/2,1/2) R ( 1/2 , 1/2 )
R ( 1 2 , 1 2 ) = 1 4 = ∑ n = 1 ∞ 2 n 2 π 2 sin ( n π 2 ) sin ( n π 2 ) = ∑ n ∈ odd ∞ 2 n 2 π 2 = 2 π 2 ( 1 1 2 + 1 3 2 + 1 5 2 + … ) \begin{align}
R(\dfrac{1}{2},\dfrac{1}{2})=\dfrac{1}{4}=&\sum_{n=1}^\infty \dfrac{2}{n^2\pi^2}\sin(\dfrac{n\pi}{2})\sin(\dfrac{n\pi}{2})\\
=&\sum_{n\in\text{odd}}^\infty \dfrac{2}{n^2\pi^2}\\
=&\dfrac{2}{\pi^2}\left(\dfrac{1}{1^2}+\dfrac{1}{3^2}+\dfrac{1}{5^2}+\ldots \right)
\end{align} R ( 2 1 , 2 1 ) = 4 1 = = = n = 1 ∑ ∞ n 2 π 2 2 sin ( 2 nπ ) sin ( 2 nπ ) n ∈ odd ∑ ∞ n 2 π 2 2 π 2 2 ( 1 2 1 + 3 2 1 + 5 2 1 + … )
On the other hand notice that
1 4 ∑ n = 1 ∞ 1 n 2 = ∑ n = 1 ∞ 1 ( 2 n ) 2 = ( 1 2 2 + 1 4 2 + 1 6 2 + … ) \begin{align}
\dfrac{1}{4}\sum_{n=1}^\infty \dfrac{1}{n^2} = \sum_{n=1}^\infty \dfrac{1}{(2n)^2}=\left(\dfrac{1}{2^2}+\dfrac{1}{4^2}+\dfrac{1}{6^2}+\ldots \right)
\end{align} 4 1 n = 1 ∑ ∞ n 2 1 = n = 1 ∑ ∞ ( 2 n ) 2 1 = ( 2 2 1 + 4 2 1 + 6 2 1 + … )
we have
∑ n = 1 ∞ 1 n 2 − 1 4 ∑ n = 1 ∞ 1 n 2 = ( 1 1 2 + 1 2 2 + 1 3 2 + … ) − ( 1 2 2 + 1 4 2 + 1 6 2 + … ) = ( 1 1 2 + 1 3 2 + 1 5 2 + … ) = π 2 8 ⇒ ∑ n = 1 ∞ 1 n 2 = 4 3 π 2 8 = π 2 6 \begin{align}
\sum_{n=1}^\infty \dfrac{1}{n^2}-\dfrac{1}{4}\sum_{n=1}^\infty \dfrac{1}{n^2} = & \left(\dfrac{1}{1^2}+\dfrac{1}{2^2}+\dfrac{1}{3^2}+\ldots \right) - \left(\dfrac{1}{2^2}+\dfrac{1}{4^2}+\dfrac{1}{6^2}+\ldots \right)\\
=&\left(\dfrac{1}{1^2}+\dfrac{1}{3^2}+\dfrac{1}{5^2}+\ldots \right)=\dfrac{\pi^2}{8}\\
\Rightarrow \sum_{n=1}^\infty \dfrac{1}{n^2}=& \dfrac{4}{3}\dfrac{\pi^2}{8} = \dfrac{\pi^2}{6}
\end{align} n = 1 ∑ ∞ n 2 1 − 4 1 n = 1 ∑ ∞ n 2 1 = = ⇒ n = 1 ∑ ∞ n 2 1 = ( 1 2 1 + 2 2 1 + 3 2 1 + … ) − ( 2 2 1 + 4 2 1 + 6 2 1 + … ) ( 1 2 1 + 3 2 1 + 5 2 1 + … ) = 8 π 2 3 4 8 π 2 = 6 π 2
Appendix: Euler's Method
Euler studied the function s i n c π t = sin π t π t \mathrm{sinc} \pi t=\dfrac{\sin \pi t}{\pi t} sinc π t = π t sin π t , which has roots at ± 1 , ± 2 , ± 3 , … \pm 1,\pm 2,\pm 3,\ldots ± 1 , ± 2 , ± 3 , … ,
which means the polynomial form of s i n c π t \mathrm{sinc}\pi t sinc π t should looks like
sin π t π t = ( 1 + t ) ( 1 − t ) ( 1 + t 2 ) ( 1 − t 2 ) … = ( 1 − t 2 ) ( 1 − t 2 4 ) … = 1 − t 2 ∑ n = 1 ∞ 1 n 2 + o ( t 2 ) \begin{align}
\dfrac{\sin \pi t}{\pi t} =& (1+t)(1-t)(1+\dfrac{t}{2})(1-\dfrac{t}{2})\ldots\\
=&(1-t^2)(1-\dfrac{t^2}{4})\ldots \\
=&1- t^2\sum_{n=1}^\infty \dfrac{1}{n^2} + o(t^2)
\end{align} π t sin π t = = = ( 1 + t ) ( 1 − t ) ( 1 + 2 t ) ( 1 − 2 t ) … ( 1 − t 2 ) ( 1 − 4 t 2 ) … 1 − t 2 n = 1 ∑ ∞ n 2 1 + o ( t 2 )
according to taylor series, it should also have expansion of the form
sin π t π t = π t − 1 6 ( π t ) 3 + o ( t 3 ) π t = 1 − π 2 6 t 2 + o ( t 2 ) \begin{align}
\dfrac{\sin \pi t}{\pi t} =&\dfrac{\pi t - \dfrac{1}{6}(\pi t)^3 + o(t^3)}{\pi t} = 1 - \dfrac{\pi^2}{6}t^2+o(t^2)
\end{align} π t sin π t = π t π t − 6 1 ( π t ) 3 + o ( t 3 ) = 1 − 6 π 2 t 2 + o ( t 2 )
by comparing the t 2 t^2 t 2 term we obtain that
∑ n = 1 ∞ 1 n 2 = π 2 6 \begin{align}
\sum_{n=1}^\infty \dfrac{1}{n^2} = \dfrac{\pi^2}{6}
\end{align} n = 1 ∑ ∞ n 2 1 = 6 π 2