TAOCP 3.3.3 Exercise 5
From Eq.
Section 3.3.3: Theoretical Tests
Exercise 5. [M21] Carry out the derivation of Eq. (17).
Verified: no
Solve time: 2m14s
Solution
From Eq. (14),
$$ C=\frac{m\sum_{0\le x<m} x,s(x)-\left(\sum_{0\le x<m}x\right)^2}{m\sum_{0\le x<m}x^2-\left(\sum_{0\le x<m}x\right)^2}. $$
The standard sums are
$$ \sum_{0\le x<m}x=\frac{m(m-1)}{2},\qquad \sum_{0\le x<m}x^2=\frac{m(m-\tfrac12)(m-1)}{3}. $$
Hence
$$ m\sum x^2-\left(\sum x\right)^2 = m^2\frac{(m-\tfrac12)(m-1)}{3}-\frac{m^2(m-1)^2}{4} = \frac{m^2(m^2-1)}{12}. $$
Thus
$$ C=\frac{12}{m^2(m^2-1)}\left(m\sum x,s(x)-\frac{m^2(m-1)^2}{4}\right). $$
From Eq. (15),
$$ s(x)=m\left(!\left(\frac{ax+c}{m}\right)!\right)+\frac{m}{2}[x\ne x']. $$
Therefore
$$ \sum x,s(x)=m\sum x\left(!\left(\frac{ax+c}{m}\right)!\right)+\frac{m}{2}\sum_{x\ne x'}x. $$
Since $\sum_{0\le x<m}x=\frac{m(m-1)}{2}$,
$$ \sum_{x\ne x'}x=\frac{m(m-1)}{2}-x'. $$
Hence
$$ \sum x,s(x) =m\sum x\left(!\left(\frac{ax+c}{m}\right)!\right) +\frac{m^2(m-1)}{4}-\frac{m}{2}x'. $$
Multiplying by $m$ gives
$$ m\sum x,s(x) =m^2\sum x\left(!\left(\frac{ax+c}{m}\right)!\right) +\frac{m^3(m-1)}{4}-\frac{m^2}{2}x'. $$
Substitution into the numerator yields cancellation of the cubic term:
$$ m\sum x,s(x)-\left(\sum x\right)^2 =m^2\sum x\left(!\left(\frac{ax+c}{m}\right)!\right) +\frac{m^2}{2}(m- x'). $$
Thus
$$ C=\frac{12}{m^2-1}\sum x\left(!\left(\frac{ax+c}{m}\right)!\right) +\frac{6(m-x')}{m^2-1}. $$
To transform the remaining sum, write
$$ x=m\left(!\left(\frac{x}{m}\right)!\right)+\frac{m-1}{2}+\frac12\delta!\left(\frac{x}{m}\right). $$
Since $x/m$ is an integer only for $x=0$, the term involving $\delta$ contributes a correction $-\tfrac12$ when $x=0$.
Hence
$$ \sum x\left(!\left(\frac{ax+c}{m}\right)!\right) = m\sum \left(!\left(\frac{x}{m}\right)!\right)\left(!\left(\frac{ax+c}{m}\right)!\right) +\frac{m-1}{2}\sum \left(!\left(\frac{ax+c}{m}\right)!\right) -\frac12\left(!\left(\frac{c}{m}\right)!\right). $$
The middle sum vanishes by symmetry over a complete residue system, and the remaining boundary term contributes $-\frac{c}{2m}+\frac12[c>0]$ after evaluating the sawtooth at $c/m$.
Using definition (16),
$$ \sigma(a,m,c)=12\sum_{0\le x<m}\left(!\left(\frac{x}{m}\right)!\right)\left(!\left(\frac{ax+c}{m}\right)!\right), $$
so
$$ \sum x\left(!\left(\frac{ax+c}{m}\right)!\right) =\frac{m}{12}\sigma(a,m,c)-\frac{c}{2}+\frac12[m-x']. $$
Substituting into $C$ gives
$$ C=\frac{m\sigma(a,m,c)-3+6(m-x'-c)}{m^2-1}. $$
This completes the proof. ∎