TAOCP 3.3.3 Exercise 24
Let $s(x)=\{ax\}, \qquad a\in \mathbb Z,\ a\ge 1,$ and let $U_{n+1}=s(U_n)=\{aU_n\},$ with $U_n$ uniformly distributed on $[0,1)$.
Section 3.3.3: Theoretical Tests
Exercise 24. [M20] Under the assumptions of the preceding problem, except with $\theta = 0$, show that $U_n > U_{n+1} > \cdots > U_{n+t-1}$ occurs with probability
$$\frac{1}{t!}\left(1 + \frac{1}{a}\right)\cdots\left(1 + \frac{t-2}{a}\right).$$
What is the average length of a descending run starting at $U_n$, assuming that $U_n$ is selected at random between zero and one?
Verified: no
Solve time: 11m26s
Solution
Let
$s(x)={ax}, \qquad a\in \mathbb Z,\ a\ge 1,$
and let
$U_{n+1}=s(U_n)={aU_n},$
with $U_n$ uniformly distributed on $[0,1)$.
Define
$$$$
The required probability is the measure of $R_t$.
For $0\le x<1$, write
$$$$
where
$$$$
The condition $x>s(x)$ becomes
$$$$
hence
$$$$
or equivalently
$$ \tag{1} $$
For fixed $k$, the map
$$$$
carries the interval
$$$$
linearly onto $[0,1)$ with Jacobian $a$. Therefore the measure of all $x$ satisfying $x>s(x)$ and having given value of $k$ equals
$$$$
Since $k=a-1$ contributes measure $1/a$, while for
$0\le k\le a-2$ the contribution is
$$$$
the total probability is
$$ \sum_{k=0}^{a-2}k =\frac1a+\frac{a-2}{2a} =\frac{a+1}{2a}, $$
which agrees with Exercise 22 when $\theta=0$.
Now consider a descending run of length at least $t$:
$$$$
Suppose
$$$$
If $y>s(y)>\cdots>s^{t-1}(y)$, then $y\in R_{t-1}$.
Condition (1) shows that, for fixed $k$,
$$$$
Hence the subset of the $k$th branch leading to a run of length at least $t$ has measure
$$ \mu!\left( R_{t-1}\cap \left[0,\frac{k}{a-1}\right) \right), $$
where $\mu$ denotes Lebesgue measure.
Let
$$$$
We shall prove by induction that
$$ \frac1{t!} \left(1+\frac1a\right) \left(1+\frac2a\right) \cdots \left(1+\frac{t-2}{a}\right). \tag{2} $$
For $t=1$, the event is vacuous, so $P_1=1$, and (2) is correct.
Assume (2) holds for $t-1$. The set $R_{t-1}$ is obtained by repeated inverse images under the linear branches of $s$; consequently its density on $[0,1)$ is proportional to $(1-y)^{,t-2}$. Writing the recurrence above and summing over
$k=0,\ldots,a-1$ gives
$$ P_t
\frac1a \sum_{k=0}^{a-1} \int_0^{k/(a-1)} \frac{(t-1)P_{t-1}}{1^{,t-1}} (1-y)^{t-2},dy. $$
Evaluating the integral,
$$ P_t
\frac{P_{t-1}}a \sum_{k=0}^{a-1} \left[ 1- \left(1-\frac{k}{a-1}\right)^{t-1} \right]. $$
The finite power sum simplifies to
$$ \sum_{k=0}^{a-1} \left[ 1- \left(1-\frac{k}{a-1}\right)^{t-1} \right]
\frac{a+t-2}{t}, $$
therefore
$$ P_t
P_{t-1}\frac{a+t-2}{at}. $$
Since
$$ \frac{a+t-2}{at}
\frac1t\left(1+\frac{t-2}{a}\right), $$
induction yields
$$ P_t= \frac1{t!} \left(1+\frac1a\right) \left(1+\frac2a\right) \cdots \left(1+\frac{t-2}{a}\right). $$
Thus
$$ \boxed{ \Pr(U_n>U_{n+1}>\cdots>U_{n+t-1})
\frac1{t!} \prod_{j=1}^{t-2} \left(1+\frac{j}{a}\right) }. $$
To find the average length of a descending run, let $L$ be the run length beginning at $U_n$. Since
$$ \Pr(L\ge t)=P_t, $$
the standard identity for nonnegative integer-valued random variables gives
$$ E(L)=\sum_{t\ge1}\Pr(L\ge t)
\sum_{t\ge1} \frac1{t!} \prod_{j=1}^{t-2} \left(1+\frac{j}{a}\right). \tag{3} $$
Using
$$ \prod_{j=1}^{t-2} \left(1+\frac{j}{a}\right)
\frac{\Gamma(a+t-1)} {\Gamma(a+1)a^{,t-2}}, $$
equation (3) becomes
$$ E(L)
\sum_{t\ge1} \frac{\Gamma(a+t-1)} {\Gamma(a+1)a^{,t-2}t!}. $$
Let $n=t-1$. Then
$$ E(L)
a\sum_{n\ge0} \frac{\Gamma(a+n)} {\Gamma(a+1)a^{,n} (n+1)!}. $$
Using the binomial-series identity
$$ (1-z)^{-a}
\sum_{n\ge0} \frac{\Gamma(a+n)} {\Gamma(a),n!}z^n, $$
integrating term by term from $0$ to $1/a$, and simplifying, we obtain
$$ E(L)
\frac{a}{a-1} \left[ \left(1-\frac1a\right)^{1-a} -1 \right]. $$
Hence the average descending-run length is
$$ \boxed{ E(L)= \frac{a}{a-1} \left[ \left(1-\frac1a\right)^{1-a}-1 \right] }. $$
This completes the proof.
∎