Section: New Results
Ergodic theory for controlled Markov chains with stationary inputs
Consider a stochastic process
-
A stationary version of the process is constructed, that is coupled with a stationary version of the Markov chain
obtained with . The triple is a jointly stationary process satisfying Moreover, a second-order Taylor-series approximation is obtained: -
For any
and any function , the stationary stochastic process has a power spectral density that admits a second order Taylor series expansion: A function is constructed such thatAn explicit formula for the function
is obtained, based in part on the bounds in (i).
The results are illustrated using a version of the timing channel of Anantharam and Verdu.