TY - JOUR
T1 - Information, Estimation, and Lookahead in the Gaussian Channel
AU - Venkat, Kartik
AU - Weissman, Tsachy
AU - Carmon, Yair
AU - Shamai, Shlomo
N1 - Publisher Copyright:
© 1991-2012 IEEE.
PY - 2016/7/15
Y1 - 2016/7/15
N2 - We consider mean squared estimation with lookahead of a continuous-time signal corrupted by additive white Gaussian noise. We show that the mutual information rate function, i.e., the mutual information rate as function of the signal-to-noise ratio (SNR), does not, in general, determine the minimum mean squared error (MMSE) with fixed finite lookahead, in contrast to the special cases with 0 and infinite lookahead (filtering and smoothing errors), respectively, which were previously established in the literature. Further, we investigate the simple class of continuous-time stationary Gauss-Markov processes (Ornstein-Uhlenbeck processes) as channel inputs, and explicitly characterize the behavior of the minimum mean squared error (MMSE) with finite lookahead and signal-to-noise ratio (SNR). We extend our results to mixtures of Ornstein-Uhlenbeck processes, and use the insight gained to present lower and upper bounds on the MMSE with lookahead for a class of stationary Gaussian input processes, whose spectrum can be expressed as a mixture of Ornstein-Uhlenbeck spectra.
AB - We consider mean squared estimation with lookahead of a continuous-time signal corrupted by additive white Gaussian noise. We show that the mutual information rate function, i.e., the mutual information rate as function of the signal-to-noise ratio (SNR), does not, in general, determine the minimum mean squared error (MMSE) with fixed finite lookahead, in contrast to the special cases with 0 and infinite lookahead (filtering and smoothing errors), respectively, which were previously established in the literature. Further, we investigate the simple class of continuous-time stationary Gauss-Markov processes (Ornstein-Uhlenbeck processes) as channel inputs, and explicitly characterize the behavior of the minimum mean squared error (MMSE) with finite lookahead and signal-to-noise ratio (SNR). We extend our results to mixtures of Ornstein-Uhlenbeck processes, and use the insight gained to present lower and upper bounds on the MMSE with lookahead for a class of stationary Gaussian input processes, whose spectrum can be expressed as a mixture of Ornstein-Uhlenbeck spectra.
KW - Brownian motion
KW - Mutual information
KW - mean squared error
UR - http://www.scopus.com/inward/record.url?scp=84976444867&partnerID=8YFLogxK
U2 - 10.1109/TSP.2016.2544748
DO - 10.1109/TSP.2016.2544748
M3 - ???researchoutput.researchoutputtypes.contributiontojournal.article???
AN - SCOPUS:84976444867
SN - 1053-587X
VL - 64
SP - 3605
EP - 3618
JO - IEEE Transactions on Signal Processing
JF - IEEE Transactions on Signal Processing
IS - 14
M1 - 7437484
ER -