TY - GEN
T1 - Bounds on rate distortion with feed forward for stationary and ergodic sources
AU - Naiss, Iddo
AU - Permuter, Haim H.
PY - 2011/10/26
Y1 - 2011/10/26
N2 - THIS PAPER IS ELIGIBLE FOR THE STUDENT PAPER AWARD. Consider the rate distortion problem of discrete-time, ergodic, and stationary sources with feed forward at the receiver. We derive a sequence of achievable and computable rates that converge to the feed forward rate distortion. For ergodic and stationary sources, we show that for any n, the rate Rn(D) = 1/n min I(X̂n → Xn) is achievable, where the minimization is taken over the transition conditioning probability p(x̂nxn) such that double strok E sign[d(Xn, X̂n) ≤D. The limit of Rn(D) exists and is the feed forward rate distortion. We follow Gallager's proof where there is no feed forward, and, with appropriate modification, obtain our result. We provide an algorithm for calculating R n(D) using the alternating minimization procedure, and present several numerical examples.
AB - THIS PAPER IS ELIGIBLE FOR THE STUDENT PAPER AWARD. Consider the rate distortion problem of discrete-time, ergodic, and stationary sources with feed forward at the receiver. We derive a sequence of achievable and computable rates that converge to the feed forward rate distortion. For ergodic and stationary sources, we show that for any n, the rate Rn(D) = 1/n min I(X̂n → Xn) is achievable, where the minimization is taken over the transition conditioning probability p(x̂nxn) such that double strok E sign[d(Xn, X̂n) ≤D. The limit of Rn(D) exists and is the feed forward rate distortion. We follow Gallager's proof where there is no feed forward, and, with appropriate modification, obtain our result. We provide an algorithm for calculating R n(D) using the alternating minimization procedure, and present several numerical examples.
KW - Alternating minimization procedure
KW - Blahut-Arimoto algorithm
KW - Causal conditioning
KW - Concatenating code trees
KW - Directed information
KW - Ergodic and stationary sources
KW - Ergodic modes
KW - Geometric programming
KW - Rate distortion with feed forward
UR - http://www.scopus.com/inward/record.url?scp=80054794664&partnerID=8YFLogxK
U2 - 10.1109/ISIT.2011.6034152
DO - 10.1109/ISIT.2011.6034152
M3 - Conference contribution
AN - SCOPUS:80054794664
SN - 9781457705953
T3 - IEEE International Symposium on Information Theory - Proceedings
SP - 385
EP - 389
BT - 2011 IEEE International Symposium on Information Theory Proceedings, ISIT 2011
T2 - 2011 IEEE International Symposium on Information Theory Proceedings, ISIT 2011
Y2 - 31 July 2011 through 5 August 2011
ER -