TY - JOUR
T1 - Graph-Based Encoders and Their Performance for Finite-State Channels with Feedback
AU - Sabag, Oron
AU - Huleihel, Bashar
AU - Permuter, Haim H.
N1 - Funding Information:
Manuscript received July 25, 2019; revised December 17, 2019; accepted December 20, 2019. Date of publication January 10, 2020; date of current version April 16, 2020. This work was supported in part by the Deutsche Forschungsgemeinschaft (DFG) via the Deutsch-lsraelische Projektkoopera-tion (DIP), in part by the Israel Science Foundation, and in part by the Cyber Center and at Ben-Gurion University of the Negev. The work of Oron Sabag was supported in part by the ISEF International Fellowship. This article was presented at the 2018 International Symposium on Information Theory (ISIT) [1]. The associate editor coordinating the review of this article and approving it for publication was R. Venkataramanan. (Corresponding author: Haim H. Permuter.) Oron Sabag is with the Department of Electrical Engineering, California Institute of Technology, Pasadena, CA 91125 USA (e-mail: oron@caltech.edu).
Publisher Copyright:
© 1972-2012 IEEE.
PY - 2020/4/1
Y1 - 2020/4/1
N2 - The capacity of unifilar finite-state channels in the presence of feedback is investigated. We derive a new evaluation method to extract graph-based encoders with their achievable rates, and to compute upper bounds to examine their performance. The evaluation method is built upon a recent methodology to derive simple bounds on the capacity using auxiliary directed graphs. While it is not clear whether the upper bound is convex, we manage to formulate it as a convex optimization problem using transformation of the argument with proper constraints. The lower bound is formulated as a non-convex optimization problem, yet, any feasible point to the optimization problem induces a graph-based encoder. In all examples, the numerical results show near-Tight upper and lower bounds that can be easily converted to analytic results. For the non-symmetric trapdoor channel and binary fading channels (BFCs), new capacity results are established by computing the corresponding bounds. For all other instances, including the Ising channel, the near-Tightness of the achievable rates is shown via a comparison with corresponding upper bounds. Finally, we show that any graph-based encoder implies a simple coding scheme that is based on the posterior matching principle and achieves the lower bound.
AB - The capacity of unifilar finite-state channels in the presence of feedback is investigated. We derive a new evaluation method to extract graph-based encoders with their achievable rates, and to compute upper bounds to examine their performance. The evaluation method is built upon a recent methodology to derive simple bounds on the capacity using auxiliary directed graphs. While it is not clear whether the upper bound is convex, we manage to formulate it as a convex optimization problem using transformation of the argument with proper constraints. The lower bound is formulated as a non-convex optimization problem, yet, any feasible point to the optimization problem induces a graph-based encoder. In all examples, the numerical results show near-Tight upper and lower bounds that can be easily converted to analytic results. For the non-symmetric trapdoor channel and binary fading channels (BFCs), new capacity results are established by computing the corresponding bounds. For all other instances, including the Ising channel, the near-Tightness of the achievable rates is shown via a comparison with corresponding upper bounds. Finally, we show that any graph-based encoder implies a simple coding scheme that is based on the posterior matching principle and achieves the lower bound.
KW - Channel capacity
KW - Markov decision process (MDP)
KW - convex optimization
KW - feedback capacity
KW - posterior matching (PM)
UR - http://www.scopus.com/inward/record.url?scp=85083818726&partnerID=8YFLogxK
U2 - 10.1109/TCOMM.2020.2965454
DO - 10.1109/TCOMM.2020.2965454
M3 - Article
AN - SCOPUS:85083818726
SN - 1558-0857
VL - 68
SP - 2106
EP - 2117
JO - IEEE Transactions on Communications
JF - IEEE Transactions on Communications
IS - 4
M1 - 8955863
ER -