Continuous-time directed information and its role in communication

Haim H. Permuter; Young Han Kim; Tsachy Weissman

doi:10.1109/ITW.2011.6089374

Continuous-time directed information and its role in communication

Haim H. Permuter, Young Han Kim, Tsachy Weissman

Department of Electrical & Computer Engineering

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

Abstract

The notion of directed information was recently introduced for stochastic processes in continuous time. The key idea of the definition is to consider all possible time partitions of a given interval. Unlike the definition of mutual information of discrete-time random variables with continuous alphabets where the supremum over all possible partitions of the alphabets plays an important role, here the infimum over all possible time-partition plays an important role. We show that the fundamental limit on reliable communication for a wide class of continuous-time channels with feedback are characterized using the notion of continuous-time directed information.

Original language	English
Title of host publication	2011 IEEE Information Theory Workshop, ITW 2011
Pages	190-194
Number of pages	5
DOIs	https://doi.org/10.1109/ITW.2011.6089374
State	Published - 21 Dec 2011
Event	2011 IEEE Information Theory Workshop, ITW 2011 - Paraty, Brazil Duration: 16 Oct 2011 → 20 Oct 2011

Publication series

Name	2011 IEEE Information Theory Workshop, ITW 2011

Conference

Conference	2011 IEEE Information Theory Workshop, ITW 2011
Country/Territory	Brazil
City	Paraty
Period	16/10/11 → 20/10/11

Keywords

Continuous-time communication
Duncan's theorem
Poisson channel
directed information
feedback capacity

ASJC Scopus subject areas

Information Systems

Access to Document

10.1109/ITW.2011.6089374

Cite this

@inproceedings{9c02f357d76d4c8a8d1305bc076a5572,

title = "Continuous-time directed information and its role in communication",

abstract = "The notion of directed information was recently introduced for stochastic processes in continuous time. The key idea of the definition is to consider all possible time partitions of a given interval. Unlike the definition of mutual information of discrete-time random variables with continuous alphabets where the supremum over all possible partitions of the alphabets plays an important role, here the infimum over all possible time-partition plays an important role. We show that the fundamental limit on reliable communication for a wide class of continuous-time channels with feedback are characterized using the notion of continuous-time directed information.",

keywords = "Continuous-time communication, Duncan's theorem, Poisson channel, directed information, feedback capacity",

author = "Permuter, {Haim H.} and Kim, {Young Han} and Tsachy Weissman",

year = "2011",

month = dec,

day = "21",

doi = "10.1109/ITW.2011.6089374",

language = "English",

isbn = "9781457704376",

series = "2011 IEEE Information Theory Workshop, ITW 2011",

pages = "190--194",

booktitle = "2011 IEEE Information Theory Workshop, ITW 2011",

note = "2011 IEEE Information Theory Workshop, ITW 2011 ; Conference date: 16-10-2011 Through 20-10-2011",

}

TY - GEN

T1 - Continuous-time directed information and its role in communication

AU - Permuter, Haim H.

AU - Kim, Young Han

AU - Weissman, Tsachy

PY - 2011/12/21

Y1 - 2011/12/21

N2 - The notion of directed information was recently introduced for stochastic processes in continuous time. The key idea of the definition is to consider all possible time partitions of a given interval. Unlike the definition of mutual information of discrete-time random variables with continuous alphabets where the supremum over all possible partitions of the alphabets plays an important role, here the infimum over all possible time-partition plays an important role. We show that the fundamental limit on reliable communication for a wide class of continuous-time channels with feedback are characterized using the notion of continuous-time directed information.

AB - The notion of directed information was recently introduced for stochastic processes in continuous time. The key idea of the definition is to consider all possible time partitions of a given interval. Unlike the definition of mutual information of discrete-time random variables with continuous alphabets where the supremum over all possible partitions of the alphabets plays an important role, here the infimum over all possible time-partition plays an important role. We show that the fundamental limit on reliable communication for a wide class of continuous-time channels with feedback are characterized using the notion of continuous-time directed information.

KW - Continuous-time communication

KW - Duncan's theorem

KW - Poisson channel

KW - directed information

KW - feedback capacity

UR - http://www.scopus.com/inward/record.url?scp=83655201528&partnerID=8YFLogxK

U2 - 10.1109/ITW.2011.6089374

DO - 10.1109/ITW.2011.6089374

M3 - Conference contribution

AN - SCOPUS:83655201528

SN - 9781457704376

T3 - 2011 IEEE Information Theory Workshop, ITW 2011

SP - 190

EP - 194

BT - 2011 IEEE Information Theory Workshop, ITW 2011

T2 - 2011 IEEE Information Theory Workshop, ITW 2011

Y2 - 16 October 2011 through 20 October 2011

ER -

Continuous-time directed information and its role in communication

Abstract

Publication series

Conference

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this