Abstract
In this work, we study the optimal configuration of the physical layer in wireless networks by means of Semi-Markov Decision Process (SMDP) modeling. In particular, assume the physical layer is characterized by a set of potential operating points, with each point corresponding to a rate and reliability pair; for example, these pairs might be obtained through a now-standard diversity-multiplexing tradeoff characterization. Given the current network state (e.g., buffer occupancies), a Decision Maker (DM) needs to dynamically decide which operating point to use. The SMDP problem formulation allows us to choose from these points. A solution to the SMDP problem is an optimal selection of operating points, which is expressed by a decision rule as a function of the number of packets in the source's finite queue, the channel state, and the size of the packet to be transmitted. We derive a general solution to the SMDP which covers various model configurations, packet size distributions and channel dynamics. For the specific case of exponential transmission times, we analytically prove the optimal policy has a threshold structure. Numerical results validate this finding, as well as depict muti-threshold policies for time varying channels such as the Gilbert-Elliott channel.
Original language | English |
---|---|
Article number | 9180309 |
Pages (from-to) | 2601-2614 |
Number of pages | 14 |
Journal | IEEE/ACM Transactions on Networking |
Volume | 28 |
Issue number | 6 |
DOIs | |
State | Published - 1 Dec 2020 |
Keywords
- Markov decision process
- physical layer
- wireless networks
ASJC Scopus subject areas
- Software
- Computer Science Applications
- Computer Networks and Communications
- Electrical and Electronic Engineering