A Tight Second-Order Converse Bound for Variable-Length Feedback Codes

📅 2026-09-10
📈 Citations: 0
Influential: 0
📄 PDF
🤖 AI Summary
本文解决了变量长度反馈码在离散无记忆信道中的性能限制问题,通过使用Rényi熵和外在Jensen-Shannon散度方法,确定了第二阶基本极限。
📝 Abstract
We study variable-length feedback (VLF) codes over a discrete memoryless channel under average decoding-time and error-probability constraints. In the non-vanishing error probability regime, Polyanskiy, Poor, and Verdú (2011) derive achievability and converse bounds on the logarithm of the maximum achievable codebook size. These bounds establish the $ε$-capacity but leave an order-$\log N$ gap in the second-order expansion, where $N$ is the average decoding time. Yavas and Tan (2025) improve the coefficient of $\log N$ in the achievability bound from $-1$ to $-\frac{C}{C_1}$, where $C$ is the channel capacity and $C_1$ is the largest Kullback--Leibler divergence between two conditional output distributions. We derive a converse with the same coefficient, establishing the second-order fundamental limit for every positive-capacity discrete memoryless channel with finite $C_1$. The result also covers the moderate-deviations and error-exponent regimes, including polynomially decaying error probabilities. The converse uses Rényi entropy and the extrinsic Jensen--Shannon divergence. We also derive necessary properties of asymptotically optimal VLF codes. First-order-optimal codes must have an early-stopping branch, and second-order-optimal codes must additionally exhibit communication and confirmation behavior. Finally, for the binary erasure channel, we determine the exact minimum expected decoding time for every message-set size and admissible error probability.
Problem

Research questions and friction points this paper is trying to address.

Variable-Length Feedback Codes
Discrete Memoryless Channel
Second-Order Expansion
Error Probability
Channel Capacity
Innovation

Methods, ideas, or system contributions that make the work stand out.

Rényi entropy
extrinsic Jensen–Shannon divergence
second-order fundamental limit
🔎 Similar Papers
💼 Related Jobs
No related jobs found.
R
Recep Can Yavas
Department of Electrical and Electronics Engineering at Bilkent University, 06800, Ankara, Turkey