2006.20: Mutual information and capacity of a linear digital channel

2006.20: D. S. Broomhead and Nikita Sidorov (2004) Mutual information and capacity of a linear digital channel. Nonlinearity, 17 (6). pp. 2203-2223. ISSN 1361-6544

Full text available as:

PDF - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader 295 Kb

DOI: 10.1088/0951-7715/17/6/010

Abstract

In this paper we analyse a simple model of a digital communications channel. This model proves to be closely related to an iterated function system (IFS) related to the well-known Bernoulli convolution. We derive it from a randomly forced first-order ordinary differential equation. This allows the parameter of the Bernoulli convolution—the contraction rate, λ—to be related to the rate at which symbols are input to the channel. It is shown that for a channel with equiprobable binary inputs the mutual information between input and output distributions is the stationary measure of the complement of the overlap region of the IFS. We show that the mutual information is Hölder continuous with respect to λ and decreases hyper-exponentially as λ → 1. We also study the case of non-equiprobable binary inputs and show that the maximum of the mutual information—the channel capacity—does not always correspond to equiprobable inputs.

Download Statistics: last 4 weeks
Repository Staff Only: edit this item