PaperlayerView exact revision on arXiv

Source-linked AI summary

An Iterative BP-CNN Architecture for Channel Decoding

Fei Liang, Cong Shen, Feng Wu

arXiv:1707.05697v1stat.MLcs.IT

TL;DR

The paper addresses decoding when noise correlation limits receiver performance. It proposes an iterative BP-CNN receiver with a new CNN loss function and reports improved decoding performance.

  • Problem

    Receiver performance can be unsatisfactory when a designed channel code is not paired with a receiver that handles noise correlation.

    Source: §I · p. 2

  • Method

    The proposed iterative BP-CNN architecture concatenates belief propagation with a CNN and uses a loss function designed to reduce residual noise power.

    Source: §I · p. 3

  • Results

    Iterating between BP and CNN improves decoding SNR and results in better decoding performance.

    Source: §I · p. 2

  • Takeaways & Limitations

    The iterative BP-CNN decoder provides a decoding structure for linear codes that addresses correlated noise.

    Source: §V · p. 28

Abstract

from arXiv · show

Inspired by recent advances in deep learning, we propose a novel iterative BP-CNN architecture for channel decoding under correlated noise. This architecture concatenates a trained convolutional neural network (CNN) with a standard belief-propagation (BP) decoder. The standard BP decoder is used to estimate the coded bits, followed by a CNN to remove the estimation errors of the BP decoder and obtain a more accurate estimation of the channel noise. Iterating between BP and CNN will gradually improve the decoding SNR and hence result in better decoding performance. To train a well-behaved CNN model, we define a new loss function which involves not only the accuracy of the noise estimation but also the normality test for the estimation errors, i.e., to measure how likely the estimation errors follow a Gaussian distribution. The introduction of the normality test to the CNN training shapes the residual noise distribution and further reduces the BER of the iterative decoding, compared to using the standard quadratic loss function. We carry out extensive experiments to analyze and verify the proposed framework. The iterative BP-CNN decoder has better BER performance with lower complexity, is suitable for parallel implementation, does not rely on any specific channel model or encoding method, and is robust against training mismatches. All of these features make it a good candidate for decoding modern channel codes.

I. INTRODUCTION

The paper addresses linear-code decoding under correlated channel noise, where model-based approaches can be complex and unreliable. It proposes an iterative BP-CNN receiver that exploits learned noise-correlation features and improves decoding performance with practical implementation benefits.

Motivation

  • Correlated channel noise can undermine otherwise well-designed channel codes, while strongly correlated noise makes joint-distribution-based BP optimization highly complex.Model-based approaches may also fail to obtain a well-behaved joint noise distribution.Source: §I · p. 2
  • Existing deep-learning channel-decoding work did not address efficient decoding of linear codes under correlated channel noise.This gap motivates a learned receiver that avoids relying on a predefined channel model.Source: §I · p. 2

Iterative BP-CNN architecture

  • Iterating between BP and CNN gradually improves decoding SNR and results in better decoding performance.The CNN is trained to estimate channel noise while producing an output beneficial to the BP decoder.Source: §I · pp. 2–3

Properties and contributions

  • The proposed decoder offers better decoding performance than standard BP with lower complexity, supports parallel computing, and adapts to different channel conditions and linear codes.Its CNN consists mostly of linear operations, and the method is described as data driven rather than dependent on predefined models.Source: §I · pp. 2–3
  • The enhanced BP-CNN loss function combines residual-noise-power reduction with a Jarque-Bera normality test, and experiments evaluate the framework extensively.The normality component shapes the residual noise for improved compatibility with BP decoding.Source: §I · p. 3

Iterative BP-CNN architecture

  • The iterative BP-CNN architecture concatenates a standard BP decoder with a trained CNN and repeatedly processes received symbols between them.BP first estimates coded bits; subtracting estimated transmit symbols yields a noise estimate that the CNN refines using learned noise correlations.Source: §I · pp. 2–3

II. RELATED WORKS

Prior work applies deep learning across communications and channel decoding, but efficient decoding of linear codes under correlated channel noise remains unaddressed.

III. SYSTEM DESIGN

The system concatenates BP decoding with CNN-based noise estimation and feeds corrected observations back into BP. Training targets both accurate estimation and residual noise properties beneficial to subsequent decoding.

III. SYSTEM DESIGN

  • The iterative BP-CNN decoder concatenates a CNN with BP and repeatedly processes corrected observations to improve decoding.BP produces an initial estimate; CNN estimates channel noise, and the resulting corrected vector is fed back for another BP round.Source: §III · p. 5, A. System Framework · p. 7
  • The architecture is presented for LDPC codes but is readily applicable to other linear codes and does not depend on the specific correlation model.Source: A. System Framework · pp. 5–6
  • After BP estimates the transmitted symbols, subtracting them from the received symbols yields an estimated channel noise vector with decoding-error contamination.Source: A. System Framework · p. 6
  • The CNN suppresses noise-estimation error by exploiting correlation in the channel noise, then produces a residual-noise estimate for BP updates.Source: A. System Framework · p. 7
  • Enhanced BP-CNN training jointly depresses residual-noise power and encourages a Gaussian residual distribution, unlike baseline quadratic-loss training.Source: A. System Framework · p. 7
  • Correlated additive noise matters in wireless and cellular systems, where fading and multi-user interference can create correlations relevant to decoding.Source: A. System Framework · p. 8

B. Why is CNN Useful for Channel Decoding?

CNN-based channel decoding is motivated by the analogy between noise recovery and image denoising. The decoder treats correlated channel noise as exploitable structure while retaining CNNs’ low-complexity denoising appeal.

B. Why is CNN Useful for Channel Decoding?

C. Belief Propagation Decoding

Standard BP passes messages on a Tanner graph under a factored AWGN probability model. Correlated noise breaks that factorization, making direct incorporation of joint noise statistics potentially highly complex.

C. Belief Propagation Decoding

  • BP decoding iteratively passes messages between variable and check nodes in a Tanner graph, then determines bit values from final variable-node LLRs.Source: C. Belief Propagation Decoding · p. 9
  • The paper introduces CNN-based noise estimation as an alternative processing stage following BP in the proposed architecture.Source: Figure 2 · p. 10
  • For AWGN channels, BP uses a joint bit-probability model combining channel-conditioned probabilities with parity-check indicators.Source: C. Belief Propagation Decoding · p. 10
  • With correlated noise, the received-symbol-conditioned probability cannot be factored because the symbols are correlated.Source: C. Belief Propagation Decoding · p. 10
  • Incorporating the joint distribution of correlated noise samples into standard BP may have very high complexity, especially under strong correlations.Source: C. Belief Propagation Decoding · pp. 9–10

D. CNN for Noise Estimation

The paper uses a one-dimensional CNN to estimate channel noise within the iterative BP-CNN receiver. Its enhanced loss jointly reduces residual-noise power and shapes residual noise toward a Gaussian distribution for subsequent BP decoding.

CNN motivation

  • CNN noise estimation is motivated by its feature-extraction and denoising capabilities in low-level restoration tasks.The proposed network adapts such architectures to one-dimensional channel-noise vectors.Source: D. CNN for Noise Estimation · p. 10

CNN architecture

  • The proposed CNN takes a 1-D vector as input rather than a 2-D image and uses convolutional layers to construct feature maps.The architecture is specified by its layers, filter sizes, and feature-map counts.Source: D. CNN for Noise Estimation · p. 11
  • Pooling, dropout, and fully connected layers are omitted because the output preserves input dimensions, validation monitoring controls overfitting, and dense layers are costly for low-level tasks.The authors report no performance gain from dropout in their tests.Source: D. CNN for Noise Estimation · pp. 11–12

Loss function

  • The baseline loss minimizes residual-noise power, whereas the enhanced loss also shapes the residual-noise distribution for concatenation with BP.The CNN output affects the next BP iteration, so training considers the relationship between both stages.Source: 1) Loss function · p. 12
  • The enhanced loss combines residual-noise power with a Jarque-Bera normality term that measures Gaussian conformity, balanced by λ.Its skewness and kurtosis components are derivable and simple to train, although the Jarque-Bera test is not optimal.Source: 1) Loss function · p. 12
  • Experiments report that the new loss provides a desirable output, while selecting λ analytically remains difficult.The parameter is therefore chosen through simulations.Source: 1) Loss function · p. 13

2) Generating the training data:

Training data are generated by simulating coded transmissions through correlated channels and decoding them with BP to obtain estimated noise inputs. The training SNR range must balance insufficient and excessive BP-decoding errors, while practical deployment relies on offline training and stored networks.

Data generation

  • Estimated noise data are generated from encoded, BPSK-mapped bits passed through simulated channel interference and BP decoding.The process also uses AWGN data and a channel correlation matrix to construct training samples.Source: 2) Generating the training data · p. 13

Channel conditions

  • Training data span multiple channel SNRs because SNR controls BP-decoding errors and therefore the CNN input.The SNR conditions are represented by the set Γ.Source: 2) Generating the training data · p. 13
  • Very good channels provide too few BP errors for robust noise-feature learning, whereas very bad channels produce errors that mask channel-noise features.The authors analyze this training-data problem experimentally.Source: 2) Generating the training data · p. 13

Practical deployment

  • CNN training requires substantial data and computational complexity, but these requirements are handled largely offline using powerful devices and mass storage.The resulting trained network can be stored in on-device memory for online use.Source: 2) Generating the training data · pp. 13–14
  • Known noise-correlation functions allow training data to be generated for representative communication-system use cases.The paper frames this as a way to address dependence of CNNs on training data.Source: 2) Generating the training data · pp. 13–14

F. Design Summary

The design summary treats iterative BP-CNN decoding as a configurable architecture whose iterations, CNN structure, BP iterations, and loss weighting determine performance–complexity trade-offs. Experiments use a fixed LDPC setup and evaluate BER across correlated and uncorrelated channels.

Architecture parameters

  • The iterative architecture is parameterized by total iterations K, CNN layers and feature maps, filter sizes, and BP-decoder iterations.It can be unfolded into an open-loop BP-CNN1-BP-CNN2-...-CNNx-BP framework.Source: F. Design Summary · p. 14
  • The closed-loop design stores one CNN, whereas the more general open-loop framework uses x CNNs with higher training and storage demands.Serially concatenated CNNs may depend on earlier networks during training.Source: F. Design Summary · p. 14

Experimental design

  • The enhanced design requires λ and training-channel conditions to be selected carefully, and experiments provide guidance for these parameters.The study evaluates their influence on decoding performance.Source: F. Design Summary · p. 15

Performance evaluation

  • With equal total BP iterations, BP-CNN is tested as BP(25)-CNN-BP(25), while standard BP is tested with BP(50).The proposed design uses one BP–CNN iteration in this comparison.Source: 1) BP-CNN reduces decoding BER · p. 16
  • At η = 0.8, BP-CNN improves decoding by approximately 3.5dB at BER=10−4, and this gain is not matched by additional standard-BP iterations.At η = 0.5 the gain is smaller, while at η = 0 the method performs similarly to standard BP.Source: 1) BP-CNN reduces decoding BER · p. 16
  • The enhanced decoder outperforms baseline BP-CNN, with gains increasing monotonically as correlation η increases.The authors attribute this trend to greater opportunity for CNNs to extract noise features.Source: 1) BP-CNN reduces decoding BER · pp. 16, 18

2) BP-CNN achieves performance gain with lower complexity:

BP-CNN improves decoding performance at lower comparable complexity, especially under strong noise correlation. The enhanced loss matters because its normality term shapes residual noise, while λ must balance distributional shaping against residual-noise power.

Complexity comparison

  • A CNN runtime is roughly equivalent to two BP iterations, making BP(5)-CNN-BP(5) approximately as complex as standard BP(12).The comparison uses matched TensorFlow environments and shared computation resources.Source: 2) BP-CNN achieves performance gain… · p. 18
  • BP(5)-CNN-BP(5) has comparable performance to BP(50) with much lower complexity.BP(12) is used as the fairer good-but-not-saturated comparison at approximately matched complexity.Source: 2) BP-CNN achieves performance gain… · pp. 18–19
  • At approximately equal complexity, both baseline and enhanced BP(5)-CNN-BP(5) outperform BP(12).The gain is around 3dB under strong correlation and 0.1 to 0.5dB under moderate correlation.Source: 2) BP-CNN achieves performance gain… · p. 19

Normality-test ablation

  • Small λ values cannot guarantee Gaussian residual noise, while large λ values cannot sufficiently reduce residual-noise power.Thus λ affects enhanced BP-CNN performance and is selected through simulations rather than analytic optimization.Source: 2) BP-CNN achieves performance gain… · pp. 20–21
  • Including the normality test makes the residual-noise distribution more suitable for concatenation with BP.The comparison uses empirical residual-noise distributions from enhanced and baseline BP-CNN.Source: 2) BP-CNN achieves performance gain… · p. 21

Hyperparameter choice

  • For η = 0.8, λ = 0.1 performs best, whereas λ = 10 performs best for η = 0.5.The paper explains that stronger correlation permits more error removal, favoring greater emphasis on residual-noise power.Source: 2) BP-CNN achieves performance gain… · pp. 21–22

4) Multiple iterations between CNN and BP further improve the performance:

Iterating between BP and CNN further improves decoding performance, with gains eventually saturating as the CNN reaches its capacity.

5) BP-CNN is robust under different correlation models:

The BP-CNN decoder maintains performance gains across correlation models, while complexity allocation and training-data diversity affect its effectiveness.

V. CONCLUSIONS AND FUTURE DIRECTIONS

The paper concludes that iterative BP-CNN decoding addresses correlated channel noise through alternating BP and CNN processing, with simulations supporting its effectiveness. Future work includes more flexible architectures and improved loss functions.

  • The proposed iterative BP-CNN structure is designed to handle correlated channel noise.Source: §V · p. 28
  • BP estimates coded bits and indirectly estimates noise, while CNN learns noise correlation to remove BP estimation errors.Source: §V · p. 28
  • Extensive simulations show the effectiveness of the proposed iterative BP-CNN decoder.Source: §V · p. 28

Future directions

  • The loss function is not completely equivalent to system performance, motivating improved loss-function design.Source: §V · p. 28
  • An open-loop generalization can vary BP iterations and CNN structures across stages to allocate complexity more flexibly.The proposed form is BP(n1)-CNN1-BP(n2)-CNN2-...-BP(nx)-CNNx-BP(nx+1).Source: §V · p. 28

Related papers

Loading 1707.05697v1…