ArticlePDF Available

Variable-Node-Based Dynamic Scheduling Strategy for Belief-Propagation Decoding of LDPC Codes

Authors:
  • Sun Yat-Sen University | Guangzhou Xinhua University

Abstract

Among the belief-propagation (BP) decoding algorithms of low-density parity-check (LDPC) codes, the algorithms based on dynamic scheduling strategy show excellent performance. In this letter, we propose a variable-node-based dynamic scheduling decoding algorithm. For the proposed algorithm, the reliability of variable nodes is evaluated based on the log-likelihood ratio (LLR) values and the parity-check equations; then, a more accurate dynamic selection strategy is presented. Simultaneously, the oscillating variable nodes are processed so that the influence of the spread of error messages caused by oscillation are suppressed. In addition, the proposed algorithm updates the same number of messages in one iteration as the original BP decoding algorithm does, which is different from some other dynamic decoding algorithms. Simulation results demonstrate that the proposed algorithm outperforms other algorithms.
IEEE COMMUNICATIONS LETTERS, VOL. 19, NO. 2, FEBRUARY 2015 147
Variable-Node-Based Dynamic Scheduling Strategy for
Belief-Propagation Decoding of LDPC Codes
Xingcheng Liu, Senior Member, IEEE, Yuanbin Zhang, and Ru Cui
Abstract—Among the belief-propagation (BP) decoding algo-
rithms of low-density parity-check (LDPC) codes, the algorithms
based on dynamic scheduling strategy show excellent perfor-
mance. In this letter, we propose a variable-node-based dynamic
scheduling decoding algorithm. For the proposed algorithm,
the reliability of variable nodes is evaluated based on the log-
likelihood ratio (LLR) values and the parity-check equations;
then, a more accurate dynamic selection strategy is presented.
Simultaneously, the oscillating variable nodes are processed so
that the influence of the spread of error messages caused by
oscillation are suppressed. In addition, the proposed algorithm
updates the same number of messages in one iteration as the
original BP decoding algorithm does, which is different from some
other dynamic decoding algorithms. Simulation results demon-
strate that the proposed algorithm outperforms other algorithms.
Index Terms—Belief-propagation (BP), dynamic scheduling
strategy, low-density parity-check (LDPC) codes, dynamic selec-
tion strategy, oscillating variable nodes.
I. INTRODUCTION
LOW-DENSITY PARITY-CHECK (LDPC) codes which
were proposed in 1962 [1] had been proved to approach
the Shannon-limit performance with the belief-propagation
(BP) decoding algorithm [2]. Scheduling strategies play an im-
portant role in decoding algorithms of LDPC codes [3]. Among
them, the parallel scheduling strategy is the basic one, in which
all check-to-variable (C2V) messages are updated simultane-
ously first and then all variable-to-check (V2C) messages are
updated simultaneously [1]. The serial scheduling strategy is
another one, with which the messages are updated serially
according to a fixed update sequence [4], [5]. Simulation results
show that the serial scheduling strategy surpasses the parallel
one [6]. Recently, a better hardware-friendly fixed schedule is
presented [7].
Though the serial scheduling strategy has excellent perfor-
mance, the fixed update sequence is not always the best op-
tion since the error-correcting performance can still be further
improved. To this end, the residual belief propagation (RBP)
algorithm [8] is designed to formulate the update sequence, and
a new scheduling strategy, the informed dynamic scheduling
strategy, is presented [9], [10]. As for the informed dynamic
scheduling strategy, messages are updated according to the
residual, and the message with the maximum residual is up-
Manuscript received July 1, 2014; revised November 30, 2014 and December
15, 2014; accepted December 16, 2014. Date of publication December 22,
2014; date of current version February 6, 2015. This work was supported by
the National Natural Science Foundation of China under Grants 60970041
and 61173018. The associate editor coordinating the review of this paper and
approving it for publication was H. Saeedi.
The authors are with the School of Information Science and Technology,
Sun Yat-sen University, Guangzhou 510275, China (e-mail: isslxc@mail.
sysu.edu.cn).
Color versions of one or more of the figures in this paper are available online
at http://ieeexplore.ieee.org.
Digital Object Identifier 10.1109/LCOMM.2014.2385096
dated first. Simulation results demonstrated that the informed
dynamic scheduling strategy has outstanding performance with
fewer iterations. Since then, some decoding algorithms us-
ing informed dynamic scheduling strategy were introduced,
such as the Variable-to-Check residual belief-propagation (VC
RBP) [11], the efficient dynamic scheduling for layered
belief-propagation (EDS-LBP) [12], the informed Variable-
to-Check residual belief-propagation (IVC RBP) [13], the
quota-based residual belief-propagation (Q-RBP) [14] and the
silent-Variable-node-free residual belief-propagation (SVNF-
RBP) [14]. Recently, such strategy for decoding of non-binary
LDPC codes [15] was also presented.
Dynamic selection strategy is an important part in dynamic
decoding algorithm. In this letter, a more accurate dynamic
selection strategy is proposed. The oscillation phenomenon
of variable nodes, which was not paid enough attention in
the dynamic decoding algorithms, is also discussed, and a
method that processes the oscillation is presented. Based on the
new dynamic selection strategy and the suggested oscillation
processing method, we propose a new dynamic decoding algo-
rithm. Simulation results illustrate that the proposed algorithm
could not only increase convergence speed but improve the
error-correcting performance at medium to high signal-to-noise
ratio (SNR) when compared to other algorithms.
II. LLR BP DECODING ALGORITHM
A binary LDPC code is represented by an M×Nmatrix H.
This matrix can be expressed with the Tanner Graph that is
composed of Nvariable nodes, vj, and Mcheck nodes, ci, where
j=1,2,...,N,i=1,2,...,M. At the beginning of the decoding
algorithm, every variable node is initialized with the informa-
tion transmitted from the channel. We only discuss the decoding
algorithms with computation of information reliability in the
common log domain. The log-likelihood ratio (LLR) Cvj,ofthe
information for variable node vj, is computed as follows
Cvj=logp(yj|vj=0)
p(yj|vj=1),(1)
where the received signal yj=(12vj)+zfor binary phase-
shift keying (BPSK) modulation, zis a Gaussian distribution
random variable with mean 0 and variance σ2. The messages
from the check nodes cito variable nodes vj(C2V) are
propagated with
mcivj=2arctanh
vbN(ci)\vj
tanh mvbci
2
,(2)
where N(ci)\vjdenotes all the variable nodes connected to
check node ciexcept variable node vj.
1089-7798 © 2014 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission.
See http://www.ieee.org/publications_standards/publications/rights/index.html for more information.
http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=6994784
Xingcheng Liu, Yuanbin Zhang, and Ru Cui, Variable-Node-Based Dynamic Scheduling Strategy for Belief-Propagation Decoding of LDPC Codes,
IEEE Communications Letters, 19(2): 147-150, Feb. 2015.
148 IEEE COMMUNICATIONS LETTERS, VOL. 19,NO. 2, FEBRUARY 2015
The messages sent from the variable nodes to check nodes
(V2C) are
mvjci=
caN(vj)\ci
mcavj+Cvj,(3)
where N(vj)\cidenotes all the check nodes connected to vari-
able node vjexcept check node ci. After updating all the C2V
and V2C messages, the decoded LLR value of each variable
node vjis given as
L(vj)=
caN(vj)
mcavj+Cvj.(4)
A hard decoding decision is made based on the LLR values
of these variable nodes given by (4). The LLR BP decoding
algorithm runs iteratively, where the entire operation, including
updating all the C2V and V2C messages, is counted as one
iteration. The algorithm continues the iterative processing until
either all the parity check equations are satisfied or the maxi-
mum number of iterations is reached.
III. THE PROPOSED ALGORITHM
A. Dynamic Selection Strategy
Unlike the serial strategy, the dynamic scheduling strategy
does not have a fixed update sequence. In fact, before the
next update step starting, the dynamic selection strategy is first
processed to determine which edge (node) will be updated.
Usually, the dynamic decoding algorithms update the least
reliable message preferentially. It is the main purpose of the
dynamic selection strategy that is to choose the least reliable
message. Most of the dynamic decoding algorithms [11], [14]
only take the residual as the basis of the dynamic selection
strategies, where the residual is computed as
r(mk)=f(mk)mk,(5)
where r(mk)denotes the residual, mkand f(mk)denote the edge
(node) message before and after an update, respectively.
In the proposed dynamic decoding algorithm, the update
sequence of the information is formulated from the viewpoint
of the variable nodes, which is that the least reliable variable
has the highest updating priority. However, whether a variable
node is least reliable or not does not just only rely on the
residual. So, if the least reliable node is judged only based
on the single condition, the criterion thus yielded is not so
accurate as it should be. In fact, the variable node with the
largest residual does not mean this variable node is definitely
the least stable. In our proposed dynamic selection strategy, a
more accurate criterion with a combination of triple judgments
is adopted. First, all variable nodes are divided into two sets,
one of which consists of variable nodes whose signs of the
LLR change before and after an update, and is denoted with
C, the other of which consists of the remaining variable nodes.
Then, the number of unsatisfied parity check equations of
each variable node is counted. Thus, the largest number of the
unsatisfied parity check equations is found and denoted with P.
Obviously, PM. The variable nodes in set Cwhose number
of the unsatisfied parity check equations reaches Paretobe
marked and denoted with the subset, denoted with C1, while the
unmarked variable nodes form the other subset, denoted with
C2. Finally, if subset C1is non-empty, the variable node with
the largest residual in C1is to be chosen as the next one to
be updated, while the variable node with the largest residual
in set C2is to be selected for updating if C1is empty and C2is
non-empty. However, the set Ccan also be empty. If the case
appears, the variable node with the largest residual among all
the variable nodes is chosen as the next one to be updated.
Intuitively, the new dynamic selection strategy can select the
least reliable variable node more accurately than the strategy
only using one single judgement for updating [10].
B. Oscillation of Variable Nodes
The error types of the LLR BP decoding algorithm were
studied years ago [16], one of which is that the decoder does
not converge due to the oscillation of variable nodes, where
the oscillation is defined as the LLR sign changes before and
after an update [11], [14]. The reason why the variable nodes
oscillation happens is that there are two or more cycles through
one variable node. Meanwhile, the accurate and inaccurate
messages looping in the cycle and arrive at the variable node
with different times [16]. The oscillation reason is related to the
structure of the parity check matrix and has little to do with the
decoding algorithms. So, the phenomenon of the variable nodes
oscillation appears in nearly all the BP algorithms. Unfortu-
nately, all the recently-proposed dynamic decoding algorithms
neglect to treat the problem. So, no specific method is taken to
decrease the effect of the variable nodes oscillation.
As has been well-known, the main characteristic of dynamic
decoding algorithms is that one variable node can generate new
messages as many times as possible in one iteration and the
newest variable node message can be immediately used in the
same iteration. The processing of variable nodes oscillations
in dynamic decoding algorithms is very important. When a
variable node oscillates, it is relatively unreliable and tends to
be selected by the dynamic selection strategy. Meanwhile, the
method proposed here is taken to handle the oscillation. If this
variable node oscillates again, it will also be re-selected. Conse-
quently, this variable node will be updated many times and the
oscillation will also be processed many times in one iteration,
which leads to the consequence that the influence of the variable
node oscillation becomes smaller and smaller during decoding.
When processing the node oscillations, the method suggested
here is employed to recompute the LLR value as
L(vj)iL(vj)i1+L(vj)i,(6)
where L(vj)i1and L(vj)irepresent the LLR values of the j-th
variable node before and after an update, respectively. When
a variable node oscillates, it means either the LLR value of
the variable node before an update or that after an update can
reflect the correct case. However, it is difficult to distinguish
which one among those before and after an update is correct.
Therefore, we take the sum of the variable node LLR value
before and after an update for the new generated message. In
this way, the incorrect LLR value will be counteracted by the
correct one to some extent.
C. The Proposed OV-RBP Algorithm
So far, we presented the two key steps for the dynamic de-
coding algorithm to be proposed. Because the new algorithm is
suggested based on the oscillating variable nodes, the algorithm
LIU et al.: VARIABLE-NODE-BASED DYNAMIC SCHEDULING STRATEGY FOR BP DECODING 149
TAB L E I
COMPUTATION COMPLEXITY TABLE OF DIFFERENT DECODING ALGORITHMS
is accordingly named as the oscillating variable nodes based
residual belief propagation (OV-RBP) algorithm. Now, the con-
crete update steps are to be introduced as follows. The first
step, all the LLR values of variable nodes are computed and
the dynamic selection strategy is performed to select the least
reliable variable node. Without loss of generality, we assume
that the selected variable node is vj. The next step, for all
the check nodes which are connected to variable node vj,the
corresponding C2V messages are updated. The third step, the
LLR value of variable node vjupdated with the new C2V
messages is calculated and an oscillation decision is made
for vj.Ifvjoscillates, the oscillation is to be processed with
(6). Again the next step, for all the check nodes which are
connected to variable node vj, the corresponding V2C messages
are updated. The last step, for each check node cathat is
connected to variable node vj, the LLR values of variable nodes
which are connected to caexcluding vjare computed and the
dynamic selection strategy is performed.
The OV-RBP algorithm in pseudo-code is given below.
Algorithm OV-RBP
1: Initialize all mcv=0
2: Initialize all mvic=Cviusing (1)
3: for every check node cado
4: for every variable node viN(ca)do
5: Compute mcaviusing (2)
6: end for
7: end for
8: for every variable node vido
9: Compute L(vi)using (4) and r(vi)using (5)
10: end for
11: Perform the proposed dynamic selection strategy and
select the least reliable variable node vi
12: for every caN(vi)do
13: Generate and propagate mcaviusing (2)
14: end for
15: Calculate L(vi)using (4)
16: Make oscillation decision for vi
17: if variable node vioscillates then
18: Recalculate LLR value using (6)
19: end if
20: Set r(vi)=0
21: for every caN(vi)do
22: Generate and propagate mvicausing (3)
23: end for
24: if stopping rule is not satisfied then
25: Go back to line 3
26: end if
D. Computation Complexity of the OV-RBP Algorithm
In the analysis of the computation complexity of the OV-
RBP algorithm, it is assumed that, dcand dvdenote the average
degrees of check nodes and variable nodes respectively, and E
is the total number of edges in the Tanner Graph. It is easy to
obtain the relations, E=dc·M=dv·N, no matter which type of
LDPC codes (regular or irregular) is used. The total number of
updates for all of the variable nodes in one iteration is computed
as the computation complexity. For convenient comparison,
the computation complexity of different decoding algorithms
is presented in Table I. It is clear that the proposed OV-RBP
algorithm updates 2Emessages (Efor C2V and V2C each)
in one iteration, which is the same as that of the original BP
algorithm [1]. However, for other dynamic decoding algorithms
like the NWRBP [10] and the VC RBP [11], more than 2E
messages are required to be updated in one iteration, which
means the OV-RBP algorithm needs more than one iteration
to update the same number of messages. Furthermore, the OV-
RBP has lower computation complexity than the NWRBP [10]
and the IVC RBP [13].
IV. S IMULATION RESULTS
In order to examine the error-correcting performance of the
proposed OV-RBP algorithm, simulations are performed over
the AWGN channel with BPSK modulation. In the simulation,
six other decoding algorithms are used for comparison, where
the LDPC codes are constructed based on the IEEE 802.16e
standard [17]. The maximum number of iterations is set to 5.
Fig. 1 shows the bit error rate (BER) performance of the dif-
ferent decoding algorithms for block-length 576 LDPC codes.
From Fig. 1, it is clearly shown that the OV-RBP algorithm
obtains the best BER performance at medium to high SNR
among the algorithms of interest. One of the main reasons is
that the proposed dynamic selection strategy can better over-
come the influence of trapping sets [18] on the error correction
performance of LDPC codes. Meanwhile, the processing of
oscillating variable nodes can decrease the influence of error
information propagating in the Tanner Graph. The BER perfor-
mance vs. the number of iterations for block-length 576 LDPC
codes at Eb/N0=2.2 dB is presented in Fig. 2. It is demon-
strated that the OV-RBP algorithm converges faster than any
other algorithms within about 25 iterations and has almost the
same performance as that of the excellent IVC RBP algorithm
[13] when the iterations exceed 25. Fig. 3 indicates the BER vs.
Eb/N0performance of the different algorithms for block-length
2304 LDPC code. From these figures, it is clearly observed that
the OV-RBP algorithm has better BER performance and faster
convergence speed than any other algorithms.
150 IEEE COMMUNICATIONS LETTERS, VOL. 19,NO. 2, FEBRUARY 2015
Fig. 1. BER vs. Eb/N0performance of (576, 288) LDPC code for LLR BP,
CSBP, NWRBP, VC RBP, EDS-LBP, IVC RBP and OV-RBP.
Fig. 2. BER vs. the number of iterations performance of (576, 288) LDPC
code at Eb/N0=2.2 dB for LLR BP, CSBP, NWRBP, VC RBP, EDS-LBP,
IVC RBP and OV-RBP.
Fig. 3. BER vs. Eb/N0performance of (2304, 1152) LDPC code for LLR BP,
CSBP, NWRBP, VC RBP, EDS-LBP, IVC RBP and OV-RBP.
V. C ONCLUSION
An variable nodes based dynamic decoding algorithm is
proposed. A more accurate dynamic selection strategy using
triple judgements is designed, which helps the OV-RBP algo-
rithm to overcome the influence of the trapping sets effectively.
Meanwhile, the oscillating variable nodes are processed in
the proposed algorithms in order to decrease the influence
of error information caused by oscillation. The comparison
targeting the OV-RBP algorithm is relatively fair for the reason
that it updates the same number of messages as that of the
original BP algorithm in one iteration. However, the number
of messages updated in one iteration in most of the other
dynamic decoding algorithms is larger than that of the proposed
algorithm. Simulation results demonstrate that the OV-RBP
algorithm outperforms other decoding algorithms in terms of
BER performance and convergence speed. Further study shows
the high accurateness of the OV-RBP algorithm.
REFERENCES
[1] R. Gallager, “Low-density parity-check codes,” IRE Trans. Inf. Theory,
vol. 8, no. 1, pp. 21–28, Jan. 1962.
[2] D. MacKay and R. Neal, “Near Shannon limit performance of low-density
parity-check codes,” IEEE Electron. Lett., vol. 32, no. 18, pp. 1645–1646,
Aug. 1996.
[3] Y. Y. Mao and A. H. Banihashemi, “Decoding low-density parity-check
codes with probabilistic scheduling,” IEEE Commun. Lett., vol. 5, no. 10,
pp. 414–416, Oct. 2001.
[4] M. M. Mansour and N. R. Shanbhag, “High-throughput LDPC decoders,”
IEEE Trans. Very Large Scale Integr. Syst., vol. 11, no. 6, pp. 976–996,
Dec. 2003.
[5] J. Zhang and M. Fossorier, “Shuffled belief propagation decoding,” IEEE
Trans. Commun., vol. 2, no. 53, pp. 209–213, Feb. 2005.
[6] E. Sharon, S. Litsyn, and J. Goldberger, “Efficient serial messagepassing
schedule for LDPC decoding,” IEEE Trans. Inf. Theory, vol. 53, no. 11,
pp. 4076–4091, Nov. 2007.
[7] H. C. Lee and Y. L. Ueng, “LDPC decoding scheduling for faster con-
vergence and lower error floor,” IEEE Trans. Commun., vol. 62, no. 9,
pp. 3104–3113, Sep. 2014.
[8] G. Elidan, I. McGraw, and D. Koller, “Residual belief propagation:
Informed scheduling for asynchronous message passing,” in Proc.
22nd Conf. Uncertainty Artif. Intell., Cambridge, MA, USA, Jul. 2006,
pp. 165–173.
[9] A. V. Casado, M. Griot, and R. Wesel, “Informed dynamic scheduling
for belief-propagation decoding of LDPC codes,” in IEEE Int. Conf.
Commun., Glasgow, UK, Jun. 2007, pp. 923–937.
[10] A. V. Casado, M. Griot, and R. Wesel, “LDPC decoders with informed
dynamic scheduling,” IEEE Trans. Commun., vol. 58, no. 12, pp. 3470–
3479, Dec. 2010.
[11] J. H. Kim, M. Y. Nam, and H. Y. Song, “Variable-to-check residual belief
propagation for LDPC codes,” IET Electron. Lett., vol. 45, no. 2, pp. 117–
118, Jan. 2009.
[12] G. J. Han and X. C. Liu, “An efficient dynamic schedule for layered belief-
propagation decoding of LDPC codes,” IEEE Commun. Lett., vol. 13,
no. 12, pp. 950–952, Dec. 2009.
[13] Y. Gong, X. C. Liu, W. C. Ye, and G. J. Han, “Effective informed dynamic
scheduling for belief propagation decoding of LDPC codes,” IEEE Trans.
Commun., vol. 59, no. 10, pp. 2683–2691, Oct. 2011.
[14] H. C. Lee, Y. L. Ueng, S. M. Yeh, and W. Y. Weng, “Two informed
dynamic scheduling strategies for iterative LDPC decoders,” IEEE Trans.
Commun., vol. 61, no. 3, pp. 886–896, Mar. 2013.
[15] G. J. Han, Y. L. Guan, and X. M. Huang, “Check node reliability-based
scheduling for BP decoding of non-binary LDPC codes,” IEEE Trans.
Commun., vol. 61, no. 3, pp. 877–885, Mar. 2013.
[16] G. Lechner and J. Sayir, “On the convergence of log-likelihood values in
iterative decoding,” in Mini-Workshop Topic Inf. Theory, Essen, Germany,
Sep. 2002, pp. 1–4.
[17] LDPC coding for OFDMA PHY., IEEE C802.16e-05/0066r3.
[18] T. Richardson, “Error floors of LDPC codes,” in Proc. Allerton
Conf. Communications, Control and Computing, Monticello, VA, USA,
Oct. 2003, pp. 1426–1435.
... It should give higher updating priority to those which are most likely to be corrected. The VN reliability measurements, e.g., decision reversion [13]- [15], the unsatisfied CN number [14], [16] and the change of VNs' total LLRs [14]- [16] were used implicitly to identify incorrect bit decisions and the unreliable VNs were given higher priority for update. On the other hand, BP decoding is usually performed in LLR domain for computational simplicity and for the fact that the likelihood can be recovered from its LLR value. ...
... It should give higher updating priority to those which are most likely to be corrected. The VN reliability measurements, e.g., decision reversion [13]- [15], the unsatisfied CN number [14], [16] and the change of VNs' total LLRs [14]- [16] were used implicitly to identify incorrect bit decisions and the unreliable VNs were given higher priority for update. On the other hand, BP decoding is usually performed in LLR domain for computational simplicity and for the fact that the likelihood can be recovered from its LLR value. ...
... LetL n = 2y n /σ 2 + m∈M(n)L C m→n be the precomputed LLR of v n . In [13] and [14], a VN's tentative decision bsgn(L n ) is regarded as unstable if bsgn(L n ) = bsgn(L n ) and the unstable VNs are given higher updating priority. In [15], a VN's reliability is judged by checking if the associated tentative bit decisions remain unchanged in three consecutive updates. ...
Article
Belief propagation (BP) decoding of low-density parity-check (LDPC) codes with various dynamic decoding schedules have been proposed to improve the efficiency of the conventional flooding schedule. As the ultimate goal of an ideal LDPC code decoder is to have correct bit decisions, a dynamic decoding schedule should be variable node (VN)-centric and be able to find the VNs with probable incorrect decisions and having a good chance to be corrected if chosen for update. We propose a novel and effective metric called conditional innovation (CI) which serves this design goal well. To make the most of dynamic scheduling which produces high-reliability bit decisions, we limit our search for the candidate VNs to those related to the latest updated nodes only. Based on the CI metric and the new search guideline separately or in combination, we develop several highly efficient decoding schedules. To reduce decoding latency, we introduce multi-edge updating versions which offer extra latency-performance tradeoffs. Numerical results show that both single-edge and multi-edge algorithms provide better decoding performance against most dynamic schedules and the CI-based algorithms are particularly impressive at the first few decoding iterations. Index Terms-LDPC codes, belief propagation, informed dynamic scheduling, decoding schedule, 5G new radio.
... To approach or even outperform the performances of RBP algorithms, some dynamic decoding algorithms based on the residual message and other selection criteria have also been proposed [16][17][18]. In the (RM RBP) [16], a reliability metric is used to define the priority of message updates. ...
... In the IVC RBP algorithm [17], the priority of message update is given to the most unstable variable node, the variable node is qualified as unstable if its sign before and after an update is reversed, and the stability metric calculation increase the computation. In the OV RBP [18], the stability metric based on the number of unsatisfied parity check equations of each variable node is used to select the scheduling order; the most unstable variable node with the high number of unsatisfied parity check equations is updated first. ...
... In addition, to this instability metric, the OV RBP algorithm [18] scheduling strategy looks at the number of unsatisfied parity check equations, defined for each variable node as Figure 4: Cycle of length 4 between v j and their vicinal variable nodes. ...
Article
Full-text available
The informed dynamic scheduling (IDS) strategies for the low-density parity check (LDPC) decoding have shown superior performance in error correction and convergence speed, particularly those based on reliability measures and residual belief propagation (RBP). However, the search for the most unreliable variable nodes and the residual precomputation required for each iteration of the IDS-LDPC increases the complexity of the decoding process which becomes more sequential, making it hard to exploit the parallelism of signal processing algorithms available in multicore platforms. To overcome this problem, a new, low-complexity scheduling system, called layered vicinal variable nodes scheduling (LWNS) is presented in this paper. With this LWNS, each variable node is updated by exchanging intrinsic information with all its associated control and variable nodes before moving to the next variable node updating. The proposed scheduling strategy is fixed by a preprocessing step of the parity control matrix instead of calculation of the residuals values and by computation of the most influential variable node instead the most unreliable metric. It also allows the parallel processing of independent Tanner graph subbranches identified and grouped in layers. Our simulation results show that the LWNS BP have an attractive convergence rate and better error correction performance with low complexity when compared to previous IDS decoders under the white Gaussian noise channel (AWGN).
... In addition, to resolve the problem of oscillation for the sign of variable nodes, the informed variable-to-check RBP (IVC-RBP) algorithm has been proposed, which updates the unstable VNs as the top priority [14]. In the oscillating variable node-based RBP (OV-RBP) algorithm, the reliability of the variable node is confirmed by LLR values and the number of connected unsatisfied check nodes jointly [15]. For the quota-based RBP (Q-RBP) algorithm, decoding resources are equally allocated to each edge [16]. ...
... Currently, many IDS algorithms [11][12][13][14][15][16][17][18][19][20] have shown promising decoding performance, but the resource allocation and greedy problems have not been adequately solved. These previous IDS algorithms always search and update the edge with the maximum message-residual from all the edges, which signifies that all the edges will be searched and calculated for each iteration. ...
Article
Full-text available
The residual belief propagation (RBP) algorithm, which is the most classic informed dynamic scheduling strategy, achieves outstanding performance in error correction and can drastically accelerate convergence speed. However, the greedy algorithmic property of this iterative decoding will inevitably cause loss of decoding performance. To address this, a novel algorithm called the partial average bundle residual belief propagation (PABRBP) is proposed in this paper. According to the construction characteristics of a base matrix of protograph‐LDPC codes, informed dynamic scheduling (IDS) strategies are applied to an edge bundle of base matrices for the first time. This edge bundle of the base matrix can be applied to a corresponding cyclic permutation matrix. Furthermore, the update level of each bundle is determined by the value of the Partially Average Bundle Residual (PABR). Therefore, the edge message with the maximum residual in each bundle is updated in order, and the process of iterative decoding is less likely to become trapped in a local optimum. Additionally, the generation of silent nodes is reduced as much as possible. To further improve the PABRBP decoding performance for medium and long codes over the fading channel, the adjusted compensation term is periodically introduced. Analysis and simulation results show that PABRBP demonstrates a notable convergence quality and decoding performance improvement over the fading channels compared to existing state‐of‐art IDS algorithms.
... Based on the observation that the variable nodes whose LLR sign changed frequently will propagate more unreliable messages, the informed variable-tocheck RBP (IVC-RBP) algorithm [12], preferentially updates the unstable variable nodes. In the oscillating variable nodes based RBP (OV-RBP) algorithm [13], the reliability of the variable node is not only judged by its LLR values, but also by the number of connected unsatisfied check nodes. By improving the accuracy of reliability judgement, both the IVC-RBP and the OV-RBP algorithms achieve appealing decoding performance. ...
... Although a number of IDS algorithms [9][10][11][12][13][14][15][16][17]20] have achieved encouraging decoding performance, the greedy problem has not been fully recognised. In this paper, we discuss the reason why the IDS strategy is greedy and try to find how the greedy strategy affects the decoding performance. ...
Article
Full-text available
The informed dynamic scheduling (IDS) strategies, in which the edge message with the maximum message‐residual is updated preferentially, achieve remarkable error‐correction performance when applied to low‐density parity‐check (LDPC) codes. However, the IDS strategies incur inferior convergence in iterative decoding owing to the greedy problem, which is called the update‐relayed trend here. In order to solve the greediness, two locally informed dynamic scheduling algorithms based on the law of large numbers are proposed. The proposed decoding algorithms use random select of check nodes over a predefined update range (RSPUR) which effectively suppresses the propagation of the update‐relayed trend and accordingly restrains the forming of multi‐update cycles. Moreover, the decoding algorithm is further improved based on random select of check nodes over an adjustable update range (RSCAR). The update ranges are selected based on the law of large numbers. Therefore, the computational resources can be allocated more equitably by increasing iterations. Simulation results show that both the proposed algorithms achieve excellent performance in terms of throughput and convergence with low decoding complexity over the Additive White Gaussian Noise (AWGN) and the fading channels compared to the previous IDS strategies. Hence, the proposed algorithms behave excellently over the wireless channels.
... Then, minimum mean square error [38] based channel equalization is carried out on the 336 data symbols in each OFDM symbol. This is followed by soft data demodulation [39,40] and LDPC channel decoding [41]. The output of the LDPC decoder is passed through the descrambling block, where a dummy header of 57 bits is added and padded bits are removed and passed through the same scrambling block as the one used in the transmitter. ...
Article
Full-text available
Rapid beam alignment is required to support high-gain millimeter wave (mmW) communication links between a base station (BS) and mobile users (MU). The standard IEEE 802.11ad protocol enables beam alignment at the BS and MU through a lengthy beam training procedure accomplished through additional packet overhead. However, this results in reduced latency and throughput. Auxiliary radar functionality embedded within the communication protocol has been proposed in prior literature to enable rapid beam alignment of communication beams without the requirement of channel overheads. In this work, we propose a complete architectural framework of a joint radar-communication wireless transceiver wherein radar-based detection of MU is realized to enable subsequent narrow beam communication. We provide a software prototype implementation with transceiver design details, signal models and signal processing algorithms. The prototype is experimentally evaluated with realistic simulations in free space and Rician propagation conditions and demonstrated to accelerate the beam alignment by a factor of four while reducing the overall bit error rate (BER) resulting in significant improvement in throughput with respect to standard 802.11ad. Likewise, the radar performance is found to be comparable to commonly used mmW radars.
... In the following, we define the order of transmitting information among nodes or edges in decoding as a scheduling sequence. In [7] [8] [9], several online (dynamic) scheduling policies have been proposed. These policies determine the scheduling sequences based on the latest information from the previous updates, meaning the decoding order is established during the decoding process. ...
Preprint
In this study, an optimization model for offline scheduling policy of low-density parity-check (LDPC) codes is proposed to improve the decoding efficiency of the belief propagation (BP). The optimization model uses the number of messages passed (NMP) as a metric to evaluate complexity, and two metrics, average entropy (AE), and gap to maximum a posteriori (GAP), to evaluate BP decoding performance. Based on this model, an algorithm is proposed to optimize the scheduling sequence for reduced decoding complexity and superior performance compared to layered BP. Furthermore, this proposed algorithm does not add the extra complexity of determining the scheduling sequence to the decoding process.
... Then, minimum mean square error [35] based channel equalization is carried out on the 336 data symbols in each OFDM symbol. This is followed by soft data demodulation [36,37] and LDPC channel decoding [38].The output of the LDPC decoder is passed through the descrambling block, where a dummy header of 57 bits is added and padded bits are removed and passed through the same scrambling block as the one used in the transmitter. The output after descrambling is the decoded data bits extracted from y DL . ...
Preprint
Full-text available
Rapid beam alignment is required to support high gain millimeter wave (mmW) communication links between a base station (BS) and mobile users (MU). The standard IEEE 802.11ad protocol enables beam alignment at the BS and MU through a lengthy beam training procedure accomplished through additional packet overhead. However, this results in reduced latency and throughput. Auxiliary radar functionality embedded within the communication protocol has been proposed in prior literature to enable rapid beam alignment of communication beams without the requirement of channel overheads. In this work, we propose a complete architectural framework of a joint radar-communication wireless transceiver wherein radar based detection of MU is realized to enable subsequent narrow beam communication. We provide a software prototype implementation with transceiver design details, signal models and signal processing algorithms. The prototype is experimentally evaluated with realistic simulations in free space and Rician propagation conditions and demonstrated to accelerate the beam alignment by a factor of four while reducing the overall bit error rate (BER) resulting in significant improvement in throughput with respect to standard 802.11ad. Likewise, the radar performance is found to be comparable to commonly used mmW radars.
... At the same time, most optimization methods including machine learning can be used in this optimization model. Different from the residual BP and other online (dynamic) scheduling algorithms [41], [42], scheduling based on "NMP-GAP" is off-line. Online scheduling needs to recalculate a new scheduling policy for each decoding attempt, which increases the latency and overall complexity. ...
Preprint
This study focuses on the efficiency of message-passing-based decoding algorithms for polar and low-density parity-check (LDPC) codes. Both successive cancellation (SC) and belief propagation (BP) decoding algorithms are studied under the message-passing framework. Counter-intuitively, SC decoding demonstrates the highest decoding efficiency, although it was considered a weak decoder regarding error-correction performance. We analyze the complexity-performance tradeoff to dynamically track the decoding efficiency, where the complexity is measured by the number of messages passed (NMP), and the performance is measured by the statistical distance to the maximum a posteriori (MAP) estimate. This study offers new insight into the contribution of each message passing in decoding, and compares various decoding algorithms on a message-by-message level. The analysis corroborates recent results on terabits-per-second polar SC decoders, and might shed light on better scheduling strategies.
Article
In many practical distributed source coding (DSC) applications, correlation information plays several important roles at decoding, which provides the prior knowledge of the source statistics for the decoding algorithms to start work. Therefore, the accurate utilization of such correlation information has a significant impact on decoding performance. In this work, a hybrid DSC (HYDSC) scheme is proposed to generate the “soft” information about the clean source symbols, which allows the channel code-based DSC scheme to effectively utilize the inter/intra source correlation without requiring prior knowledge of its statistics, so as to further improve the decoding performance. Further performance improvement, at the cost of moderate increasing in computational complexity, can be achieved by performing additional iterations on the basis of the HYDSC scheme. We mainly focus on, in particular, applications where Slepian-Wolf coding and usual source coding are jointly used to exploit both the correlation among the adjoining source symbols and the correlation between the sources. Experiment results indicate that the presented scheme not only show superior performance from an error correction viewpoint, but also achieve better compression ratio in the case of strong internal correlation of the source sequence, as compared with the previous DSC techniques.
Article
With the increase of program/erase (PE) cycles and retention time, it is difficult to predict the threshold-voltage distributions for detection in NAND flash memory. To accurately acquire the log-likelihood ratios (LLRs) without the knowledge of threshold-voltage distributions, a convolutional neural network (CNN)-based detection algorithm is proposed for the multi-level-cell (MLC) flash memory. The CNN-based detection algorithm employs the trained CNN to accurately calculate the LLRs for each threshold-voltage region. Furthermore, we develop a CNN-aided read-voltage design scheme to optimize the read voltages by maximizing the mutual information between the coded bits and their corresponding LLRs. Exploiting the proposed scheme, we first design three hard-decision read voltages, and then formulate more soft-decision read voltages to further improve the detection performance. Simulation results demonstrate that the CNN-based detection algorithm can achieve performance approaching that of the optimal detection algorithm.
Article
Full-text available
Replica shuffled belief propagation decoders of low-density parity-check codes are pre- sented. The proposed decoders converge faster than standard and shuffled belief prop- agation decoders. Simulations show that the new decoders offer good performance versus complexity trade-offs.
Article
Full-text available
We introduce a computational technique that accurately predicts performance for a given LDPC code in the error floor region. We present some results obtained by applying the technique and describe certain aspects of it.
Conference Paper
Full-text available
Low-density parity-check (LDPC) codes are usually decoded by running an iterative belief-propagation, or message-passing, algorithm over the factor graph of the code. The traditional message-passing schedule consists of updating all the variable nodes in the graph, using the same pre-update information, followed by updating all the check nodes of the graph, again, using the same pre-update information. Recently several studies show that sequential scheduling, in which messages are generated using the latest available information, significantly improves the convergence speed in terms of number of iterations. Sequential scheduling raises the problem of finding the best sequence of message updates. This paper presents practical scheduling strategies that use the value of the messages in the graph to find the next message to be updated. Simulation results show that these informed update sequences require significantly fewer iterations than standard sequential schedules. Furthermore, the paper shows that informed scheduling solves some standard trapping set errors. Therefore, it also outperforms traditional scheduling for a large numbers of iterations. Complexity and implementability issues are also addressed.
Article
This paper presents a maximum mutual information increase $({rm M}^{2}{rm I}^{2})$-based algorithm that can be used to arrange low-density parity-check (LDPC) decoding schedules for faster convergence, where the increase is used to guide the arrangement of the fixed decoding schedule. The predicted mutual information for the messages to be updated is used in the calculation of the increase. By looking ahead for several decoding stages, a high-order prediction can be realized, which can then be used to devise a schedule with an even faster convergence. For a single received frame, different decoding results can be obtained using different schedules, and, hence, schedule diversity, that lowers the error floor resultant from the dominant trapping sets, is proposed. By adopting the ${rm M}^{2}{rm I}^{2}$-based schedule together with the schedule diversity, both the convergence speed in the waterfall region and the error-rate in the floor region can be improved.
Article
When residual belief-propagation (RBP), which is a kind of informed dynamic scheduling (IDS), is applied to low-density parity-check (LDPC) codes, the convergence speed in error-rate performance can be significantly improved. However, the RBP decoders presented in previous literature suffer from poor convergence error-rate performance due to the two phenomena explored in this paper. The first is the greedy-group phenomenon, which results in a small part of the decoding graph occupying most of the decoding resources. By limiting the number of updates for each edge message in the decoding graph, the proposed Quota-based RBP (Q-RBP) schedule can reduce the probability of greedy groups forming. The other phenomenon is the silent-variable-nodes issue, which is a condition where some variable nodes have no chance of contributing their intrinsic messages to the decoding process. As a result, we propose the Silent-Variable-Node-Free RBP (SVNF-RBP) schedule, which can force all variable nodes to contribute their intrinsic messages to the decoding process equally. Both the Q-RBP and the SVNF-RBP provide appealing convergence speed and convergence error-rate performance compared to previous IDS decoders for both dedicated and punctured LDPC codes.
Article
Scheduling strategy is considered an important aspect of belief-propagation (BP) decoding of low-density parity-check (LDPC) codes because it affects the decoder's convergence rate, decoding complexity and error-correction performance. In this paper, we propose two new scheduling strategies for the BP decoding of non-binary LDPC (NB-LDPC) codes. Both the strategies are devised based on the concept of check node reliability and employ a heuristically defined threshold which can adapt to the communication channel variations. As the scheduling strategies only update a subset of the check nodes in each iteration, they result in reduced iteration cost. Furthermore, since the BP performs suboptimally for finite-length LDPC codes, especially for short-length LDPC codes, by enhancing the message propagation over the Tanner Graphs of short-length NB-LDPC codes, the new scheduling strategies can even improve the error-correction performances of BP decoding. Simulation results demonstrate that the new scheduling strategies provide good performance/complexity tradeoffs.
Article
The authors report the empirical performance of Gallager's low density parity check codes on Gaussian channels. They show that performance substantially better than that of standard convolutional and concatenated codes can be achieved; indeed the performance is almost as close to the Shannon limit as that of turbo codes
Article
The authors report the empirical performance of Gallager's low density parity check codes on Gaussian channels. It is shown that performance substantially better than that of standard convolutional and concatenated codes can be achieved, indeed the performance is almost as close to the Shannon limit as that of Turbo codes
Article
Inference for probabilistic graphical models is still very much a practical challenge in large domains. The commonly used and effective belief propagation (BP) algorithm and its generalizations often do not converge when applied to hard, real-life inference tasks. While it is widely recognized that the scheduling of messages in these algorithms may have significant consequences, this issue remains largely unexplored. In this work, we address the question of how to schedule messages for asynchronous propagation so that a fixed point is reached faster and more often. We first show that any reasonable asynchronous BP converges to a unique fixed point under conditions similar to those that guarantee convergence of synchronous BP. In addition, we show that the convergence rate of a simple round-robin schedule is at least as good as that of synchronous propagation. We then propose residual belief propagation (RBP), a novel, easy-to-implement, asynchronous propagation algorithm that schedules messages in an informed way, that pushes down a bound on the distance from the fixed point. Finally, we demonstrate the superiority of RBP over state-of-the-art methods for a variety of challenging synthetic and real-life problems: RBP converges significantly more often than other methods; and it significantly reduces running time until convergence, even when other methods converge.