Abstract
In this paper, we present a general Gaussian N-relay network by allowing relays to communicate to each other and allowing a direct channel between source and destination as compared to the standard diamond network in Nazaroğlu et al. (IEEE Trans Inf Theory 60:6329–6341, 2014) at the cost of extra channel uses. Our main focus is to examine the min-cut bound capacities of the relay network. Very recently, the results in Uykan (IEEE Trans Neural Netw Learn Syst 31:3294–3304, 2020) imply that the GADIA in Babadi and Tarokh (IEEE Trans Inf Theory 56:6228–6252, 2010), a pioneering algorithm in the interference avoidance literature, actually performs max-cut of a given power-domain (nonnegative) link gain matrix in the 2-channel case. Using the results of the diamond network in Nazaroğlu et al. (2014) and the results in Uykan (2020), in this paper, we (i) turn the mutual information maximization problem in the Gaussian N-relay network into an upper bound minimization problem, (ii) propose a modified GADIA-based algorithm to find the min-cut capacity bound and (iii) present an upper and a lower bound to its min-cut capacity bound using the modified GADIA as applied to the defined “squared channel gain matrix/graph”. Some advantages of the proposed modified GADIA-based simple algorithm are as follows: (1) The Gaussian N-relay network can determine the relay clusters in a distributed fashion and (2) the presented upper bound gives an insight into whether allowing the relays to communicate to each other pays off the extra channel uses or not as far as the min-cut capacity bound is concerned. The simulation results confirm the findings. Furthermore, the min-cut upper bound found by the proposed modified-GADIA is verified by the cut-set bounds found by the spectral clustering based solutions as well.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
1 Introduction and motivation
Cover and El Gamal stated, in their pioneering paper in 1979, that the full understanding of the relay channel would yield the capacity of the single sender single receiver general relay network (in Fig. 7 in [3]). They anticipated that this unknown capacity would be an information theoretic generalization of the well-known max-flow min-cut theorem. However, as of 2021, i.e., after 42 years, we are very far from this “foreseen” goal: The capacity of the relay channel, even the simplest Gaussian relay network with a single source, single destination and a relay, is still unknown [4], and the interference channel’s capacity region—even without a relay—is still an open problem [5]. In short, except for the simplest networks like Gaussian SIMO and MISO channels, the capacity region of most Gaussian networks is still unknown [4, 5].
Speaking strictly, the only available upper bound on the capacity of the Gaussian relay channel is the cut-set bound developed by Cover and El Gamal in 1979 [3]. The cut-set bound has been consistently used as a benchmark for performance of various relay networks (see e.g. [5,6,7,8,9,10,11,12,13,14,15,16,17]) since 1970s. In order to turn the challenging Gaussian networks capacity problems into mathematically tractable frameworks, various simplifications have been suggested in recent years. Avestimehr, Diggavi and Tse have introduced a deterministic approach and a deterministic model for analyzing the capacity of wireless relay networks [5, 8, 18, 19]. Although their linear deterministic network model is discrete and deterministic like traditional wireline network models, it has attracted a great attention because it captures certain physical aspects of wireless communications such as broadcasting and interference. They show that the capacity of Gaussian relay networks can be closely approximated by the cut-set bound, and more precisely, the gap between the cut-set bound and capacity in these networks can be bounded by a function that grows linearly with the number of nodes in the network [5, 8, 18, 19].
In [7], the authors present an improved lower bound on the rate achieved by the compress-and-forward based strategies in arbitrary Gaussian relay networks. In [4], the authors develop a new upper bound on the capacity of the Gaussian primitive relay channel which is tighter than the cut-set bound. Various approximation approaches [5, 8, 18, 20, 21] in wireless information theory recently focus on bounding the gap of the achievable strategies to the cut-set bound of the network. A large scale multi-level relay network has been analyzed in [22]. A combinatorial study of linear deterministic relay networks is presented in [23].
Most of the existing literature exclusively focus on developing achievable strategies for the relay channel as well as larger relay networks [4]. Consequently, an abundant number of methods on relaying schemes have been developed over the last decade, such as decode-and forward, compress-and-forward, amplify-and-forward, compute-and-forward, quantize-map-and-forward, noisy network coding, etc. [20, 26,27,28,29,30,31,32, 34, 35]. However, all these relaying schemes are out of the scope of this paper, and here we focus on the min-cut capacity bounds for general Gaussian N-relay networks.
Nazaroğlu et.al. [24] examine the Gaussian N-relay diamond network and also present an upper bound to its capacity in terms of the capacities of SIMO and MISO channels inside the network. Our motivation of this paper is to extend the wireless network simplification in [24] to a more general relay network: Nazaroğlu et. al. in [24] assume that the source node can only transmit to the relay nodes over broadcast channel and the relay nodes can only transmit to the destination node over a multi-access channel. However, in this paper, we assume that (i) the relay nodes can transmit among themselves and (ii) there is a direct channel between the source node and the destination node.
On the other hand, the GADIA in [2] has become a pioneering algorithm in the wireless interference avoidance literature recently. The author in [1] shows that the basic GADIA [2] with only 2-channels actually performs a max-cut partitioning of corresponding channel gain matrix.
1.1 Main contributions of this paper
Our main contributions in this paper are as follows: Using the results of the diamond network in [24] and the recent results in [1], we
-
(i)
present a Gaussian N-relay network by allowing relays to communicate to each other and allowing a direct channel between source and destination. The standard N-Relay diamond network [24] is a special case of the presented N-Relay general network.
-
(ii)
propose a modified GADIA-based algorithm to find the min-cut capacity bound of the Gaussian N-relay network. The proposed modified GADIA-based simple algorithm enables the N-relay network to determine the relay clusters in a distributed manner.
-
(iii)
present an upper and a lower bound to its min-cut capacity using the modified basic GADIA algorithm. The proposed bounds are relatively tight to the min-cut capacity bound.
-
(iv)
show that the modified GADIA-based capacity upper bounds give an insight into whether allowing the relays to communicate to each other pays off the extra channel uses or not.
The manuscript is arranged as follows: Related work in [24] and the basic GADIA [2] is summarized in Sect. 2. We present our main results, i.e., the upper bound and the modified-GADIA, in Sect. 3. Simulation results are shown in Sect. 4, followed by the conclusions in Sect. 5.
2 Related work
The traditional Gaussian N-Relay diamond network [24] is shown in Fig. 1. The received signals are obtained in terms of the transmitted signal and the channel gains as follows:
where \({h}_{i,s}\) represents the complex coefficient from the source to the relay node i; and \(h_{di}\) denotes the complex channel gain from the node i to the destination node d. \(Z_{i} \left[ t \right]{, }i = 1, \cdots ,N\), and \(Z\left[ t \right]\) are independent and identically distributed circularly symmetric Gaussian random variables of variance \(\sigma^{2}\). Without loss of generality and for the sake of brevity, we assume that the transmit powers of all nodes are the same and equal to P, and \(SNR = P/\sigma^{2}\) [24].
Capacity of the Gaussian N-Relay diamond network in Fig. 1 is investigated in [24] and [25]. A cut divides the network into two sets \(\left\{ {s,{\boldsymbol{\varLambda}}} \right\}\) and \({\text{\{ }}\overline{\boldsymbol{\varLambda }},d\}\) where s represents source, d is destination, set \({\boldsymbol{\varLambda}}\) includes the indices of the relays in the first set, and set \(\overline{\boldsymbol{\varLambda }}\) includes the indices of the other relays which are in the second set. For any cut, the maximization of the mutual information can be upper bounded by the capacities of the SIMO (single input multiple output) channel between source and relays in set \(\overline{\boldsymbol{\varLambda }}\) and MISO (multiple input single output) channel between relays in \({\boldsymbol{\varLambda}}\) and destination d [24]. Therefore
From [24], Eq. (9) on p.6333, we write the upper bound for the network in Fig. 1.
Naturally the simplest case is 1-relay network (i.e. N = 1). Obviously, this 1-relay scenario has two possible meaningful cuts: These two cuts include some well-known results like the upper-bound in [16], Eq. (18), and the achievable rate \(R_{DF}\) in [8], Appendix A, page 1897, and the upper bound in [13], Eq. (11), page 2022 (taking zero correlation between the source and relay outputs \(X_{1}\) and \(X_{2}\), i.e. taking \(\beta = 0\) [13]), among others. Considering the relays-receive period \(\alpha D\) and relays-transmit period \(\left( {1 - \alpha } \right)D\) in Time Division mode in [13], two possible cuts are given in [13], Eqs. (10) and (11), page 2022, as follows
both of which are special cases of (3). A very similar result in Frequency Division mode is presented in [8].
On the other hand, the GADIA [2] has been one of the pioneering algorithms in the wireless interference avoidance literature. In this paper, in Sect. 3, we will propose a modified simple GADIA for determining the min-cut capacity bound for the general relay network. Therefore, for the readers’ convenience, in what follows we first summarize how the basic GADIA [2] works for 2-channel case.
2.1 Basic GADIA [2] with 2-channel case
Definition
Total Co-channel (Intra-Set) Interference for 2-Channel Case: Putting the relays into sets \(\overline{\boldsymbol{\varLambda }}_{t}\) and \({\boldsymbol{\varLambda}}_{t}\) at time t, we define the Total Co-channel (Intra-Set) Interference \(I_{{\overline{\boldsymbol{\varLambda }},{\boldsymbol{\varLambda}}}}^{tot}\) as follows:
where \(h_{ii} = 0.\) Let’s assume there are N transmitters to be allocated to 2 channels only (and \(N > 2\)). The deterministic basic GADIA for 2-set case is given by Table 1. Representing the co-channel interference of channel 1 and channel 2 for node n at time t as \(I_{{\boldsymbol{\varLambda}}}^{n} \left( t \right)\) and \(I_{{\overline{\boldsymbol{\varLambda }}}}^{n} \left( t \right)\), respectively, where n = 1,2, …, N, the deterministic basic GADIA [2] assigns the node n to the following channel
where channel index \(x_{n} \left( {t + 1} \right) \in \left\{ {\overline{\boldsymbol{\varLambda }},{\boldsymbol{\varLambda}}} \right\}\). From the analysis in [2], each time a node changes its channel by Eq. (7) the total co-channel interference is further decreased:
For the details of the proof, see [2]. The basic GADIA performs in a distributed fashion in such a way that each node is allocated only using its interference measurements. How the basic GADIA [2] works for relay n at arbitrary step number t in a 2-channel case is illustrated in Fig. 3. It is very recently shown in [1] (Proposition 5 and Corollary 4) that the basic GADIA [2] actually performs the max-cut of the corresponding graph for the 2-channel case. For further details, see [1]. An extension to the complex graph case has very recently been presented in [33].
3 Main results
3.1 Network model
Our model is based on the model in [24]. The main difference is as follows: In the traditional Gaussian N-Relay diamond network in [24] (see Fig. 1) the source only transmits to the relays and the relays transmit only to the destination (and there is no direct channel between the source and destination). However, in our network model, relays can also transmit to each other if/when needed and direct channel between the source and destination also exists as seen in Fig. 2. Our motivation for this extension is twofold: (i) to unleash the potential of the unused channels in full-duplex relay networks, and (ii) to generalize the network in [24].
Using the model and notation in [24] for the general relay network in Fig. 2, the received signals are obtained in terms of the transmitted signal and the channel gains as follows:
where \(T_{i}\) represents the set of indices of the transmitting relays when the relay node i is the receiver, and \(T_{i} \subseteq \left\{ {s,1,2, \cdots ,N} \right\}\), and \(h_{is}\) represents the complex channel gain from the source to the relay node i; and \(h_{di}\) denotes the complex channel gain from the node i to the destination node d. \(Z_{i} \left[ t \right]{, }i = 1, \cdots ,N\), and \(Z\left[ t \right]\) are independent and identically distributed circularly symmetric Gaussian random variables of variance \(\sigma^{2}\). Without loss of generality and for the sake of brevity, we assume that the transmit powers of all nodes are the same and equal to P, and we define \(SNR = P/\sigma^{2}\) as in [24]. We examine the maximum reliable communication rate C in bits/channel use that can be achieved between the source node and the destination node in a generalized Gaussian N-relay network. First we define “squared channel gain matrix/graph” for the N-relay general network.
Definition
For the standard N-relay diamond network (which does not allow relays to communicate to each other), the following (N + 2) × (N + 2) dimensional (partially full) matrix is called “diamond squared channel gain matrix”.
Most of the entries in matrix \({{\varvec{A}}}_{d}\) in (11) are zero because relays cannot transmit to each other in the traditional N-relay diamond network [24].
Definition
The following (N + 2) × (N + 2) dimensional matrix is called “squared channel gain matrix” for N-Relay general network:
i.e., \({\left[{{\varvec{A}}}_{g}\right]}_{ij}=\left\{\begin{array}{c}0, \, \, \, \, \, \, \, \, \, i=j\\ {\left|{h}_{ij}\right|}^{2}\text{,} \, \, \, \, \, i\ne j\end{array}\right.\) where \(i,j\in \left\{s,\mathrm{1,2},\cdots ,N,d\right\}\).
Comparing (11) with (12), the general N-relay network’s matrix \({{\varvec{A}}}_{g}\) is a full matrix (with zero diagonal) unlike the diamond N-relay network’s matrix \({{\varvec{A}}}_{d}\).
Definition
Cut of Interference matrix is defined as follows
3.2 Modified GADIA
A very recent paper [1] shows that the deterministic basic GADIA [2] with the interference matrix \({\varvec{A}}_{g}\) in (12) performs max-cut of the corresponding graph. However, we need min-cut for determining the relay network’s cut-set capacity bound. How can we modify the basic GADIA in [2] so that it performs min-cut instead of max-cut? In what follows, we present a modified and constrained simple GADIA to perform the min-cut of the interference matrix \({\varvec{A}}_{g}\) in (12).
In the proposed modified GADIA (14), we have the negative sign to turn the max-cut problem into the min-cut problem. If we do not introduce any constraints, then this change would eventually give us the trivial solution where the cut would finally vanish, i.e., all relays would be assigned to the same set, which is practically meaningless. To avoid this trivial solution, we need to introduce the constraint that \(N_{{\boldsymbol{\varLambda}}} \ne 0\) and \(N_{{\overline{\boldsymbol{\varLambda }}}} \ne 0\) and \(N_{{\boldsymbol{\varLambda}}}\) and \(N_{{\overline{\boldsymbol{\varLambda }}}}\) are close to each other, i.e., the number of relays in set \({\boldsymbol{\varLambda}}\) and the number of relays in set \(\overline{\boldsymbol{\varLambda }}\) are close to each other.
Proposition 1
For a given general relay network in Fig. 2with the channel gains in (12), the proposed modified algorithm in Table 2minimizes the cut \(J_{{\overline{\boldsymbol{\varLambda }},{\boldsymbol{\varLambda}}}}^{{}} \left( t \right)\) in (13).
Proof
where \(\left| {{\varvec{A}}_{g} } \right|_{1}\) represents the 1-norm of matrix \({\varvec{A}}_{g}\), which is constant. Now let’s take an arbitrary relay n in set \(\overline{\boldsymbol{\varLambda }}\). The total intra-set interference in \({\boldsymbol{\varLambda}}\) and \(\overline{\boldsymbol{\varLambda }}\), i.e., \(I_{{\boldsymbol{\varLambda}}}^{tot}\), and \(I_{{\overline{\boldsymbol{\varLambda }}}}^{tot}\), respectively, at an arbitrary time t is equal to
where \(I_{{\overline{\boldsymbol{\varLambda }}}}^{n} = \mathop \sum \limits_{{j \in \left\{ {\overline{\boldsymbol{\varLambda }}_{t} ,d} \right\}}} \left| {h_{nj} } \right|^{2}\) as shown in Fig. 3. If relay n is allocated from set \(\overline{\boldsymbol{\varLambda }}\) to \({\boldsymbol{\varLambda}}\), then
An illustration of the basic GADIA [2] for relay n at arbitrary step number t in a 2-set case
where \(I_{{\boldsymbol{\varLambda}}}^{n} = \mathop \sum \limits_{{j \in \left\{ {s,{\boldsymbol{\varLambda}}} \right\}}} \left| {h_{nj} } \right|^{2}\). From (6), (14), (16) and (17), the proposed modified GADIA gives
Similarly, it is straightforward to show that if a relay in \({\boldsymbol{\varLambda}}\) is assigned to \(\overline{\boldsymbol{\varLambda }}\) by the proposed algorithm (14), then the total interference is strictly further increased, i.e., \(I_{{\overline{\boldsymbol{\varLambda }},{\boldsymbol{\varLambda}}}}^{tot} \left( {t + 1} \right) > I_{{\overline{\boldsymbol{\varLambda }},{\boldsymbol{\varLambda}}}}^{tot} \left( t \right)\). From (15), an increase in \(I_{{\overline{\boldsymbol{\varLambda }},{\boldsymbol{\varLambda}}}}^{tot} \left( t \right)\) causes the cut \(J_{{\overline{\boldsymbol{\varLambda }},{\boldsymbol{\varLambda}}}}^{{}} \left( t \right)\) to decrease. Because the cut \(J_{{\overline{\boldsymbol{\varLambda }},{\boldsymbol{\varLambda}}}}^{{}} \left( t \right)\) is finite, we conclude that the proposed modified GADIA in Table 2minimizes the cut \(J_{{\overline{\boldsymbol{\varLambda }},{\boldsymbol{\varLambda}}}}^{{}} \left( t \right)\) in (13), which completes the proof. □
3.3 Comparison of the basic GADIA [2] and the Modified GADIA
It is recently shown in [1] that the basic GADIA [2] in (9) performs max-cut for the positive interference matrix \({\varvec{A}}_{g}\) in (12). So, the GADIA [2] yields the minimum total interference (\(\min {\text{of}}I_{{\overline{\boldsymbol{\varLambda }},{\boldsymbol{\varLambda}}}}^{tot} \left( t \right)\) in (6)) in the relay network. However, the proposed modified and constraint GADIA does exactly the opposite: The modified GADIA in Table 2 aims at temporarily maximizing the total interference in the relay network for a short time duration just in order to determine the sets \({\boldsymbol{\varLambda}}\) and \(\overline{\boldsymbol{\varLambda }}\) which are needed to find the min-cut capacity bound. In summary, the proposed modified GADIA fully loads the relay network by maximizing the total network interference (\(I_{{\overline{\boldsymbol{\varLambda }},{\boldsymbol{\varLambda}}}}^{tot} \left( t \right)\) in (6)) so that the cut-set bound of the relay network is “discovered” in a distributed fashion.
3.4 Low SNR case
Proposition 2
In the low-SNR regime, the proposed simple modified-GADIA algorithm in Table 2 for the “squared channel gain matrix” in (12) yields an upper bound to the mutual information between the source and destination in the Gaussian N-relay network in Fig. 2.
Proof
Applying the max-flow min-cut theorem to the Gaussian general N-relay network in Fig. 2, and following the steps in [24], Appendix A, page 6338, we obtain
where \({Y}_{d}^{\boldsymbol{\varLambda }}={\sum }_{i\in \left\{s,\boldsymbol{\varLambda }\right\}}{h}_{di}{X}_{i}\). Thus
Unlike the diamond network in [24], allowing the relays to transmit to each other results in extra \({N}_{\boldsymbol{\varLambda }}\) SIMO channels as seen from Fig. 2. We allocate these inter-relay SIMO channels in \({N}_{\boldsymbol{\varLambda }}\) orthogonal sub timeslots/frequencies so that during each sub timeslot/frequency we realize one interference-free SIMO channel. This results in \({N}_{\boldsymbol{\varLambda }}\) extra channel uses as compared to that in [24]. From Fig. 2.
where L is the total number of channel uses. Allowing inter-relay \(N_{{\boldsymbol{\varLambda}}}\) SIMO channels yields extra \(N_{{\boldsymbol{\varLambda}}}\) channel uses, and therefore \(L = N_{{\boldsymbol{\varLambda}}} + 2\), where 2 represents the channel use of SIMO from source to \(\overline{\boldsymbol{\varLambda }}\) and the channel use of MISO from \({\boldsymbol{\varLambda}}\) to destination. Considering the low SNR regime, i.e. \(\log \left( {1 + x} \right) \approx x\) in Eq. (11), we obtain
Examining the upper bound in (23), we see that the capacity upper bound (23) is equal to the min-cut of the graph represented by the matrix \({{\varvec{A}}}_{g}\) in (12), i.e.,
From Proposition 1 above, Eqs. (19) and (24), we conclude that the proposed simple modified-GADIA algorithm in Table 2 for the “squared channel gain matrix” in (12) yields an upper bound to the mutual information between the source and destination in the Gaussian N-relay general network in Fig. 2, which completes the proof. □
In summary, the min-cut capacity bound in (3) for the standard diamond relay network is obtained by two channel uses (timeslots/frequencies), and thus
On the other hand, the min-cut capacity upper bound in (19) for the proposed general relay network is
Comparing (25) and (26), there is a trade-off between the increased channel uses (because \(L\ge 3\)) and the min-cut capacity bound. Do the extra channel uses pay off or not? The answer is that it depends on the inter-relay channel gains as follows (for the low SNR case). From (25), (26) and (24), we have
Using \(\frac{1}{2}=\frac{1}{L}+\frac{L-2}{2L}\) and the SIMO channels among the relays (from each relay in set \({\boldsymbol{\varLambda}}\) to all relays in set \(\overline{\boldsymbol{\varLambda }}\)) in the right side of (27), we obtain the following result: If
or equivalently, if
then the min-cut capacity bound is increased. As long as the min-cut capacity bound is concerned, this shows that allowing the relays to communicate to each other pays off the extra channel uses if the condition in (29) is met. The left side of (29) is a portion of the standard diamond relay network’s min-cut capacity bound and the right side of (29) is due to the inter-relay channels which are not used in the diamond network. As an example, for the Gaussian generalized 3-relay network in Fig. 5 examined in Example 1, where \({\boldsymbol{\varLambda}}= \left\{ 3 \right\}\), and \(\overline{\boldsymbol{\varLambda }} = \left\{ {1,2} \right\}\), and \(L = 3\), if
then the min-cut capacity upper bound is increased, i.e. the inter-relay communication pays off in terms of the min-cut capacity bound for low SNR regime.
As another example, let’s assume a 4-Relay network where \({\boldsymbol{\varLambda}}= \left\{ {2,3} \right\}\), and \(\overline{\boldsymbol{\varLambda }} = \left\{ {1, 4} \right\}\), and thus \(L = 4\). From (29), if
then the min-cut capacity bound is further increased in the low SNR case.
3.5 High SNR case
Proposition 3
In the high-SNR regime, the mutual information between the source and destination in the Gaussian general N-relay network in Fig. 2admits an upper bound obtained by the proposed modified-GADIA algorithm in Table 2for the “squared channel gain matrix” in (12).
Proof
We observe the following tight upper bound to the sum of two log’s.
where
for any \({x}_{i},{x}_{j}\ge 2\). In (33) the maximum difference, which is 1, is obtained if and only if \({x}_{i}={x}_{j}\).Footnote 1
The presented bound in (32)–(33) plays a critical role in our derivations below for the high SNR case because (1) the proposed bound is tight and (2) it allows us to replace the sum of two log’s by the log of two sums. In order to give an insight into how tight the bound in (32) is, without loss of generality and the for the sake of brevity, we present an illustrative example with an arbitrary argument \({x}_{1}={2}^{9}={512}\) in Fig. 4. The argument of the other log function varies in the range \(2\le {x}_{2}\le 10000\). Figure 4 confirms that the proposed bound in (32)–(33) is indeed tight for any arguments \({x}_{1}\) and \({x}_{2}\) because in (32)–(33) what matters is the difference between the arguments \({x}_{1}\) and \({x}_{2}\) and not the absolute values of \({x}_{1}\) and \({x}_{2}\). The plots of Fig. 4(a, b) are the same, where argument \({x}_{2}\) is in linear scale and log scale in Fig. 4(a, b), respectively, for the sake of clarity. This is because the term \(\mathit{log}\left(\mathit{min}\left\{{x}_{i},{x}_{j}\right\}\right)\) strictly decreases and vanishes as the difference between the arguments \({x}_{1}\) and \({x}_{2}\) increases.
Let’s define the following terms:
and
Using (26), (32), (34) and (35), we are able to upper bound the sum of log’s in (22) by the log of sums as follows:
where \({\rm K}\) has (\({N}_{\varLambda }+1\)) log terms, which are obtained by applying Eq. (32) \(\left({N}_{\varLambda }+1\right)\) times when we upper bound the sum of \(\left({N}_{\varLambda }+2\right)\) log’s by log of \(\left({N}_{\varLambda }+2\right)\) sums. From (34), (35) and (36), we obtain
From Proposition 1 above, (19) and (37), we conclude that the mutual information between the source and destination in the Gaussian general N-relay network in Fig. 2 admits an upper bound obtained by the proposed modified-GADIA algorithm in Table 2 for the “squared channel gain matrix” in (12), which completes the proof. □
In order to elaborate more about the constant K in (19), we give the following example: If N = 5, \({\boldsymbol{\varLambda}}= \left\{ {1,3} \right\}\), and \(\overline{\boldsymbol{\varLambda }} = \left\{ {2,4,5} \right\}\), then \({\rm K}\) in (36) is equal to the following:
In what follows, we ask the same question as before: Does allowing the relays to communicate to each other pay off the extra channel uses or not for high SNR case? The answer is that it depends on the channel gains as shown below: Writing \(\frac{1}{2}=\frac{1}{L}+\frac{L-2}{2L}\) in (20)–(22) and using (34) and (35) yields the following result: If
or equivalently, if
then the min-cut capacity bound is increased. This shows that as long as the min-cut capacity bound is concerned, allowing the relays to communicate to each other pays off the extra channel uses for high SNR regime if Eq. (40) holds.
3.6 Lower bound
A lower bound is straightforwardly obtained by the best link in each transmission of the relay min-cut capacity bound. So, for the low SNR regime, replacing the sum operation by a max operation in the min-cut capacity bound in (23) yields the lower bound in (41). In other words, (41) is a lower bound in the low SNR regime simply because it is a subset of the min-cut capacity bound itself.
Similarly, for the high SNR regime, replacing the sum operation by a max operation in the min-cut capacity bound in (37) yields the lower bound in (42).
4 Simulation results
The proposed method can be applied to any Gaussian N-relay network where the number of relays N is arbitrary. In what follows, without loss of generality and for the sake of brevity, we examine two networks with 3 relays (in Fig. 5) and 20 relays (in Fig. 12) in Example 1 and 2, respectively. Furthermore, without loss of generality, in both Example 1 and 2 below, we model the channel gains as in e.g. [36, 37] where the attenuation factor is 3, the log-normally distributed slow fading is generated according to the model in [36], and the lognormal variance is 6 dB. The transmit powers vary from 1 mW to 1 W. A unit variance Gaussian noise is added to the received signal at each node.
The min-cut capacity bound of the proposed method is verified by the cut-set bounds found by the spectral clustering and using (37) (which was obtained by Eqs. (32)–(33)). For the spectral clustering formulation as applied to the channel allocation problem, see e.g. [38, 39, 43]. Let’s define a discrete-value vector \({\varvec{x}}={\left[{x}_{1} \cdots {x}_{N}\right]}^{T}\) such that
Because \({{\varvec{x}}}^{T}{\varvec{L}}{\varvec{x}} \, = \, {\sum }_{i=1}^{N} {\sum }_{j=1}^{N}{\left|{h}_{i,j}\right|}^{2}{\left({x}_{i}-{x}_{j}\right)}^{2}\), (see e.g. [40,41,42], for details)
Relaxing the optimization in (43) such that \({\varvec{x}}\in {\mathfrak{R}}^{N\times 1}\) (instead of being integers), it’s well-known that the optimum solution which maximizes \({{\varvec{h}}}^{T}{\varvec{L}}{\varvec{h}}\) with unit norm constraint is equal to
where L is the Laplacian matrix and \({{\varvec{e}}}_{min}\) is its 2nd minimum eigenvector because the minimum eigenvector gives a trivial solution which is not practical (for details and for further information and references see e.g., [40,41,42]).
Example 1
A 3-Relay network is represented by the following squared channel gain matrix \({{\varvec{A}}}_{g}\) as follows
In order to give an insight into how min-cut capacity bounds change with respect to relay locations, we examine three cases in Figs. 6a, 7a and 8a, which represents the scenario where the relay locations are relatively closer to each other in the middle, the scenario where relay locations are slightly closer to the source and the scenario where relay locations are slightly closer to the destination, respectively. The proposed modified-GADIA (in Table 2) yields source s and relay 3 in one set (shown as yellow diamonds in Fig. 5) and relays 1 and 2 and destination in the other set (shown as red circles in Fig. 5). This means \({\boldsymbol{\varLambda}}= \left\{ 3 \right\}\), and \(\overline{\boldsymbol{\varLambda }} = \left\{ {1, 2} \right\}\) (thus \({N}_{\varLambda }=1\) and\({N}_{\overline{\varLambda } }=2\)). So, we have 3 channel uses (i.e.,\(L=3\)) because there are two SIMO channels from (34) and one MISO channel in Fig. 5.
Case 1: a Relay locations and the final modified-GADIA solution, b evolution of the modified GADIA for the case when transmit power is 1 W, c evolution of the cut when transmit power is 1 W, and d the min-cut capacity bounds and the upper bound of the relay network as transmit power increases from 100 mW to 1 W
Case 2: a Relay locations and the final modified-GADIA solution, b evolution of the modified GADIA for the case when transmit power is 1 W, c evolution of the cut when transmit power is 1 W, and d the min-cut capacity bounds and the upper bound of the relay network as transmit power increases from 100 mW to 1 W
Case 3: a Relay locations and the final modified-GADIA solution, b evolution of the modified GADIA for the case when transmit power is 1 W, c evolution of the cut when transmit power is 1 W, and d the min-cut capacity bounds and the upper bound of the relay network as transmit power increases from 100 mW to 1 W
For the relay locations shown in Fig. 6a, the total interference in the relay network (i.e., \(I_{{\overline{\boldsymbol{\varLambda }},{\boldsymbol{\varLambda}}}}^{tot} \left( t \right)\) in (6)), the cut of interference matrix (i.e., \(J_{{\overline{\boldsymbol{\varLambda }},{\boldsymbol{\varLambda}}}}^{{}} \left( t \right)\) in (13)), and the min-cut capacity bounds of the modified-GADIA solution are shown in Fig. 6b–d, respectively, in the high SNR regime. The results of the other two cases (called case 2 and 3) with different relay locations are shown in Figs. 7 and 8. In order to examine if allowing the relays to communicate to each other pays off the extra channel uses or not, we define a relative increase in the min-cut capacity bound with respect to that of the diamond relay network:\(gain\%=\frac{\left({{mincutCapa}_{general}-mincutCapa}_{diamond}\right)}{{mincutCapa}_{diamond}}\times 100\%.\) These gains are shown in Fig. 9 for cases 1, 2, and 3. As seen from Fig. 9, the percentage gains for cases 1, 2 and 3 are positive, varying between + 4 and + 18% depending on the transmit powers (SNRs) and relay locations.
In low-SNR regime, for the relay locations shown in Figs. 6a, 7a and 8a, the cut of interference matrix (i.e., \(J_{{\overline{\boldsymbol{\varLambda }},{\boldsymbol{\varLambda}}}}^{{}} \left( t \right)\) in (13)), and the min-cut capacity bounds of the modified-GADIA solution are shown in Fig. 10a–c respectively. The relative min-cut capacity gains are shown in Fig. 11 for cases 1, 2, and 3 for low SNR. As seen from Fig. 11, the percentage gains for the cases 1, 2 and 3 are positive, varying between + 13% and + 160% depending on the transmit powers (SNRs) and relay locations. Figures 6b, 7b and 8b confirm that the proposed modified GADIA fully loads the relay network by strictly increasing the total network interference so that the min-cut of the relay network is found in a distributed fashion. Figures 6c, 7c, 8c and 10a confirm that the cut of the interference matrix is minimized by the proposed modified simple GADIA in Table 2. In short, all the results (min-cut capacities, modified-GADIA based min-cut capacity bounds, modified simple GADIA evolution, total interference evolution in the relay network, etc.) in Figs. 6, 7, 8, 10 and 11 confirm the findings in Sect. 3.
Example 2
In this example, we increase the number of relays to 20 as seen in Fig. 12(a). For the relay locations shown in Fig. 12a, the total interference in the relay network (i.e., \(I_{{\overline{\boldsymbol{\varLambda }},{\boldsymbol{\varLambda}}}}^{tot} \left( t \right)\) in (6)), the cut of interference matrix (i.e., \(J_{{\overline{\boldsymbol{\varLambda }},{\boldsymbol{\varLambda}}}}^{{}} \left( t \right)\) in (13)), and the min-cut capacity bounds of the modified-GADIA solution are shown in Fig. 12b–d, respectively, in the high SNR regime. The results for low SNR case are presented in Fig. 13. All the results (min-cut capacities, modified-GADIA based min-cut capacity bounds, modified simple GADIA evolution, total interference evolution in the relay network, etc.) in Figs. 12 and 13 confirm that the upper bound in (37) (which is obtained by using Eqs. (32)–(33)) is tight to the min-cut capacity bound and confirm the findings in Sect. 3. Furthermore, we verify the modified simple GADIA based solution with the spectral clustering based solution. The cut bounds obtained by the spectral clustering together with Eq. (37) are presented in Fig. 14. Comparing Fig. 12d and Fig. 14(b), the capacity bounds found by the proposed method are comparable to those of the spectral clustering based capacity bounds obtained by Eq. (37), which verifies the proposed solution.
a Example 2: a Relay locations and the modified-GADIA cluster solution, b evolution of the modified GADIA for the case when transmit power is 1 W, c evolution of the cut when transmit power is 1 W, and d the min-cut capacity bounds and the upper bound of the relay network as transmit power increases from 100 mW to 1 W
a Relay locations and the spectral clustering solution and b the cut-set capacity bound and its upper bound of the relay network obtained by the spectral clustering together with (37) as transmit power increases from 100 mW to 1 W
5 Conclusions
In this paper, we present a Gaussian N-relay general network by allowing relays to communicate to each other and allowing a direct channel between source and destination in the standard diamond network in [24] at the cost of extra channel uses. The standard N-Relay diamond network [24] is a special case of the presented general N-Relay network. Our investigations yield various novel results some of which are as follows: We
-
(i)
propose a modified simple GADIA-based algorithm to find the min-cut capacity upper bound of the Gaussian N-relay network. The proposed modified GADIA-based simple algorithm enables the N-relay general network to determine the relay clusters in a distributed manner.
-
(ii)
present a capacity upper bound and a lower bound to its min-cut capacity bound using the modified simple GADIA algorithm. The proposed upper bound is relatively tight to the min-cut capacity bound.
-
(iii)
show that the modified GADIA-based upper bounds give an insight into whether allowing the relays to communicate to each other pays off the extra channel uses or not in the general relay network.
-
(iv)
verify the proposed capacity bound by comparing the capacity cut-set bounds found by the spectral clustering.
These results also highlight the importance of unleashing the interference avoidance theory for addressing the challenging wireless relay networks capacity problems.
In this paper we focus only on the min-cut capacity upper bounds of the relay networks, and thus we do not consider any particular relay transmission schemes (such as amplitude-and-forward relaying, compute-and-forward, etc.). To examine and design various relay transmission schemes for the Gaussian general N-relay networks would be an interesting future research subject.
Data availability
The datasets generated during and/or analysed during the current study are available from the corresponding author on reasonable request.
Notes
In order to upper bound the sum of log’s by the log of sums as in (32), we may use some other inequalities like \(\log \left( x \right) \le \frac{x - 0.52}{{\sqrt x }}\), \(x_{i} ,x_{j} \ge 2\). However, the reason why we chose the one in (32) is because it is a tight upper bound for the entire regime.
References
Uykan, Z. (2020). On the working principle of the hopfield neural networks and its equivalence to the GADIA in optimization. IEEE Transaction on Neural Networks and Learning Systems, 31(9), 3294–3304. https://doi.org/10.1109/TNNLS.2019.2940920
Babadi, B., & Tarokh, V. (2010). GADIA: a Greedy asynchronous distributed interference avoidance algorithm. IEEE Transactions on Information Theory, 56(12), 6228–6252.
Cover, T., & El Gamal, A. (1979). Capacity theorems for the relay channel. IEEE Transactions on Information Theory, 25, 572–584.
Wu, X., & Özgür, A. (2017). Cut-St bound is loose for Gaussian relay networks. IEEE Transactions on Information Theory, 64(2), 1023–1037.
Avestimehr, A. S., Diggavi, S. N., & Tse, D. (2007). A deterministic model to wireless relay networks and its capacity. In Proceedings of 2007 IEEE information theory workshop on information theory for wireless networks (pp. 1–6), Solstrand.
Courtade, T. A., & Özgür, A. (2015). Approximate capacity of Gaussian relay networks: is a sublinear gap to the cutset bound plausible? In Proceedings of IEEE international symposium on information theory (ISIT) (pp. 2251–2255).
Kolte, R., Özgür, A., & El Gamal, A. (2015). Capacity approximations for gaussian relay networks. IEEE Transactions on Information Theory, 61(9), 4721–4734.
Avestimehr, A. S., Diggavi, S. N., & Tse, D. (2011). Wireless network information flow: A deterministic approach. IEEE Transactions on Information Theory, 57(4), 1872–1905.
Gupta, P., & Kumar, P. R. (2003). Towards an information theory of large networks: An achievable rate region. IEEE Transactions on Information Theory, 49(8), 1877–1894.
Nam, J. (2017). On the high-SNR capacity of the gaussian interference channel and new capacity bounds. IEEE Transactions on Information Theory, 63(8), 5266–5285.
Benammar, M., Piantanida, P., & Shitz, S. S. (2017). Capacity results for the multicast cognitive interference channel. IEEE Transactions on Information Theory, 63(7), 4119–4136.
El Gamal, A., & Kim, Y. H. (2012). Network information theory. Cambridge University Press.
Host-Madsen, A., & Zhang, J. (2005). Capacity bounds and power allocation for wireless relay channels. IEEE Transactions on Information Theory, 51(6), 2020–2040.
Yazdi, S. T., & Savari, S. A. (2010). A max-flow/min-cut algorithm for a class of wireless networks. In Proceedings of the ACM-SIAM symposium on discrete algorithms (SODA10) (pp. 1209–1226), Austin, Texas, USA.
Cover, T. M., & Thomas, J. A. (1991). Elements of information theory. Wiley.
Kramer, G., Gastpar M., & Gupta, P. (2003). Capacity theorems for wireless relay channels. In Proceedings of 41st Allerton conference on communication, control, and computing (pp. 1074–1083).
Hekmat, R., & Van Mieghem, P. (2004). Interference in wireless multi-hop ad-hoc networks and its effect on network capacity. Wireless Networks, 10, 389–399.
Avestimehr, A. S., Diggavi, S. N., & Tse, D. (2007). Wireless network information flow. In Proceedings of Allerton conference on communication, control, and computing, Illinois, September, 1–6.
Avestimehr, A. S., Diggavi, S. N., & Tse, D. (2008). Approximate capacity of Gaussian relay networks. In Proceedings of IEEE symposium on information theory (ISIT08) (pp. 474–478).
Lim, S. H., Kim, Y. H., El Gamal, A., & Chung, S. Y. (2011). Noisy network coding. IEEE Transactions on Information Theory, 57(5), 3132–3152.
Brahma, S., Fragouli, C., & Özgür, A. (2016). On the complexity of scheduling in half-duplex diamond networks. IEEE Transactions on Information Theory, 62(5), 2557–2572.
Yeh, S. P., & Leveque, O. (2007). Asymptotic capacity of multi-level amplify-and-forward relay networks. In Proceedings of 2007 IEEE international symposium on information theory (pp. 1436–1440).
Yazdi, S. T., & Savari, S. A. (2010). A combinatorial study of linear deterministic relay networks. In 2010 IEEE information theory on workshop on information theory (ITW 2010, Cairo) (pp. 1–5).
Nazaroğlu, C., Özgür, A., & Fragouli, C. (2014). Wireless network simplification: The Gaussian N-relay diamond network. IEEE Transactions on Information Theory, 60(10), 6329–6341.
Kang, W., Liu, N., & Chong, W. (2015). The Gaussian multiple access diamond channel. IEEE Transactions on Information Theory, 61(61), 6049–6059.
Lari, M. (2018). Power allocation and effective capacity of AF successive relays. Wireless Networks, 24, 885–895.
Insausti, X., Saez, A., & Crespo, P. M. (2019). A novel scheme inspired by the compute-and-forward relaying strategy for the multiple access relay channel. Wireless Networks, 25, 665–673.
Kramer, G., Gastpar, M., & Gupta, P. (2005). Cooperative strategies and capacity theorems for relay networks. IEEE Transactions Information Theory, 51(9), 3037–3063.
Wu, X., & Xie, L. L. (2014). A unified relay framework with both D-F and C-F relay nodes. IEEE Transaction Information Theory, 60(1), 586–604.
Schein, B., & Gallager, R. (2000). The Gaussian parallel relay network. In Proceedings of IEEE international symposium on information theory, ISIT-2000, 22.
Nazer, B., & Gastpar, M. (2011). Compute-and-forward: Harnessing interference through structured codes. IEEE Transactions on Information Theory, 57(10), 6463–6486.
Maric, I., & Yates, R. D. (2004). Forwarding strategies for Gaussian parallel-relay networks. In Proceedings of IEEE international symposium on information theory, ISIT-2004, 269.
Uykan, Z. (2021). Shadow-Cuts minimization/maximization and complex Hopfield neural networks. IEEE Transactions on Neural Networks and Learning Systems, 32(3), 1096–1109.
Aydin, I., & Aygolu, U. (2015). Performance analysis of a multi-hope relay network using distributed Alamouti code. Wireless Networks, 21, 217–226.
Khayatian, H., Parvaresh, F., Abouei, J., et al. (2020). On optimal relaying strategies for VANETs over Nakagami-m fading channels. Wireless Networks, 26, 3521–3537.
Viterbi, A. J. (1995). CDMA: principles of spread spectrum communication. Addison-Wesley.
Uykan, Z., & Jäntti, R. (2014). Joint optimization of transmission-order selection and channel allocation for bidirectional wireless links—part II: algorithms. IEEE Transactions on Wireless Communications, 13(7), 3991–4002.
Uykan, Z. (2014). N-GAIR: Non-Greedy asynchronous interference reduction algorithm in wireless networks. Ad Hoc & Sensor Wireless Networks, 23(1–2), 93–116.
Uykan, Z. (2011). Spectral based solutions for (near) optimum channel/frequency allocation. In Proceedings of IWSSIP 2011 (The 18th international conference on systems, signals and image processing), Sarajevo, Bosnia and Herzegovina.
Bolla, M. (2013). Spectral clustering and biclustering. Wiley.
Luxburg, U. V. (2006). A tutorial on spectral clustering. Technical Report TR-149. Max-Planck Institute for Biological Cybernetics.
Luxburg, U. V., Belkin, M., & Bousquet, O. (2008). Consistency of spectral clustering. Annals of Statistics, 36(2), 555–586.
Kasi, S. K., Naqvi, I. H., et al. (2019). Interference management in dense inband D2D network using spectral clustering& dynamic resource allocation. Wireless Networks, 25, 4431–4441.
Funding
Open access funding provided by Aalto University.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Uykan, Z., Jäntti, R. A modified GADIA-based upper-bound to the capacity of Gaussian general N-relay networks. Wireless Netw 27, 4095–4110 (2021). https://doi.org/10.1007/s11276-021-02707-x
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11276-021-02707-x