1 Introduction

In the future 5th generation (5G) wireless communication networks, the emergence of new data-hungry applications such as machine to machine (M2M) communication and internet of things (IOT) call for the need of larger capacity physical layer. This, in turn, has led to the development of several modulations and multicarrier techniques that are combined with massive multiple-input-multiple-output (MIMO), which is a key feature of all advanced cellular wireless systems. In multicarrier modulation systems, the overall bandwidth is divided into smaller subchannels whose equalization can be carried out independently in a simple way. One of the most popular methods of multicarrier transmission is orthogonal frequency division multiplexing (OFDM) which attracts a lot of attention because of its ability to cope with frequency selective channels)Zaki 2019). In this system, a cyclic prefix (CP) is inserted between OFDM frames to avoid inter-symbol interference (ISI) which makes it robust to multipath fading.

The combination of OFDM and Code-division multiple-access (CDMA), which is known as multicarrier CDMA (MC-CDMA), has also received a lot of interest in wireless multimedia communications due to its excellent performance (Hara 1997) and different MC-CDMA techniques have been proposed (Sourour 1996, Kondao 1996, Vandendorpe 1995, DaSilva 1994, Sharma 2020). Despite the benefits of OFDM, there exist some drawbacks such as low spectral efficiency due to the presence of cyclic prefix, and sensitivity to time and frequency offsets caused by synchronization errors, as well as Doppler shifts. Specifically, carrier frequency offset (CFO) will cause loss of orthogonality which will lead to inter-carrier interference (ICI) that results in severe performance degradation in asynchronous multiuser applications) Zaki 2019).

An alternative method to OFDM is filter-bank multicarrier (FBMC) which was first introduced over 50 years ago by Chang (1966) and Saltzberg (1967). Compared to OFDM, FBMC is expected to provide higher bandwidth efficiency due to the absence of CP. Moreover, in the case of applying massive MIMO to FBMC systems, the linear combing of signal components smoothes channel distortion, thus, reducing the number of subcarriers significantly (Aminjavaheri 2018, Singh 2020, Hosseiny 2022, Besseghier 2022). As a result, both, the peak to average power ratio (PAPR) and the system complexity are reduced along with increasing subcarrier spacing which has the benefit of reducing the sensitivity to CFO. Another advantage of FBMC over OFDM is that it is more flexible in terms of carrier/spectral aggregation since each subcarrier band is bound to an assigned portion of the spectrum with negligible interference with other bands. Based on these benefits, FBMC is being considered as the modulation of choice for the next generation of cellular networks.

Cosine modulated filter bank (CMFB), which belongs to the class of uniform filter banks similar to FBMC/OQAM, has been widely studied in the signal processing community as well as its application to multicarrier modulation (Vaidyanathan 1993, Srivastava 2021, Masarra 2022, Besseghier 2022). In particular, it has been used for data transmission over digital subscriber line (DSL) under the name of discrete wavelet multitone (DWMT) in (Tzannes 1993) and (Sandberg 1995). Moreover, it is shown in (Farhang 2014a and b, Hosseiny 2022) that CFMB is a perfect match for massive MIMO, further studies show that performance enhancements can be achieved by using frequency spreading equalization (FSE) as introduced in (Aminjavaheri 2015). CMFB also provides a simple blind equalization method which is very beneficial in the case of pilot decontamination (Farhang-Boroujeny2003, Farhang 2014a and b).

Filterbank-based MC-CDMA (FB-MC-CDMA) schemes have been studied in single antenna systems. These systems were first proposed in (Liu 2004) and (Bianchi 2004) and further studied in (Wang 2014, Van Bolo 2017), where the performance of different FB-MC-CDMA systems in the presence of CFO is studied. Further studies show that different digital implementations of MC-CDMA can overcome the flaws of the polyphase decomposition-based fast algorithm (Gao 2006, Bian 2018, Reena raj 2021, Wang 2022).

In this paper, a new technique based on CDMA and CMFB with massive MIMO systems is proposed. In the proposed approach, the transmitted symbols are spread by a user signature code, direct-sequence CDMA (DS-CDMA), the chips belonging to different symbols are then assigned to different subcarriers by means of transmultiplexer, which allows the data symbols to be spread in each sub-band. The spread of the data symbol in each sub-band will reduce the interference between the data symbols and hence the BER performance will be improved. To the best of the author's knowledge, the combination of the CDMA and CMFB to massive MIMO communication systems is not considered previously in the literature.

The rest of the paper is organized as follows: In Sect. 2, the proposed FB-MC-CDMA system model is described. The simulation results are shown and discussed in Sect. 3. Finally, the conclusions are presented in Sect. 4.

2 Proposed filterbank-based MC-CDMA system model

In this section, a new technique based on CMFB and CDMA in massive MIMO systems is introduced. Figure 1 presents the block diagram of the proposed CMFB-MC-CDMA transceiver.

Fig. 1
figure 1

The Proposed CMFB MC-CDMA System

2.1 CMFB-MC CDMA transmitter

The incoming stream of the modulated data symbols, \(\left\{ {{\text{b}}\left( {\text{n}} \right)} \right\}_{{{{\rm n}} = 0}}^{{{{\rm M}} - 1}}\), first goes through a serial-to-parallel converter (S/P) to give a vector of parallel data streams \({\text{b}}\), which is of dimensions \({\text{M}} \times 1\). Each symbol is then spread by a sequence \({\text{s}} = { }\left[ {{\text{s}}_{0} {\text{ s}}_{1} { } \ldots {\text{ s}}_{{{{\rm L}} - 1}} } \right]^{{\text{T}}}\), the spreading sequence is unique for each user, yielding a row vector of \({\text{L}}\) chips (Hara 1997),

$${\text{C}} = {\text{b}}\;{{\rm s}}^{{{\rm T}}} = \left[ {\begin{array}{*{20}c} {{\text{c}}_{0} } \\ {\begin{array}{*{20}c} {{\text{c}}_{1} } \\ {\begin{array}{*{20}c} \vdots \\ {{\text{c}}_{{{{\rm M}} - 1}} } \\ \end{array} } \\ \end{array} } \\ \end{array} } \right] = \left[ {\begin{array}{*{20}c} {{\text{b}}\left( 0 \right){\text{s}}_{0} } & {{\text{b}}\left( 0 \right){\text{s}}_{1} } & \cdots & {{\text{b}}\left( 0 \right){\text{s}}_{{{{\rm L}} - 1}} } \\ {{\text{b}}\left( 1 \right){\text{s}}_{0} } & {{\text{b}}\left( 1 \right){\text{s}}_{1} } & \cdots & {{\text{b}}\left( 1 \right){\text{s}}_{{{{\rm L}} - 1}} } \\ \vdots & \vdots & \ddots & \vdots \\ {{\text{b}}\left( {{\text{M}} - 1} \right){\text{s}}_{0} } & {{\text{b}}\left( {{\text{M}} - 1} \right){\text{s}}_{1} } & \cdots & {{\text{b}}\left( {{\text{M}} - 1} \right){\text{s}}_{{{{\rm L}} - 1}} } \\ \end{array} } \right],$$
(1)

where \({\text{C}}\) represents a matrix of dimensions \({\text{M}} \times {\text{L}}\). Each row of \({\text{C}}\) which contains \({\text{L}}\) Chips of spread symbol \({\text{b}}\left( {\text{k}} \right)\) are then upsampled by \({\text{M}}\). The up sampled row signal \({\text{ C}}_{{{\rm k}}} \left( {{\text{z}}^{{{\rm M}}} } \right)\) with length \({\text{LM}}\) is fed to a synthesis filter \({\text{F}}_{{{\rm k}}} \left( {\text{z}} \right)\). Which is one of the filter bank synthesis filters? \(\left\{ {{\text{F}}_{{{\rm k}}} \left( {\text{z}} \right)} \right\}_{{{{\rm k}} = 0}}^{{{{\rm M}} - 1}}\) (Vaidyanathan 1993). Hence, as shown in Fig. 1 the outputs of the synthesis filters are summed to generate the transmit signal \({\text{X}}\left( {\text{z}} \right)\)

$${\text{X}}\left( {\text{z}} \right) = \mathop \sum \limits_{{{{\rm k}} = 0}}^{{{\text{M}} - 1}} {\text{C}}_{{{\rm k}}} \left( {{\text{z}}^{{{\rm M}}} } \right){\text{F}}_{{{\rm k}}} \left( {\text{z}} \right),$$
(2)

which can be represented in time domain as

$$\begin{array}{*{20}c} {x\left( {\text{n}} \right) = { }\mathop \sum \limits_{{{{\rm k}} = 0}}^{{{{\rm M}} - 1}} \mathop \sum \limits_{{{{\rm l}} = 0}}^{{{\text{N}} - 1}} {\text{f}}_{{{\rm k}}} \left( {{\text{n}} - {{\rm l}}} \right){\text{c}}_{{{\rm k}}} \left( {\frac{{\text{l}}}{{\text{M}}}} \right),} & {{\text{n}} = 0,\;{\text{M}},\;2{\text{M}},\; \ldots ,\;{\text{M}}\left( {\text{M}} \right).} \\ \end{array}$$
(3)

In the proposed transmitter specific synthesis filters \({\text{f}}_{{{\rm k}}} \left( {\text{n}} \right)\) are selected. Theses filters are named as cosine modulated filters and represented as:

$${\text{f}}_{{{\rm k}}} \left( {\text{n}} \right) = 2{\text{p}}_{0} \left( {\text{n}} \right){\text{cos}}\left( {\frac{{\uppi }}{{\text{M}}}\left( {{\text{k}} + \frac{1}{2}} \right)\left( {{\text{n}} - { }\frac{{\text{D}}}{2}} \right) - \left( { - 1} \right)^{{\text{k}}} \frac{{\uppi }}{4}} \right),$$
(4)

where, \({\text{ k}} = 0,{ }1,{ }2,{ } \ldots ,{\text{ M}} - 1\), \({\text{p}}_{0} \left( {\text{n}} \right)\) is the prototype filter and \({\text{D}}\) is the filter order. Finally, the cycle prefix is added to perform the transmitted signal (Vaidyanathan 1993).

2.2 CMFB-MC CDMA receiver

The transmit signal is sent through a single mobile terminal (MT) antenna through the channel \({\text{H}}_{{{\rm l}}} \left( {\text{z}} \right)\). The received signal at the channel output after removing cycle prefix, \({\text{Y}}_{{{\rm l}}} \left( {\text{z}} \right)\) is given by

$$\begin{array}{*{20}c} {{\text{Y}}_{{{\rm l}}} \left( {\text{z}} \right) = {\text{H}}_{{{\rm l}}} {\text{X}}\left( {\text{z}} \right) + {\text{W}}_{{{\rm l}}} \left( {\text{z}} \right),} & {{\text{l}} = 0,\;1,\;2,\; \ldots ,\;{\text{N}} - 1,} \\ \end{array}$$
(5)

where \({\text{Y}}_{{{\rm l}}} \left( {\text{z}} \right)\) represents the received signal at the \({\text{l}}\)th base station (BS) antenna, \({\text{W}}_{{{\rm l}}} \left( {\text{z}} \right)\) is the complex gaussian noise response at the \({\text{l}}\)th base station, which assumed to have zero mean and variance \(\upsigma_{{{\text{W}}_{{{\rm l}}} }}^{2} {\text{I}}\), and \({\text{H}}_{{{\rm l}}}\) is frequency domain equivalent matrix (channel response) between the MT and the \({\text{l}}\)th BS antenna, can be generated as) Zaki 2019):

$${\text{H}}_{{{{\rm l~}}}} = {\text{diag}}\left( {{\mathcal{\rm F}}\left( {{\text{h}}_{{{\rm l}}} } \right)} \right)$$
(6)

where \({\text{diag}}\left( \cdot \right)\) is represent diagonal matrix, \({\mathcal{\rm F}}( \cdot )\) is FFT matrix operation and \({\text{h}}_{{{\rm l}}} = \left[ {{\text{h}}_{{{\rm l}}} \left( 0 \right),{\text{h}}_{{{\rm l}}} \left( 1 \right) \ldots {\text{ h}}_{{{\rm l}}} \left( {{\text{L}}_{{{\rm t}}} } \right)} \right]\) is channel impulse response of length \({\text{L}}_{{{\rm t}}}\). At the receiver, the signals received from the \({\text{N}}\) BS antennas are equalized by zero forcing equalizer (Rashich 2019) using the equalizer-weighted diagonal matrix \({\Psi}_{{\text{l}}}\), which can be expressed as:

$${\Psi}_{{\text{l}}} = \left( {{\text{H}}_{{{\rm l}}}^{*} {\text{H}}_{{{\rm l}}} } \right)^{ - 1} {\text{H}}_{{{\rm l}}}^{*} ,$$
(7)

where \(\left( \cdot \right)^{*}\) represent the complex conjugate transpose of matrix and \(\left( \cdot \right)^{ - 1}\) is the inverse of the matrix. The equalizer output can be written as:

$${\hat{\text{Y}}}_{{\rm l}} \left( {\text{z}} \right){ } = {{\Psi} }_{{\rm l}} {\text{ Y}}_{{\rm l}} \left( {\text{z}} \right).$$
(8)

The inverse Fourier transform operation is next applied to the output of the equalizer. Then, the combining process is applied using Equal gain combining (EGC) resulting in the combined signal \({\text{y}}\left( {\text{n}} \right)\) in time domain as:

$${\text{y}}\left( {\text{n}} \right) = \frac{1}{{\text{N}}}\mathop \sum \limits_{{{\text{l}} = 0}}^{{{\text{N}} - 1}} {\hat{\text{y}}}_{{\text{l}}} \left( {\text{n}} \right).$$
(9)

The combined signal \(\left\{ {{\text{y}}\left( {\text{n}} \right) \leftrightarrow {\text{Y}}\left( {\text{z}} \right)} \right\}\) is then passed through analysis CMFB \(\left\{ {{\text{G}}_{{\text{k}}} \left( {\text{z}} \right)} \right\}_{{{\text{k}} = 0}}^{{{\text{M}} - 1}}\), where each filter output is down sampled by \({\text{M}}\), to produce the received coded data symbols \(\left\{ {{\text{U}}^{{\text{T}}} } \right\}_{{{\text{k}} = 0}}^{{{\text{M}} - 1}}\) vectors each of a dimension \(1 \times {\text{L}}\),

$${\tilde{{\rm U}}}_{{\rm k}} \left( {\text{z}} \right) = {\text{G}}_{{\rm k}} \left( {\text{z}} \right)~{\text{Y}}\left( {\text{z}} \right),$$
(10)
$$\begin{array}{*{20}c} {{\text{U}}_{{\rm k}} \left( {\text{z}} \right) = \frac{1}{{\text{M}}}\mathop \sum \limits_{{{\rm l} = 0}}^{{{\text{M}} - 1}} {{\tilde{\rm U}}}_{{\rm k}} \left( {{\text{z}}^{{\frac{1}{{\text{M}}}}} {\text{e}}^{{ - {\text{j}}\frac{{2{\uppi l}}}{{\text{M}}}}} } \right),} & {{\text{k}} = 0,\;1,\;2,\; \ldots ,\;{\text{M}} - 1,} \\ \end{array}$$
(11)

where \(\left\{ {{{\tilde{\rm U}}}_{{\rm k}} } \right\}_{{{\rm k} = 0}}^{{{\text{M}} - 1}}\) are the analysis filters outputs and \({\text{U}}_{{\rm k}}\) is the \({\text{k}}\)th row of the matrix \({\text{U}}\)(Farhang 2014a and b).

The resulting downsampled outputs are multiplied by the corresponding chip of the spreading sequence and summed over \({\text{L}}\) consecutive values to yield the received symbols \({\hat{\rm b}}\),

$${{\hat{\rm b}}} = {\text{Ud}}_{{\rm s}} = \frac{1}{{\text{L}}}{\rm Us}.$$
(12)

The received symbols are then passed through a parallel-to-serial converter (P/S), to generate the received stream of symbols \({\hat{\rm b}}\left( {\text{n}} \right)\) at the input of the decision device.

However, for the analysis filters \({\text{G}}_{{\rm k}} \left( {\text{z}} \right)\) at the receiver, complex coefficient implementation is used which gives the opportunity for blind equalization to be carried out in a simple manner as shown in (P. Vaidyanathan 1993) and (Farhang 2014a and b).

$$\begin{array}{*{20}c} {{\text{G}}_{{\rm k}} \left( {\text{z}} \right) = {\text{Q}}_{{\rm k}} \left( {\text{z}} \right) + {\text{Q}}_{{2{\text{M}} - 1 - {\text{k}}}} \left( {\text{z}} \right)} & {{\text{k}} = 0,\;1,\;2,\; \ldots ,\;{\text{M}} - 1,} \\ \end{array}$$
(13)
$$\begin{array}{*{20}c} {{\text{Q}}_{{\rm k}} \left( {\text{z}} \right) = {\text{d}}_{{\rm k}} {\text{P}}_{0} \left( {{\text{zW}}_{{2{\text{M}}}}^{{{\text{k}} + 0.5}} } \right)} & {{\text{k}} = 0,\;1,\;2,\; \ldots ,\;2{\text{M}} - 1,} \\ \end{array}$$
(14)
$${\text{d}}_{{\rm k}} = \left\{ {\begin{array}{*{20}l} {{\text{e}}^{{{\text{j}}\left( {\uptheta_{{\rm k}} - \frac{{\uppi \left( {{\text{k}} + 0.5} \right){\text{D}}}}{{2{\text{M}}}}} \right)}} ,} \hfill & {{\text{k}} = 0,\;1,\;2,\; \ldots ,\;{\text{M}} - 1} \hfill \\ {{\text{d}}_{{2{\text{M}} - 1 - {\text{k}}}}^{*} ,} \hfill & {{\text{k}} = {\text{M}},\;{\text{M}} + 1,\; \ldots ,\;2{\text{M}} - 1} \hfill \\ \end{array} } \right.,$$
(15)

where \(\uptheta_{{\rm k}} = { }\left( { - 1} \right)^{{\text{k}}} \left( {\uppi /4} \right)\), * denotes the conjugate operator.

In CMFB, data symbols are pulse-amplitude modulated (PAM) and transmitted through a set of vestigial side-band (VSB) subcarrier channels. Moreover, subcarrier phases are alternated between 0 and \(\uppi /2\) among adjacent subcarriers; this phase adjustment allows the receiver to separate the transmitted data symbols free of ISI and ICI. More details are explained in (Chang 1966) and (Farhang-Boroujeny 2010).

2.3 Bit error rate analysis (BER)

The BER analysis for the proposed CMFB MC-CDMA System over Rayleigh fading channels is presented. Consider the received signals in (5), by applying ZF channel equalizer as in (7) to the received signals, the equalizer output can be written as:

$${\hat{\rm Y}}_{{\text{l}}} \left( {\text{z}} \right) = {\Psi}_{{\text{l}}} {\text{Y}}_{{\rm l}} \left( {\text{z}} \right) = {\text{X}}\left( {\text{z}} \right) + {\Psi}_{{\text{l}}} {\text{W}}_{{\rm l}} \left( {\text{z}} \right)$$
(16)

Then the IFFT and the equal gain combiner is applied successively to get the output of the combiner as:

$${\text{y}}\left( {\text{n}} \right) = \frac{1}{{\text{N}}}\mathop \sum \limits_{{{\text{l}} = 0}}^{{{\text{N}} - 1}} {\text{x}}\left( {\text{n}} \right) + {\Psi}_{{\text{l}}} {\text{w}}_{{\rm l}} \left( {\text{n}} \right) = {\text{x}}\left( {\text{n}} \right) + \frac{1}{{\text{N}}}\mathop \sum \limits_{{{\text{l}} = 0}}^{{{\text{N}} - 1}} {\Psi}_{{\text{l}}} {\text{w}}_{{\rm l}} \left( {\text{n}} \right).$$
(17)

The operations of filtering (using analysis CMFB where each filter output is down sampled), CDMA de-spreading, and parallel to serial converter are applied to get received stream of symbols \({\hat{\rm b}}\left( {\rm n} \right)\) using (10), (11), and (12) as (Sharma 2020):

$${\hat{\rm b}}\left( {\rm n} \right) = {\text{b}}\left( {\text{n}} \right) + {\upeta ,}$$
(18)

where

$$\upeta = {\text{d}}_{{\rm s}} {\text{ G}}\left( {\text{z}} \right) \cdot {\mathcal{\rm F}}\left( {{\ddot{\rm w}}\left( {\text{n}} \right)} \right) = {\text{d}}_{{\rm s}} {\upeta }_{{\rm G}} ,$$
(19)
$${\ddot{\rm w}}\left( {\text{n}} \right) = \frac{1}{{\text{N}}}\mathop \sum \limits_{{{\rm l} = 0}}^{{{\text{N}} - 1}} {\Psi}_{{\rm l}} {\text{w}}_{{\rm l}} \left( {\text{n}} \right) = \frac{1}{{\text{N}}}\mathop \sum \limits_{{{\rm l} = 0}}^{{{\text{N}} - 1}} {\check{\rm w}}_{1} \left( {\text{n}} \right).$$
(20)

The average of many uncorrelated noise vectors \({\hat{\rm w}}_{1} \sim {\mathbb{CN}}\left( {0;\upsigma_{{{\hat{\rm w}}_{1} }}^{2} {\rm I}} \right)\) reduce the output variance to \(\frac{1}{{\text{N}}}\) of the average of the variances of noise vectors, which can be expressed as:

$$\upsigma_{{{\ddot{\rm w}}}}^{2} = {\text{E}}\left[ {\left( {\frac{1}{{\text{N}}}\mathop \sum \limits_{{{\rm l} = 0}}^{{{\text{N}} - 1}} {\check{\rm w}}_{1} \left( {\text{n}} \right)} \right) \cdot \left( {\frac{1}{{\text{N}}}\mathop \sum \limits_{{{\rm l} = 0}}^{{{\text{N}} - 1}} {\check{\rm w}}_{1} \left( {\text{n}} \right)} \right)^{*} } \right],$$
(21)
$$\upsigma_{{{\ddot{\rm w}}}}^{2} = \frac{1}{{{\text{N}}^{2} }}\left[ {\upsigma_{{\overset{\lower0.5em\hbox{$\smash{\scriptscriptstyle\smile}$}}{w}_{1} }}^{2} {\rm I} + \upsigma_{{\overset{\lower0.5em\hbox{$\smash{\scriptscriptstyle\smile}$}}{w}_{1} }}^{2} {\rm I} + \ldots + \upsigma_{{\overset{\lower0.5em\hbox{$\smash{\scriptscriptstyle\smile}$}}{w}_{{{\rm N} - 1}} }}^{2} {\rm I}} \right],\;\;{\text{E}}\left( {{\check{\rm w}}_{{\rm i}} ,{\check{ \rm w}}_{{\rm j}} } \right) = 0.$$
(22)

The noise vector \({\check{\rm w}}_{1}\) is resultant of multiplication of diagonal matrix \({\Psi}_{{\rm l}}\) by noise vector \({\text{w}}_{{\rm l}} \sim {\mathbb{\rm CN}}\left( {0;\upsigma_{{{\rm w}_{{\rm l}} }}^{2} {\rm I}} \right).\) The resultant variance of \({\check{\rm w}}_{1}\) given by:

$$\upsigma_{{\overset{\lower0.5em\hbox{$\smash{\scriptscriptstyle\smile}$}}{w}_{1} }}^{2} = {\text{E}}\left[ {\left( {{\Psi}_{{\rm l}} {\text{w}}_{{\rm l}} } \right)\left( {{\Psi}_{{\rm l}} {\text{w}}_{{\rm l}} } \right)^{*} } \right] = {\text{E}}\left[ {\left( {{\Psi}_{{\rm l}} {\text{w}}_{{\rm l}} {\text{w}}_{{\rm l}}^{*} {\Psi}_{{\rm l}}^{*} } \right)} \right] = {\Psi}_{{\rm l}} \left( {\upsigma_{{{\rm w}_{{\rm l}} }}^{2} } \right){\Psi}_{{\rm l}}^{*} = \upsigma_{{{\rm w}_{{\rm l}} }}^{2} {\Psi}_{{\rm l}} {\Psi}_{{\rm l}}^{*} .$$
(23)

The average value of the variance in this case can be represented as:

$$\upsigma_{{\overset{\lower0.5em\hbox{$\smash{\scriptscriptstyle\smile}$}}{w}_{1} {\Psi} }}^{2} = \frac{{\upsigma_{{{{\rm w}}_{{{\rm l}}} }}^{2} }}{{{\text{M}} + {\text{D}} - 1}}\mathop \sum \limits_{{{{\rm f}} = 1}}^{{\left( {{\text{M}} + {\text{D}} - 1} \right)}} \left| {{\Psi}_{{{\rm l}}} \left( {{{\rm f}},{{\rm f}}} \right)} \right|^{2} = \alpha_{{{\rm l}}} \upsigma_{{{{\rm w}}_{{{\rm l}}} }}^{2} ,$$
(24)
$$\alpha_{{{\rm l}}} = \frac{1}{{{\text{M}} + {\text{D}} - 1}}\mathop \sum \limits_{{{{\rm f}} = 1}}^{{\left( {{\text{M}} + {\text{D}} - 1} \right)}} \left| {{\Psi}_{{{\rm l}}} \left( {{\text{f}},{\text{f}}} \right)} \right|^{2} ,\;\;\;{\text{l}} = 0,\;1,\; \ldots ,\;{\text{N}} - 1.$$
(25)

As, \(\upsigma_{{{\hat{\rm w}}_{1} }}^{2}\) = \(\alpha_{{{\rm l}}} \upsigma_{{{{\rm w}}_{{{\rm l}}} }}^{2}\) and using (22) then,

$$\upsigma_{{{\ddot{\rm w}}}}^{2} = \frac{1}{{{\text{N}}^{2} }}\left[ {\alpha_{0} \upsigma_{{{{\rm w}}_{0} }}^{2} {\rm I} + \alpha_{1} \upsigma_{{{{\rm w}}_{1} }}^{2} {\rm I} + \ldots + \alpha_{{{{\rm N}} - 1}} \upsigma_{{{{\rm w}}_{{{{\rm N}} - 1}} }}^{2} {\rm I}} \right] = \frac{1}{{{\text{N}}^{2} }}\mathop \sum \limits_{{{{\rm l}} = 0}}^{{{{\rm N}} - 1}} \alpha_{{{\rm l}}} \upsigma_{{{{\rm w}}_{{{\rm l}}} }}^{2} ,$$
(26)
$$\upsigma_{{{\ddot{\rm w}}}}^{2} = \frac{1}{{{{\rm N}}^{2} }}\mathop \sum \limits_{{{{\rm l}} = 0}}^{{{{\rm N}} - 1}} \upsigma_{{\overset{\lower0.5em\hbox{$\smash{\scriptscriptstyle\smile}$}}{w}_{1} }}^{2} .$$
(27)

Since the analysis CMFB is linear time invariant filter and the down sampling operation do not affect the noise variance, so the output noise variance of the filter can be represented as:

$$\upsigma_{{\upeta_{{{\rm G}}} }}^{2} = \left| {{\text{G}}\left( {\text{z}} \right)} \right|^{2} \cdot \upsigma_{{{\ddot{\rm w}}}}^{2} .$$
(28)

As the variance of \(\upeta\) in (16) is given by \({\text{E}}\left( {\upeta \upeta^{*} } \right)\) as follows:

$${\text{E}}\left( {\upeta \upeta^{*} } \right) = {\text{E}}\left( {{\text{d}}_{{{\rm s}}} \upeta_{{{\rm G}}} \left( {{\text{d}}_{{{\rm s}}} \upeta_{{{\rm G}}} } \right)^{*} } \right){ } = {\text{d}}_{{{\rm s}}} {\text{E}}\left( {\upeta_{{{\rm G}}} \upeta_{{{\rm G}}}^{*} } \right){\text{d}}_{{{\rm s}}}^{*} = \frac{{\upsigma_{{\upeta_{{{\rm G}}} }}^{2} }}{{{\rm L}}}$$
(29)

Hence, using the relations (26), (28), and (29) the final resultant noise variance \(\upeta\) in (19) can be expressed as

$$\upsigma_{\upeta }^{2} = \frac{{\left| {{\text{G}}\left( {\text{z}} \right)} \right|^{2} }}{{\text{L}}}.{ }\frac{1}{{{\text{N}}^{2} }}\mathop \sum \limits_{{{{\rm l}} = 0}}^{{{{\rm N}} - 1}} \alpha_{{{\rm l}}} \upsigma_{{{{\rm w}}_{{{\rm l}}} }}^{2} .$$
(30)

Considering noise vectors \({{\rm w}}_{{{\rm l}}}\) have the same variance, thus the final resultant noise variance in (30) can be rewritten as:

$$\upsigma_{\upeta }^{2} = \frac{{\left| {{\text{G}}\left( {\text{z}} \right)} \right|^{2} }}{{\text{L}}}.{ }\frac{{\upsigma_{{{\rm w}}}^{2} }}{{{\text{N}}^{2} }}\mathop \sum \limits_{{{{\rm l}} = 0}}^{{{\text{N}} - 1}} \alpha_{{{\rm l}}}$$
(31)

As notice that in (31) the resultant noise variance reduced by factor \({\text{L}}\) due to the use of the CDMA spreading process in proposed technique compared to the conventional technique that not considered CDMA Spreading process.

3 Simulation results and discussion

This section presents a set of computer simulations, for the bit-error-rate (BER) performance, to verify the accuracy of the proposed model. In this section, simulations are performed for a multiuser MIMO and massive MIMO scenarios, where \({\text{K}}\) mobile terminals (MTs) communicate with a base station (BS) in a time division duplex (TDD) manner is assumed (T. Marzetta 2010). The BS is equipped with \({\text{N}}\) transmit/receive antennas while each MT is equipped with a single transmit and receive antenna. The number of BS antennas is considered to be much larger than the number of users (\({\text{N}} \gg {\text{K}}\)) and all users in the cell can simultaneously use all the subcarriers. Signals of different users are identified by the BS through their respective subcarrier gains between each MT antenna and the BS antennas, since the channel gain vectors for different users are statistically independent with respect to each other.

The results obtained are for a prototype filter of length equal to 4 \({\text{M}}\). The BER performance is tested in multipath Rayleigh fading channels and for a sample set of channel responses generated according to the SUI-4 channel model proposed by the IEEE802.16 broadband wireless access group (IEEE802.16 2001).

Furthermore, BER is also obtained for SISO, MIMO and massive MIMO systems in single user and multiuser scenarios for comparison. Additionally, in the multiuser scenario, BER is presented for both cases when MT is equipped with single and 2 transmit/receive antennas. Finally, the effect of increasing number of subcarriers is presented.

3.1 CMFB in SISO systems

By considering the single user scenario, the response of CMFB in single tap Rayleigh fading channel, for both BPSK and 4-PAM, is presented in Fig. 2 for number of subcarriers \({\text{M}} = 64\). As shown in the Fig. 2, a BER of \(10^{ - 4}\) is achieved at SNR = 17.5 dB for 4-PAM modulation where in the case of BPSK, the same BER is achieved at SNR = 10.8 dB. Furthermore, Fig. 3 shows the BER in case of 3-tap multipath Rayleigh fading channel. The performance of both BPSK and 4-PAM degrades significantly in such channels. As noticed from Fig. 3, for 4-PAM modulation a BER of \(2 \times 10^{ - 2}\) is achieved at SNR = 19 dB while for BPSK modulation the same BER is achieved at SNR = 12.5 dB. Thus, it is concluded that BPSK outperforms the 4-PAM modulation by 6.5 dB, however, this is at the expense of data rate.

Fig. 2
figure 2

BER of CMFB versus \({\text{E}}_{{{\rm s}}} /{{\rm N}}_{{0{ }}}\) for \({\text{M}} = 64\) and SISO in single tap Rayleigh fading channel

Fig. 3
figure 3

BER of CMFB versus \({\text{E}}_{{{\rm s}}} /{{\rm N}}_{{0{ }}}\) for \({\text{M}} = 64\) and SISO in 3-tap Rayleigh fading channel

Next, the performance of CMFB system is considered in the SUI-4 channel model defined by the IEEE802.16 broadband wireless access group and the results are presented in Fig. 4. As shown from Fig. 4, the BER performance degrades slightly, compared to the performance in single tap Rayleigh fading channel, for both 4-PAM and BPSK to give a BER of \(10^{ - 4}\) at SNR = 18 dB and at SNR = 11 dB respectively.

Fig. 4
figure 4

BER of CMFB versus \({\text{E}}_{{{\rm s}}} /{{\rm N}}_{{0{ }}}\) for \({\text{M}} = 64\) and SISO in SUI-4 channel

3.2 CMFB in MIMO and massive MIMO systems

In a single user scenario, the effect of increasing the number of antennas at the receiver on the BER is evaluated and presented for 4-PAM modulation and \({\text{M}} = 64\) in Fig. 5. As depicted in Fig. 5, a BER of \(10^{ - 4}\) is achieved at SNR = 11.5, 7.5 and 5.5 dB for 4, 10 and 16 antennas respectively, instead of 17.5 dB when compared to a SISO system with the same parameters for single tap Rayleigh fading channel. As highlighted by these results, distortions due to multipath fading channel are averaged out as the number of antennas increases and the BER is improved. For instance, the SNR is improved by 6, 10 and 12 dB for N = 4, 10 and 16 respectively at BER \(= 10^{ - 4}\). It is worth mentioning that when the number of antennas is larger than 10 the systems is considered to be a massive MIMO system (Björnson, 2016).

Fig. 5
figure 5

BER of CMFB versus \({\text{E}}_{{{\rm s}}} /{{\rm N}}_{{0{ }}}\) for \({\text{M}} = 64\) subcarriers for different number of receive antennas \({\text{N}}\) for single user scenario in single tap Rayleigh fading channel

Figure 6 illustrates the effect of 3-tap Rayleigh fading channel on the CMFB system in the presence of a different number of receive antennas \({\text{ N}}\). As noticed from Fig. 6, the SNR is improved from 17 to 12 dB for \({\text{BER}} = 10^{ - 2}\) if the number of receive antennas is increased from \({\text{N}} = 4\) to \({\text{N}} = 16\). Moreover, by comparing these results to SISO systems it can be shown that the SNR is improved by 5, 8.5 and 10 dB for \({\text{N}}\) = 4, 10 and 16 respectively. Additionally, the BER performance of the practical SUI-4 channel model is given in Fig. 7. A BER of \(10^{ - 4}\) is achieved at SNR = 12, 8 and 6 dB for \({\text{N}} = 4{ },{ }10\) and 16 respectively. These results show an enhancement of 6, 10 and 12 dB for \({\text{N}} = 4,{ }10{ }\) and \(16\) antennas successively compared to the results of single antennas systems obtained in Fig. 4.

Fig. 6
figure 6

BER of CMFB versus \({\text{E}}_{{{\rm s}}} /{{\rm N}}_{{0{ }}}\) for \({\text{M}} = 64\) subcarriers for different number of receive antennas \({\text{N}}\) for single user scenario in 3-tap Rayleigh fading channel

Fig. 7
figure 7

BER of CMFB versus \({\text{E}}_{{{\rm s}}} /{{\rm N}}_{{0{ }}}\) for \({\text{M}} = 64\) subcarriers for different number of receive antennas \({\text{N}}\) for single user scenario in the SUI-4 channel

3.3 The proposed CMFB-MC-CDMA in massive MIMO channels for the single user scenario

This section presents the simulation results of the proposed system for a single user scenario, where CDMA is applied to the CMFB system in the presence of the massive MIMO system. Figure 8 illustrates the enhancement in performance, when using the proposed systems, compared to the conventional CMFB system. Due to the spreading of each user signal in each sub-band, a BER of \(10^{ - 4}\) is achieved at SNR = − 1.5 dB when CDMA is combined with CMFB while in the case when CDMA is not used the same BER is achieved at SNR = 7.5 dB. As illustrated in Fig. 8, the proposed system further improves the SNR by 9 dB for a single tap Rayleigh fading channel.

Fig. 8
figure 8

BER comparison between the conventional CMFB system and the proposed CMFB-MC-CDMA for \({\text{N}} = 10\) and \({\text{M}} = 64\) in single tap Rayleigh channel

Figure 9 presents the BER performance of the proposed system and the conventional CMFB system in a 3-taps Rayleigh fading channel for \({\text{N}} = 16\) antennas. As shown in Fig. 9, the SNR needed to achieve \({\text{BER}} = 10^{ - 2}\) is enhanced from 12 dB for the conventional CMFB system to 3 dB when using the proposed CMFB-MC-CDMA system, hence, introducing an overall enhancement of 9 dB. It can also be noticed from Fig. 9 that the BER reaches an acceptable value of \(2 \times 10^{ - 4}\) at SNR = 19 dB when the proposed CMFB-MC-CDMA system is used as opposed to the conventional CMFB system in massive MIMO channels. Furthermore, the enhancement in performance achieved by the proposed system in the SUI-4 channel model is shown in Fig. 10. Results show that a BER of \(10^{ - 4}\) is achieved at SNR = 8 dB for the conventional system while for the proposed system the BER of \(10^{ - 4}\) is achieved at SNR = − 1 dB, thus, further improving the performance by 9 dB.

Fig. 9
figure 9

BER comparison between the conventional CMFB system and the proposed CMFB-MC-CDMA for \({\text{N}} = 16\) and \({\text{M}} = 64\) in 3-tap Rayleigh fading channel

Fig. 10
figure 10

BER comparison between the conventional CMFB system and the proposed CMFB-MC-CDMA for \({\text{N}} = 10\) and \({\text{M}} = 64\) in SUI-4 channel

Since the results of SUI-4 channel model are very close to the results of a single tap Rayleigh fading channel, in the following analysis the focus will be only on one of these two models. That is, in the following section discussing the results of the proposed CMFB-MC-CDMA system in multiuser scenarios, only two channel models will be considered.

3.4 The proposed CMFB-MC-CDMA in massive MIMO channels for the multiuser scenario

Next, a multiuser scenario for \({\text{K}} = 8\) users is considered where the number of subcarriers \({\text{M}} = 64\) and simulations are repeated for different number of antennas \({\text{N}}\). Figure 11 illustrates the BER performance of the proposed system for different number of antennas \({\text{N}}\) (\({\text{N}} = 4\),\({ }10\) MIMO system and \({\text{N}} = 16\), 50 and 100 Massive MIMO system) in a single tap Rayleigh fading channel. As shown in Fig. 11, the SNR is improved by \(6\) dB for BER = \(10^{ - 4}\) by increasing the number of BS antennas from 4 to 16. Comparing the results of Fig. 11 to that of Fig. 5 (single user case), it is noticed that the multiuser scenario with the proposed system gives the same results when compared to a single user scenario of the conventional CMFB system. Moreover, the effect of massive MIMO, where \({\text{N}} \gg {\text{K}}\), on the proposed system model is also addressed in Fig. 11. It can be shown from Fig. 11 that a \({\text{BER}} = 10^{ - 4}\) is achieved at SNR = 0.5 dB when the number of antennas is equal to 50 and the same BER is achieved at SNR = − 2.5 dB when the number of BS antennas is equal to 100. Therefore, it can be concluded that, for massive multiuser MIMO systems, the received signal can be received with power equal to or less than the noise power which increases the security of data reception.

Fig. 11
figure 11

BER of CMFB-MC-CDMA versus \({\text{E}}_{{{\rm s}}} /{{\rm N}}_{{0{ }}}\) for \({\text{M}} = 64\) subcarriers, \({\text{K}} = 8\) users for different number of receive antennas \({\text{N}}\) in a single tap Rayleigh channel

Figure 12 shows the same multiuser scenario in 3-tap Rayleigh fading channel. At \({\text{BER}} = 10^{{ - 2{ }}}\) the SNR is improved from 17 to 12 dB when the number of receive antennas at the BS is increased from 4 to 16. Also, by comparing the results of Fig. 12 to that of Fig. 6 (single user case), it is noticed that the multiuser scenario with the proposed CMFB-MC-CDMA again gives the same results when compared to single user scenario of the conventional CMFB system, thus, confirming the fact that the proposed system model in the case of multiuser offers significant performance enhancement in 3-tap Rayleigh fading channel as well as the single tap channel. Additionally, when the number of receive antennas is increased to 50 and 100 as shown in Fig. 12, a BER of \(10^{ - 2}\) is achieved at SNR = 7 and 4 dB for respectively. Furthermore, Fig. 12 shows that an acceptable BER of \(10^{ - 3}\) is achieved at SNR = 13 dB for \({\text{N}} = { }100\) antennas for 3-tap Rayleigh fading channel.

Fig. 12
figure 12

BER of CMFB-MC-CDMA versus \({\text{E}}_{{{\rm s}}} /{{\rm N}}_{{0{ }}}\) for \({\text{M}} = 64\) subcarriers, \({\text{K}} = 8\) users for different number of receive antennas \({\text{N}}\) in 3-tap Rayleigh channel

Furthermore, the effect of having an MT equipped with 2 transmit antennas on the proposed CMFB-MC-CDMA system is considered in Fig. 13. The figure shows the BER performance in the case of single tap Rayleigh fading channel, where the number of receive antennas at the BS \({\text{N}} = 16\), the number of subcarriers is equal to 64 and \({\text{K}} = 8\) users. As observed from Fig. 13, having 2 transmit antennas enhances the performance by 3 dB. For instance, the SNR required to achieve BER = \(10^{ - 4}\) is 5.5 dB when the MT has only 1 transmit antenna, while the SNR needed to achieve the same BER is 2.5 dB when the number of transmit antennas is increased to 2.

Fig. 13
figure 13

BER of CMFB-MC-CDMA versus \({\text{E}}_{{{\rm s}}} /{{\rm N}}_{{0{ }}}\) for \({\text{M}} = 64\), \({\text{K}} = 8\), \({\text{N}} = 16\) with different number of transmit antennas in single tap Rayleigh channel

In Fig. 14, the same multiuser setup is considered for a 3-tap Rayleigh fading channel and the BER performance is evaluated. As shown in Fig. 14, the enhancement in SNR as a result of increasing the number of transmit antennas at the MT to 2 is also 3 dB for BER = \(10^{ - 2}\). Moreover, when the number of transmit antennas is increased to 2, a BER of \(10^{ - 3}\) is achieved at SNR = 18 dB. Although increasing the number of transmit antennas at the MT improves the performance, MTs are usually constrained by their size and cost, hence increasing the number of antennas at the MT is not an easy task since it will have an effect on the size and cost of the MT. Consequently, the rest of the simulations focus on the case where the mobile terminal is equipped with only 1 transmit antenna.

Fig. 14
figure 14

BER of CMFB-MC-CDMA versus \({\text{E}}_{{{\rm s}}} /{{\rm N}}_{{0{ }}}\) for \({\text{M}} = 64\), \({\text{K}} = 8\), \({\text{N}} = 16\) with different number of transmit antennas in 3-tap Rayleigh channel

Finally, the effect of using a different number of subcarriers \({\text{M}}\) on the proposed CMFB-MC-CDMA system, for the case of \({\text{K}} = 8\) users and \({\text{N}} = 50\) antennas, in both SUI-4 channel model and 3-tap Rayleigh fading channel is illustrated in Fig. 15 and Fig. 16 respectively. As shown in Fig. 16, for a BER of \(10^{ - 4}\), the enhancement in SNR is approximately 0.5 dB when the number of subcarriers is increased to 64 instead of 8. Moreover, Fig. 16 shows that for the same proposed system in a 3-tap Rayleigh fading channel, increasing the number of subcarriers from 8 to 64 introduces an enhancement of 0.4 dB. Therefore, it can be concluded that increasing the number of subcarriers will slightly enhance the performance at the cost of increasing the system complexity and delay significantly. Consequently, one may significantly reduce the number of subcarriers in a MIMO CMFB-MC-CDMA system. Based on the results presented in this paper, it can be clearly shown that proposed CMFB-MC-CDMA with massive MIMO has a significant effect on enhancing the system performance.

Fig. 15
figure 15

Massive MIMO CMFB-MC-CDMA system for \({\text{N}} = 50{ }\), \({\text{K}} = 8\) and different number of subcarriers in SUI-4 channel

Fig. 16
figure 16

Massive MIMO CMFB-MC-CDMA system for \({\text{N}} = 50\), \({\text{K}} = 8\) and different number of subcarriers \({\text{M}}\) in 3-tap Rayleigh fading channel

4 Conclusion

In this paper, a new CMFB-MC-CDMA massive MIMO system is introduced to improve the BER performance. For single user scenario, BER performance was studied for SISO, MIMO, and massive MIMO systems. Simulation results showed that the SNR was improved by 10 dB at BER = \(2 \times 10^{ - 2}\) in the case of 3-tap Rayleigh fading channel when massive MIMO for \({\text{N}} = 16\) was used compared to SISO systems. Additionally, in the SUI-4 channel model, the SNR in the case of massive MIMO for \({\text{N}} = 16\) was enhanced by 12 dB at BER = \(10^{ - 4}\) compared to the BER performance of SISO. Simulation results also showed that the SNR was further improved by 9 dB when the proposed system is used in a single tap Rayleigh fading channel at BER equal to \(10^{ - 4}\) for \({\text{N}} = 10\) antennas. Moreover, for 3-tap Rayleigh fading channel, the enhancement in SNR after applying the proposed system was 8 dB for \({\text{N}} = 10\) and 9 dB for \({\text{N}} = 16\) at BER = \(10^{ - 2}\) when compared the conventional one.

Also, the multiuser scenario was investigated for the proposed CMFB-MC-CDMA system for 8 users. Results showed that for a BER of \(10^{ - 2}\), the SNR was enhanced by 5 and 8 dB for \(N = 50\) and 100 respectively, compared to the case where \(N = 16\) in a 3-taps Rayleigh fading channel. Additionally, in a single tap Rayleigh fading channel and the SUI-4 channel, results showed that when the number of antennas was greatly increased, the power needed to receive the signal to achieve BER = \(10^{ - 4}\) was significantly reduced to a value that is equal to the noise power for \(N = 50\). Finally, it was shown that increasing the number of subcarriers from 8 to 64 in the presence of massive MIMO system introduces only 0.5 dB improvement in SNR, thus, a smaller number of subcarriers could be used for both 3-tap Rayleigh fading channel and SUI-4 channel model. Accordingly, the system complexity and latency could be reduced. The results presented in this paper show that CMFB-MC-CDMA is a promising alternative to OFDM based MC-CDMA systems in the future 5G networks.