Abstract
This paper proposes a nonlinear fractional unit root approach which is known as the autoregressive neural network–fractional integration (ARNN–FI) test. This new fractional integration test is based on a new multilayer perceptron of a neural network process, proposed in Yaya et al. (Oxf Bull Econ Stat 83(4):960–981, 2021). The asymptotic theory and the properties of the proposed test are given. By setting up a Monte Carlo simulation experiment, the simulation results reveal that as the number of observations increases, size and power distortions would disappear in the test. The empirical application based on this new test reveals that the unemployment rates of three European countries are neither stationary nor mean-reverting in line with the hysteresis hypothesis.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
1 Introduction
A unique characteristic of the European labour market was pointed out by Olivier Blanchard and Lawrence Summers in 1986. According to them, a standard macroeconomic theory predicates that demand and supply shocks may unexpectedly cause some deviations of the actual unemployment rate from its equilibrium level. However, the actual unemployment rate would eventually return to its equilibrium level in the long run (Blanchard and Summers 1986a, 1986b). This hypothesis is known as the natural rate hypothesis, which is one of the central ideas of theoretical macroeconomics (Song and Wu 1998). On the other hand, shocks are more persistent than the standard theory could predicate, and high unemployment does not seem to return to its equilibrium level in the European labour market. Blanchard and Summers theorised this interesting empirical regularity of European unemployment as the hysteresis hypothesis (Blanchard and Summers 1986a; Blanchard and Summers 1986b; Mitchell 1993; León–Ledesma 2002; Camarero and Tamarit 2004).
To test empirically the hysteresis hypothesis, researchers used various types of unit root tests. The summary of major empirical findings is reported in Table 1. As the table indicates, there are four different periods of empirical analysis which are separated by dominant methods for the analysis of unemployment hysteresis. During the first period, that is, from 1986 to 1996, researchers used the standard unit root tests, such as the augmented Dickey-Fuller (ADF) test (Dickey and Fuller 1979, 1981) or the Phillips-Perron (PP) test (Phillips and Perron 1988). They observed the presence of hysteresis in the time-series data (Blanchard and Summers 1986b; Neudorfer et al. 1990; Brunello 1990; Mitchell 1993; Røed 1996).
In the second period (1998–2004), the dominant method for empirical analysis of unemployment hysteresis changed from individual time series-based unit root tests in the previous period to the panel data-based unit root tests. Researchers used some major panel unit root tests, such as the Levin-Lin-Chu (LLC) test (Levin et al. 2002), the Im-Pesaran-Shin (IPS) test (Im et al. 2003) and the multivariate ADF test (MADF) test (Sarno and Taylor 1998). They generally concluded that there was no hysteresis in the panel data on unemployment rates (Song and Wu 1998; León–Ledesma 2002; Smyth 2003; Camarero and Tamarit 2004).
Furthermore, during the third period from 2004 to 2010, a popular method for empirical analysis of unemployment hysteresis was the unit root test with structural breaks. Researchers used several different types of structural break unit root tests, such as the ADF test with structural breaks (Lumsdaine and Papell 1997), the panel KPSS test with structural breaks (Carrion-i-Silvestre et al. 2005) and the panel LM test with structural breaks (Im et al. 2005). They concluded that there was no hysteresis in the unemployment rate (Camarero et al. 2005, 2006; Lee et al. 2009, 2010).
During the fourth and most recent period from 2011 to the present, researchers started to use the nonlinear unit root test to take account of unknown nonlinearity and they produced mixed results (Chang 2011; Bolat et al. 2014; Furuoka 2017; Akay et al. 2020). Some researchers detected the presence of hysteresis in unemployment rates (Chang 2011; Akay et al. 2020) while other researchers denied the presence of unemployment hysteresis (Bolat et al. 2014; Furuoka 2017; Yaya et al. 2019; Awolaja et al. 2021; Cheng 2022). For example, Chang (2011) examined unemployment hysteresis in OECD countries by using the Fourier KPSS test (Becker et al. 2006) and concluded that unemployment hysteresis existed in these countries. By contrast, Bolat et al. (2014) analysed the unemployment hysteresis in European countries using the panel KSS test without the Fourier function (Ucar and Omay 2009) and the panel KSS test with the Fourier function (Chang and Chang 2012). The panel KSS test without the Fourier function indicated that unemployment hysteresis existed in these countries, while the panel KSS test with the Fourier function showed that there was no unemployment hysteresis. Furthermore, Furuoka (2017) used the Fourier ADF with structural break (FADF-SB) test to examine the unemployment hysteresis in the Nordic countries and concluded that there was no unemployment hysteresis in these countries. However, Akay et al. (2020) examined the unemployment hysteresis in transition economies using the Kruse test (Kruse 2011) and the Fourier Kruse test (Güriş 2019) and they detected unemployment hysteresis in these countries.
Despite their numerous research efforts, researchers could not empirically prove whether there was hysteresis in the unemployment rates. As the summary in Table 1 indicates, researchers failed to produce consistent empirical findings on this crucial topic in macroeconomics. To overcome the inconsistency in the empirical findings from the unit root approach, Luis A. Gil-Alana suggested using the fractional integration approach for the analysis of unemployment hysteresis. He pointed out that the standard unit root approach could consider a restrictive dichotomy between the unit root process (\(I\left( 1 \right))\) and the stationary process (\(I\left( 0 \right)) \) following Diebold and Rudebusch (1991); Hassler and Wolters (1994) and Lee and Schmidt (1996). In other words, the traditional approach may tend to ignore a unique difference in the manifestation of unemployment dynamics which could be captured by the fractional integration approach (\(I\left( d \right))\). Thus, he suggested that Robinson’s Lagrange Multiplier (LM) method (Robinson 1994) could be used for the empirical estimation of the fractional integration parameter (d) in the unemployment dynamics (Gil-Alana 2001a, 2001b, 2002). There could be three possible ranges of the fractional integration parameter in line with major hypotheses of unemployment rates. Firstly, if the estimated fractional integration parameter is in the range (0, 0.5), unemployment rates are stationary and mean-reverting in line with the natural rate hypothesis. Secondly, if it lies in the range [0.5, 1.0), unemployment rates are non-stationary but mean-reverting in line with the persistence hypothesis. Thirdly, if it lies in the range [1.0, ∞), unemployment rates are non-stationary and non-mean-reverting in line with the hysteresis hypothesis (Caporale and Gil‐Alana 2007; Cuestas et al. 2011; Caporale and Gil‐Alana 2018).
More recently, a new unit root approach for the analysis of unemployment dynamics was suggested by Yaya et al (2021). They authors proposed a novel ADF-type unit root test, which was based on the autoregressive neural network (ARNN) framework. The methodological advantage of this ARNN-ADF test was that the hidden layer in the neural network approach could be used to capture the latent structure of unemployment dynamics in terms of nonlinearities. According to the results of their Monte Carlo simulation, the ARNN-ADF test would suffer less from size distortion than the standard unit root test (Yaya et al. 2021). Also, due to short samples of unemployment data, often obtained annually for cross-section of countries, a good nonlinear approximator, such as the ARNN nonlinear function, is required in the unit root testing framework for unemployment hysteresis. Introducing this in empirical analysis of unemployment data will drastically reduce the bias due to fewer annual time series observations for unemployment.
Thus, the main objective of the current study is to propose a new fractional integration approach or the autoregressive neural network fractional integration (ARNN-FI) testing framework, which is an updated version of Robinson’s (1994) LM method, based on a nonlinear ARNN nonlinearity, rather than the original linear ADF regression.
Our contribution to the literature is threefold. First, we propose a fractional integration test based on the ANN nonlinearity testing framework and provide a theoretical background for it. Second, we evaluate the size and power of the testing procedure in comparison with extant unit root tests, such as the recently proposed ARNN-ADF unit root test by Yaya et al. (2021), in a Monte Carlo simulation exercise. Third, we apply the new test to empirically ascertain the stationarity stance of unemployment rates in selected countries.
Following this introductory section, the theoretical properties of the new fractional integration approach are given in Sect. 2 and Sect. 3 presents a supporting asymptotic theory. Section 4 displays the simulation analysis, while Sect. 5 contains an empirical application to unemployment rates in selected European countries; finally, the overall conclusion is given in Sect. 6.
2 A new fractional integration approach
Testing unit roots has become a standard practice in the empirical analysis of economic data because econometric analysis of economic time series data tends to rely on stationary time structures (Box and Jenkins 1976). A prominent seminal paper by Dickey and Fuller (1979) on Augmented Dickey-Fuller (ADF) unit root test led to the development of many other unit root tests in the literature over the last thirty years. These include those of Phillips and Perron (1988), Kwiatkowski et al. (1992), Elliot et al. (1996), and Ng and Perron (2001), among others. However, it is a familiar stylized fact that most unit root methods have very low power when alternatives include: structural breaks (Perron 1989; Campbell and Perron 1991), fractional unit roots (Diebold and Rudebusch 1991; Hassler and Wolters 1994; Lee and Schmidt 1996), regime-switching (Nelson et al. 2001), or more general nonlinear structures (Enders and Granger 1998).
One way to overcome these limitations is to incorporate nonlinearities in the deterministic components of the auxiliary regressions of the unit root tests, as a proxy for structural breaks. While fractional integration and structural break are intimately related and can be likened to nonlinearities in the time series; either nonlinearity or fractional integration is shown to dominate the other in some cases (van Dijk et al. 2002; Gil-Alana and Yaya 2021); hence, a powerful nonlinear approximator is needed in this case. Franses and van Dijk (2000) emphasized nonlinear time series models as more appropriate tools for explaining and predicting economic time series. Several approaches have attempted to integrate nonlinear dynamics into the unit root testing framework; these include as such Caner and Hansen (2001), Shin and Lee (2001) and Kapetanios et al. (2003). In another study, Allen et al. (2016) extended the unit root tests to nonlinear models for the analysis of exchange rate movements. Furthermore, Trapletti et al. (2000) introduced the Autoregressive Neural Network (ARNN) process, driven by additive noise and demonstrated the behaviour of its stationarity. They further showed that the nonlinear unit root test examined would be satisfactory if the activation function of the ARNN is bounded. Earlier, Steurer (1996) demonstrated empirically that neural networks only work best for stationary data.
The artificial neural network (ANN) is a parametric model’s approximator for other nonlinear time series models, such as the Threshold Autoregressive (TAR), Smooth Transition Autoregressive (STAR), Markov Switching (MS), and Bilinear models (Franses and van Dijk 2000). Thus, it is uncommon to imagine an ANN model as a Data Generating Process (DGP) of any time-dependent system. Thus, to test for neural network-type nonlinearity, the ANN serves as a universal nonlinear approximator, as it induces stronger nonlinearities than other extant nonlinear time series models (Lee et al. 1993).
So far, unit root tests based on ANN nonlinearity are scarce in the literature. A recent test—the ARNN-ADF unit root test—was proposed by Yaya et al (2021). The testing procedure relies on the linear, quadratic, and cubic components of the neural network process that induce nonlinearity in the ARNN-ADF test. The authors applied the simplest form of the ANN model in the ARNN-ADF test regression.
In this present paper, we extend the ARNN-ADF unit root test of Yaya et al. (2021) to a fractional unit root framework by relying on the fact that the classical unit root tests, as well as other Dickey-Fuller-like tests, have very low power against fractional unit root alternatives. Thus, the proposed fractional integration test is based on the fractional integration approach using the ANN framework and a more general test to the existing ARNN-ADF unit root test. This new fractional integration approach is based on the following model:
where yt is the time series under investigation, \(F\left( {\gamma_{p}^{\prime } ,w_{t} } \right)\) is the expression for the ANN nonlinear function in time t, where \(\gamma_{p}\) and \(w_{t}\) are defined later, \(\theta_{p}\), \(p = 1, \ldots ,r\) being the “connector strength” parameters and \(x_{t}\) is the fractionally integrated process which is expressed by:
where L is the usual lag-operator in the form of \(L^{k} x_{t} = Lx_{t - k}\) for every k lag integer, d is the fractional integration parameter defined in the interval \(- 0.5 < d < 2\) including the moving average invertibility and nonstationary ranges of time series (Sowell 1992), and \(u_{t}\) is the covariance stationary I(0) process, assumed to be independently and uniformly dispersed with mean, 0 and variance, \(\sigma_{u}^{2}\). We suppose \(x_{t} = 0\) for \(t \le 0\), following Type II definition of fractional integration as in Marinucci and Robinson (1999). For the fractional integration parameter, at \(d = 0\) from (2), \(x_{t} = u_{t}\), and at \(d = 1\) and \(d = 2\); we have the respective series differenced-transformations \(x_{t} - x_{t - 1} = u_{t}\) and \(x_{t} - 2x_{t - 1} + x_{t - 2} = u_{t}\). The fractional difference operator \((1 - L)^{d} \) is expressed by the Maclaurin series as:
where \(\Gamma \left( . \right)\) is a Gamma function. By putting (3) in (2), \(u_{t}\) in (2) can be expressed as:
The function \(F\left( {\gamma_{p}^{\prime } w_{t} } \right)\) in (1) is known as the hidden unit of the ANN. This is a bounded logistic function between 0 and 1, such that:
where \(\gamma_{p} \,\, = \,\,\,( - c,\,\,\gamma_{11} \,,\,...\,,\,\gamma_{1p} )^{\prime}\) and \(\left( {p + 1} \right) \times 1\) vector of parameters of p hidden units.
These hidden units are then approximated using third-order Taylor series expansion on the logistic function asFootnote 1:
where \(R_{h} \left( {\gamma_{p} ,w_{t} ,w_{t}^{0} } \right)\) is the remainder of the hth order expansion in the Taylors series expansion (Rech 2002; Medeiros et al. 2006; Yaya 2013; Yaya et al. 2021), and
Then, \(\frac{{\partial^{3} F\left( {\gamma_{p}^{\prime } w_{t}^{0} } \right)}}{{\partial \gamma_{i} \partial \gamma_{j} \partial \gamma_{k} }} = \frac{1}{16}y_{t - i} y_{t - j} y_{t - l}\) and if \(i,j \ge 1\), and \(l = 0\),
Thus, by substituting Eqs. (7)–(10) appropriately in Eq. (6), we obtain the approximated hidden unit of the ANN function \(F\left( {\gamma_{p}^{\prime } w_{t} } \right)\) which is used to mimic nonlinear dynamics in \(f\left( {\gamma_{p} ,w_{t} } \right)\) in (1). Also, by merging terms of the same orders in Eq. (6) gives,Footnote 2
where coefficients \(m_{0}\) is the intercept; and \(m_{i}\) form the parameters for the linear logistic component, which further acts as the autoregressive parameters linking \(y_{t}\) and \(y_{t - i}\). In the nonlinear part, \(m_{ij}\) is the parameter for the quadratic component, where \(y_{t - i} y_{t - j}\) is the quadratic component; \(m_{ijl}\) is the parameter for the cubic component; and \(y_{t - i} y_{t - j} y_{t - l}\) is the cubic component.
About the linearity of the process, the acceptance of the null hypothesis:
implies linearity of the time structure. A suitable F test for linearity against nonlinearity, is therefore conducted. Note, the standard test may be carried out and the problem of nuisance parameter \(\theta \) not being identified under the null hypothesis as noted in Luukkonen et al. (1988) is solved following Davies (1977).
To estimate the parameters in the model in Eq. (10), one needs to minimize the errors \(\tilde{\varepsilon }_{t}\) which could be re-written as the linear parameter form,
where \(y_{t}^{*} \,\,\, = \,\,\,(1\, - \,L)^{{d_{o} }} \,y_{t} \,:\) \(1_{t}^{*} \,\,\, = \,\,\,(1\, - \,L)^{{d_{o} }} \,1_{t} \,:\) \(z_{t}^{*} = \left( {1 - L} \right)^{{d_{0} }} y_{t - i}\); \(zz_{t}^{*} = \left( {1 - L} \right)^{{d_{0} }} y_{t - i} y_{t - j}\) and \(zzz_{t}^{*} = \left( {1 - L} \right)^{{d_{0} }} y_{t - i} y_{t - j} y_{t - l}\) with the hypothesized value \(d = d_{0}\). The error process \(\tilde{\varepsilon }_{t}\) is assumed to be I(0).
In the absence of nonlinearity, that is under the acceptance of the nested null hypothesis, testing the ARNN-FI framework in Eq. (11) reduces to the linear specification of the Robinson fractional integration test for \(p = 1\), and \(y_{t - i} = t\), that is, a time trend with coefficient \(\beta\) and intercept \(m_{0} = \alpha\).
with the error process \(\overline{\varepsilon }_{t}\), one can easily estimate the coefficients α and β by the conventional OLS methods such that,
and \(y_{t}^{*} \,\,\, = \,\,\,(1\, - \,L)^{{d_{o} }} \,y_{t} \,:\) \(1_{t}^{*} \,\,\, = \,\,\,(1\, - \,L)^{{d_{o} }} \,1_{t} \,:\) \(t_{t}^{*} \,\,\, = \,\,\,(1\, - \,L)^{{d_{o} }} \,t_{t} \,,\) with the aid of the complex form of the test statistic,
where T is the sample size, and
where λf = 2πf/T, and * indicates that the sums are taken over all frequencies bounded in the spectrum, with periodogram I(λj) for \(\tilde{\varepsilon }_{t}\) and \(\hat{\tau }\,\,\,\,\, =\)\(\,\arg \,\,\min_{{\tau \, \in \,T^{*} }} \,\sigma^{2} (\tau )\,,\)(T* is a subset of the Rq Euclidean space), and f is the frequency of the sine function, and \(\pi = 3.142\).
3 Asymptotic theory
This section offers an asymptotic theory for the newly developed statistic or autoregressive neural network–fractional integration (ARNN–FI) statistic. This new statistic is based on the nested hypothesis by setting the parameter θ to zero. The zero restrictions would impose on the sequence of scalar real values or \(x_{t}\) (Robinson 1994; Gil-Alana and Robinson 1997):
where φ is a function of L which is the lag operator, \(u_{t} \) is covariance stationary sequence with zero mean and weak autocorrelation. The lag operator function φ could be expressed as \(\varphi \left( {z;\theta } \right)\) in which z is variate and θ is a vector of parameter. The value of \(x_{t}\) is set to zero when \(t = 0\). Furthermore, \(\varphi \left( {z;\theta } \right) = \varphi \left( z \right) \) for all z if and only if the zero restrictions are imposed on the parameter. The simple unit root model could be described as \(\varphi \left( z \right)x_{t} = \left( {1 - z} \right)x_{t} = u_{t}\). By contrast, the simple autoregressive model could be expressed as \(\varphi \left( {z;\theta } \right)x_{t} = \left( {1 - \left( {1 + \theta } \right)z} \right)x_{t} = u_{t}\) (Robinson 1994).
Using the fractional integration function, Eq. (1) could be re-formulated as (Robinson 1994; Gil-Alana and Robinson 1997; Gil-Alana 2000):
where d is fractional integration parameter which means \(x_{t}\) is integrated of order d. The fractional integration function could be expressed as (Gil-Alana and Robinson 1997; Gil-Alana 2000):
In the fractional integration framework, the unit root hypothesis could be tested whether the fractional integration parameter is equal to unity (\(d = 1\)). If the fractional integration parameter is greater than zero (\(d > 0\)), \(x_{t}\) could be considered as the long memory process in which the autocorrelation would persist for the long run. By contrast, if the fractional integration parameter is equal to zero (\(d = 0\)), \(x_{t}\) could be considered as the short memory process in which the autocorrelation would rapidly decay (Gil-Alana and Robinson 1997; Gil-Alana 2000).
The main objective of the fractional integration test could be to examine unit root processes or other forms of non-stationarity. In this context, Equation (2) could be expressed as (Tanaka 1999; Gil-Alana 2000):
In this equation, the zero restrictions on the parameter could be expressed as the following null hypothesis (Diebold and Rudebusch 1989; Robinson 1994; Gil-Alana and Robinson 1997):
This newly developed statistical test uses the Lagrange multiplier (LM) statistic for the hypothesis testing on the fractional integration by solving zero restrictions on the parameter as constrained maximization problem. The LM statistic is widely used because it has a simple null distribution in the analysis of nested parametric hypotheses. However, in the analysis of unit root process, the LM statistic may have non-standard null and local asymptotic distribution (Robinson 1994; Davidson and MacKinnon 2004). Robinson (1994) offered an interesting statistical solution for this non-standard distribution of fractional integration statistics which are asymptotically locally most powerful. Under the assumption of the Gaussian distribution of \(u_{t}\), Robinson’s test statistic could be considered as efficient against other local alternatives in a Pitman sense (Robinson 1994; Gil-Alana 2000). Our fractional integration test is an extension of his approach. In the estimation of this new fractional integration statistic, \(x_{t}\) could be non-observable but it could be considered as the error terms in the multiple regression model (Robinson 1994; Gil-Alana and Robinson 1997):
where \(y_{t}\) and \(k \times 1 \) vector \(z_{t}\) are observable and β is \(k \times 1 \) vector of unknown parameters and k is number of parameters. The parameter β could be estimated as (Robinson 1994; Gil-Alana and Robinson 1997):
where \(w_{t} = \left( {1 - L} \right)^{d} Z_{t}\) and T is number of observations in the time-series. Using the estimations from the multiple regression model of Eq. (6), \(u_{t}\) in Eq. (4) could be also estimated as (Robinson 1994; Gil-Alana and Robinson 1997):
Furthermore, the periodogram of \(\tilde{u}_{t}\) can be expressed as (Geweke and Porter‐Hudak 1983; Gil-Alana and Robinson 1997; Hurvich et al. 1998):
where \(\lambda = 2\pi j/T\), and m is a positive integer. Using these estimations, our test statistic could be expressed as:
There is a large similarity in the estimation approach between the Robinson’s test statistic \(\widehat{R }\) and our test statistic \(\hat{R}_{NN} \) which is based on the autoregressive neural network (ARNN) process (Yaya et al. 2021). The difference between these two test statistics essentially lies in the definition of \(z_{t}\). In other words, we propose a new test statistic by modifying \(z_{t}\) following an example of the Fourier fractional integration test (Gil-Alana and Yaya 2021). In the Robinson’s original test statistics, \(z_{t}\) is deterministic regressors (i.e. \(z_{t} = \left( {1,t} \right)\)) and \(z_{t}\) is defined as the Fourier function. In the Fourier fractional integration, that Eq. (22) could be re-formulated as (Gil-Alana and Yaya 2021):
where \(f\left( t \right)\) is the smooth trend Fourier function. Similarly, in our new fractional integration test, Eq. (22) could be re-formulated as:
where \(n\left( t \right)\) is the autoregressive neutral network function which is defined as (Yaya et al. 2021):
where \(k_{i}\) is coefficient for linear component, \(k_{ij}\) is coefficient for quadratic component and \(k_{ijl}\) is coefficient for cubic component, p is lag length for linear component, q is lag length for quadratic linear component and r is lag length for cubic component (Yaya et al. 2021).
Theorem 1
Under the null hypothesis defined in (4) and (5) and under the condition:
where det denotes determinant, the ARNN–FI test statistic would converge in distribution:
where \(I_{p}\) is p-lowed identity matrix and p is number of zero restriction (Refer to Appendix for the proof of this theorem).
4 Monte Carlo simulation analysis
In this section, the Monte Carlo simulation is used to examine the finite-sample behaviour of three different fractional integration tests, namely the Robinson test (Robinson 1994), the Alana-Yaya (AY) test (Gil-Alana and Yaya 2021), and the proposed autoregressive neural network-fractional integration (ARNN-FI) test. Firstly, a simple version of the Robinson test (Robinson 1994) is based on the following equation:
where d is the fractional integration parameter, μ is the intercept, t is the trend, β is the gradient (slope) parameter and \(\varepsilon_{t}\) is the white noise. In this simulation analysis, the gradient parameter (β) is set to unity. Secondly, the Alana-Yaya (AY) test (Gil-Alana and Yaya 2021) is based on equation:
where sin is a sine function, cos is a cosine function and γ is the slope parameter for the trigonometry function which is set to unity in this simulation. The ARNN-FI test is based on the new multilayer perceptron framework with time trend, \(t\) suggested in Yaya et al. (2021):
In this simulation analysis, the lag of the linear component (r) is set to zero and the lag of the quadratic component (s) and the cubic component (v) is set to 1. The null hypothesis in this Monte Carlo simulation could be formulated as:
For the size and power analysis, the null hypothesis is rejected when the absolute value of estimated statistics is greater than the 5% critical value. In this Monte Carlo simulation, five alternative values of fractional integration parameters are used:
with four alternative values: \(d_{0} = 0, 0.25, 0.75, 1. \) This simulation study uses 1,000 replications with five different sample sizes, \(T = 50, T = 100, T = 250,T = 500 and T = 1000\).
Table 2 reports the simulation results from the Robinson test (Robinson 1994). As the simulation analysis indicated, there would be some power and size distortions in the Robinson test when the number of observations is small (\(T = 50 {\text{or }} T = 100).\) For example, at the lowest number of observations (\(T = 50)\), the power of the Robinson test would be 0.270 when \(d_{0} = 0 \) and \(d = - 0.25, \) and the size of the test is 0.206 when both \(d_{0}\) and \(d\) is equal to zero. As the number of observations increases to 500 or 1000, these distortions tend to disappear in the Robinson test. For example, as the number of observations becomes 1000, the power of the test would converge to 1.000 when \(d_{0} = 0 \) and \(d = - 0.25\) and the size of the test would decrease to 0.115 when both \(d_{0}\) and \(d\) are set to 0.
The simulation results from the Alana-Yaya (AY) test (Gil-Alana and Yaya 2021) are reported in Table 3. In comparison with the Robinson test, there would be relatively stronger power and size distortions in the AY test when the number of observations is small (\(T = 50 {\text{or}} T = 100).\) For example, in \(T = 100\), the power of the AY test would be 0.390 and the power of the Robinson test is 0.727, when \(d_{0} = 0.75 \) and \(d = 0.5\). In the same number of observations, the size of the AY test is 0.218 and the size of the Robinson test is 0.125, when both \(d_{0}\) and \(d\) is equal to 0.75. As the number of observations increases to 500 or 1000, these distortions tend to slowly disappear in the AY test. For example, at \(T = 500\), the size of the AY test would be still 0.162 when \(d_{0} = 0 \) and \(d = 0. \) At the highest number of observations \(T = 1000\), the size of the AY test would decrease to 0.121 when both \(d_{0}\) and \(d\) are set to zero.
More importantly, Table 4 reports the simulation results from the autoregressive neural network-fractional integration (ARNN-FI) test. In comparison with the Robinson test or the Alana-Yaya (AY) test, there would be a lower size in the ARNN-FI test. For example, in the \(T = 500, \) the size of the Robinson test is 0.106, the size of the AY test is 0.147 and the size of the ARNN-FI test is 0.041 when both \(d_{0}\) and \(d \) is set to 0.25. It means that the ARNN-FI test would have a relatively lower probability to reject incorrectly the true hypothesis. On the other hand, there would be a relatively higher power and size distortions in the ARNN-FI test when the number of observations is small\(.\) For example, with \(T = 100\), for \(d_{0} = 0.25\) and \(d = - 0.25\), the power of the ARNN-FI test is 0.614, the power of the Robinson test is 0.990 and the power of the AY test is 0.925. As the number of observations increases, these distortions tend to disappear in this test. For example, at the number of observations is 1000, the power of the ARNN-FI test would be equal to 1.000 when \(d_{0} = 0.25\) and \(d = - 0.25\). The fact that the ARNN-FI simulation results indicate higher power when the number of observations is small compared to large number of time series observations further emphasized the applicability of ARNN to modelling unit root processes of unemployment data that are often with few observations.
5 Empirical application
We examine the hysteresis in monthly unemployment rates (1978M1–2020M12) in three European countries, namely France (FR), Germany (DE) and the United Kingdom (UK) as well as two non-European countries are included for comparison, namely the United States (US) and Japan (JP). The total number of observations was 540. The source of data was the S&P Capital IQ (S&P Global 2023). Three fractional integration tests, namely, the Robinson test (Robinson 1994), the Alana-Yaya (AY) test (Gil-Alana and Yaya 2021), and the autoregressive neural network-fractional integration (ARNN–FI) test, are used for the empirical analysis.
Firstly, the Robinson test (Robinson 1994) is based on Eq. (17). As Table 5 shows, the Robinson test indicates that the unemployment rates in three European countries, namely France, Germany and United Kingdom, are non-stationary and non-mean-reverting in line with the hysteresis hypothesis. It means that the findings from the Robinson test confirmed those from the seminal paper by Blanchard and Summers (1986a,b). On the other hand, the Robinson test failed to offer unambiguous results on unemployment status in the USA because its 95% confidence interval was in the range of [0.90–1.44]. By contrast, the findings from the Robinson test indicated that the unemployment rate in Japan is non-stationary but mean-reverting in line with the persistence hypothesis.
Secondly, the Alana-Yaya (AY) test (Gil-Alana and Yaya 2021) is based on Eq. (18). The methodological advantage of this test would be able to take account of unknown nonlinearity by using the Fourier approximation function. As Table 6 shows, the findings from the AY test confirmed those from the Robinson test that the unemployment rates in the three European countries are non-stationary and non-mean-reverting in line with the hysteresis hypothesis. On the other hand, the AY test also failed to produce clear-cut results on unemployment rates in the USA. However, the findings from the AY test showed that the unemployment rate in Japan is non-stationary but mean-reverting.
Finally, the ARNN-FI test would incorporate a new multilayer perceptron (Yaya et al. 2021) into the context of fractional integration analysis. The test is based on Eq. (19). As Table 7 shows, three different fractional unit root tests, namely the Robinson test, the AY test and the ARNN-FI test, produced consistent findings on the unemployment rate in three European countries to support empirically the validity of the hysteresis hypothesis. On the other hand, the ARNN-FI test produced unambiguous findings on unemployment rates in the USA to substantiate the hysteresis hypothesis. The findings from the ARNN-FI test indicated that unemployment rates in Japan are non-stationary but mean-reverting.
In short, the main objective of the empirical analysis in this section is to employ the ARNN–FI test to revisit and re-examine a unique pattern of unemployment or unemployment hysteresis in the European labour market (Blanchard and Summers 1986b). In the context of the existing literature, the findings from the ARNN–FI test have largely confirmed the results from the earlier country-specific time series analyses that reported the presence of hysteresis in the unemployment rates in three European countries, namely, France, Germany and the UK (Blanchard and Summers 1986b; Mitchell 1993; Røed 1996; Camarero et al. 2005; Chang 2011). However, the findings from the ARNN–FI test contradict a recent study by Cheng (2022) that detected the natural rate of unemployment in France. This minor discrepancy in the results could be due to the differences in the methods. Cheng (2022) employed the threshold regression method which takes account of the change of the slope coefficients within the different regimes in the unemployment time series. In contrast, the ARNN–FI test does not incorporate the threshold effect in the estimation.
6 Conclusions
This paper proposed the autoregressive neural network-fractional integration (ARNN–FI) test which is a nonlinear fractional integration time series test based on a new multilayer perceptron framework. The methodological advantage of this multilayer perceptron framework is that its estimation model includes a hidden layer that is expected to capture a latent structure in time-series data as in Yaya et al. (2021). The theoretical properties and the asymptotic theory of the new fractional integration test are presented in the paper.
In the simulation exercise, the Monte-Carlo analysis examined the size and power of three alternative fractional integration tests; namely, the Robinson test, the AY test and a newly-proposed proposed ARNN–FI test. The simulation analysis showed that there were power and size distortions in all three methods when the number of observations was small. However, as the number of observations increased, these distortions tended to disappear in all three methods. As an empirical application example, the three fractional integration tests examined unemployment hysteresis in three European countries, namely France, Germany and United Kingdom. The findings from the ARNN–FI test are consistent with those from the Robinson test and the AY test and indicated that unemployment in these European countries was non-stationary and non-mean-reverting in line with the hysteresis hypothesis.
The empirical findings reported in this article have theoretical and policy implications. From a theoretical perspective, the current findings have substantiated the hysteresis hypothesis proposed by Blanchard and Summers (1986a). In other words, this study offers additional empirical evidence that contradicts the mainstream theoretical perspective on unemployment dynamics or the natural rate hypothesis that assumes the mean-reversion of unemployment rates. In this context, a notable policy implication is that a high unemployment rate in the European labour market would not revert to a lower level without appropriate labour market interventions. In other words, policymakers in three European countries, namely, France, Germany and the UK, need to hammer out policies aimed at reducing the persistently high unemployment in the labour market.
There are some potential weaknesses in the ARNN–FI test. As mentioned in the previous section, this new fractional integration test does not take account of the regime change or structural break. In this context, Gil‐Alana (2008) proposed an innovative method to incorporate structural breaks in the fractional integration framework. Researchers may consider re-formulating the ARNN–FI test by adopting this pioneering idea. Another possible weakness is that the newly proposed test is based on the linear regression analysis. Future lines of research within the methodology of fractional integration might include the analysis of nonlinearities using stochastic approaches rather than deterministic ones. An earlier study by Caporale and Gil-Alana (2007) offered some examples of such approaches.
Notes
This is necessary because the distribution of parameters of ARNN does not exist, whereas that of the Taylor polynomial exists.
References
Akay EC, Oskonbaeva Z, Bülbül H (2020) What do unit root tests tell us about unemployment hysteresis in transition economies? Appl Econ Anal 28(84):221–238
Allen DE, McAleer M, Peiris S, Singh AK (2016) Nonlinear time series and neural-network of exchange rates between the US dollar and major currencies. Tinbergen Institute Discussion Paper, TI 2015–125/III
Awolaja OG, Yaya OS, Vo XV, Ogbonna AE, Joseph SO (2021) Unemployment Hysteresis in Middle East and North Africa Countries: panel SUR-based Unit root test with a Fourier function. Middle East Dev J 13(2):318–334
Becker R, Enders W, Lee J (2006) A stationarity test in the presence of an unknown number of smooth breaks. J Time Ser Anal 27(3):381–409
Blanchard OJ, Summers LH (1986a) Hysteresis in unemployment. NBER Working Paper No. 2035
Blanchard OJ, Summers LH (1986b) Hysteresis and the European unemployment problem. NBER Working Paper No. 1950
Bolat S, Tiwari AK, Erdayi AU (2014) Unemployment hysteresis in the Eurozone area: evidences from nonlinear heterogeneous panel unit root test. Appl Econ Lett 21(8):536–540
Box GEP, Jenkins GM (1976) Time series analysis, forecasting and control, 2nd edn. Holden Day, San Francisco
Brown BM (1971) Martingale central limit theorems. Ann Math Stat 53:59–66
Brunello G (1990) Hysteresis and the Japanese unemployment problem: a preliminary investigation. Oxf Econ Pap 42(3):483–500
Camarero M, Tamarit C (2004) Hysteresis vs. natural rate of unemployment: new evidence for OECD countries. Econ Lett 84(3):413–417
Camarero M, Carrion-i-Silvestre JL, Tamarit C (2005) Unemployment dynamics and NAIRU estimates for accession countries: a univariate approach. J Comp Econ 33(3):584–603
Camarero M, Carrion-i-Silvestre JL, Tamarit C (2006) Testing for hysteresis in unemployment in OECD countries: new evidence using stationarity panel tests with breaks. Oxf Bull Econ Stat 68(2):167–182
Campbell JY, Perron P (1991) Pitfalls and opportunities: What macroeconomists should know about unit roots”, NBER Macroeconomic Annual, pp 1141–201
Caner M, Hansen BE (2001) Threshold autoregression with a unit root. Econometrica 69:1555–1596
Caporale GM, Gil-Alana LA (2007) Nonlinearities and fractional integration in the US unemployment rate. Oxf Bull Econ Stat 69(4):521–544
Caporale GM, Gil-Alana LA (2018) Unemployment in Africa: a fractional integration approach. S Afr J Econ 86(1):76–81
Carrion-i-Silvestre JL, del Barrio-Castro T, Lopez-Bazo E (2005) Breaking the panels: an application to the GDP per capita. The Econ J 159–175
Chang T (2011) Hysteresis in unemployment for 17 OECD countries: stationary test with a Fourier function. Econ Model 28(5):2208–2214
Chang CK, Chang T (2012) Statistical evidence on the mean reversion of real interest rates: SPSM using the Panel KSS test with a Fourier function. Appl Econ Lett 19(13):1299–1304
Cheng KM (2022) Doubts on natural rate of unemployment: evidence and policy implications. Q Rev Econ Finance 86:230–239
Cuestas JC, Gil-Alana LA, Staehr K (2011) A further investigation of unemployment persistence in European transition economies. J Comp Econ 39(4):514–532
Davidson R, MacKinnon JG (2004) Econometric theory and methods. Oxford University Press, New York
Davies RB (1977) Hypothesis testing when a nuisance parameter is present only under the alternative. Biometrica 64:247–254
Dickey DA, Fuller WA (1981) Likelihood ratio statistics for autoregressive time series with a unit root. Econ J Econ Soc 1057–1072
Dickey DA, Fuller WA (1979) Distributions of the estimators for autoregressive time series with a unit root. J Am Stat Assoc 74(366):427481
Diebold FX, Rudebusch GD (1989) Long memory and persistence in aggregate output. J Monet Econ 24(2):189–209
Diebold FX, Rudebusch GD (1991) On the power of Dickey–Fuller test against fractional alternatives. Econ Lett 35:155–160
Elliot G, Rothenberg TJ, Stock JH (1996) Efficient tests for an autoregressive unit root. Econometrica 64:813–836
Enders W, Granger CWJ (1998) Unit root tests and asymmetric adjustment with an example using the term structrure of interest rates. J Bus Econ Stat 16(3):304–311
Franses PH, van Dijk D (2000) Nonlinear time series models in empirical finance. Cambridge University Press, Cambridge
Furuoka F (2017) A new approach to testing unemployment hysteresis. Empir Econ 53(3):1253–1280
Geweke J, Porter-Hudak S (1983) The estimation and application of long memory time series models. J Time Ser Anal 4(4):221–238
Gil-Alana LA (2000) Evaluation of Robinson’s (1994) tests in finite samples. J Stat Comput Simul 68(1):39–63
Gil-Alana LA (2001a) The persistence of unemployment in the USA and Europe in terms of fractionally ARIMA models. Appl Econ 33(10):1263–1269
Gil-Alana LA (2001b) A fractionally integrated exponential model for UK unemployment. J Forecast 20(5):329–340
Gil-Alana LA (2002) Testing the order of integration of the UK Unemployment. Appl Econ Int Dev 2(1):21–40
Gil-Alana LA (2008) Fractional integration and structural breaks at unknown periods of time. J Time Ser Anal 29(1):163–185
Gil-Alana LA, Robinson PM (1997) Testing of unit root and other nonstationary hypotheses in macroeconomic time series. J Econ 80(2):241–268
Gil-Alana LA, Yaya OS (2021) Testing fractional unit root with non-linear smooth break approximations using Fourier functions. J Appl Stat. https://doi.org/10.1080/02664763.2020.1757047
Gil-Alana LA (1997) Testing of fractional integration in macroeconomic time series. Ph.D. thesis submitted to London School of Economics
Güriş B (2019) A new nonlinear unit root test with Fourier function. Commun Stat Simul Comput 48(10):3056–3062
Hassler U, Wolters J (1994) On the power of unit root tests against fractional alternatives. Econ Lett 45:1–5
Hurvich CM, Deo R, Brodsky J (1998) The mean squared error of Geweke and Porter–Hudak’s estimator of the memory parameter of a long-memory time series. J Time Ser Anal 19(1):19–46
Im KS, Pesaran MH, Shin Y (2003) Testing for unit roots in heterogeneous panels. J Econ 115(1):53–74
Im KS, Lee J, Tieslau M (2005) Panel LM unit-root tests with level shifts. Oxf Bull Econ Stat 67(3):393–419
Kapetanios G, Shin Y, Snell A (2003) Testing for a unit root in the nonlinear STAR framework. J Econ 112:359–379
Kruse R (2011) A new unit root test against ESTAR based on a class of modified statistics. Stat Pap 52:71–85
Kwiatkowski D, Phillips PCD, Schmidt P, Shin Y (1992) Testing the null hypothesis of stationarity against the alternative of a unit root: How sure are we that economic time series have a unit root? J Econ 54:159–178
Lee D, Schmidt P (1996) On the power of the KPSS test of stationarity against fractionally integrated alternatives. J Econom 73(1):285–302
Lee TH, White H, Granger CWJ (1993) Testing for neglected nonlinearity in time series models. J Econom 56:269–290
Lee JD, Lee CC, Chang CP (2009) Hysteresis in unemployment revisited: evidence from panel LM unit root tests with heterogeneous structural breaks. Bull Econ Res 61(4):325–334
Lee HY, Wu JL, Lin CH (2010) Hysteresis in East Asian unemployment. Appl Econ 42(7):887–898
León-Ledesma MA (2002) Unemployment hysteresis in the US states and the EU: a panel approach. Bull Econ Res 54(2):95–103
Levin A, Lin CF, Chu CSJ (2002) Unit root tests in panel data: asymptotic and finite-sample properties. J Econom 108(1):1–24
Lumsdaine RL, Papell DH (1997) Multiple trend breaks and the unit-root hypothesis. Rev Econ Stat 79(2):212–218
Luukkonen R, Saikkonen P, Terasvirta T (1988) Testing linearity in univariate time series models. Scand J Stat 16:161–175
Marinucci D, Robinson P (1999) Alternative forms of fractional Brownian motions. J Stat Plan Infer 80:111–122
Medeiros MC, Teräsvirta T, Rech G (2006) Building neural network models for some series: a statistical approach. J Forecast 25:49–75
Mitchell WF (1993) Testing for unit roots and persistence in OECD unemployment rates. Appl Econ 25(12):1489–1501
Nelson CR, Piger J, Zivot E (2001) Markov regime-switching and unit root tests. J Bus Econ Stat 19:404–415
Neudorfer P, Pichelmann K, Wagner M (1990) Hysteresis, Nairu and long term unemployment in Austria. Empir Econ 15:217–229
Ng S, Perron P (2001) Lag selection and the construction of unit root tests with good size and power. Econometrica 69:1519–1554
Perron P (1989) The great crash, the oil price shock, and the unit root hypothesis. Econometrica 57:1361–1401
Phillips PCB, Perron P (1988) Testing for a unit root in time series regression. Biometrica 75:335–346
Priestley MB (1988) Non-linear and non-stationary time series analysis. Academic Press, Minnesota
Rech G (2002) Modelling and forecasting economic time series with single hiddenlayer feedforward autoregressive artificial neural networks. PhD Thesis. Stockholm School of Economics
Robinson PM (1991) Testing for strong serial correlation and dynamic conditional heteroskedasticity in multiple regression. J Econom 47(1):67–84
Robinson PM (1994) Efficient tests of nonstationary hypotheses. J Am Stat Assoc 89:1420–1437
Røed K (1996) Unemployment hysteresis-macro evidence from 16 OECD countries. Empir Econ 21:589–600
S&P Global (2023) S&P Capital IQ. [accessed on 16 February, 2023]. https://www.capitaliq.com/
Sarno L, Taylor MP (1998) Real exchange rates under the recent float: unequivocal evidence of mean reversion. Econ Lett 60(2):131–137
Shin D, Lee O (2001) Tests for asymmetry in possibly nonstationary time series data. J Bus Econ Stat 19:233–244
Smyth R (2003) Unemployment hysteresis in Australian states and territories: evidence from panel data unit root tests. Austr Econ Rev 36(2):181–192
Song FM, Wu Y (1998) Hysteresis in unemployment: evidence from OECD countries. Q Rev Econ Finance 38(2):181–192
Sowell F (1992) Maximum likelihood estimation of stationary univariate fractionally integrated time series models. J Econom 53:165–188
Steurer E (1996) Prognose von 15 Zeitreihen der DGOR mit Neuronalen Netzen. Or Spektrum 18:117–125
Tanaka K (1999) Nonstationary fractional unit root. Economet Theor 15(4):549–582
Trapletti A, Leisch F, Hornik K (2000) Stationary and integrated autoregressive neural network processes. Neural Comput 12:2427–2450
Ucar N, Omay T (2009) Testing for unit root in nonlinear heterogeneous panels. Econ Lett 104(1):5–8
van Dijk D, Franses PH, Paap R (2002) A nonlinear long memory model, with an application to US unemployment. J Econom 110:135–165
Yaya OS, Ogbonna AE, Mudida R (2019) Hysteresis of unemployment rate in Africa: new findings from Fourier ADF test. Qual Quant Int J Methodol 53(6):2781–2795
Yaya OS, Ogbonna AE, Furuoka R, Gil-Alana LA (2021) A new unit root test for unemployment hysteresis based on the autoregressive neural network. Oxf Bull Econ Stat 83(4):960–981
Yaya OS (2013) On the variants of nonlinear models. Ph.D. Thesis, University of Ibadan, Ibadan
Funding
Open Access funding provided thanks to the CRUE-CSIC agreement with Springer Nature.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Luis A. Gil-Alana acknowledges support from the Ministerio de Economía, Industria y Competitividad, through the grant number MINEIC-AEI-FEDER PID2020-113691RB-I00. An internal project from the University Francisco de Vitoria is also acknowledged. Fumitaka Furuoka acknowledges support from the Universiti Malaya Covid-19 Special Research Grant (UMCSRG), throughout the grant number CSRG014-2020S. The Ox program was used for empirical analysis. We are grateful to Professor Jurgen A. Doornik of Oxford University for providing OxEdit free of charge for academic purposes. Data and Oxgauss codes are available at https://sites.google.com/site/fumitakafuruokaswebpage/data-andoxgauss-codes-iii/paper-44.
Appendix
Appendix
The proof for Theorem 1
The autoregressive neural network–fractional integration (ARNN–FI) statistic is an extension of Robinson’s fractional integration framework (Robinson 1994) to the neural network setting. The test statistic could be formulated as:
where T is number of observations. The sample variance of residuals from Equation (11) could be expressed as (Gil-Alana 1997):
Using the Chebyshev's Inequality, under assumption of stationary martingale difference process of \({u}_{t}\), Theorem 1 in Robinson (1994) ensures that sample variance converge in probability to the variance of probability density function or \({\sigma }^{2}\) (Robinson 1994; Tanaka 1999):
where ε is any positive number. Under the assumption of white noise process of \({u}_{t}\), the information matrix \(\widehat{A}\) in Equation (A1) could be expressed as (Robinson 1994):
Under the assumption of differential \(\varphi \left(z;\theta \right)\) in θ on a neighbourhood of \(\theta =0\) and white noise process of \({u}_{t}\), \(\psi \left(\lambda \right)\) be expressed as (Robinson 1991, 1994; Tanaka 1999):
where ε is any positive number and Re stands for real. The Euclidean norm of \(\psi \left( \lambda \right)\) has finite number of poles \(\rho_{l} , l = 1,2 \ldots .r\) and r is number of poles and the function is monotonically increasing function and the disjoin intervals \(S_{l} , l = 1,2 \ldots .r\). The supremum in this function could be expressed as:
where η is a real number which is greater than 0.5, \(k = 1,2 \ldots \ldots ..r\) and \(\cdot\) donates Euclidean norm. Equation (A6) ensures a crucial condition for this test statistic which is expressed as Eq. (13). The sampling error for \(a\) in Equation (A1) could be expressed as:
Furthermore, the Ergodic Theorem and martingale difference sequence assumption ensure that \(\mathop {{\text{plim}}}\limits_{T \to \infty } \left( {\beta - \tilde{\beta }} \right) = 0\) which implies:
Under the assumptions of Equation (13) and Equation (A8), the Theorem 2.1 and Theorem 2.2 in the neural network framework (Yaya et al. 2021) and the martingale difference central limit theorem (Brown 1971) ensure:
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Furuoka, F., Gil-Alana, L.A., Yaya, O.S. et al. A new fractional integration approach based on neural network nonlinearity with an application to testing unemployment hysteresis. Empir Econ 66, 2471–2499 (2024). https://doi.org/10.1007/s00181-023-02540-5
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00181-023-02540-5