Abstract
We examine the predictability of private and public real estate returns using recursive, out-of-sample, linear and Markov switching models, employing a rich set of predictor variables. We find considerable improved predictive power compared to simple regression models, especially at the intermediate horizon. Next, we test whether such improved forecasting accuracy translates into a positive risk-adjusted out-of-sample performance by performing a recursive mean-variance portfolio allocation analysis. We observe significant improvements in realized Sharpe ratios and mean-variance utility scores, especially when employing Markov switching models and exploiting predictability at intermediate horizons. Furthermore, our results are robust to the inclusion of transaction costs.
Similar content being viewed by others
Notes
More specifically, for example, in the case of public real estate and H = 1, we exploit all the information available at the end of December 2004 to forecast the excess return as of the end of January 2005; in the case of H = 6, we exploit the information available at the end of July 2004 to predict the cumulative, 6-month excess return over the period August 2004 – January 2005; in the case of H = 60, we use the information available in January 2000 to forecast the 60-month excess return over the period February 2000 – January 2005. A similar logic is applied to private real estate, but with quarterly frequency.
At least in-sample, the fit of the model would benefit from setting K > 2. In this sense, our results may be interpreted as providing a lower bound to the empirical results, one could obtain. However, it is unclear whether increasing the number of regimes may improve the OOS predictive accuracy. To balance between empirical fit and estimation burden, especially in the case of private real estate, for which we have shorter available time series, we focus on the case of K = 2.
While Ling et al. (2000) also experiment with higher transaction costs, their sample is based a period prior to 2000 when transaction costs were arguably higher than during our 2005–2018 sample period. Therefore, adopting their “low cost” configuration is sensible for the purposes of our analysis.
The Index of Consumer Sentiment is available at http://www.sca.isr.umich.edu/charts.html.
However, to avoid losing an excessive number of observations, in the case of NCREIFMOM, we fill the initially missing values with momentum estimates based on REITs data, available since 1972.
We do not report all outputs of these estimation problems for brevity. The outputs are available from the authors upon request. Such tables and plots consist of in-sample outputs and are only indirectly related to the forecasting performance of the different models and their power to generate economic value. For instance, MS models (differently from linear predictive regressions) tend to imply increasing R-squares that exploit their non-linear flexible features, but this is known to not always imply a satisfactory forecasting performance.
The graphs derived from the remaining models carry similar qualitative features and are available from the authors upon request.
This is not a necessary condition, as the fact that maximum likelihood (ML) estimates of the MS slope coefficients ought to straddle OLS estimates is neither an implication of the problem, nor it has been imposed.
All models seem to systematically under-predict the actual values of the series. Note that this is possible, although grossly sub-optimal in OOS tests, even though by construction the in-sample residuals are forced to have zero mean.
The case of H = 60 months sits in between, in the sense that while the MS models struggle to guarantee positive \( {R}_{OOS}^2 \) (even though a few of them lead to \( {R}_{OOS}^2 \) in excess of 0.5), RMSFE tends to favor both MSI and MSIH over linear models.
In fact, on average for H = 3 and 6 months, MSI tends to generally outperform MSIH, with occasional exceptions. Because MSIH implies more delicate estimation issues vs. MSI, in the text we focus on MSI.
In Tables 4 and 5, the results for the realized recursive mean returns generally mimic the results reported for the realized Sharpe ratios and utility gains. As there is no evidence of predictive power at H = 60, both the linear and the MS models (especially the MSI model) fail to generate economic value when compared to the sample mean benchmark. We caution the reader that using an H = 60 horizon implies loss of data to perform the back-testing using the last portion of the sample and this implicitly limits the assessment of the economic value over the period of 2005–2013, giving a considerable weight to the realized returns during the GFC.
References
Akinsomi, O., Ong, S. E., Ibrahim, M. F., & Newell, G. (2014). The idiosyncratic risks of a Shariah compliant REIT investor. Journal of Property Research, 31, 211–243.
Ang, A., Hodrick, R. J., Xing, Y., & Zhang, X. (2006). The cross-section of volatility and expected returns. Journal of Finance, 61, 259–299.
Barkham, R., & Geltner, D. (1995). Price discovery in American and British property markets. Real Estate Economics, 23(1), 21–44.
Bianchi, D., & Guidolin, M. (2014). Can linear predictability models time bull and bear real estate markets? Out-of-sample evidence from REIT portfolios. Journal of Real Estate Finance and Economics, 49, 116–164.
Bond, S. A., & Hwang, S. (2007). Smoothing, nonsynchronous appraisal and cross-sectional aggregation in real estate Price indices. Real Estate Economics, 35, 349–382.
Bond, S. A., Hwang, S., & Marcato, G. (2012). Commercial real estate returns: An anatomy of smoothing in asset and index returns. Real Estate Economics, 40, 637–661.
Boudry, W. I., Coulson, N. E., Kallberg, J. G., & Liu, C. H. (2012). On the hybrid nature of REITs. Journal of Real Estate Finance and Economics, 44, 230–249.
Byrne, P., & Lee, S. (1997). Real estate portfolio analysis under conditions of non-normality: The case of NCREIF. Journal of Real Estate Portfolio Management, 3, 37–46.
Campbell, J., & Thompson, S. (2008). Predicting excess stock returns out of sample: Can anything beat the historical average? Review of Financial Studies, 21, 1509–1531.
Case, B., Guidolin, M., & Yildirim, Y. (2014). Markov switching dynamics in REIT returns: Univariate and multivariate evidence on forecasting performance. Real Estate Economics, 42, 279–342.
Chun, G., Sa-Aadu, J., & Shilling, J. (2004). The role of real estate in an institutional investor’s portfolio. Journal of Real Estate Finance and Economics, 29, 295–320.
Clayton, J., & MacKinnon, G. (2001). The time-varying nature of the link between REIT, real estate and financial asset returns. Journal of Real Estate Portfolio Management, 7, 43–54.
Clayton, J., Ling, D. C., & Naranjo, A. (2009). Commercial real estate valuation: Fundamentals versus investor sentiment. Journal of Real Estate Finance and Economics, 38, 5–37.
Cotter, J., & Roll, R. (2015). A comparative anatomy of residential REITs and private real estate markets: Returns, risks and distributional characteristics. Real Estate Economics, 43, 209–240.
Crawford, G., & Fratantoni, M. (2003). Assessing the forecasting performance of regime switching, ARIMA and GARCH models of house prices. Real Estate Economics, 31, 223–243.
Dal Pra, G., Guidolin, M., Pedio, M., & Vasile, F. (2018). Regime shifts in excess stock return predictability: An out-of-sample portfolio analysis. Journal of Portfolio Management, 44, 10–24.
Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977). Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society: Series B (Methodological), 39, 1–22.
Fugazza, C., Guidolin, M., & Nicodano, G. (2007). Investing for the long-run in European real-estate. Journal of Real Estate Finance and Economics, 34, 35–80.
Fugazza, C., Guidolin, M., & Nicodano, G. (2009). Time and risk diversification in real estate investments: Assessing the ex-post economic values. Real Estate Economics, 37, 341–381.
Füss, R., Stein, M., & Zietz, J. (2012). A regime-switching approach to modelling rental prices of UK real estate sectors. Real Estate Economics, 40, 317–350.
Geltner, D., MacGregor, B. D., & Schwann, G. M. (2003). Appraisal smoothing and price discovery in real estate markets. Urban Studies, 40(5/6), 1047–1064.
Ghysels, E., Plazzi, A., Torous, W.N. and Valkanov, R.I. (2013). Forecasting real estate prices. In Handbook of Economic Forecasting. pp. 509–580, Elsevier.
Goyal, A., & Welch, I. (2008). A comprehensive look at the empirical performance of equity premium prediction. Review of Financial Studies, 21, 1455–1508.
Guidolin, M., & Pedio, M. (2018). Essentials of time series for financial applications. Academic Press. San Diego, US
Guirguis, H., Giannikos, C., & Anderson, R. (2005). The US housing market: Asset pricing forecasts using time varying coefficients. Journal of Real Estate Finance and Economics, 30, 33–53.
Hamilton, J. D. (1989). A new approach to the economic analysis of nonstationary time series and the business cycle. Econometrica, 57, 357–384.
Henkel, S., Martin, J., & Nardari, F. (2011). Time-varying short-horizon predictability. Journal of Financial Economics, 99, 560–580.
Hung, K., Onayev, Z., & Tu, C. (2008). Time-varying diversification effect of real estate in institutional portfolio. Journal of Real Estate Portfolio Management, 14, 241–261.
Karolyi, G. A., & Sanders, A. B. (1998). The variation of economic risk premiums in real estate returns. Journal of Real Estate Finance and Economics, 17, 245–262.
Lee, M. L., & Chiang, K. (2010). Long-run price behavior of equity REITs: Become more like common stocks after the early 1990s? Journal of Property Investment and Finance, 28, 454–465.
Ling, D., & Naranjo, A. (1997). Economic risk factors and commercial real estate returns. Journal of Real Estate Finance and Economics, 14, 283–301.
Ling, D. C., & Naranjo, A. (1999). The integration of commercial real estate markets and stock markets. Real Estate Economics, 27, 483–515.
Ling, D. C., & Naranjo, A. (2015). Returns and information transmission dynamics in public and private real estate markets. Real Estate Economics, 43, 163–208.
Ling, D. C., Naranjo, A., & Ryngaert, M. D. (2000). The predictability of equity REIT returns: Time variation and economic significance. Journal of Real Estate Finance and Economics, 20, 117–136.
Liow, K., Chen, Z., & Liu, J. (2011). Multiple regimes and volatility transmission in securitized real estate markets. Journal of Real Estate Finance and Economics, 42, 295–328.
Liu, C. H., & Mei, J. (1992). The predictability of returns on equity REITs and their co-movement with other assets. Journal of Real Estate Finance and Economics, 5, 401–418.
Liu, C. H., & Mei, J. (1994). The predictability of real estate returns and market timing. Journal of Real Estate Finance and Economics, 8, 115–135.
MacKinnon, G., & Al Zaman, A. (2009). Real estate for the long term: The effect of return predictability on long-horizon allocations. Real Estate Economics, 37, 117–153.
Neil Myer, F., & Webb, J. (1993). Return properties of equity REITs, common stocks, and commercial real estate: A comparison. Journal of Real Estate Research, 8, 87–106.
Nelling, E., & Gyourko, J. (1998). The predictability of equity REIT returns. Journal of Real Estate Research, 16, 251–268.
Okunev, J., Wilson, P., & Zurbruegg, R. (2000). The casual relationship between real estate and stock markets. Journal of Real Estate Finance and Economics, 21, 251–261.
Ooi, J. T., Wang, J., & Webb, J. R. (2009). Idiosyncratic risk and REIT returns. Journal of Real Estate Finance and Economics, 38, 420–442.
Pagliari, J. L., Jr. (2017). Another take on real estate's role in mixed-asset portfolio allocations. Real Estate Economics, 45, 75–132.
Rapach, D. E., Strauss, J. K., & Zhou, G. (2010). Out-of-sample equity premium prediction: Combination forecasts and links to the real economy. Review of Financial Studies, 23, 821–862.
Rapach, D., & Zhou, G. (2013). Forecasting stock returns. In Handbook of economic forecasting. pp. 328-383, Elsevier .
Rerhing, C. (2012). Real estate in a mixed-asset portfolio: The role of the investment horizon. Real Estate Economics, 40, 65–95.
Sa-Aadu, J., Shilling, J., & Tiwari, A. (2010). On the portfolio properties of real estate in good times and bad times. Real Estate Economics, 38, 529–565.
Seiler, M., Webb, J., & Neil Mye, F. (2001). Can private real estate portfolios be rebalanced/diversified using equity REIT shares? Journal of Real Estate Portfolio Management, 7, 25–41.
Serrano, C., & Hoesli, M. (2010). Are securitized real estate returns more predictable than stock returns? Journal of Real Estate Finance and Economics, 41, 170–192.
Timmermann, A. (2008). Elusive return predictability. International Journal of Forecasting, 24, 1–18.
Wong, S. K., Yiu, C. Y., & Chau, K. W. (2012). Liquidity and information asymmetry in the real estate market. Journal of Real Estate Finance and Economics, 45, 49–62.
Acknowledgements
We gratefully acknowledge Wayne Archer, David C. Ling, Gianluca Marcato and Andy Naranjo for valuable comments and suggestions. We also thank the participants of the USF-UF-UCF Critical Issues in Real Estate Symposium, 2019, for helpful discussion.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Appendix
Appendix
Rights and permissions
About this article
Cite this article
Guidolin, M., Pedio, M. & Petrova, M.T. The Predictability of Real Estate Excess Returns: An Out-of-Sample Economic Value Analysis. J Real Estate Finan Econ 67, 108–149 (2023). https://doi.org/10.1007/s11146-020-09769-2
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11146-020-09769-2