Skip to main content
Log in

The Predictability of Real Estate Excess Returns: An Out-of-Sample Economic Value Analysis

  • Published:
The Journal of Real Estate Finance and Economics Aims and scope Submit manuscript

Abstract

We examine the predictability of private and public real estate returns using recursive, out-of-sample, linear and Markov switching models, employing a rich set of predictor variables. We find considerable improved predictive power compared to simple regression models, especially at the intermediate horizon. Next, we test whether such improved forecasting accuracy translates into a positive risk-adjusted out-of-sample performance by performing a recursive mean-variance portfolio allocation analysis. We observe significant improvements in realized Sharpe ratios and mean-variance utility scores, especially when employing Markov switching models and exploiting predictability at intermediate horizons. Furthermore, our results are robust to the inclusion of transaction costs.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2

Similar content being viewed by others

Notes

  1. More specifically, for example, in the case of public real estate and H = 1, we exploit all the information available at the end of December 2004 to forecast the excess return as of the end of January 2005; in the case of H = 6, we exploit the information available at the end of July 2004 to predict the cumulative, 6-month excess return over the period August 2004 – January 2005; in the case of H = 60, we use the information available in January 2000 to forecast the 60-month excess return over the period February 2000 – January 2005. A similar logic is applied to private real estate, but with quarterly frequency.

  2. At least in-sample, the fit of the model would benefit from setting K > 2. In this sense, our results may be interpreted as providing a lower bound to the empirical results, one could obtain. However, it is unclear whether increasing the number of regimes may improve the OOS predictive accuracy. To balance between empirical fit and estimation burden, especially in the case of private real estate, for which we have shorter available time series, we focus on the case of K = 2.

  3. Following Campbell and Thompson (2008), Goyal and Welch (2008) and Rapach et al. (2010), we constrain the weights of the risky assets to lie between 0% and 150%, so that wi = 0 if wi < 0,and wi = 150% if wi > 1.5.

  4. While Ling et al. (2000) also experiment with higher transaction costs, their sample is based a period prior to 2000 when transaction costs were arguably higher than during our 2005–2018 sample period. Therefore, adopting their “low cost” configuration is sensible for the purposes of our analysis.

  5. The Index of Consumer Sentiment is available at http://www.sca.isr.umich.edu/charts.html.

  6. However, to avoid losing an excessive number of observations, in the case of NCREIFMOM, we fill the initially missing values with momentum estimates based on REITs data, available since 1972.

  7. We do not report all outputs of these estimation problems for brevity. The outputs are available from the authors upon request. Such tables and plots consist of in-sample outputs and are only indirectly related to the forecasting performance of the different models and their power to generate economic value. For instance, MS models (differently from linear predictive regressions) tend to imply increasing R-squares that exploit their non-linear flexible features, but this is known to not always imply a satisfactory forecasting performance.

  8. In particular, Figs. 1 and 2 refer to the MSIH model.

  9. The graphs derived from the remaining models carry similar qualitative features and are available from the authors upon request.

  10. This is not a necessary condition, as the fact that maximum likelihood (ML) estimates of the MS slope coefficients ought to straddle OLS estimates is neither an implication of the problem, nor it has been imposed.

  11. All models seem to systematically under-predict the actual values of the series. Note that this is possible, although grossly sub-optimal in OOS tests, even though by construction the in-sample residuals are forced to have zero mean.

  12. The case of H = 60 months sits in between, in the sense that while the MS models struggle to guarantee positive \( {R}_{OOS}^2 \) (even though a few of them lead to \( {R}_{OOS}^2 \) in excess of 0.5), RMSFE tends to favor both MSI and MSIH over linear models.

  13. In fact, on average for H = 3 and 6 months, MSI tends to generally outperform MSIH, with occasional exceptions. Because MSIH implies more delicate estimation issues vs. MSI, in the text we focus on MSI.

  14. In Tables 4 and 5, the results for the realized recursive mean returns generally mimic the results reported for the realized Sharpe ratios and utility gains. As there is no evidence of predictive power at H = 60, both the linear and the MS models (especially the MSI model) fail to generate economic value when compared to the sample mean benchmark. We caution the reader that using an H = 60 horizon implies loss of data to perform the back-testing using the last portion of the sample and this implicitly limits the assessment of the economic value over the period of 2005–2013, giving a considerable weight to the realized returns during the GFC.

References

  • Akinsomi, O., Ong, S. E., Ibrahim, M. F., & Newell, G. (2014). The idiosyncratic risks of a Shariah compliant REIT investor. Journal of Property Research, 31, 211–243.

    Article  Google Scholar 

  • Ang, A., Hodrick, R. J., Xing, Y., & Zhang, X. (2006). The cross-section of volatility and expected returns. Journal of Finance, 61, 259–299.

    Article  Google Scholar 

  • Barkham, R., & Geltner, D. (1995). Price discovery in American and British property markets. Real Estate Economics, 23(1), 21–44.

    Article  Google Scholar 

  • Bianchi, D., & Guidolin, M. (2014). Can linear predictability models time bull and bear real estate markets? Out-of-sample evidence from REIT portfolios. Journal of Real Estate Finance and Economics, 49, 116–164.

    Article  Google Scholar 

  • Bond, S. A., & Hwang, S. (2007). Smoothing, nonsynchronous appraisal and cross-sectional aggregation in real estate Price indices. Real Estate Economics, 35, 349–382.

    Article  Google Scholar 

  • Bond, S. A., Hwang, S., & Marcato, G. (2012). Commercial real estate returns: An anatomy of smoothing in asset and index returns. Real Estate Economics, 40, 637–661.

    Article  Google Scholar 

  • Boudry, W. I., Coulson, N. E., Kallberg, J. G., & Liu, C. H. (2012). On the hybrid nature of REITs. Journal of Real Estate Finance and Economics, 44, 230–249.

    Article  Google Scholar 

  • Byrne, P., & Lee, S. (1997). Real estate portfolio analysis under conditions of non-normality: The case of NCREIF. Journal of Real Estate Portfolio Management, 3, 37–46.

    Article  Google Scholar 

  • Campbell, J., & Thompson, S. (2008). Predicting excess stock returns out of sample: Can anything beat the historical average? Review of Financial Studies, 21, 1509–1531.

    Article  Google Scholar 

  • Case, B., Guidolin, M., & Yildirim, Y. (2014). Markov switching dynamics in REIT returns: Univariate and multivariate evidence on forecasting performance. Real Estate Economics, 42, 279–342.

    Article  Google Scholar 

  • Chun, G., Sa-Aadu, J., & Shilling, J. (2004). The role of real estate in an institutional investor’s portfolio. Journal of Real Estate Finance and Economics, 29, 295–320.

    Article  Google Scholar 

  • Clayton, J., & MacKinnon, G. (2001). The time-varying nature of the link between REIT, real estate and financial asset returns. Journal of Real Estate Portfolio Management, 7, 43–54.

    Article  Google Scholar 

  • Clayton, J., Ling, D. C., & Naranjo, A. (2009). Commercial real estate valuation: Fundamentals versus investor sentiment. Journal of Real Estate Finance and Economics, 38, 5–37.

    Article  Google Scholar 

  • Cotter, J., & Roll, R. (2015). A comparative anatomy of residential REITs and private real estate markets: Returns, risks and distributional characteristics. Real Estate Economics, 43, 209–240.

    Article  Google Scholar 

  • Crawford, G., & Fratantoni, M. (2003). Assessing the forecasting performance of regime switching, ARIMA and GARCH models of house prices. Real Estate Economics, 31, 223–243.

    Article  Google Scholar 

  • Dal Pra, G., Guidolin, M., Pedio, M., & Vasile, F. (2018). Regime shifts in excess stock return predictability: An out-of-sample portfolio analysis. Journal of Portfolio Management, 44, 10–24.

    Article  Google Scholar 

  • Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977). Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society: Series B (Methodological), 39, 1–22.

    Google Scholar 

  • Fugazza, C., Guidolin, M., & Nicodano, G. (2007). Investing for the long-run in European real-estate. Journal of Real Estate Finance and Economics, 34, 35–80.

    Article  Google Scholar 

  • Fugazza, C., Guidolin, M., & Nicodano, G. (2009). Time and risk diversification in real estate investments: Assessing the ex-post economic values. Real Estate Economics, 37, 341–381.

    Article  Google Scholar 

  • Füss, R., Stein, M., & Zietz, J. (2012). A regime-switching approach to modelling rental prices of UK real estate sectors. Real Estate Economics, 40, 317–350.

    Article  Google Scholar 

  • Geltner, D., MacGregor, B. D., & Schwann, G. M. (2003). Appraisal smoothing and price discovery in real estate markets. Urban Studies, 40(5/6), 1047–1064.

    Article  Google Scholar 

  • Ghysels, E., Plazzi, A., Torous, W.N. and Valkanov, R.I. (2013). Forecasting real estate prices. In Handbook of Economic Forecasting. pp. 509–580, Elsevier.

  • Goyal, A., & Welch, I. (2008). A comprehensive look at the empirical performance of equity premium prediction. Review of Financial Studies, 21, 1455–1508.

    Article  Google Scholar 

  • Guidolin, M., & Pedio, M. (2018). Essentials of time series for financial applications. Academic Press. San Diego, US

  • Guirguis, H., Giannikos, C., & Anderson, R. (2005). The US housing market: Asset pricing forecasts using time varying coefficients. Journal of Real Estate Finance and Economics, 30, 33–53.

    Article  Google Scholar 

  • Hamilton, J. D. (1989). A new approach to the economic analysis of nonstationary time series and the business cycle. Econometrica, 57, 357–384.

    Article  Google Scholar 

  • Henkel, S., Martin, J., & Nardari, F. (2011). Time-varying short-horizon predictability. Journal of Financial Economics, 99, 560–580.

    Article  Google Scholar 

  • Hung, K., Onayev, Z., & Tu, C. (2008). Time-varying diversification effect of real estate in institutional portfolio. Journal of Real Estate Portfolio Management, 14, 241–261.

    Article  Google Scholar 

  • Karolyi, G. A., & Sanders, A. B. (1998). The variation of economic risk premiums in real estate returns. Journal of Real Estate Finance and Economics, 17, 245–262.

    Article  Google Scholar 

  • Lee, M. L., & Chiang, K. (2010). Long-run price behavior of equity REITs: Become more like common stocks after the early 1990s? Journal of Property Investment and Finance, 28, 454–465.

    Article  Google Scholar 

  • Ling, D., & Naranjo, A. (1997). Economic risk factors and commercial real estate returns. Journal of Real Estate Finance and Economics, 14, 283–301.

    Article  Google Scholar 

  • Ling, D. C., & Naranjo, A. (1999). The integration of commercial real estate markets and stock markets. Real Estate Economics, 27, 483–515.

    Article  Google Scholar 

  • Ling, D. C., & Naranjo, A. (2015). Returns and information transmission dynamics in public and private real estate markets. Real Estate Economics, 43, 163–208.

    Article  Google Scholar 

  • Ling, D. C., Naranjo, A., & Ryngaert, M. D. (2000). The predictability of equity REIT returns: Time variation and economic significance. Journal of Real Estate Finance and Economics, 20, 117–136.

    Article  Google Scholar 

  • Liow, K., Chen, Z., & Liu, J. (2011). Multiple regimes and volatility transmission in securitized real estate markets. Journal of Real Estate Finance and Economics, 42, 295–328.

    Article  Google Scholar 

  • Liu, C. H., & Mei, J. (1992). The predictability of returns on equity REITs and their co-movement with other assets. Journal of Real Estate Finance and Economics, 5, 401–418.

    Article  Google Scholar 

  • Liu, C. H., & Mei, J. (1994). The predictability of real estate returns and market timing. Journal of Real Estate Finance and Economics, 8, 115–135.

    Article  Google Scholar 

  • MacKinnon, G., & Al Zaman, A. (2009). Real estate for the long term: The effect of return predictability on long-horizon allocations. Real Estate Economics, 37, 117–153.

    Article  Google Scholar 

  • Neil Myer, F., & Webb, J. (1993). Return properties of equity REITs, common stocks, and commercial real estate: A comparison. Journal of Real Estate Research, 8, 87–106.

    Article  Google Scholar 

  • Nelling, E., & Gyourko, J. (1998). The predictability of equity REIT returns. Journal of Real Estate Research, 16, 251–268.

    Article  Google Scholar 

  • Okunev, J., Wilson, P., & Zurbruegg, R. (2000). The casual relationship between real estate and stock markets. Journal of Real Estate Finance and Economics, 21, 251–261.

    Article  Google Scholar 

  • Ooi, J. T., Wang, J., & Webb, J. R. (2009). Idiosyncratic risk and REIT returns. Journal of Real Estate Finance and Economics, 38, 420–442.

    Article  Google Scholar 

  • Pagliari, J. L., Jr. (2017). Another take on real estate's role in mixed-asset portfolio allocations. Real Estate Economics, 45, 75–132.

    Article  Google Scholar 

  • Rapach, D. E., Strauss, J. K., & Zhou, G. (2010). Out-of-sample equity premium prediction: Combination forecasts and links to the real economy. Review of Financial Studies, 23, 821–862.

    Article  Google Scholar 

  • Rapach, D., & Zhou, G. (2013). Forecasting stock returns. In Handbook of economic forecasting. pp. 328-383, Elsevier .

  • Rerhing, C. (2012). Real estate in a mixed-asset portfolio: The role of the investment horizon. Real Estate Economics, 40, 65–95.

    Article  Google Scholar 

  • Sa-Aadu, J., Shilling, J., & Tiwari, A. (2010). On the portfolio properties of real estate in good times and bad times. Real Estate Economics, 38, 529–565.

    Article  Google Scholar 

  • Seiler, M., Webb, J., & Neil Mye, F. (2001). Can private real estate portfolios be rebalanced/diversified using equity REIT shares? Journal of Real Estate Portfolio Management, 7, 25–41.

    Article  Google Scholar 

  • Serrano, C., & Hoesli, M. (2010). Are securitized real estate returns more predictable than stock returns? Journal of Real Estate Finance and Economics, 41, 170–192.

    Article  Google Scholar 

  • Timmermann, A. (2008). Elusive return predictability. International Journal of Forecasting, 24, 1–18.

    Article  Google Scholar 

  • Wong, S. K., Yiu, C. Y., & Chau, K. W. (2012). Liquidity and information asymmetry in the real estate market. Journal of Real Estate Finance and Economics, 45, 49–62.

    Article  Google Scholar 

Download references

Acknowledgements

We gratefully acknowledge Wayne Archer, David C. Ling, Gianluca Marcato and Andy Naranjo for valuable comments and suggestions. We also thank the participants of the USF-UF-UCF Critical Issues in Real Estate Symposium, 2019, for helpful discussion.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Milena T. Petrova.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Appendix

Appendix

Table A1 Private real estate – realized OOS performance over sub-samples
Table A2 Public real estate – realized OOS performances over sub-samples
Table A3 Private real estate – mean-variance realized OOS performance (γ = 2)
Table A4 Private real estate – mean-variance realized OOS performance (γ = 10)
Table A5 Public real estate – mean-variance realized OOS performance (γ = 2)
Table A6 Public real estate – mean-variance realized OOS performance (γ = 10)

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Guidolin, M., Pedio, M. & Petrova, M.T. The Predictability of Real Estate Excess Returns: An Out-of-Sample Economic Value Analysis. J Real Estate Finan Econ 67, 108–149 (2023). https://doi.org/10.1007/s11146-020-09769-2

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11146-020-09769-2

Keywords

Navigation