Skip to main content

An Answer to Roll’s Critique (1977) 45 Years Later

  • Chapter
  • First Online:
Essays on Financial Analytics

Abstract

We implement a new framework to mitigate the errors-in-variables (EIV) problem in the estimation of asset pricing models. Considering an international data of portfolio stock returns from 1990 to 2021 widely used in empirical studies, we highlight the importance of the estimation method in time-series regressions. We compare the traditional ordinary-least squares (OLS) method to an alternative estimator based on a compact genetic algorithm (CGA) in the case of the CAPM. Based on intercepts, betas, adjusted R2, and the Gibbons et al. (1989) test, we find that the CGA-based method outperforms overall the OLS method. In particular, we obtain less statistically significant intercepts, smoother R2 across different portfolios, and lower GRS test statistics.

Specifically, in line with Roll’s critique (1977) on the unobservability of the market portfolio, we reduce the attenuation bias in market risk premium estimates. Moreover, our results are robust to alternative methods such as instrumental variables estimated with generalized-method of moments (GMM). Our findings have several empirical and managerial implications related to the estimation of asset pricing models as well as their interpretation as a popular tool in terms of corporate financial decision-making.

Some results in this chapter are published in Asset pricing models with measurement error problems: A new framework with Compact Genetic Algorithms, Finance, 2022. https://doi.org/10.3917/fina.432.0001

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 139.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 179.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    See Huang and Litzenberger (1988, ch. 10) for a complete discussion of the conceptual and econometric issues involved in testing the CAPM.

  2. 2.

    The cost of a badly measured Y  is that the variance of \(\epsilon \) is equal to \(Var(\epsilon ) + Var(\nu )\).

  3. 3.

    The trick is \(-2 \bar {X^*} \sum X_t^* \times \frac {T}{T} = -2 T \bar {X^*}^2\).

  4. 4.

    This is a key result when it comes to the relationship between the measurement error and the regression-based estimation of asset pricing models in finance. Consider, for simplicity, the single-factor model where the right-hand-side variable is the market risk premium. By construction, it is positive. It turns out that under errors-in-variables, positive alphas will tend to be underestimated while negative alphas will be overestimated than their true levels. Recognizing this effect and putting it into context would have profound impacts on the fund management industry. We will later turn to this discussion in this paper.

  5. 5.

    The algebra of \(\widehat {\lambda }\) follows from the fact that \(Var(X^*) = Var(X - u)\).

  6. 6.

    This is maybe the main reason why textbook treatments of measurement error models are mostly limited to the one-variable model.

  7. 7.

    We deliberately drop the “hat” \(\hat {}\) over the fitted series for ease of exposition.

  8. 8.

    Constructing such error-free estimates of the regressors has been previously suggested within the IV-based methods of EIV models in the literature; see, for example, Dagenais and Dagenais (1997) or Coën and Racicot (2007).

  9. 9.

    The appendix gives a detailed exposition of the pseudo-code of the algorithm.

  10. 10.

    The setup also requires a third parameter n, which is simply the sample size of the mismeasured variable X.

  11. 11.

    Pioneering studies include, among others, Holland (1973, 1975, 1987) and Goldberg (1989). For a review of CGAs, see, among others, Baluja and Caruana (1995) or Harik et al. (1999, 2006).

  12. 12.

    The term “probability vector” employed here does not correspond to a conventional vector whose elements sum up to 1 but instead refers to a list where each element shows the probability that the given element takes a specific value.

  13. 13.

    Detailed results are available upon request.

  14. 14.

    All data are extracted from Kenneth French’s website: https://mba.tuck.dartmouth.edu/pages/faculty/ken.french/data_library.html.

References

  • Amihud, Y. (2002). Illiquidity and stock returns: Cross-section and time series effects. Journal of Financial Markets, 5(1), 31–56.

    Article  Google Scholar 

  • Andersson, J., & Møen, J. (2016). A simple improvement of the IV-estimator for the classical errors-in-variables problem. Oxford Bulletin of Economics & Statistics, 78(1), 113–125.

    Article  Google Scholar 

  • Ashenfelter, O., & Krueger, A. (1994). Estimates of the economic return to schooling from a new sample of twins. American Economic Review, 84(5), 1157–1173.

    Google Scholar 

  • Baluja, S., & Caruana, R. (1995). Removing the genetics from the standard genetic algorithm. Pittsburgh, PA: Carnegie Mellon University.

    Book  Google Scholar 

  • Banz, R. W. (1981). The relationship between return and market value of common stocks. Journal of Financial Economics, 9(1), 3–18.

    Article  Google Scholar 

  • Basu, S. (1977). Investment performance of common stocks in relation to their price-earnings ratios: A test of the efficient market hypothesis. Journal of Finance, 32(3), 663–682.

    Article  Google Scholar 

  • Black, F. (1972). Capital market equilibrium with restricted borrowing. The Journal of Business, 45(3), 444–455.

    Article  Google Scholar 

  • Breeden, D. T., Gibbons, M. R., & Litzenberger, R. H. (1989). Empirical tests of the consumption-oriented CAPM. Journal of Finance, 44(2), 231–262.

    Google Scholar 

  • Buonaccorsi, J. P. (2010). Measurement error: Models, methods, and applications. Boca Raton, FL: Chapman & Hall.

    Book  Google Scholar 

  • Carhart, M. M. (1997). On persistence in mutual fund performance. Journal of Finance, 52(1), 57–82.

    Article  Google Scholar 

  • Carmichael, B., & Coën, A. (2008). Asset pricing models with errors-in-variables. Journal of Empirical Finance, 15(4), 778–788.

    Article  Google Scholar 

  • Carroll, R. J., Ruppert, D., Stefanski, L. A., & Crainiceanu, C. M. (2006). Measurement error in nonlinear models: A modern perspective. Boca Raton, FL: Chapman & Hall.

    Book  Google Scholar 

  • Chan, L. K. C., Hamao, Y., & Lakonishok, J. (1991). Fundamentals and stock returns in Japan. Journal of Finance, 46(5), 1739–1764.

    Article  Google Scholar 

  • Cheng, C.-L., & Van Ness, J. W. (1999). Statistical regression with measurement error. London: Wiley.

    Google Scholar 

  • Cochrane, J. H. (2005). Asset pricing. Princeton University Press.

    Google Scholar 

  • Cochrane, J. H. (2011). Presidential address: Discount rates. Journal of Finance, 66(4), 1047–1108.

    Article  Google Scholar 

  • Coen, A., Hübner, G., & Desfleurs, A. (2010). Hedge fund return specification with errors-in-variables. Journal of Derivatives and Hedge Funds, 16(1), 22–52.

    Article  Google Scholar 

  • Coën, A., & Racicot, F. E. (2007). Capital asset pricing models revisited: Evidence from errors in variables. Economics Letters, 95(3), 443–450.

    Article  Google Scholar 

  • Cragg, J. G. (1994). Making good inferences from bad data. Canadian Journal of Economics, 27(4), 776–800.

    Article  Google Scholar 

  • Cragg, J. G. (1997). Using higher moments to estimate the simple errors-in-variables model. RAND Journal of Economics, 28, 71–91.

    Article  Google Scholar 

  • Dagenais, M. G., & Dagenais, D. L. (1997). Higher moment estimators for linear regression models with errors in the variables. Journal of Econometrics, 76(1), 193–221.

    Article  Google Scholar 

  • De Bondt, W. F. M., & Thaler, R. (1985). Does the stock market overreact? Journal of Finance, 40(3), 793–805.

    Article  Google Scholar 

  • Dimson, E., & Marsh, P. (Winter 1999). Murphy’s Law and market anomalies. Journal of Portfolio Management, 25(2), 53–69.

    Article  Google Scholar 

  • Durbin, J. (1954). Errors in variables. Revue de l’institut International de Statistique, 22(1/3), 23–32.

    Article  Google Scholar 

  • Fama, E. F., & French, K. R. (1992). The cross-section of expected stock returns. Journal of Finance, 47(2), 427–465.

    Article  Google Scholar 

  • Fama, E. F., & French, K. R. (1993). Common risk factors in the returns on stocks and bonds. Journal of Financial Economics, 33(1), 3–56.

    Article  Google Scholar 

  • Fama, E. F., & French, K. R. (1995). Size and book-to-market factors in earnings and returns. Journal of Finance, 50(1), 131–155.

    Article  Google Scholar 

  • Fama, E. F., & French, K. R. (1997). Industry costs of equity. Journal of Financial Economics, 43(2), 153–193.

    Article  Google Scholar 

  • Fama, E. F., & French, K. R. (2012). Size, value, and momentum in international stock returns. Journal of Financial Economics, 105(3), 457–472.

    Article  Google Scholar 

  • Fama, E. F., & French, K. R. (2015). A five-factor asset pricing model. Journal of Financial Economics, 116(1), 1–22.

    Article  Google Scholar 

  • Fama, E. F., & French, K. R. (2016). Dissecting anomalies with a five-factor model. The Review of Financial Studies, 29(1), 69–103.

    Article  Google Scholar 

  • Fama, E. F., & French, K. R. (2018a). Choosing factors. Journal of Financial Economics, 128(2), 234–252.

    Article  Google Scholar 

  • Fama, E. F., & French, K. R. (2018b). Long-horizon returns. The Review of Asset Pricing Studies, 8(2), 232–252.

    Article  Google Scholar 

  • Fama, E. F., & French, K. R. (2018c). Volatility lessons. Financial Analysts Journal, 74(3), 42–53.

    Article  Google Scholar 

  • Fama, E. F., & French, K. R. (2020). Comparing cross-section and time-series factor models. The Review of Financial Studies, 33(5), 1891–1926.

    Article  Google Scholar 

  • Fama, E. F., & MacBeth, J. D. (1973). Risk, return, and equilibrium: Empirical tests. Journal of Political Economy, 81(3), 607–636.

    Article  Google Scholar 

  • Ferson, W. (2019). Empirical asset pricing: Models and methods. Cambridge, MA: MIT Press.

    Google Scholar 

  • Fuller, W. A. (1987). Measurement error models. New York, NY: John Wiley & Sons, Inc.

    Book  Google Scholar 

  • Gibbons, M. R., Ross, S. A., & Shanken, J. (1989). A test of the efficiency of a given portfolio. Econometrica, 57(5), 1121–1152.

    Article  Google Scholar 

  • Goldberg, D. E. (1989). Genetic algorithms in search, optimization and machine learning. Boston, MA, USA: Addison-Wesley Longman Publishing Co., Inc.

    Google Scholar 

  • Greene, W. H. (2018). Econometric analysis. Essex: Pearson.

    Google Scholar 

  • Hansen, L. (1982). Large sample properties of generalized method of moments estimators. Econometrica, 50(4), 1029–1054.

    Article  Google Scholar 

  • Harik, G. R., Lobo, F. G., & Goldberg, D. E. (1999). The compact genetic algorithm. IEEE Transactions on Evolutionary Computation, 3(4), 287–297.

    Article  Google Scholar 

  • Harik, G. R., Lobo, F. G., & Sastry, K. (2006). Linkage learning via probabilistic modeling in the extended compact genetic algorithm (ECGA). In M. Pelikan, K. Sastry, & E. CantúPaz (Eds.), Scalable optimization via probabilistic modeling (pp. 39–61). Berlin, Heidelberg: Springer.

    Chapter  Google Scholar 

  • Harvey, C., Liu, Y., & Zhu, H. (2016). ... and the cross-section of expected returns. Review of Financial Studies, 29(1), 5–68.

    Google Scholar 

  • Hausman, J. A. (2001). Mismeasured variables in econometric analysis: Problems from the right and problems from the left. Journal of Economic Perspectives, 15(4), 57–67.

    Article  Google Scholar 

  • Hausman, J. A., & Watson, M. W. (1985). Errors in variables and seasonal adjustment procedures. Journal of the Americal Statistical Association, 80(391), 531–540.

    Article  Google Scholar 

  • Holland, J. H. (1973). Genetic algorithms and the optimal allocation of trials. SIAM Journal on Computing, 2(2), 88–105.

    Article  Google Scholar 

  • Holland, J. H. (1975). Adaptation in natural and artificial systems: An introductory analysis with applications to biology, control and artificial intelligence. University of Michigan Press.

    Google Scholar 

  • Holland, J. H. (1987). Genetic algorithms and classifier systems: Foundations and future directions. In International Conference on Genetic Algorithms (pp. 82–89). Cambridge, Massachusetts, USA.

    Google Scholar 

  • Hou, K., Xue, C., & Zhang, L. (2015). Digesting anomalies: An investment approach. The Review of Financial Studies, 28(3), 650–705.

    Article  Google Scholar 

  • Huang, C.-f., & Litzenberger, R. H. (1988). Foundations for financial economics. North-Holland.

    Google Scholar 

  • Iwata, S. (1992). Instrumental variables estimation in errors-in-variables models when instruments are correlated with errors. Journal of Econometrics, 53(1), 297–322.

    Article  Google Scholar 

  • Jensen, M. C. (1968). The performance of mutual funds in the period 1945–1964. Journal of Finance, 23(2), 389–416.

    Article  Google Scholar 

  • Leamer, E. (1987). Errors in variables in linear systems. Econometrica, 55(4), 893–909.

    Article  Google Scholar 

  • Lintner, J. (1965). The valuation of risk assets and the selection of risky investments in stock portfolios and capital budgets. The Review of Economics and Statistics, 47(1), 13–37.

    Article  Google Scholar 

  • Markowitz, H. (1952). Portfolio selection. Journal of Finance, 7(1), 77–91.

    Google Scholar 

  • Mossin, J. (1966). Equilibrium in a capital asset market. Econometrica, 34(4), 768–783.

    Article  Google Scholar 

  • Novy-Marx, R. (2013). The other side of value: The gross profitability premium. Journal of Financial Economics, 108(1), 1–28.

    Article  Google Scholar 

  • Olea, J. L. M., & Pflueger, C. (2013). A robust test for weak instruments. Journal of Business and Economic Statistics, 31(3), 358–369.

    Article  Google Scholar 

  • Pal, M. (1980). Consistent moment estimators of regression coefficients in the presence of errors in variables. Journal of Econometrics, 14(3), 349–364.

    Article  Google Scholar 

  • Pástor, L., & Stambaugh, R. F. (2003). Liquidity risk and expected stock returns. Journal of Political Economy, 111(3), 642–685.

    Article  Google Scholar 

  • Racicot, F.-E. (2015a). Engineering robust instruments for GMM estimation of panel data regression models with errors in variables: a note. Applied Economics, 47(10), 981–989.

    Article  Google Scholar 

  • Racicot, F.-E. (2015b). Errors in economic and financial variables. La Revue des Sciences de Gestion, 3–4(267–268), 79–103.

    Google Scholar 

  • Racicot, F.-É., Rentz, W. F., & Kahl, A. L. (2017). Rolling regression analysis of the Pástor-Stambaugh model: Evidence from robust instrumental variables. International Advances in Economic Research, 23(1), 75–90.

    Article  Google Scholar 

  • Racicot, F.-E., Rentz, W. F., Kahl, A., & Mesly, O. (2019). Examining the dynamics of illiquidity risks within the phases of the business cycle. Borsa Istanbul Review, 19(2), 117–131.

    Article  Google Scholar 

  • Racicot, F.-É., Rentz, W. F., & Théoret, R. (2018). Testing the new Fama and French factors with illiquidity: A panel data investigation. Finance, 39(3), 45–102.

    Article  Google Scholar 

  • Racicot, F.-E., & Theoret, R. (2015). The Pastor-Stambaugh empirical model revisited: evidence from robust instruments. Journal of Asset Management, 16(5), 329–341.

    Article  Google Scholar 

  • Racicot, F.-E., & Theoret, R. (2016). Testing Fama-French’s new five-factor asset pricing model: Evidence from robust instruments. Applied Economics Letters, 23(6), 444–448.

    Google Scholar 

  • Reinganum, M. R. (1981). Misspecification of capital asset pricing: Empirical anomalies based on earnings’ yields and market values. Journal of Financial Economics, 9(1), 19–46.

    Article  Google Scholar 

  • Roll, R. (1977). A critique of the asset pricing theory’s tests Part I: On past and potential testability of the theory. Journal of Financial Economics, 4(2), 129–176.

    Article  Google Scholar 

  • Rosenberg, B., Reid, K., & Lanstein, R. (1985). Persuasive evidence of market inefficiency. Journal of Portfolio Management, 11(3), 9–16.

    Article  Google Scholar 

  • Satman, M. H., & Diyarbakirlioglu, E. (2015). Reducing errors-in-variables bias in linear regression using compact genetic algorithms. Journal of Statistical Computation and Simulation, 85(16), 3216–3235.

    Article  Google Scholar 

  • Satman, M. H., & Diyarbakirlioglu, E. (2018). eive: An Algorithm for Reducing Errors-in-variables Bias in Linear Regression. R package version 2.3.

    Google Scholar 

  • Shanken, J. (1992). On the estimation of beta-pricing models. Review of Financial Studies, 5(1), 1–33.

    Article  Google Scholar 

  • Sharpe, W. F. (1964). Capital asset prices: A theory of market equilibrium under conditions of risk. Journal of Finance, 19(3), 425–442.

    Google Scholar 

  • Stock, J. H., Wright, J. H., & Yogo, M. (2002). A survey of weak instruments and weak identification in generalized method of moments. Journal of Business and Economic Statistics, 20(4), 518–529.

    Article  Google Scholar 

  • Tobin, J. (1958). Liquidity preference as behavior towards risk. The Review of Economic Studies, 25(2), 65–86.

    Article  Google Scholar 

  • Wooldridge, J. M. (2015). Introductory econometrics: A modern approach. Cengage Learning.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Souad Lajili Jarjir .

Editor information

Editors and Affiliations

Appendix: Pseudo-Code of the Algorithm

Appendix: Pseudo-Code of the Algorithm

This appendix provides a plain language description of the EIV-CGA approach developed by Satman and Diyarbakirlioglu (2015). All functions and methods necessary to implement the approach are available with the R package eive (see Satman and Diyarbakirlioglu (2018)).

We conceive the process in two subsequent parts and a penalty function, which establishes the convergence criterion. The first part sets the initial parameter values and generates the search space within which the CGA will search the solution.

Next, we start the iterations until the “best” offspring is obtained among all possible combinations we can extract from the search space. This goes through random sampling of two parent vectors with elements coming from the current state of \(P[i]\). Then, we attach the parents, e.g., the samples, a cost function such that the winner to survive the next generation is the one who has the lowest penalty. Next, we update the \(P[i]\) using a simple rule in a loop over the entire search space. The algorithm converges when all elements of \(P[i]\) are either equal to 0 or 1.

The cost function returns the sum of squared residuals from the regression given in Eq. 9 between two candidate solutions sampled from the search space and declares the “winner” as the one for which this score is lowest. The end result yields the series \(X^{CGA}\) that we consider as a filtered version of original observations.

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Desban, M., Diyarbakirlioglu, E., Jarjir, S.L., Satman, M.H. (2023). An Answer to Roll’s Critique (1977) 45 Years Later. In: Alphonse, P., Bouaiss, K., Grandin, P., Zopounidis, C. (eds) Essays on Financial Analytics. Lecture Notes in Operations Research. Springer, Cham. https://doi.org/10.1007/978-3-031-29050-3_14

Download citation

Publish with us

Policies and ethics