Abstract

To improve forecasting accuracy, combine forecasts derived from methods that differ substantially and draw from different sources of information. When feasible, use five or more methods. Use formal procedures to combine forecasts: An equal-weights rule offers a reasonable starting point, and a trimmed mean is desirable if you combine forecasts resulting from five or more methods. Use different weights if you have good domain knowledge or information on which method should be most accurate. Combining forecasts is especially useful when you are uncertain about the situation, uncertain about which method is most accurate, and when you want to avoid large errors. Compared with errors of the typical individual forecast, combining reduces errors. In 30 empirical comparisons, the reduction in ex ante errors for equally weighted combined forecasts averaged about 12.5% and ranged from 3 to 24%. Under ideal conditions, combined forecasts were sometimes more accurate than their most accurate components.

Keywords

Consensus domain knowledge earnings forecasts equal weights group discussion uncertainty 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Agnew, C. (1985), “Bayesian consensus forecasts of macroeconomic variables,” Journal of Forecasting, 4, 363–376.CrossRefGoogle Scholar
  2. Armstrong, J. S. (1983), “Relative accuracy of judgmental and extrapolative methods in forecasting annual earnings,” Journal of Forecasting, 2, 437–447. Full text at hops.wharton.upenn.edu/forecast.Google Scholar
  3. Armstrong, J. S. (1985), Long-Range Forecasting: From Crystal Ball to Computer (2nd ed.). New York: John Wiley. Full text at hops.wharton.upenn.edu./forecastGoogle Scholar
  4. Armstrong, J. S., M. Adya and F. Collopy (2001), “Rule-based forecasting: Using judgment in time-series extrapolation,” in J. S. Armstrong (ed.), Principles of Forecasting. Norwell, MA: Kluwer Academic Publishers.Google Scholar
  5. Armstrong, J. S., V. G. Morwitz and V. Kumar (2000), “Sales forecasts for existing consumer products and services: Do purchase intentions contribute to accuracy?” International Journal of Forecasting, 16, 383–397. Full text at hops.wharton.upenn.edu./forecastGoogle Scholar
  6. Ashton, A. H. and R. H. Ashton (1985), “Aggregating subjective forecasts: Some empirical results,” Management Science, 31, 1499–1508.CrossRefGoogle Scholar
  7. Baker, E. J., S. G. West, D. J. Moss and J. M. Weyant (1980), “Impact of offshore nuclear power plants: Forecasting visits to nearby beaches,” Environment and Behavior, 12, 367–407.CrossRefGoogle Scholar
  8. Batchelor, R. and P. Dua (1990), “All forecasters are equal,” Journal of Business and Economic Statistics, 8, 143–144.Google Scholar
  9. Batchelor, R. and P. Dua (1992), “Conservatism and consensus-seeking among economic forecasters,” Journal of Forecasting, 11, 169–181.CrossRefGoogle Scholar
  10. Batchelor, R. and P. Dua (1995), “Forecaster diversity and the benefits of combining forecasts,” Management Science, 41, 68–75.CrossRefGoogle Scholar
  11. Bates, J. M. and C. W. J. Granger (1969), “The combination of forecasts,” Operational Research Quarterly, 20, 451–468.CrossRefGoogle Scholar
  12. Bessler, D. A. and J. A. Brandt (1981), “Forecasting livestock prices with individual and composite methods,” Applied Economics, 13, 513–522.CrossRefGoogle Scholar
  13. Blattberg, R. C. and S. J. Hoch (1990), “Database models and managerial intuition: 50% model and 50% manager,” Management Science, 36, 887–899.CrossRefGoogle Scholar
  14. Brandt, J. A. and D. A. Bessler (1983), “Price forecasting and evaluation: An application in agriculture,” Journal of Forecasting, 2, 237–248.CrossRefGoogle Scholar
  15. Bretschneider, S., W. P. Gorr, G. Grizzle and E. Klay (1989), “Political and organizational influences on the accuracy of forecasting state government revenues,” International Journal of Forecasting, 5, 307–319.CrossRefGoogle Scholar
  16. Chan, C. K., B. G. Kingsman and H. Wong (1999), “The value of combining forecasts in inventory management a case study in banking,” European Journal of Operational Research, 117, 199–210.CrossRefGoogle Scholar
  17. Clemen, R. T. (1989), “Combining forecasts: A review and annotated bibliography,” International Journal of Forecasting, 5, 559–583.CrossRefGoogle Scholar
  18. Clemen, R. T. and R. L. Winkler (1986), “Combining economic forecasts,” Journal ofBusiness and Economic Statistics, 4, 39–46.Google Scholar
  19. Cronbach, L. J. and P. E. Meehl (1955), “Construct validity in psychological tests,” Psychological Bulletin, 52, 281–302.CrossRefGoogle Scholar
  20. Dalrymple, D. J. (1987), “Sales forecasting practices: Results from a United States survey,” International Journal of Forecasting, 3, 379–391.CrossRefGoogle Scholar
  21. Fildes, R. (1991), “Efficient use of information in the formation of subjective industry forecasts,” Journal of Forecasting, 10, 597–617.Google Scholar
  22. Fischer, I. and N. Harvey (1999), “Combining forecasts: What information do judges need to outperform the simple average?” International Journal of Forecasting, 15, 227–246.CrossRefGoogle Scholar
  23. Fischhoff, B. (1976), “The effect of temporal setting on likelihood estimates,” Organizational Behavior and Human Performance, 15, 180–184.CrossRefGoogle Scholar
  24. Galton, F. (1878), “Composite portraits,” Journal of the Anthropological Institute of Great Britain and Ireland, 8, 132–142.CrossRefGoogle Scholar
  25. Gartner, W. B. and R. J. Thomas (1993), “Factors affecting new product forecasting accuracy in new firms,” Journal of Product Innovation Management, 10, 35–52.CrossRefGoogle Scholar
  26. Gordon, K. (1924), “Group judgments in the field of lifted weights,” Journal ofExperimental Psychology, 7, 398–400.Google Scholar
  27. Hogarth, R. (1978), “A note on aggregating opinions,” Organizational Behavior and Human Performance21,40–46. Google Scholar
  28. Huffcutt, A. I. and D. J. Woehr (1999), “Further analysis of employment interview validity: A quantitative evaluation of interview-related structuring methods,” Journal of Organizational Behavior, 20, 549–560.CrossRefGoogle Scholar
  29. Kaplan, A., A. L. Skogstad and M. A. Girshick (1950), “The prediction of social and technological events,” Public Opinion Quarterly, 14 (Spring), 93–110.CrossRefGoogle Scholar
  30. Klugman, S. F. (1945), “Group judgments for familiar and unfamiliar materials,” Journal of General Psychology, 32, 103–110.CrossRefGoogle Scholar
  31. Krishnamurti, T. N. et al. (1999), “Improved multimodal weather and seasonal climate forecasts from multimodel `superensemble,”’ Science, 285 (Sept. 3), 1548–1550.CrossRefGoogle Scholar
  32. Landefeld, J. S. and E. P. Seskin (1986), “A comparison of anticipatory surveys and econometric models in forecasting U.S. business investment,” Journal of Economic and Social Measurement, 14, 77–85.Google Scholar
  33. Langlois, J. H. and L. A. Roggman (1990), “Attractive faces are only average,” Psychological Science, 1 (March), 115–121.CrossRefGoogle Scholar
  34. Larreche, J. C. and R. Moinpour (1983), “Managerial judgment in marketing: The concept of expertise,” Journal of Marketing Research, 20, 110–121.CrossRefGoogle Scholar
  35. Lawrence, M. J., R. H. Edmundson and M. J. O’Connor (1986), “The accuracy of combin- ing judgmental and statistical forecasts,” Management Science, 32, 1521–1532.CrossRefGoogle Scholar
  36. Levine, R. A. (1960), “Capital expenditures forecasts by individual firms,” in National Bureau of Economic Research, The Quality and Significance of Anticipations Data. Princeton, N.J. pp. 351–366.Google Scholar
  37. Levins, R. (1966), “The strategy of model building in population biology,” American Scientist, 54, 421–431.Google Scholar
  38. Libby, R. and R. K. Blashfield (1978), “Performance of a composite as a function of the number of judges,” Organizational Behavior and Human Performance, 21, 121–129.CrossRefGoogle Scholar
  39. Lobo, G. J. (1991), “Alternative methods of combining security analysts’ and statistical forecasts of annual corporate earnings,” International Journal of Forecasting, 7, 57–63.CrossRefGoogle Scholar
  40. Lobo, G. J. (1992), “Analysis and comparison of financial analysts’, times series, and combined forecasts of annual earnings,” Journal of Business Research, 24, 269–280.CrossRefGoogle Scholar
  41. Lobo, G. J. and R. D. Nair (1990), “Combining judgmental and statistical forecasts: An application to earnings forecasts,” Decision Sciences, 21, 446–460.CrossRefGoogle Scholar
  42. Lott, J. (1998), More Guns, Less Crime. Chicago: U. of Chicago Press.Google Scholar
  43. MacLaughlin, R. L. (1973), “The forecasters’ batting averages,” Business Economics, 3 (May), 58–59.Google Scholar
  44. Makridakis, S. (1990), “Sliding simulation: A new approach to time series forecasting,” Management Science, 36, 505–512.CrossRefGoogle Scholar
  45. Makridakis, S., C. Chatfield, M. Hibon, M. Lawrence, T. Mills, K. Ord and L. F. Simons (1993), “The M2-Competition: A real-time judgmentally based forecasting study,” International Journal of Forecasting, 9, 5–22.CrossRefGoogle Scholar
  46. Makridakis, S. and R. Winkler (1983), “Averages of forecasts: Some empirical results,” Management Science, 29, 987–996.CrossRefGoogle Scholar
  47. McNees, S. K. (1992), “The uses and abuses of consensus’ forecasts,” Journal of Forecasting, 11, 703–710CrossRefGoogle Scholar
  48. Meade, N. and T. Islam (1998), “Technological forecasting—model selection, model stability, and combining models,” Management Science, 44, 1115–1130.CrossRefGoogle Scholar
  49. National Industrial Conference Board (1963), Forecasting Sales. Studies in Business Policy, No. 106. New York.Google Scholar
  50. Newbold, P. and C. W. J. Granger (1974), “Experience with forecasting univariate time series and the combination of forecasts,” Journal of the Royal Statistical Society, Series A, Part 2, 131–165.Google Scholar
  51. Okun, A. E. (1960), “The value of anticipations data in forecasting national product,” in National Bureau of Economic Research, The Quality and Economic Significance of Anticipations Data. Princeton, N.J.Google Scholar
  52. Pencavel, J. H. (1971), “A note on the predictive performance of wage inflation models of the British economy,” Economic Journal, 81, 113–119.CrossRefGoogle Scholar
  53. Plous, S. (1995), “A comparison of strategies for reducing interval overconfidence in group judgments,” Journal of Applied Psychology, 80, 443–454.CrossRefGoogle Scholar
  54. PoKempner, S. J. and E. Bailey (1970), Sales Forecasting Practices. New York: The Conference Board.Google Scholar
  55. Richards, R. M. and D. R. Fraser (1977), “Further evidence on the accuracy of analysts’ earnings forecasts: A comparison among analysts,” Journal of Economics and Business, 29 (3), 193–197.Google Scholar
  56. Rowse, G. L., D. H. Gustafson and R. L. Ludke (1974), “Comparison of rules for aggregating subjective likelihood ratios,” Organizational Behavior and Human Performance, 12, 274–285.CrossRefGoogle Scholar
  57. Sanders, N. R. and K. B. Manrodt (1994), “Forecasting practices in U.S. corporations: Survey results,” Interfaces 24 (March–April), 92–100.CrossRefGoogle Scholar
  58. Sanders, N. R. and L. P. Ritzman (1989), “Some empirical findings on short-term forecasting: Technique complexity and combinations,” Decision Sciences, 20, 635–640.CrossRefGoogle Scholar
  59. Sanders, N. R. and L. P. Ritzman (1992), “The need for contextual and technical knowledge in judgmental forecasting,” Journal of Behavioral Decision Making, 5, 39–52.CrossRefGoogle Scholar
  60. Schnaars, S. (1986), “A comparison of extrapolation models on yearly sales forecasts,” International Journal of Forecasting, 2, 71–85.CrossRefGoogle Scholar
  61. Shamseldin, A. Y., K. M. O’Connor and G. C. Liang (1997), “Methods for combining the outputs of different rainfall-runoff models,” Journal of Hydrology, 197, 203–229.CrossRefGoogle Scholar
  62. Stroop, J. R. (1932), “Is the judgment of the group better than the average member of the group,” Journal of Experimental Psychology, 15, 550–560.CrossRefGoogle Scholar
  63. Thorndike, R. L. (1938), “The effect of discussion upon the correctness of group decisions when the factor of a majority influence is allowed for,” Journal of Social Psychology, 9, 343–362.CrossRefGoogle Scholar
  64. Vandome, P. (1963), “Econometric forecasting for the United Kingdom,” Bulletin of the Oxford University Institute of Economics and Statistics, 25, 239–281.CrossRefGoogle Scholar
  65. Walker, H. E. (1970), “The value of human judgment,” Industrial Marketing Research Association Journal, 6 (May), 71–74.Google Scholar
  66. Weinberg, C. B. (1986), “Arts plan: Implementation, evolution, and usage,” Marketing Science, 5, 143–158.CrossRefGoogle Scholar
  67. Winkler, R. L. (1967), “Probabilistic prediction: Some experimental results,” Journal of the American Statistical Association, 66, 675–685.CrossRefGoogle Scholar
  68. Winkler, R. L. and R. M. Poses (1993), “Evaluating and combining physicians’ probabilities of survival in an intensive care unit,” Management Science, 39, 1526–1543.CrossRefGoogle Scholar
  69. Wolfe, H. D. (1966), Business Forecasting Methods. New York: Holt, Rinehart and Winston.Google Scholar
  70. Zarnowitz, V. (1984), “The accuracy of individual and group forecasts from business outlook surveys,” Journal of Forecasting, 3, 11–26.CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media New York 2001

Authors and Affiliations

  • J. Scott Armstrong
    • 1
  1. 1.The Wharton SchoolUniversity of PennsylvaniaUSA

Personalised recommendations