Judgmental Time-Series Forecasting Using Domain Knowledge

  • Richard Webby
  • Marcus O’Connor
  • Michael Lawrence

Abstract

This chapter concerns principles regarding when and how to use judgment in time-series forecasting with domain knowledge. The evidence suggests that the reliability of domain knowledge is critical, and that judgment is essential when dealing with “soft” information. However judgment suffers from biases and inefficiencies when dealing with domain knowledge. We suggest two sets of principles for dealing with domain knowledge—when to use it and how to use it. Domain knowledge should be used when there is a large amount of relevant information, when experts are deemed to possess it, and when the experts do not appear to have predetermined agendas for the final forecast or the forecast setting process. Forecasters should select only the most important causal information, adjust initial estimates boldly in the light of new domain knowledge, and use decomposition strategies to integrate domain knowledge into the forecast.

Keywords

Contextual information domain knowledge judgmental decomposition judgmental forecasting time-series forecasting 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Adam, E. E. R. J. Ebert (1976), “A comparison of human and statistical forecasting,” AIIE Transactions, 8, 120–127.Google Scholar
  2. Adelman, L. (1981), “The influence of formal, substantive, and contextual task properties on the relative effectiveness of different forms of feedback in multiple cue probability learning tasks,” Organizational Behavior and Human Decision Processes, 27, 423–442.Google Scholar
  3. Armstrong, J. S. (1983), “Relative accuracy of judgmental and extrapolative methods in forecasting annual earnings,” Journal of Forecasting, 2, 437–447. Full text at hops.wharton.upenn.edu/forecast Google Scholar
  4. Armstrong, J. S. (1985), Long Range Forecasting: From Crystal Ball to Computer,2nd ed., NY: Wiley. Full text at hops.wharton.upenn.edu/forecast Google Scholar
  5. Armstrong, J. S., M. Adya F. Collopy (2001), “Rule-based forecasting: Using judgment in time-series extrapolation,” in J. S. Armstrong (ed.) Principles of Forecasting. Norwell, MA: Kluwer Academic Publishers.Google Scholar
  6. Armstrong, J. S. F. Collopy (1998), “Integration of statistical methods and judgment for time-series forecasting: Principles from empirical research,” in G.Wright P. Goodwin (eds.), Forecasting with Judgement, Wiley, pp. 269–293. Full text at hops.wharton.upenn.edu/forecast Google Scholar
  7. Brehmer, B. J. Kuylenstiema (1980), “Content and consistency in probabilistic inference tasks,” Organizational Behavior and Human Decision Processes, 26, 54–64.Google Scholar
  8. Brown, L. D., R. L. Hagerman, P. A. Griffin M. E. Zmijewski (1987), “Security analyst superiority relative to univariate time-series models in forecasting quarterly earnings,” Journal of Accounting and Economics, 9, 61–87.CrossRefGoogle Scholar
  9. Bunn, D. G. Wright (1991), “Interaction of judgemental and statistical forecasting methods: Issues and analysis,” Management Science, 37, 501–518.CrossRefGoogle Scholar
  10. Carbone, R. W. Gorr (1985), “Accuracy of judgmental forecasting of time-series,” Decision Sciences, 16, 153–160.CrossRefGoogle Scholar
  11. Collopy, F. J. S. Armstrong (1992), “Expert opinions about extrapolations and the mystery of the overlooked discontinuities,” International Journal of Forecasting, 8, 575–582. Full text at hops.wharton.upenn.edu/forecast Google Scholar
  12. Dalrymple, D. (1987), “Sales forecasting practices: Results from a United States survey,” International Journal of Forecasting, 3, 379–391.CrossRefGoogle Scholar
  13. Davis, F. D., G. Lohse J. E. Kotterman (1994), “Harmful effects of seemingly helpful information on forecasts of stock earnings,” Journal of Economic Psychology, 15, 253–267.CrossRefGoogle Scholar
  14. Edmundson, R. H. (1990), “Decomposition: A strategy for judgemental forecasting,” Journal of Forecasting, 9, 301–314.CrossRefGoogle Scholar
  15. Edmundson, R. H., M. J. Lawrence M. J. O’Connor (1988), “The use of non time-series information in sales forecasting: A case study,” Journal of Forecasting, 7, 201–211.CrossRefGoogle Scholar
  16. Gorr, W.L. (1986), “Special event data in shared databases,” MIS Quarterly, 10, September, 239–255.Google Scholar
  17. Handzic, M. (1997), The utilization of contextual information in a judgemental decision making task. Unpublished Ph.D. thesis, University of New South Wales,“ available from m.handzic @unsw.edu.au Google Scholar
  18. Hopwood, W. S. J. C. McKeown (1990), “Evidence on surrogates for earnings expectations within a capital market context,” Journal of Accounting, Auditing and Finance, 5, 339–368.Google Scholar
  19. Johnson, E. (1988), “Expertise and decision making under uncertainty: performance and process,” in M. Chi, R. Glaser M. Farr (eds.), The Nature of Expertise. Hillsdale, NY: L.Erlbaum Assoc.Google Scholar
  20. Kardes, F. (1996), “In defense of experimental consumer psychology,” Journal of Consumer Psychology, 5, 279–296.CrossRefGoogle Scholar
  21. Koele, P. (1980), “The influence of labeled stimuli on nonlinear multiple cue probability learning,” Organizational Behavior and Human Decision Processes, 26, 22–31.Google Scholar
  22. Kurke, L. H. Aldrich (1983), “Mintzberg was right! A replication and extension of The Nature of Managerial Work, ” Management Science, 32, 683–695.Google Scholar
  23. Lawrence, M. J., R. H. Edmundson M. J. O’Connor (1985), “An examination of the accuracy of judgemental extrapolation of time-series,” International Journal of Forecasting, 1, 25–35.CrossRefGoogle Scholar
  24. Lawrence, M. J. M. J. O’Connor (1992), “Exploring judgemental forecasting,” International Journal of Forecasting, 8, 15–26.CrossRefGoogle Scholar
  25. Lawrence, M. J. M. J. O’Connor (1996), “Judgement or models: The importance of task differences,” 24, 245–254.Google Scholar
  26. Lawrence, M. J., M. J. O’Connor R. H. Edmundson (2000), “A field study of sales forecasting accuracy and processes,” European Journal of Operational Research, 122, 151–160.CrossRefGoogle Scholar
  27. Lim, J. S. M. J. O’Connor (1996), “Judgemental forecasting with time series and causal information,” International Journal of Forecasting, 12, 139–153.CrossRefGoogle Scholar
  28. MacGregor, D. (2001), “Decomposition for judgemental forecasting and estimation,” in J. S. Armstrong (ed.) Principles of Forecasting. Norwell, MA: Kluwer Academic Publishers.Google Scholar
  29. Makridakis, S. (1988), “Metaforecasting,” International Journal of Forecasting, 4, 467–491.CrossRefGoogle Scholar
  30. Miller, P. M. (1971), “Do labels mislead?: A multiple cue study, within the framework of Brunswik’s probabilistic functionalism,” Organizational Behavior and Human Decision Processes, 6, 480–500.Google Scholar
  31. Mintzberg, H. (1973), The Nature of Managerial Work. New York: Harper Row.Google Scholar
  32. Muchinsky, P.M. A. Dudycha (1975), “Human inference behavior in abstract and meaningful environments,” Organizational Behavior and Human Decision Processes, 13, 377–391.Google Scholar
  33. O’Connor, M. J., W. Remus K. Griggs (1993), “Judgemental forecasting in times of change,” International Journal of Forecasting, 9, 163–172.CrossRefGoogle Scholar
  34. O’Connor, M. J., W. Remus K. Griggs (1997), “Going up—going down: How good are people at forecasting trends and changes in trends?” Journal of Forecasting, 16, 165–176.CrossRefGoogle Scholar
  35. Payne, J. (1982), “Contingent decision behaviour,” Psychological Bulletin, 92, 382–402. Sanders, N. (1992), “Accuracy of judgmental forecasts: A comparison,” Omega, 20, 353–364.Google Scholar
  36. Sanders, N. R. K. Manrodt (1994), “Forecasting practices in U.S. corporations: Survey results,” Interfaces, 24, 92–100.CrossRefGoogle Scholar
  37. Sanders, N. L. Ritzman (1992), “The need for contextual and technical knowledge in judgmental forecasting,” Journal of Behavioral Decision Making, 5, 39–52.CrossRefGoogle Scholar
  38. Sanders, N. L. Ritzman (2001), “Judgemental adjustment of statistical forecasts,” in J. S. Armstrong (ed.) Principles of Forecasting. Norwell, MA: Kluwer Academic Publishers.Google Scholar
  39. Sniezek, J. A. (1986), “The role of variable labels in cue probability learning tasks,” Organizational Behavior and Human Decision Processes, 38, 141–161.CrossRefGoogle Scholar
  40. Webby, R. G. (1994), Graphical Support for the Integration of Event Information into Time-series Forecasting: An Empirical Investigation. Unpublished Ph.D. dissertation, University of New South Wales.Google Scholar
  41. Webby, R. G. M. J. O’Connor (1996), “Judgemental versus statistical time-series forecasting: A review of the literature,” International Journal of Forecasting, 12, 91–118.CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media New York 2001

Authors and Affiliations

  • Richard Webby
    • 1
  • Marcus O’Connor
    • 2
  • Michael Lawrence
    • 2
  1. 1.Telecordia TechnologiesAustralia
  2. 2.School of Information SystemsUniversity of New South WalesAustralia

Personalised recommendations