Advertisement

Predictive Statistical Models for User Modeling

  • Ingrid Zukerman
  • David W. Albrecht
Article

Abstract

The limitations of traditional knowledge representation methods for modeling complex human behaviour led to the investigation of statistical models. Predictive statistical models enable the anticipation of certain aspects of human behaviour, such as goals, actions and preferences. In this paper, we motivate the development of these models in the context of the user modeling enterprise. We then review the two main approaches to predictive statistical modeling, content-based and collaborative, and discuss the main techniques used to develop predictive statistical models. We also consider the evaluation requirements of these models in the user modeling context, and propose topics for future research.

content-based learning collaborative learning linear models TFIDF-based models Markov models Neural networks classifications rule induction Bayesian networks 

References

  1. Albrecht, D.W., Zukerman, I. and Nicholson, A.E.: 1998, Bayesian Models for Keyhole Plan Recognition in an Adventure Game. User Modeling and User-Adapted Interaction 8(1–2), 5-47.Google Scholar
  2. Albrecht, D.W., Zukerman, I. and Nicholson, A.E.: 1999, Pre-sending Documents on the WWW: A Comparative Study. In: IJCAI99–The Sixteenth International Joint Conference on Artificial Intelligence. Stockholm, Sweden, pp. 1274-1279.Google Scholar
  3. Alspector, J., Koicz, A. and Karunanithi, N.: 1997, Feature-Based and Clique-Based User Models for Movie Selection: A Comparative Study. User Modeling and User-Adapted Inter-action 7(4), 279-304.Google Scholar
  4. Balabanović, M.: 1998, Exploring versus Exploiting when Learning User Models for Text Recommendation. User Modeling and User-Adapted Interaction 8(1–2), 71-102.Google Scholar
  5. Basu, C., Hirsh, H. and Cohen, W.: 1998, Recommendation as Classification: Using Social and Content-Based Information in Recommendation. In: AAAI98–Proceedings of the Fifteenth National Conference on Artificial Intelligence. Madison, Wisconsin, pp. 714-720.Google Scholar
  6. Basu, C., Hirsh, H. Cohen, W. and Nevill-Manning, C.: 1999, Recommending Papers by Mining the Web. In: Proceedings of the IJCAI99 Workshop on Learning about Users. Stockholm, Sweden, pp. 1-11.Google Scholar
  7. Bestavros, A.: 1996, Speculative Data Dissemination and Service to Reduce Server Load, Network Traffic and Service Time in Distributed Information Systems. In: Proceedings of the 1996 International Conference on Data Engineering.Google Scholar
  8. Billsus, D. and Pazzani, M.: 1999, A Hybrid User Model for News Stories Classification. In: UM99–Proceedings of the Seventh International Conference on User Modeling. Banff, Canada, pp. 99-108.Google Scholar
  9. Breese, J.S., Heckerman, D. and Kadie, C.: 1998, Empirical Analysis of Predictive Algorithms for Collaborative Filtering. In: UAI98–Proceedings of the Fourteenth Conference on Uncertainty in Artificial Intelligence. Madison, Wisconsin, pp. 43-52.Google Scholar
  10. Carberry, S.: 2001, Techniques for Plan Recognition. User Modeling and User-Adapted Interaction 11(1–2), 31-48 (this issue).Google Scholar
  11. Chiu, B., Webb, G.I. and Kuzmycz, M.: 1997, A Comparison of First-order and Zeroth-Order Induction for Input-Output Agent Modelling. In: UM97–Proceedings of the Sixth International Conference on User Modeling. Sardinia, Italy, pp. 347-358.Google Scholar
  12. Chiu, B.C. and Webb, G.: 1998, Using Decision Trees for Agent Modeling: Improving Prediction Performance. User Modeling and User-Adapted Interaction 8(1–2), 131-152.Google Scholar
  13. Cohen, W.W.: 1996, Learning Trees and Rules with Set-valued Features. In: AAAI96–Proceedings of the Thirteenth National Conference on Artificial Intelligence. Portland, Oregon.Google Scholar
  14. Davison, B. and Hirsh, H.: 1998, Predicting Sequences of User Actions. In: Notes of the AAAI/ICML 1998 Workshop on Predicting the Future: AI Approaches to Time-Series Analysis. Madison, Wisconsin.Google Scholar
  15. Dean, T. and Wellman, M.P.: 1991, Planning and Control. San Mateo, California: Morgan Kaufmann Publishers.Google Scholar
  16. Delgado, J. and Ishii, N.: 1999, Formal Models for Learning a User's Preferences, a Preliminary Report. In: Proceedings of the IJCAI99 Workshop on Learning about Users. Stockholm, Sweden, pp. 13-20.Google Scholar
  17. Duda, R. and Hart, P.: 1973, Pattern Classification and Scene Analysis. New York, New York: John Wiley and Sons.Google Scholar
  18. Gervasio, M., Iba, W. and Langley, P.: 1998, Learning to Predict User Operations for Adaptive Scheduling. In: AAAI98–Proceedings of the Fifteenth National Conference on Artificial Intelligence. Madison, Wisconsin, pp. 721-726.Google Scholar
  19. Gmytrasiewicz, P.J., Noh, S. and Kellog, T.: 1998, Bayesian Update of Recursive Agent Models. User Modeling and User-Adapted Interaction 8(1–2), 49-69.Google Scholar
  20. Horvitz, E.: 1998, Continual Computation Policies for Utility-Directed Prefetching. In: CIKM'98–Proceedings of the Seventh ACM Conference on Information and Knowledge Management. Bethesda, Maryland, pp. 175-184.Google Scholar
  21. Horvitz, E., Breese, J., Heckerman, D., Hovel, D. and Rommelse, K.: 1998, The Lumiere Project: Bayesian User Modeling for Inferring the Goals and Needs of Software Users. In: Proceedings of the Fourteenth Conference on Uncertainty in Artificial Intelligence. Madison, Wisconsin, pp. 256-265.Google Scholar
  22. Horvitz, E., Jacobs, A. and Hovel, D.: 1999, Attention-sensitive Alerting. In: UAI99–Proceedings of the Fifteenth Conference on Uncertainty in Artificial Intelligence. Stockholm, Sweden, pp. 305-313.Google Scholar
  23. Howard, R. and Matheson: 1984, Influence diagrams. In: R. Howard and J. Matheson (eds.): Readings on the Principles and Applications of Decision Analysis. Menlo Park, California: Strategic Decisions Group, pp. 721-762.Google Scholar
  24. Jameson, A.: 1995, Numerical Uncertainty Management in User and Student Modeling: An Overview of Systems and Issues. User Modeling and User-Adapted Interaction 5(3–4), 193-251.Google Scholar
  25. Jameson, A., Groβmann-Hutter, B. March, L. and Rummer, R.: 2000, Creating an Empirical Basis for Adaptation Decisions. In: IUI2000–Proceedings of the International Conference on Intelligent User Interfaces. New Orleans, Louisiana, pp. 149-156.Google Scholar
  26. Jennings, A. and Higuchi, H.: 1993, A User Model Neural Network for a Personal News Service. User Modeling and User-Adapted Interaction 3(1), 1-25.Google Scholar
  27. Joerding, T.: 1999, Temporary User Modeling for Adaptive Product Presentation in theWeb. In: UM99–Proceedings of the Seventh International Conference on User Modeling. Banff, Canada, pp. 333-334.Google Scholar
  28. Kobsa, A. and Wahlster, W.: 1989, User Models in Dialog Systems. Springer-Verlag.Google Scholar
  29. Larson, H.J.: 1969, Introduction to Probability Theory and Statistical Inference. Wiley International Edition.Google Scholar
  30. Lau, T. and Horvitz, E.: 1999, Patterns of Search: Analyzing and Modeling Web Query Refinement. In: UM99–Proceedings of the Seventh International Conference on User Modeling. Banff, Canada, pp. 119-128.Google Scholar
  31. Lieberman, H.: 1995, Letizia: An Agent that Assists Web Browsing. In: IJCAI95–Proceedings of the Fourteenth International Joint Conference on Artificial Intelligence. Montreal, Canada, pp. 924-929.Google Scholar
  32. Litman, D. and Pan, S.: 2000, Predicting and Adapting to Poor Speech Recognition in a Spoken Dialogue System. In: AAAI2000–Proceedings of the Seventeenth National Conference on Artificial Intelligence. San Antonio, Texas, pp. 722-728.Google Scholar
  33. Macskassy, S.A., Dayanik, A.A. and Hirsh, H.: 1999, EmailValet: Learning User Preferences for Wireless Email. In: Proceedings of the IJCAI99 Workshop on Learning about Users. Stockholm, Sweden, pp. 45-50.Google Scholar
  34. Morales, R. and Pain, H.: 1999, Modelling of Novices' Control Skills with Machine Learning. In: UM99–Proceedings of the Seventh International Conference on User Modeling. Banff, Canada, pp. 159-168.Google Scholar
  35. Moukas, A. and Maes, P.: 1998, Amalthaea: An Evolving Multiagent Information Filtering and Discovery System for the WWW. Autonomous Agents and Multi-Agent Systems 1.Google Scholar
  36. Orwant, J.: 1995, Heterogenous Learning in the Doppelgänger User Modeling System. User Modeling and User-Adapted Interaction 4(2), 107-130.Google Scholar
  37. Pearl, J.: 1988, Probabilistic Reasoning in Intelligent Systems. SanMateo, California: Morgan Kaufmann Publishers.Google Scholar
  38. Perkowitz, M. and Etzioni, O.: 2000, Towards Adaptive Web Sites: Conceptual Framework and Case Study. Artificial Intelligence 118(1–2), 245-275.Google Scholar
  39. Quinlan, J.R.: 1986, Induction of Decision Trees. Machine Learning 1, 81-106.Google Scholar
  40. Quinlan, J.R.: 1993, C4.5: Programs for Machine Learning. San Mateo, California: Morgan Kaufmann Publishers.Google Scholar
  41. Quinlan, J.R.: 1996, Learning First-order Definitions of Functions. Artificial Intelligence Research 5, 139-161.Google Scholar
  42. Raskutti, B., Beitz, A. and Ward, B.: 1997, A Feature-based Approach to Recommending Selections based on Past Preferences. User Modeling and User-Adapted Interaction 7(3), 179-218.Google Scholar
  43. Resnick, P., Iacovou, N. Sushak, M. Bergstrom, P. and Riedl, J.: 1994, GroupLens: An Open Architecture for Collaborative Filtering of Netnews. In: CSCW'94 Proceedings–the Conference on Computer Supported Collaborative Work. pp. 175-186.Google Scholar
  44. Salton, G. and McGill, M.: 1983, An Introduction toModern Information Retrieval. McGrawHill.Google Scholar
  45. Shen, W.M.: 1997, Active and Semi-Incremental Learning with Bordering Counterexamples. Technical Report USC-ISI-97, Information Sciences Institute, Los Angeles, California.Google Scholar
  46. Webb, G.I. and Kuzmycz, M.: 1996, Feature Based Modelling: AMethodology for Producing Coherent, Consistent, Dynamically Changing Models of Agents' Competencies. User Modeling and User-Adapted Interaction 5(2), 117-150.Google Scholar
  47. Webb, G.I., Pazzani, M.J. and Billsus, D.: 2001, Machine Learning for User Modeling. User Modeling and User-Adapted Interaction 11(1–2), 19-29 (this issue).Google Scholar
  48. Zukerman, I., Albrecht, D.W. and Nicholson, A.E.: 1999, Predicting Users' Requests on the WWW. In: UM99–Proceedings of the Seventh International Conference on User Modeling. Banff, Canada, pp. 275-284.Google Scholar

Copyright information

© Kluwer Academic Publishers 2001

Authors and Affiliations

  • Ingrid Zukerman
    • 1
  • David W. Albrecht
    • 1
  1. 1.School of Computer Science and Software EngineeringMonash UniversityClaytonAustralia.

Personalised recommendations