Learning in dynamically changing domains: Theory revision and context dependence issues

  • Charles Taylor
  • Gholamreza Nakhaeizadeh
Part III: Workshop Position Papers
Part of the Lecture Notes in Computer Science book series (LNCS, volume 1224)


Dealing with dynamically changing domains is a very important topic in Machine Learning (ML) which has very interesting practical applications. Some attempts have already been made both in the statistical and machine learning communities to address some of the issues. In this paper we give a state of the art from the available literature in this area. We argue that a lot of further research is still needed, outline the directions that such research should go and describe the expected results. We argue also that most of the problems in this area can be solved only by interaction between the researchers of both the statistical and ML-communities.


  1. 1.
    Aha, D., Kibler, D., & Albert, M.K. (1991). Instance-Based Learning Algorithms. Machine Learning, 6(1), 37–66.Google Scholar
  2. 2.
    Atkeson, C.G., Moore, A.W. and Schaal, S. (1997) Locally Weighted Learning. To appear in a special issue of Artificial Intelligence Review on Lazy Learning.Google Scholar
  3. 3.
    De Raedt, L. and Bruynooghe, M. (1992). Belief updating from integrity constraints and queries. Artificial Intelligence 53, 291–307.Google Scholar
  4. 4.
    Dübon, K. (1997). Dynamic Aspects in Risk Classification. To appear.Google Scholar
  5. 5.
    Dufour, J. M. and Ghysels, E. (1996) Editors' introduction: Recent developments in the econometrics of structural change. Journal of Econometrics 70, 1–8.Google Scholar
  6. 6.
    Filosofov, L. V. (1992). Dynamic classification systems with learning from observation catalogs. Cybernetics and Systems Analysis 28, 368–376.Google Scholar
  7. 7.
    Kubat, M. and Widmer, G. (1995). Adapting to drift in continuous domains. In Lecture Notes in Artificial Intelligence, Volume 912, pp. 307–310.Google Scholar
  8. 8.
    Mannila, H. (1995) Aspects of Data Mining. Keynote talk in: Statistics, Machine Learning and Knowledge Discovery in Databases, Kodratoff, Y., Nakhaeizadeh, G. and Taylor, C.C (eds.), Heraklion, Crete. pp. 1–12.Google Scholar
  9. 9.
    Michie, D., Spiegelhalter, D. J. and Taylor, C. C. (eds) (1994) Machine Learning, Neural and Statistical Classification, Ellis Horwood, Chichester.Google Scholar
  10. 10.
    Nakhaeizadeh, G. (1995) What Daimler-Benz has learned as an Industrial Partner from the Machine Learning Project StatLog? In: Aha, D. and Riddle P. (Eds.). Proceedings of the Workshop on Applying Machine Learning in Practice at the Twelfth International Machine Learning Conference.Google Scholar
  11. 11.
    Nakhaeizadeh, G. and Taylor, C. C. (eds) (1997) Machine Learning and Statistics: the Interface. Wiley, New York.Google Scholar
  12. 12.
    Nakhaeizadeh, G., Taylor, C. C. and Kunisch, G. (1996) Dynamic Aspects of Statistical Classification. In Intelligent Adaptive Agents, AAAI Technical report No. WS-96-04, pp. 55–64. AAAI Press, Menlo Park, CA.Google Scholar
  13. 13.
    Nakhaeizadeh, G., Taylor, C. C and Kunisch, G. (1997) Dynamic Supervised Learning: Some Basic Issues and Application Aspects. In Classification, Data Analysis, and Knowledge Organisation, Klar, B. &: Opitz, O. (eds.). Springer Verlag.Google Scholar
  14. 14.
    Rissland, E. E., Brodley. C. E. and Friedman, M. T. (1995) Measuring structural change in concepts. Technical report, Department of Computer Science, University of Massachusetts, Amtierst, MA 01003.Google Scholar
  15. 15.
    Schlimmer, J. C. (1987). Incremental adjustment of representations for learning. In Fourth International Workshop on Machine Learning, pp. 79–90. Irvine, CA:Morgan Kaufmann.Google Scholar
  16. 16.
    Schlimmer, J. C. and Granger, R. (1986). Incremental learning from noisy data. Machine Learning 1, 317–354.Google Scholar
  17. 17.
    Utgoff, P. E. (1989) Incremental learning of decision trees. Machine Learning 4, 161–186.Google Scholar
  18. 18.
    Utgoff, P. E. (1994) An improved algorithm for incremental induction of decision trees. In Proceedings of Eleventh Machine Learning Conference, Rutgers University. Morgan Kaufmann.Google Scholar
  19. 19.
    Widmer, G. (1994) Combining Robustness and Flexibility in Learning Drifting Concepts. Proceedings of the Eleventh European Conference on Artificial Intelligence (pp. 468–472). Wiley, Chichester.Google Scholar
  20. 20.
    Widmer, G. (1997) Tracking Context Changes through Meta-Learning Machine Learning (to appear). Draft version available electronically at Scholar
  21. 21.
    Widmer, G. and Kubat, M. (1993) Effective Learning in Dynamic Environments by Explicit Context Tracking. Proceedings of the Sixth European Conference on Machine Learning (pp. 227–243). Berlin: Springer-Verlag.Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 1997

Authors and Affiliations

  • Charles Taylor
    • 1
  • Gholamreza Nakhaeizadeh
    • 2
  1. 1.University of LeedsLeedsUK
  2. 2.Daimler-Benz Research and TechnologyUlmGermany

Personalised recommendations