A framework for discovering interesting business changes from data
- Cite this article as:
- Böttcher, M., Nauck, D., Borgelt, C. et al. BT Technol J (2006) 24: 219. doi:10.1007/s10550-006-0064-3
Since the world with its markets, innovations and customers is changing faster than ever before, the key to survival for businesses is the ability to detect, assess and respond to changing conditions — rapidly and intelligently. Discovering changes, and reacting to or acting upon them before others do, has therefore become a strategic issue for many companies.
Many businesses collect huge volumes of data. Commonly this data is continuously gathered over long periods and thus reflects changes in the parts of the business from which it has been derived. To control their business operations and to gain a competitive edge, it is crucial for businesses to detect these changes — early and precisely. However, existing data analysis techniques are insufficient for this task. The widely used method for defining key performance indicators is too weak to detect changes early enough, and requires time-consuming in-depth analysis before decisions can be made. State-of-the-art knowledge discovery techniques, on the other hand, provide the required level of detail, but assume that the domain under consideration is stable over time.
This paper presents a framework that detects changes within a data set at virtually any level of granularity. The underlying idea is to derive a rule-based description of the data set at different points in time and to subsequently analyse how these rules change. While rules are themselves a very comprehensible representation of knowledge, further techniques are required to assist the data analyst in interpreting and assessing changes. Therefore the framework also contains methods to discard rules that are non-drivers for change, and to assess the interestingness of the detected changes.