Maintaining Frequent Itemsets over High-Speed Data Streams
We propose a false-negative approach to approximate the set of frequent itemsets (FIs) over a sliding window. Existing approximate algorithms use an error parameter, ε, to control the accuracy of the mining result. However, the use of ε leads to a dilemma. A smaller ε gives a more accurate mining result but higher computational complexity, while increasing ε degrades the mining accuracy. We address this dilemma by introducing a progressively increasing minimum support function. When an itemset is retained in the window longer, we require its minimum support to approach the minimum support of an FI. Thus, the number of potential FIs to be maintained is greatly reduced. Our experiments show that our algorithm not only attains highly accurate mining results, but also runs significantly faster and consumes less memory than do existing algorithms for mining FIs over a sliding window.
KeywordsData Stream Minimum Support Frequent Itemset Memory Consumption Frequent Itemset Mining
Unable to display preview. Download preview PDF.
- 1.Chang, J.H., Lee, W.S.: estWin: Adaptively Monitoring the Recent Change of Frequent Itemsets over Online Data Streams. In: Proc. of CIKM (2003)Google Scholar
- 2.Chang, J.H., Lee, W.S.: A Sliding Window method for Finding Recently Frequent Itemsets over Online Data Streams. Journal of Information Science and Engineering 20(4) (July 2004)Google Scholar
- 3.Cheng, J., Ke, Y., Ng, W.: Maintaining Frequent Itemsets over High-Speed Data Streams. Technical Report, http://www.cs.ust.hk/~csjames/pakdd06tr.pdf
- 4.Li, H., Lee, S., Shan, M.: An Efficient Algorithm for Mining Frequent Itemsets over the Entire History of Data Streams. In: Proc. of First International Workshop on Knowledge Discovery in Data Streams (2004)Google Scholar
- 5.Manku, G.S., Motwani, R.: Approximate Frequency Counts over Data Streams. In: Proc. of VLDB (2002)Google Scholar
- 6.Yu, J., Chong, Z., Lu, H., Zhou, A.: False Positive or False Negative: Mining Frequent Itemsets from High Speed Transactional Data Streams. In: VLDB (2004)Google Scholar