Skip to main content

CADM: Confusion Model-Based Detection Method for Real-Drift in Chunk Data Stream

  • Conference paper
  • First Online:
Sensor Systems and Software (S-Cube 2022)

Abstract

Concept drift detection has attracted considerable attention due to its importance in many real-world applications such as health monitoring and fault diagnosis. Conventionally, most advanced approaches will be of poor performance when the evaluation criteria of the environment has changed (i.e. concept drift), either can only detect and adapt to virtual drift. In this paper, we propose a new approach to detect real-drift in the chunk data stream with limited annotations based on concept confusion. When a new data chunk arrives, we use both real labels and pseudo labels to update the model after prediction and drift detection. In this context, the model will be confused and yields prediction difference once drift occurs. We then adopt cosine similarity to measure the difference. And an adaptive threshold method is proposed to find the abnormal value. Experiments show that our method has a low false alarm rate and false negative rate with the utilization of different classifiers.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 59.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 79.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    https://scikit-multiflow.github.io/.

  2. 2.

    The code is available at https://github.com/songqiaohu/CADM-Confusion-Model.

References

  1. Liu, Z., Deng, Y., Zhang, Y., Ding, Z., He, X.: Safety assessment of dynamic systems: an evidential group interaction-based fusion design. IEEE Trans. Instrum Measur. 70, 1–14 (2021)

    Article  Google Scholar 

  2. Gama, J., Medas, P., Castillo, G., Rodrigues, P.: Learning with drift detection. In: Proceedings of the 17th Brazilian Symposium On Artificial Intelligence, pp. 286–295 (2004)

    Google Scholar 

  3. Bifet, A., Gavalda, R.: Learning from time-changing data with adaptive windowing. In: Proceedings of the 2007 SIAM International Conference on Data Mining. Society for Industrial and Applied Mathematics, pp. 443–448 (2007)

    Google Scholar 

  4. Tanha, J., Samadi, N., Abdi, Y., et al.: CPSSDS: conformal prediction for semi-supervised classification on data streams. Inf. Sci. 584, 212–234 (2022)

    Article  Google Scholar 

  5. Lu, Y., Cheung, Y.M., Tang, Y.Y.: Adaptive chunk-based dynamic weighted majority for imbalanced data streams with concept drift. IEEE Trans. Neural Netw. Learn. Syst. 31(8), 2764–2778 (2019)

    Article  Google Scholar 

  6. Liu, Z., Zhang, Y., Ding, Z., He, X.: An online active broad learning approach for real-time safety assessment of dynamic systems in nonstationary environments. IEEE Trans. Neural Netw. Learn. Syst., (2022)

    Google Scholar 

  7. Siffer, A., Fouque, P.A., Termier, A., et al.: Anomaly detection in streams with extreme value theory. In: Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 1067–1075 (2017)

    Google Scholar 

  8. Sethi, T.S., Kantardzic, M., Hu, H.: A grid density based framework for classifying streaming data in the presence of concept drift. J. Intell. Inf. Syst. 46(1), 179–211 (2016)

    Article  Google Scholar 

  9. Losing, V., Hammer, B., Wersing, H.: Incremental on-line learning: a review and comparison of state of the art algorithms. Neurocomputing 275, 1261–1274 (2018)

    Article  Google Scholar 

  10. Kolter, J.Z., Maloof, M.A.: Dynamic weighted majority: an ensemble method for drifting concepts. J. Mach. Learn. Res. 8, 2755–2790, December (2007). ISSN 1532–4435

    Google Scholar 

  11. Gomes, H.M., et al.: Adaptive random forests for evolving data stream classification. Mach. Learn. 106(9), 1469–1495 (2017). https://doi.org/10.1007/s10994-017-5642-8

    Article  MathSciNet  Google Scholar 

  12. Hulten, G., Spencer, L., Domingos, P.: Mining time-changing data streams. In: KDD’01, pp. 97–106. ACM Press, San Francisco, CA (2001)

    Google Scholar 

  13. Murphy, K.P.: Naive Bayes classifiers. Univ. British Columbia 18(60), 1–8 (2006)

    Google Scholar 

  14. Ding, S., Zhao, H., Zhang, Y., et al.: Extreme learning machine: algorithm, theory and applications. Artif. Intell. Rev. 44(1), 103–115 (2015)

    Article  Google Scholar 

  15. Chen, C.L.P., Liu, Z.: Broad learning system: an effective and efficient incremental learning system without the need for deep architecture. IEEE Trans. Neural Netw. Learn. Syst. 29(1), 10–24 (2017)

    Article  MathSciNet  Google Scholar 

Download references

Acknowledgment

This work was supported by National Natural Science Foundation of China under Grant 61733009, National Key Research and Development Program of China under Grant 2017YFA0700300, and Huaneng Group science and technology research project.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Xiao He .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 ICST Institute for Computer Sciences, Social Informatics and Telecommunications Engineering

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Hu, S., Liu, Z., He, X. (2023). CADM: Confusion Model-Based Detection Method for Real-Drift in Chunk Data Stream. In: Karimi , H.R., Wang, N. (eds) Sensor Systems and Software. S-Cube 2022. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol 487. Springer, Cham. https://doi.org/10.1007/978-3-031-34899-0_13

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-34899-0_13

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-34898-3

  • Online ISBN: 978-3-031-34899-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics