Advertisement

Sum-Product Networks for Early Outbreak Detection of Emerging Diseases

Conference paper
  • 277 Downloads
Part of the Lecture Notes in Computer Science book series (LNCS, volume 12721)

Abstract

Recent research in syndromic surveillance has focused primarily on monitoring specific, known diseases, concentrating on a certain clinical picture under surveillance. Outbreaks of emerging infectious diseases with different symptom patterns are likely to be missed by such a surveillance system. In contrast, monitoring all available data for anomalies allows to detect any kind of outbreaks, including infectious diseases with yet unknown syndromic clinical pictures. In this work, we propose to model the joint probability distribution of syndromic data with sum-product networks (SPN), which are able to capture correlations in the monitored data and even allow to consider environmental factors, such as the current influenza infection rate. Conversely to the conventional use of SPNs, we present a new approach to detect anomalies by evaluating p-values on the learned model. Our experiments on synthetic and real data with synthetic outbreaks show that SPNs are able to improve upon state-of-the-art techniques for detecting outbreaks of emerging diseases.

Keywords

Sum-product networks Syndromic surveillance Outbreak detection Anomaly detection 

Notes

Acknowledgments

We thank our project partners the Health Protection Authority of Frankfurt, the Hesse State Health Office and Centre for Health Protection, the Hesse Ministry of Social Affairs and Integration, the Robert Koch-Institut, the Epias GmbH and the Sana Klinikum Offenbach GmbH who provided insight and expertise that greatly assisted the research. This work was funded by the Innovation Committee of the Federal Joint Committee (G-BA) [ESEG project, grant number 01VSF17034].

References

  1. 1.
    Brossette, S., Sprague, A., Hardin, J., Waites, K., Jones, W., Moser, S.: Association rules and data mining in hospital infection control and public health surveillance. J. Am. Med. Inform. Assoc. 5, 373–81 (1998)CrossRefGoogle Scholar
  2. 2.
    Fanaee-T, H., Gama, J.: Eigenevent: an algorithm for event detection from complex data streams in syndromic surveillance. Intell. Data Anal. 19(3), 597–616 (2015)CrossRefGoogle Scholar
  3. 3.
    Fawcett, T., Provost, F.: Activity monitoring: noticing interesting changes in behavior. In: Proceedings of the 5th International Conference on Knowledge Discovery and Data Mining, pp. 53–62 (1999)Google Scholar
  4. 4.
    Henning, K.J.: What is syndromic surveillance? Morbidity and Mortality Weekly Report: Supplement, vol. 53, pp. 7–11 (2004)Google Scholar
  5. 5.
    Hutwagner, L., Thompson, W., Seeman, G., Treadwell, T.: The bioterrorism preparedness and response early aberration reporting system (EARS). J. Urban Health 80(1), i89–i96 (2003)Google Scholar
  6. 6.
    Kulessa, M., Loza Mencía, E., Fürnkranz, J.: Revisiting non-specific syndromic surveillance. In: Proceedings of the 19th International Symposium on Intelligent Data Analysis (IDA) (2021)Google Scholar
  7. 7.
    Molina, A., Vergari, A., Mauro, N.D., Natarajan, S., Esposito, F., Kersting, K.: Mixed sum-product networks: a deep architecture for hybrid domains. In: Proceedings of 32nd AAAI Conference on Artificial Intelligence (AAAI), pp. 3828–3835 (2018)Google Scholar
  8. 8.
    Poon, H., Domingos, P.: Sum-product networks: a new deep architecture. In: Cozman, F.G., Pfeffer, A. (eds.) Proceedings of 27th Conference on Uncertain. AI, pp. 337–346 (2011)Google Scholar
  9. 9.
    Roure, J., Dubrawski, A., Schneider, J.: A study into detection of bio-events in multiple streams of surveillance data. In: Zeng, D., et al. (eds.) BioSurveillance 2007. LNCS, vol. 4506, pp. 124–133. Springer, Heidelberg (2007).  https://doi.org/10.1007/978-3-540-72608-1_12CrossRefGoogle Scholar
  10. 10.
    Song, X., Wu, M., Jermaine, C., Ranka, S.: Conditional anomaly detection. IEEE Trans. Knowl. Data Eng. 19(5), 631–645 (2007)CrossRefGoogle Scholar
  11. 11.
    Tsamardinos, I., Greasidou, E., Borboudakis, G.: Bootstrapping the out-of-sample predictions for efficient and accurate cross-validation. Mach. Learn. 107(12), 1895–1922 (2018).  https://doi.org/10.1007/s10994-018-5714-4MathSciNetCrossRefzbMATHGoogle Scholar
  12. 12.
    Vovk, V., Wang, R.: Combining p-values via averaging. Biometrika 107(4), 791–808 (2020)MathSciNetCrossRefGoogle Scholar
  13. 13.
    Whitlock, M.C.: Combining probability from independent tests: the weighted Z-method is superior to Fisher’s approach. J. Evol. Biol. 18(5), 1368–1373 (2005)CrossRefGoogle Scholar
  14. 14.
    Wong, W., Moore, A., Cooper, G., Wagner, M.: What’s strange about recent events (WSARE): an algorithm for the early detection of disease outbreaks. J. Mach. Learn. Res. 6, 1961–1998 (2005)MathSciNetzbMATHGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2021

Authors and Affiliations

  1. 1.Technische Universität DarmstadtDarmstadtGermany
  2. 2.Johannes Kepler Universität LinzLinzAustria

Personalised recommendations