Advertisement

Analyzing Big Data Streams with Apache SAMOA

Conference paper
  • 118 Downloads
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11406)

Abstract

Apache Apache samoa (Scalable Advanced Massive Online Analysis) is an open-source platform for mining big data streams. Big data is defined as datasets whose size is beyond the ability of typical software tools to capture, store, manage and analyze, due to the time and memory complexity. Velocity is one of the main properties of big data. Apache Apache samoa provides a collection of distributed streaming algorithms for the most common data mining and machine learning tasks such as classification, clustering, and regression, as well as programming abstractions to develop new algorithms. It features a pluggable architecture that allows it to run on several distributed stream processing engines such as Apache Flink, Apache Storm, Apache Samza, and Apache Apex. Apache Apache samoa is written in Java and is available at https://samoa.incubator.apache.org/ under the Apache Software License version 2.0.

References

  1. 1.
    Aggarwal, C.C.: Data Streams: Models and Algorithms. Springer, New York (2007).  https://doi.org/10.1007/978-0-387-47534-9CrossRefzbMATHGoogle Scholar
  2. 2.
    Ben-Haim, Y., Tom-Tov, E.: A streaming parallel decision tree algorithm. JMLR 11, 849–872 (2010)MathSciNetzbMATHGoogle Scholar
  3. 3.
    Bifet, A., Holmes, G., Kirkby, R., Pfahringer, B.: MOA: massive online analysis. J. Mach. Learn. Res. 11, 1601–1604 (2010)Google Scholar
  4. 4.
    Bordino, I., Kourtellis, N., Laptev, N., Billawala, Y.: Stock trade volume prediction with Yahoo finance user browsing behavior. In: 30th International Conference on Data Engineering (ICDE), pp. 1168–1173. IEEE (2014)Google Scholar
  5. 5.
    Chatzakou, D., Kourtellis, N., Blackburn, J., De Cristofaro, E., Stringhini, G., Vakali, A.: Mean birds: detecting aggression and bullying on Twitter. In: 9th International Conference on Web Science (WebSci). ACM (2017)Google Scholar
  6. 6.
    Chen, C., Zhang, J., Chen, X., Xiang, Y., Zhou, W.: 6 million spam tweets: a large ground truth for timely Twitter spam detection. In International Conference on Communications (ICC). IEEE (2015)Google Scholar
  7. 7.
    De Francisci Morales, G.: SAMOA: a platform for mining big data streams. In: RAMSS 2013: 2nd International Workshop on Real-Time Analysis and Mining of Social Streams @WWW 2013 (2013)Google Scholar
  8. 8.
    De Francisci Morales, G., Bifet, A.: SAMOA: scalable advanced massive online analysis. JMLR J. Mach. Learn. Res. 16, 149–153 (2014)Google Scholar
  9. 9.
    Dean, J., Ghemawat, S.: MapReduce: simplified data processing on large clusters. In OSDI 2004: 6th Symposium on Operating Systems Design and Implementation, pp. 137–150. USENIX Association (2004)Google Scholar
  10. 10.
    Devooght, R., Kourtellis, N., Mantrach, A.: Dynamic matrix factorization with priors on unknown values. In: 21st International Conference on Knowledge Discovery and Data Mining (SIGKDD), pp. 189–198. ACM (2015)Google Scholar
  11. 11.
    Domingos, P., Hulten, G.: Mining high-speed data streams. In: KDD 2000: 6th International Conference on Knowledge Discovery and Data Mining, pp. 71–80 (2000)Google Scholar
  12. 12.
    Gama, J., Zliobaite, I., Bifet, A., Pechenizkiy, M., Bouchachia, A.: A survey on concept drift adaptation. ACM Comput. Surv. 46(4), 44 (2014)CrossRefGoogle Scholar
  13. 13.
    Hoeffding, W.: Probability inequalities for sums of bounded random variables. J. Am. Stat. Assoc. 58(301), 13–30 (1963)MathSciNetCrossRefGoogle Scholar
  14. 14.
    Ikonomovska, E., Gama, J., Džeroski, S.: Learning model trees from evolving data streams. Data Min. Knowl. Discov. 23(1), 128–168 (2011)MathSciNetCrossRefGoogle Scholar
  15. 15.
    Jacobs, A.: The pathologies of big data. Commun. ACM 52(8), 36–44 (2009)CrossRefGoogle Scholar
  16. 16.
    Kourtellis, N., Bonchi, F., De Francisci Morales, G.: Scalable online betweenness centrality in evolving graphs. IEEE Trans. Knowl. Data Eng. 27, 2494–2506 (2015)CrossRefGoogle Scholar
  17. 17.
    Kourtellis, N., De Francisci Morales, G., Bifet, A.: VHT: vertical Hoeffding tree. In BigData 2016: 4th IEEE International Conference on Big Data (2016)Google Scholar
  18. 18.
    Page, E.: Continuous inspection schemes. Biometrika 41, 100–115 (1954)MathSciNetCrossRefGoogle Scholar
  19. 19.
    Thu Vu, A., De Francisci Morales, G., Gama, J., Bifet, A.: Distributed adaptive model rules for mining big data streams. In: BigData 2014: Second IEEE International Conference on Big Data (2014)Google Scholar
  20. 20.
    Uddin Nasir, M.A., De Francisci Morales, G., Garcia-Soriano, D., Kourtellis, N., Serafini, M.: The power of both choices: practical load balancing for distributed stream processing engines. In: ICDE 2015: 31st International Conference on Data Engineering. IEEE ( 2015)Google Scholar
  21. 21.
    Uddin Nasir, M.A., De Francisci Morales, G., Kourtellis, N., Serafini, M.: When two choices are not enough: balancing at scale in distributed stream processing. In: ICDE 2016: 32nd International Conference on Data Engineering. IEEE (2016)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  1. 1.Telefonica ResearchBarcelonaSpain
  2. 2.ISI FoundationTurinItaly
  3. 3.LTCI, Télécom Paris, IP-ParisParisFrance
  4. 4.University of WaikatoHamiltonNew Zealand

Personalised recommendations