Abstract
This paper explores approaches to optimize micro-services that manage game analytics in terms of stream analysis. Typically, the micro-services parameters should be adjusted to suit the streaming data efficiently. We focus on the important data pipeline’s issues, i.e. the throughput and velocity of the data stream generated by extraction information modules. We investigate the existing technologies employed by the empirical studies as well as the architecture of the micro-services that make up the end-to-end data pipeline. The findings are reported as conclusion.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Debian – the universal operating system. https://www.debian.org/index.en.html
Grafana: The open observability platform—grafana labs. https://grafana.com/
Kubernetes. https://kubernetes.io/
Microk8s - zero-ops kubernetes for developers, edge and IoT. https://microk8s.io/
odota/parser: Replay parse server generating JSON log events from Dota 2 replay files. https://github.com/odota/parser
Prometheus - monitoring system & time series database. https://prometheus.io/
SteamPipe - Valve Developer Community. https://developer.valvesoftware.com/wiki/Replay, https://developer.valvesoftware.com/wiki/SteamPipe
Dax: Data-driven audience experiences in esports, pp. 94–105 (2020). https://doi.org/10.1145/3391614.3393659
Agarwala, A., Pearce, M.: Learning dota 2 team compositions, pp. 2–6 (2014). https://cs229.stanford.edu/proj2014/Atish%20Agarwala,%20Michael%20Pearce,%20Learning%20Dota%202%20Team%20Compositions.pdf
Blamey, B., Hellander, A., Toor, S.: Apache spark streaming, Kafka and HarmonicIO: a performance benchmark and architecture comparison for enterprise and scientific computing. In: Gao, W., Zhan, J., Fox, G., Lu, X., Stanzione, D. (eds.) Bench 2019. LNCS, vol. 12093, pp. 335–347. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-49556-5_30
Chambers, C., et al.: FlumeJava: easy, efficient data-parallel pipelines (2010). https://doi.org/10.1145/1809028.1806638, https://research.google/pubs/pub35650/
Cheng, D., Chen, Y., Zhou, X., Gmach, D., Milojicic, D.: Adaptive scheduling of parallel jobs in spark streaming (2017). https://doi.org/10.1109/INFOCOM.2017.8057206
Dobbelaere, P., Esmaili, K.S.: Industry paper: Kafka versus RabbitMQ: a comparative study of two industry reference publish/subscribe implementations. In: DEBS 2017 - Proceedings of the 11th ACM International Conference on Distributed Event-Based Systems, pp. 227–238 (2017). https://doi.org/10.1145/3093742.3093908
Eggert, C., Herrlich, M., Smeddinck, J., Malaka, R.: Classification of player roles in the team-based multi-player game dota 2. In: Chorianopoulos, K., Divitini, M., Hauge, J.B., Jaccheri, L., Malaka, R. (eds.) ICEC 2015. LNCS, vol. 9353, pp. 112–125. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-24589-8_9
Hodge, V.J., Devlin, S., Sephton, N., Block, F., Cowling, P.I., Drachen, A.: Win prediction in multiplayer esports: Live professional match prediction. IEEE Trans. Games 13, 368–379 (2021). https://doi.org/10.1109/TG.2019.2948469, https://ieeexplore.ieee.org/document/8906016/
Kalyanaraman, K.: To win or not to win? A prediction model to determine the outcome of a DotA2 match (2014). https://cseweb.ucsd.edu/jmcauley/cse255/reports/wi15/Kaushik_Kalyanaraman.pdf
Kinkade, N., Jolla, L., Lim, K.: DOTA 2 win prediction. Univ. Calif. 1, 1–13 (2015)
Kreps, J., Narkhede, N., Rao, J.: Kafka: a distributed messaging system for log processing. ACM SIGMOD Workshop on Networking Meets Databases, p. 6 (2011). http://research.microsoft.com/en-us/um/people/srikanth/netdb11/netdb11papers/netdb11-final12.pdf
Maarala, A.I., Rautiainen, M., Salmi, M., Pirttikangas, S., Riekki, J.: Low latency analytics for streaming traffic data with apache spark, pp. 2855–2858 (2015). https://doi.org/10.1109/BigData.2015.7364101
Makarov, I., Savostyanov, D., Litvyakov, B., Ignatov, D.I.: Predicting winning team and probabilistic ratings in “dota 2’’ and “counter-strike: global offensive’’ video games. In: van der Aalst, W.M.P., et al. (eds.) AIST 2017. LNCS, vol. 10716, pp. 183–196. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-73013-4_17
Meng, X., et al.: Mllib: machine learning in apache spark. J. Mach. Learn. Res. 17, 1–7 (2016)
Sarhan, Q.I., Gawdan, I.S.: Java message service based performance comparison of apache ActiveMQ and apache Apollo brokers. Sci. J. Univ. Zakho 5(4), 307–312 (2017). https://doi.org/10.25271/2017.5.4.376
Schubert, M., Drachen, A., Mahlmann, T.: Esports analytics through encounter detection. In: MIT Sloan Sports Analytics Conference, pp. 1–18 (2016)
Seif El-Nasr, M., Drachen, A., Canossa, A.: Game Analytics. Springer, London (2013). https://doi.org/10.1007/978-1-4471-4769-5
Yang, P., Harrison, B., Roberts, D.L.: Identifying patterns in combat that are predictive of success in MOBA games, pp. 1–8 (2014)
Yu, L., Zhang, D., Chen, X., Xie, X.: MOBA-slice: a time slice based evaluation framework of relative advantage between teams in MOBA games. Commun. Comput. Inf. Sci. 1017, 23–40 (2019). https://doi.org/10.1007/978-3-030-24337-1_2
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
wongta, N., Natwichai, J. (2023). Data Pipeline of Efficient Stream Data Ingestion for Game Analytics. In: Barolli, L. (eds) Advances in Internet, Data & Web Technologies. EIDWT 2023. Lecture Notes on Data Engineering and Communications Technologies, vol 161. Springer, Cham. https://doi.org/10.1007/978-3-031-26281-4_50
Download citation
DOI: https://doi.org/10.1007/978-3-031-26281-4_50
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-26280-7
Online ISBN: 978-3-031-26281-4
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)