Skip to main content
Log in

Research of the processing technology for time complex event based on LSTM

  • Published:
Cluster Computing Aims and scope Submit manuscript

Abstract

With the huge amount of data, it is increasingly meaningful to combine different business system data with potential values. In the traditional event description, the input event flow of the event engine is a single atomic event type. The event predicate constraint contains simple attribute value, comparison operation and simple aggregation operation. The time constraint between events always simply. This makes the traditional detection method cannot meet the requirements such as financial, medical and other relatively accurate time requirements, event predicate constraints require more complex applications. Thus, this paper introduces the long short-term memory network model (LSTM), designs a multivariate event input to process these data based on TCN quantitative timing constraint representation model and predicate constraint representation model. In this paper, an innovative method makes the complex event processing technology more high efficient. By the analysis 200 million records of 2045 stocks, the results show that the processing technology of the complex events is more effective, more efficient.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

References

  1. Efthymiou, V., Papadakis, G., Papastefanatos, G., et al.: Parallel meta-blocking for scaling entity resolution over big heterogeneous data. Inf. Syst. 65, 137–157 (2017)

    Article  Google Scholar 

  2. Cugola, G., Margara, A.: Processing flows of information: from data stream to complex event processing. ACM Comput. Surv. (CSUR) 44(3), 1–62 (2012)

    Article  Google Scholar 

  3. Chang, X., Yu, Y.L., Yang, Y., et al.: Semantic pooling for complex event analysis in untrimmed videos. IEEE Trans. Pattern Anal. Mach. Intell. 39(8), 1617–1632 (2017)

    Article  Google Scholar 

  4. Chang, X., Yang, Y., Xing, E., et al.: Complex event detection using semantic saliency and nearly-isotonic SVM. In: Proceedings of the International Conference on Machine Learning. pp. 1348–1357 (2015)

  5. Kim, J.: Blocking causal drainage and other maintenance chores with mental causation. Philos. Phenomenol. Res. 67, 151–176 (2003)

    Article  Google Scholar 

  6. Zhou, Q., Simmhan, Y., Prasanna, V.: Knowledge-infused and consistent complex event processing over real-time and persistent streams. Future Gener. Comput. Syst. 76, 391–406 (2017)

    Article  Google Scholar 

  7. Data Stream Management: Processing high-speed data streams. Springer, Berlin (2016)

    Google Scholar 

  8. Kambatla, K., Kollias, G., Kumar, V., et al.: Trends in big data analytics. J. Parallel Distrib. Comput. 74(7), 2561–2573 (2014)

    Article  Google Scholar 

  9. Wu, E., Diao, Y., Rizvi, S.: High-performance complex event processing over streams. In: Proceedings of the 2006 ACM SIGMOD International Conference on Management of data. ACM, pp. 407–418 (2006)

  10. Zhang, H., Diao, Y., Immerman, N.: On complexity and optimization of expensive queries in complex event processing. In: Proceedings of the 2014 ACM SIGMOD International Conference on Management of data. ACM, pp. 217–228 (2014)

  11. Li, M., Mani, M., Rundensteiner, E.A., et al.: Complex event pattern detection over streams with interval-based temporal semantics. In: Proceedings of the 5th ACM International Conference on Distributed Event-based System. ACM, pp. 291–302 (2011)

  12. Sebastian B. et.al. OECEP: enriching complex event processing with domain knowledge from ontologies. In: Proceedings of the Fifth Balkan Conference in Informatics. BCI, pp. 20–25 (2012)

  13. Cugola, G., Margara, A.: Processing flows of information: from data stream to complex event processing. ACM Comput. Surv. (CSUR) 44(3), 15 (2012)

    Article  Google Scholar 

  14. Hasan, S., Curry, E.: Approximate semantic matching of events for the internet of things. ACM Trans. Internet Technol. (TOIT) 14(1), 2 (2014)

    Article  Google Scholar 

  15. Aasi, J., Abbott, B.P., Abbott, R., et al.: Advanced ligo. Class. Quantum Gravity 32(7), 074001 (2015)

    Article  Google Scholar 

  16. Isermann, R.: Model-based fault-detection and diagnosis–status and applications. Annu. Rev. Control 29(1), 71–85 (2005)

    Article  Google Scholar 

  17. Ma, M., Wang, P., Chu, C.H., et al.: Efficient multipattern event processing over high-speed train data streams. IEEE Internet Things J. 2(4), 295–309 (2015)

    Article  Google Scholar 

  18. Bosch, H., Thom, D., Heimerl, F., et al.: Scatterblogs2: real-time monitoring of microblog messages through user-guided filtering. IEEE Trans. Vis. Comput. Graphics 19(12), 2022–2031 (2013)

    Article  Google Scholar 

  19. Yi, I., Lee, J.G., Whang, K.Y.: Apam: Adaptive eager-lazy hybrid evaluation of event patterns for low latency. In: Proceedings of the 25th ACM International on Conference on Information and Knowledge Management. ACM, pp 2275–2280 (2016)

  20. Brenna, L., Demers, A., Gehrke, J., et al.: Cayuga: a high-performance event processing engine. In: Proceedings of the 2007 ACM SIGMOD International Conference on Management of Data. ACM, pp 1100–1102 (2007)

  21. You, U., Zhong-Zhi, L., Ming, X., De-Pei, Q.: Operator-based extendable complex event processing model. J. Softw. 25(11), 2715–2730 (2014)

    Google Scholar 

  22. Hochreiter, S., Schmidhuber, J.: Long short-term memory. Neural Comput. 9(8), 1735–1780 (1997)

    Article  Google Scholar 

Download references

Acknowledgements

The authors acknowledge the National Key Research and Development Program of China (Grant No. 2017YFB1402400), National High Technology Research and Development Program of China (Grant: 2015AA015308), Social Undertakings and Livelihood Security Science and Technology Innovation Funds of CQ CSTC (Grant: cstc2017shmsA0641), the National Nature Science Foundation of China (Grant: 61762025).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jiang Zhong.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Li, Q., Zhong, J., Tao, Y. et al. Research of the processing technology for time complex event based on LSTM. Cluster Comput 22 (Suppl 4), 9571–9579 (2019). https://doi.org/10.1007/s10586-018-2765-z

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10586-018-2765-z

Keywords

Navigation