Skip to main content
SpringerLink
Log in

Towards More Data-Aware Application Integration

  • Conference paper
  • First Online:
Data Science (BICOD 2015)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 9147))

Included in the following conference series:

Abstract

Although most business application data is stored in relational databases, programming languages and wire formats in integration middleware systems are not table-centric. Due to costly format conversions, data-shipments and faster computation, the trend is to “push-down” the integration operations closer to the storage representation. We address the alternative case of defining declarative, table-centric integration semantics within standard integration systems. For that, we replace the current operator implementations for the well-known Enterprise Integration Patterns by equivalent “in-memory” table processing, and show a practical realization in a conventional integration system for a non-reliable, “data-intensive” messaging example. The results of the runtime analysis show that table-centric processing is promising already in standard, “single-record” message routing and transformations, and can potentially excel the message throughput for “multi-record” table messages.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    Solace Solutions, visited 02/2015; last update 2012: http://www.solacesystems.com/techblog/deconstructing-kafka.

  2. 2.

    SAP Convergent Charging, visited 04/2015: https://help.sap.com/cc.

  3. 3.

    SAP S/4 HANA, visited 04/2015: http://discover.sap.com/S4HANA.

  4. 4.

    Apache JMeter, visited 02/2015: http://jmeter.apache.org/.

References

  1. Abiteboul, S., Antoine, E., Miklau, G., Stoyanovich, J., Testard, J.: Rule-based application development using webdamlog. In: ACM SIGMOD (2013)

    Google Scholar 

  2. AdroitLogic: Esb performance (2013). http://esbperformance.org/

  3. Anstey, J., Zbarcea, H.: Camel in Action. Manning, Stamford (2011)

    Google Scholar 

  4. Böhm, A., Kanne, C., Moerkotte, G.: Demaq: a foundation for declarative XML message processing. In: CIDR 2007, pp. 33–43 (2007)

    Google Scholar 

  5. Chappell, D.: Enterprise Service Bus. O’Reilly Media Inc., Sebastopol (2004)

    Google Scholar 

  6. Genesereth, M.R.: Data Integration: The Relational Logic Approach. Morgan & Claypool Publishers, San Rafael (2010)

    Google Scholar 

  7. Green, T.J., Aref, M., Karvounarakis, G.: LogicBlox, platform and language: a tutorial. In: Barceló, P., Pichler, R. (eds.) Datalog 2.0 2012. LNCS, vol. 7494, pp. 1–8. Springer, Heidelberg (2012)

    Chapter  Google Scholar 

  8. Haas, L.M., Kossmann, D., Wimmers, E.L., Yang, J.: Optimizing queries across diverse data sources. In: VLDB, pp. 276–285 (1997)

    Google Scholar 

  9. Hohpe, G., Woolf, B.: Enterprise Integration Patterns: Designing, Building, and Deploying Messaging Solutions. Addison-Wesley Longman, Boston (2003)

    Google Scholar 

  10. Reimann, P., Schwarz, H.: Datenmanagementpatterns in simulationsworkflows. In: BTW, pp. 279–293 (2013)

    Google Scholar 

  11. Ritter, D.: What about database-centric enterprise application integration? In: ZEUS, pp. 73–76 (2014)

    Google Scholar 

  12. Ritter, D.: Towards more data-aware application integration (extended version). CoRR abs/1504.05707 (2015). arXiv: 1504.05707

  13. Ritter, D., Bross, J.: DatalogBlocks: relational logic integration patterns. In: Decker, H., Lhotská, L., Link, S., Spies, M., Wagner, R.R. (eds.) DEXA 2014, Part II. LNCS, vol. 8645, pp. 318–325. Springer, Heidelberg (2014)

    Google Scholar 

  14. Ritter, D., Westmann, T.: Business network reconstruction using datalog. In: Barceló, P., Pichler, R. (eds.) Datalog 2.0 2012. LNCS, vol. 7494, pp. 148–152. Springer, Heidelberg (2012)

    Chapter  Google Scholar 

  15. Russell, N., ter Hofstede, A., Edmond, D., van der Aalst, W.: Workflow data patterns: identification, representation and tool support. In: ER (2005)

    Google Scholar 

  16. Shah, M.A., Madden, S., Franklin, M.J., Hellerstein, J.M.: Java support for data-intensive systems: experiences building the telegraph dataflow system. SIGMOD Rec. 30(4), 103–114 (2001)

    Article  Google Scholar 

  17. Ullman, J.: Principles of Database and Knowledge-Base Systems, vol. I. Computer Science Press, New York (1988)

    Google Scholar 

  18. Vrhovnik, M., Schwarz, H., Suhre, O., Mitschang, B., Markl, V., Maier, A., Kraft, T.: An approach to optimize data processing in business processes. In: VLDB (2007)

    Google Scholar 

  19. Welsh, M., Culler, D.E.: Jaguar: enabling efficient communication and I/O in Java. Concurr. Pract. Exp. 12(7), 519–538 (2000)

    Article  MATH  Google Scholar 

  20. Zaniolo, C.: A logic-based language for data streams. In: SEBD 2012 (2012)

    Google Scholar 

  21. Zaniolo, C.: Logical foundations of continuous query languages for data streams. In: Barceló, P., Pichler, R. (eds.) Datalog 2.0 2012. LNCS, vol. 7494, pp. 177–189. Springer, Heidelberg (2012)

    Chapter  Google Scholar 

Download references

Acknowledgements

We especially thank Dr. Fredrik Nordvall Forsberg, Dr. Norman May and Prof. Dr. Erhard Rahm for proof-reading and valuable discussions on the paper.

Author information

Authors and Affiliations

  1. SAP SE, Technology Development, Dietmar-Hopp-Allee 16, 69190, Walldorf, Germany

    Daniel Ritter

Authors
  1. Daniel Ritter
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Daniel Ritter .

Editor information

Editors and Affiliations

  1. University of Edinburgh, Edinburgh, United Kingdom

    Sebastian Maneth

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this paper

Cite this paper

Ritter, D. (2015). Towards More Data-Aware Application Integration. In: Maneth, S. (eds) Data Science. BICOD 2015. Lecture Notes in Computer Science(), vol 9147. Springer, Cham. https://doi.org/10.1007/978-3-319-20424-6_3

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-20424-6_3

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-20423-9

  • Online ISBN: 978-3-319-20424-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation